Content uploaded by Harm op den Akker
Author content
All content in this area was uploaded by Harm op den Akker
Content may be subject to copyright.
Opportunities for Smart & Tailored Activity Coaching
Harm op den Akker
Roessingh Research and Development
Telemedicine group
h.opdenakker@rrd.nl
Randy Klaassen
University of Twente
Human Media Interaction
r.klaassen@utwente.nl
Rieks op den Akker
University of Twente
Human Media Interaction
h.j.a.opdenakker@utwente.nl
Valerie M. Jones
University of Twente
Telemedicine group
v.m.jones@utwente.nl
Hermie J. Hermens
Roessingh Research and Development
Telemedicine group
h.hermens@rrd.nl
Abstract
This short paper describes how emerging technologies
can be used to augment the effectivenes of activity coaching
applications through tailoring.
1 Introduction
Technology aided coaching on healthy behavior is
widely regarded as a promising paradigm to aid in the pre-
vention of chronic diseases and the process of healthy age-
ing in general. In order to encourage physical activity in
patients suffering from chronic disease, as well as healthy
adults, many different coaching systems have been devel-
oped. Typically these consist of an activity sensor and
some form of coaching application delivered either through
a web portal, smartphone or the sensor itself. We present
our model of tailoring as a framework for discussing key
areas in which such activity coaching applications can be
improved. Tailoring is the process whereby a system ad-
justs its communication to a specific user. We concretize
this definition by considering four communication proper-
ties: intention, timing, content, and representation. In our
case, a typical intention would be to either inform about
the benefits of physical activity, or to provide information
on the user’s daily progress towards a goal. Timing defines
the moment at which the system chooses to initiate an in-
teraction. Content consists of the chosen words in a verbal
communication, or values displayed in a graphical represen-
tation of progress. Given these four properties, the goal of
tailoring is to increase the system’s likelihood of conveying
its intention by matching the timing, content, and represen-
tation to the user in his specific context. Based on the work
by Hawkins et al. [2] and our own literature study [6], we
identified six different forms of tailoring and matched them
to the communication properties. In this model (Figure 1),
feedback is used to present the user with information about
himself. Inter-human interaction provides support for in-
teraction with other real humans. Adaptation “attempts to
direct messages to individuals’ status on key theoretical de-
terminants...” [2]. User targeting “attempts to increase at-
tention or motivation by conveying that the communication
is designed specifically for you” [2]. Context awareness is
the notion of tailoring a communication based on external
information. Self learning can be used to enhance other tai-
loring techniques through adapting to the user by learning
from his reactions to previous communications.
2 Key Areas for Improvement
The model of tailoring presented is based on an analy-
sis of the state of the art of tailoring in real-time activity
coaching systems [6]. Combined with research into emerg-
ing smart technologies as well as our many years of expe-
rience in deploying physical activity coaching systems to
various patient populations, we have identified opportuni-
ties for future research directions in six key areas related to
activity coaching.
I. Smart Sensing. Use sensor data fusion to combine ac-
celerometer data from the activity sensor and location data
from the smartphone to provide accurate activity classifi-
cation, increasing the accuracy of energy estimation algo-
rithms and providing additional context to the virtual coach.
II. Adaptive Goal Setting. Employ activity data gath-
ered from the user to learn a user-specific — challenging but
achievable — goal, and define a balanced individual pattern
that can prompt the user to increase his activity at times dur-
ing the week and day where it is most suitable for him.
III. Adaptive Reminding. Find the opportune moment
Timing
Intention
Representation
Content
Motivation
Strategies
Adaptation
Static
Tailoring
Dynamic
Tailoring
Context Awareness
User targeting
Self Learning
Inter-Human Interaction
Feedback
Figure 1. The relationships between tailoring techniques and the communication model properties.
The layering describes how certain techniques can be used to augment others.
for motivational cues by analysing the user’s response to
those messages in relationship to current contextual factors,
increasing the possibility of favourable response while re-
ducing the risk of information overload and interruption ir-
ritability [3]. The proof of this self-learning approach is
given in [5].
IV. Personalized Message Generation. Motivational
messages can be tailored to psychological constructs (adap-
tation) or the user’s environment (context awareness) and
preferences. Natural language generation techniques can be
used to generate varying and relevant messages.
V. Advanced HCI. To increase perceived intelligence of
a smart coaching system, embodied (conversational) agents
offer an interesting opportunity as HCI-paradigm. As Bick-
more et al. showed [1], ECAs can have a positive effect on
perceived relationship with a software agent.
VI. Pervasive Coaching. As humans interact with many
different devices during the day, cross media systems offer
the opportunity for the activity coach to travel with the user
across those devices. Depending on the needs and context
of the user, coaching can thus be provided on the most suit-
able device (e.g. smartphone, PC, smart television) [4].
3 Conclusions
We have identified six areas where smart technologies
can be applied to tailor various aspects of an individualised
activity coach. Location-aware activity-type sensing (I) and
self-learning individual goal setting algorithms (II) should
form the basis for providing awareness of physical activity
as well as obtainable goals. The generation of motivational
messages can benefit from complex pattern analysis to de-
termine an optimal timing (III) and content (IV) of mes-
sages for the user in his current context. Language gen-
eration tools can alleviate the problem of repetitiveness in
natural language interaction between user and coach. The
presentation of an intelligent coach can use advanced HCI
methods — e.g. the use of ECA’s (V) — that can migrate
with the user through various devices in order to optimally
use the available interaction resources at the user’s current
location (VI). Based on our analysis we formulated a model
for smart tailoring of feedback and attempted to improve
coaching strategies. In different experiments we developed
and implemented technologies that aim to find an optimal
timing for motivational messages [5], systems for context-
aware message generation and intelligent embodied agents
which travel with the user across multiple devices [4]. From
own experience, as well as the state of art [6], we see fu-
ture research directions in the use of more advanced context
sensing and the application of machine learning technolo-
gies as the way towards an autonomous, adaptive and indi-
vidualised coaching agent.
References
[1] T. W. Bickmore and R. W. Picard. Establishing and maintain-
ing long-term human-computer relationships. ACM Transac-
tions on Computer-Human Interaction, 12(2):293–327, 2005.
[2] R. P. Hawkins, M. Kreuter, K. Resnicow, M. Fishbein, and
A. Dijkstra. Understanding tailoring in communicating about
health. Health Education Research, 23(3):454–466, 2008.
[3] J. Ho and S. S. Intille. Using context-aware computing to
reduce the perceived burden of interruptions from mobile de-
vices. Proceedings of the SIGCHI conference on Human fac-
tors in computing systems CHI 05, Portland,:909, 2005.
[4] R. Klaassen, R. op den Akker, T. Lavrysen, and S. van Wis-
sen. User preferences for multi-device context-aware feed-
back in a digital coaching system. Journal on Multimodal
User Interfaces (to appear), 2013.
[5] H. op den Akker, V. M. Jones, and H. J. Hermens. Pre-
dicting Feedback Compliance in a Teletreatment Application.
In Proc. of the 3rd Int. Symposium on Applied Sciences in
Biomedical and Communication Technologies, Rome, 2010.
[6] H. op den Akker, V. M. Jones, and H. J. Hermens. A literature
review of real-time, tailored coaching systems for physical ac-
tivity. User Modeling and User-Adapted Interaction, Special
Issue on Personalization and Behaviour Change (submitted),
2013.