Conference PaperPDF Available

Opportunities for Smart & Tailored Activity Coaching

Authors:

Abstract and Figures

This short paper describes how emerging technologies can be used to augment the effectivenes of activity coaching applications through tailoring.
Content may be subject to copyright.
Opportunities for Smart & Tailored Activity Coaching
Harm op den Akker
Roessingh Research and Development
Telemedicine group
h.opdenakker@rrd.nl
Randy Klaassen
University of Twente
Human Media Interaction
r.klaassen@utwente.nl
Rieks op den Akker
University of Twente
Human Media Interaction
h.j.a.opdenakker@utwente.nl
Valerie M. Jones
University of Twente
Telemedicine group
v.m.jones@utwente.nl
Hermie J. Hermens
Roessingh Research and Development
Telemedicine group
h.hermens@rrd.nl
Abstract
This short paper describes how emerging technologies
can be used to augment the effectivenes of activity coaching
applications through tailoring.
1 Introduction
Technology aided coaching on healthy behavior is
widely regarded as a promising paradigm to aid in the pre-
vention of chronic diseases and the process of healthy age-
ing in general. In order to encourage physical activity in
patients suffering from chronic disease, as well as healthy
adults, many different coaching systems have been devel-
oped. Typically these consist of an activity sensor and
some form of coaching application delivered either through
a web portal, smartphone or the sensor itself. We present
our model of tailoring as a framework for discussing key
areas in which such activity coaching applications can be
improved. Tailoring is the process whereby a system ad-
justs its communication to a specific user. We concretize
this definition by considering four communication proper-
ties: intention, timing, content, and representation. In our
case, a typical intention would be to either inform about
the benefits of physical activity, or to provide information
on the user’s daily progress towards a goal. Timing defines
the moment at which the system chooses to initiate an in-
teraction. Content consists of the chosen words in a verbal
communication, or values displayed in a graphical represen-
tation of progress. Given these four properties, the goal of
tailoring is to increase the system’s likelihood of conveying
its intention by matching the timing, content, and represen-
tation to the user in his specific context. Based on the work
by Hawkins et al. [2] and our own literature study [6], we
identified six different forms of tailoring and matched them
to the communication properties. In this model (Figure 1),
feedback is used to present the user with information about
himself. Inter-human interaction provides support for in-
teraction with other real humans. Adaptation attempts to
direct messages to individuals’ status on key theoretical de-
terminants... [2]. User targeting attempts to increase at-
tention or motivation by conveying that the communication
is designed specifically for you” [2]. Context awareness is
the notion of tailoring a communication based on external
information. Self learning can be used to enhance other tai-
loring techniques through adapting to the user by learning
from his reactions to previous communications.
2 Key Areas for Improvement
The model of tailoring presented is based on an analy-
sis of the state of the art of tailoring in real-time activity
coaching systems [6]. Combined with research into emerg-
ing smart technologies as well as our many years of expe-
rience in deploying physical activity coaching systems to
various patient populations, we have identified opportuni-
ties for future research directions in six key areas related to
activity coaching.
I. Smart Sensing. Use sensor data fusion to combine ac-
celerometer data from the activity sensor and location data
from the smartphone to provide accurate activity classifi-
cation, increasing the accuracy of energy estimation algo-
rithms and providing additional context to the virtual coach.
II. Adaptive Goal Setting. Employ activity data gath-
ered from the user to learn a user-specific challenging but
achievable goal, and define a balanced individual pattern
that can prompt the user to increase his activity at times dur-
ing the week and day where it is most suitable for him.
III. Adaptive Reminding. Find the opportune moment
Timing
Intention
Representation
Content
Motivation
Strategies
Adaptation
Static
Tailoring
Dynamic
Tailoring
Context Awareness
User targeting
Self Learning
Inter-Human Interaction
Feedback
Figure 1. The relationships between tailoring techniques and the communication model properties.
The layering describes how certain techniques can be used to augment others.
for motivational cues by analysing the user’s response to
those messages in relationship to current contextual factors,
increasing the possibility of favourable response while re-
ducing the risk of information overload and interruption ir-
ritability [3]. The proof of this self-learning approach is
given in [5].
IV. Personalized Message Generation. Motivational
messages can be tailored to psychological constructs (adap-
tation) or the user’s environment (context awareness) and
preferences. Natural language generation techniques can be
used to generate varying and relevant messages.
V. Advanced HCI. To increase perceived intelligence of
a smart coaching system, embodied (conversational) agents
offer an interesting opportunity as HCI-paradigm. As Bick-
more et al. showed [1], ECAs can have a positive effect on
perceived relationship with a software agent.
VI. Pervasive Coaching. As humans interact with many
different devices during the day, cross media systems offer
the opportunity for the activity coach to travel with the user
across those devices. Depending on the needs and context
of the user, coaching can thus be provided on the most suit-
able device (e.g. smartphone, PC, smart television) [4].
3 Conclusions
We have identified six areas where smart technologies
can be applied to tailor various aspects of an individualised
activity coach. Location-aware activity-type sensing (I) and
self-learning individual goal setting algorithms (II) should
form the basis for providing awareness of physical activity
as well as obtainable goals. The generation of motivational
messages can benefit from complex pattern analysis to de-
termine an optimal timing (III) and content (IV) of mes-
sages for the user in his current context. Language gen-
eration tools can alleviate the problem of repetitiveness in
natural language interaction between user and coach. The
presentation of an intelligent coach can use advanced HCI
methods e.g. the use of ECAs (V) that can migrate
with the user through various devices in order to optimally
use the available interaction resources at the user’s current
location (VI). Based on our analysis we formulated a model
for smart tailoring of feedback and attempted to improve
coaching strategies. In different experiments we developed
and implemented technologies that aim to find an optimal
timing for motivational messages [5], systems for context-
aware message generation and intelligent embodied agents
which travel with the user across multiple devices [4]. From
own experience, as well as the state of art [6], we see fu-
ture research directions in the use of more advanced context
sensing and the application of machine learning technolo-
gies as the way towards an autonomous, adaptive and indi-
vidualised coaching agent.
References
[1] T. W. Bickmore and R. W. Picard. Establishing and maintain-
ing long-term human-computer relationships. ACM Transac-
tions on Computer-Human Interaction, 12(2):293–327, 2005.
[2] R. P. Hawkins, M. Kreuter, K. Resnicow, M. Fishbein, and
A. Dijkstra. Understanding tailoring in communicating about
health. Health Education Research, 23(3):454–466, 2008.
[3] J. Ho and S. S. Intille. Using context-aware computing to
reduce the perceived burden of interruptions from mobile de-
vices. Proceedings of the SIGCHI conference on Human fac-
tors in computing systems CHI 05, Portland,:909, 2005.
[4] R. Klaassen, R. op den Akker, T. Lavrysen, and S. van Wis-
sen. User preferences for multi-device context-aware feed-
back in a digital coaching system. Journal on Multimodal
User Interfaces (to appear), 2013.
[5] H. op den Akker, V. M. Jones, and H. J. Hermens. Pre-
dicting Feedback Compliance in a Teletreatment Application.
In Proc. of the 3rd Int. Symposium on Applied Sciences in
Biomedical and Communication Technologies, Rome, 2010.
[6] H. op den Akker, V. M. Jones, and H. J. Hermens. A literature
review of real-time, tailored coaching systems for physical ac-
tivity. User Modeling and User-Adapted Interaction, Special
Issue on Personalization and Behaviour Change (submitted),
2013.
... According to [21] and [22], the success of this type of systems is based on their capacity 157 of adaptation, which is the notion of tailoring a communication on the basis of external 158 information [22] and involves attempts to increase attention or motivation by conveying 159 personalized communication" [22]. ...
... According to [21] and [22], the success of this type of systems is based on their capacity 157 of adaptation, which is the notion of tailoring a communication on the basis of external 158 information [22] and involves attempts to increase attention or motivation by conveying 159 personalized communication" [22]. ...
... According to [21] and [22], the success of this type of systems is based on their capacity 157 of adaptation, which is the notion of tailoring a communication on the basis of external 158 information [22] and involves attempts to increase attention or motivation by conveying 159 personalized communication" [22]. ...
Article
Full-text available
The World Health Organization and the American College of Sports Medicine have released guidelines on physical activity and sedentary behavior, as part of an effort to reduce inactivity worldwide. However, to date, there is no computational model that can facilitate the integration of these recommendations into health solutions (e.g., digital coaches). In this paper, we present an operational and machine-readable model that represents and is able to reason about these guidelines. To this end, we adopted a symbolic AI approach that combines two paradigms of research in knowledge representation and reasoning: ontology and rules. Thus, we first present HeLiFit, a domain ontology implemented in OWL, which models the main entities that characterize the definition of physical activity, as defined per guidance. Then, we describe HeLiFit-Rule, a set of rules implemented in the RDFox Rule language, which can be used to represent and reason with these recommendations in concrete real-world applications. Furthermore, to ensure a high level of syntactic/semantic interoperability across different systems, our framework is also compliant with the FHIR standard. Through motivating scenarios that highlight the need for such an implementation, we finally present an evaluation of our model that provides results that are both encouraging in terms of the value of our solution and also provide a basis for future work.
... Some work has gone further and used current trajectory towards a goal to intervene. For instance, they can notify a user if they are not on track to meet their goal by a certain time frame if they keep that trajectory, or are consistently not meeting daily goals [1,12,22,34,38]. However, these methods do not consider a holistic view of the many important behaviors that lead to a goal being met, and make simplistic assumptions about linear progressions. ...
... Some researchers have sought to assign adaptive fitness goals based on a particular user's historical data, in order to improve a goal that is too difficult or too easy. These typically employ simple algorithms that raise goals that the user is easily achieving, and lower goals that the user is struggling to achieve [1,12,22,34,38]. MyBehavior, in a study of 17 users, suggested exercise or actions to take, but not goals [42]. ...
Preprint
Full-text available
Activity tracking apps often make use of goals as one of their core motivational tools. There are two critical components to this tool: setting a goal, and subsequently achieving that goal. Despite its crucial role in how a number of prominent self-tracking apps function, there has been relatively little investigation of the goal-setting and achievement aspects of self-tracking apps. Here we explore this issue, investigating a particular goal setting and achievement process that is extensive, recorded, and crucial for both the app and its users' success: weight loss goals in MyFitnessPal. We present a large-scale study of 1.4 million users and weight loss goals, allowing for an unprecedented detailed view of how people set and achieve their goals. We find that, even for difficult long-term goals, behavior within the first 7 days predicts those who ultimately achieve their goals, that is, those who lose at least as much weight as they set out to, and those who do not. For instance, high amounts of early weight loss, which some researchers have classified as unsustainable, leads to higher goal achievement rates. We also show that early food intake, self-monitoring motivation, and attitude towards the goal are important factors. We then show that we can use our findings to predict goal achievement with an accuracy of 79% ROC AUC just 7 days after a goal is set. Finally, we discuss how our findings could inform steps to improve goal achievement in self-tracking apps.
... Research work in [13] defines a framework for discussing key areas in which such activity tracking applications can be improved. It considers four properties (see Fig.1): intention, timing, content, and representation. ...
... Focused Research Model -adapted from[13]. ...
Conference Paper
Full-text available
Mobile health tracking applications are in abundance over the last years, with applications such as fitness tracking, photo diet tracking for weight loss and diet reporting applications. These applications are used for self-assessment, dynamic feedback and motivation of the users, while some more recent studies revealed that the data from these applications can be beneficial for experts in advising their clients. In this work, a real-time nutrition and fitness tracking web platform is proposed that enables experts to track the progress of their clients (even) in real-time or based on their work schedule, so as to establish a more holistic view of clients' progress. The platform aims to support experts in providing the best guidance and advice on a nutrition and fitness plan. The web platform was developed, used and evaluated by both clients and experts, which showcased the importance of this real-time expert-user interaction.
... Virtual coaches detect situations where an intervention would be desirable and proposed to the user. To this end, coaches take the form of activity sensors combined with a coaching application located on the Internet, a smartphone, a sensor (17), or a social assistance robot (SAR) (18). Technology plays an important role in the aging process, impacting both individuals and society as a whole. ...
Article
Full-text available
Aim The aim of this study is to report a trial protocol for assessing the improvement of older adults’ well-being, promoting active and healthy aging, and reducing the risks of social exclusion, using a virtual coach. Background Increased longevity brings with it reduced autonomy and independence, and it is therefore necessary to act with preventive measures that can promote active and healthy aging. With the development of technology, new tools have appeared, including virtual coaches, which can enable people to lead a healthy lifestyle by identifying individual needs and goals and providing personalized recommendations and advice. However, it is important that these coaches take into consideration the inter-individual and cross-cultural differences of each person. Design A randomized controlled trial is proposed. Methods This study will recruit 240 healthy subjects aged 65 years and older. Participants will be assigned to an experimental group that will receive the e-VITA system or to the control group that will receive an information booklet only. The primary outcome measure is the person's quality of life (QoL). Data will be collected at baseline, 3 months after the trial, and at the end of the trial, after 6 months. Discussion This study will evaluate the effectiveness of the e-VITA system, consisting of a virtual coach, several sensors for monitoring, a smartphone for use at home, and a booklet, in improving the older person's quality of life. The increased perceived well-being will also be linked to improvements in other areas of the person's life, psychological and cognitive status, the area of sociality, nutrition, and eHealth literacy.
... Time scope includes, for example, the duration of the intervention (short-term vs. long-term; [13] and the frequency and duration of the coaching interactions (speed coaching vs. longer conversation; [13]). Organization of coaching includes, for example, the communication channel (e.g., in person, telephone, web [25][26][27] and additional voluntary interventions including environmental modifications (e.g., walking tracks outside a company; [28]). Further parameters comprise the underlying theory (e.g., selfdetermination theory, SDT, [29]; transtheoretical model of change, TTM, [30]; social cognitive theory, SCT, [31]) and the question of which and how many behavior change techniques (BCTs) are applied [32]. ...
Article
Full-text available
Aim Studies show that about 60 min of moderate physical activity (PA) per day compensate for sitting all day at work. However, the workplace offers an ideal setting for health-promoting interventions such as PA coaching as a person-centered intervention aimed at achieving lasting health behavior changes. Given a good evidence base of health coaching studies in general, this systematic review aims to provide an overview of workplace PA coaching interventions. Methods This review was conducted according to PRISMA guidelines. Studies published up to July 2021 were considered based on the following inclusion criteria: (1) longitudinal intervention studies, (2) analysis of PA at work, (3) sedentary employees, (4) PA coaching in the workplace as intervention, (5) increasing workplace PA. Results Of 4323 studies found, 14 studies with 17 interventions met inclusion criteria. All 17 interventions indicated an increase in at least one PA outcome. Twelve interventions indicated significant improvements in at least one workplace or total PA outcome. There is a high variation within the different coaching parameters, such as behavior change techniques and communication channels. The study quality showed a moderate to high risk of bias. Conclusions The majority of interventions provided evidence for the effectiveness of workplace PA coaching. Nevertheless, the results are inconclusive with regard to the variety of coaching parameters and thus no general statement can be made about the effectiveness of individual parameters. However, this variety of parameters also leads to a high degree of individualization of workplace PA coaching interventions to increase PA for different groups of employees and different types of workplaces.
... Electronic systems for motivation and education have been adopted in different medical fields, and particularly for fostering physical exercise and a healthy lifestyle. [14][15][16][17][18][19] From these studies, it is possible to deduce that each type of patient (under rehabilitation, with chronic conditions, etc.) and each objective (weight-loss, physical exercise, adherence to intervention, etc.) has its own characteristics and challenges. Generalising, key factors to be considered when designing such systems are: setting goals, timing and personalisation of feedback, usability and acceptance of the system and the use ofwell-grounded behavioural change theories. ...
Article
Introduction Home-based programmes for cardiac rehabilitation play a key role in the recovery of patients with coronary artery disease. However, their necessary educational and motivational components have been rarely implemented with the help of modern mobile technologies. We developed a mobile health system designed for motivating patients to adhere to their rehabilitation programme by providing exercise monitoring, guidance, motivational feedback, and educational content. Methods Our multi-disciplinary approach is based on mapping “desired behaviours” into specific system’s specifications, borrowing concepts from Fogg’s Persuasive Systems Design principles. A randomised controlled trial was conducted to compare mobile-based rehabilitation (55 patients) versus standard care (63 patients). Results Some technical issues related to connectivity, usability and exercise sessions interrupted by safety algorithms affected the trial. For those who completed the rehabilitation (19 of 55), results show high levels of both user acceptance and perceived usefulness. Adherence in terms of started exercise sessions was high, but not in terms of total time of performed exercise or drop-outs. Educational level about heart-related health improved more in the intervention group than the control. Exercise habits at 6 months follow-up also improved, although without statistical significance. Discussion Results indicate that the adopted design methodology is promising for creating applications that help improve education and foster better exercise habits, but further studies would be needed to confirm these indications.
... With our approach, we contribute to the areas of Adaptive goal-setting, Adaptive Reminding and Personalized Message Generation, which have been identified as relevant future research directions by op den Akker et al. [33]. ...
Conference Paper
Goal-setting has shown some promise in promoting physical activity behavior change among adults. In this context, adaptive goal setting has been identified as a relevant future research area. However, it is not yet addressed in research sufficiently. We present a theoretical approach for adaptively supporting users in goal-setting. We explore potentials of using heart rate variability (HRV) for tailoring goal-setting in activity tracking applications. In consideration of intrapersonal variance in HRV, we suggest strategies for adaptively supporting goal-setting. We indicate the potential of HRV as a parameter for designing supportive activity tracking applications.
Article
Background Technological advances in robotics, artificial intelligence, cognitive algorithms, and internet-based coaches have contributed to the development of devices capable of responding to some of the challenges resulting from demographic aging. Numerous studies have explored the use of robotic coaching solutions (RCSs) for supporting healthy behaviors in older adults and have shown their benefits regarding the quality of life and functional independence of older adults at home. However, the use of RCSs by individuals who are potentially vulnerable raises many ethical questions. Establishing an ethical framework to guide the development, use, and evaluation practices regarding RCSs for older adults seems highly pertinent. Objective The objective of this paper was to highlight the ethical issues related to the use of RCSs for health care purposes among older adults and draft recommendations for researchers and health care professionals interested in using RCSs for older adults. Methods We conducted a narrative review of the literature to identify publications including an analysis of the ethical dimension and recommendations regarding the use of RCSs for older adults. We used a qualitative analysis methodology inspired by a Health Technology Assessment model. We included all article types such as theoretical papers, research studies, and reviews dealing with ethical issues or recommendations for the implementation of these RCSs in a general population, particularly among older adults, in the health care sector and published after 2011 in either English or French. The review was performed between August and December 2021 using the PubMed, CINAHL, Embase, Scopus, Web of Science, IEEE Explore, SpringerLink, and PsycINFO databases. Selected publications were analyzed using the European Network of Health Technology Assessment Core Model (version 3.0) around 5 ethical topics: benefit-harm balance, autonomy, privacy, justice and equity, and legislation. Results In the 25 publications analyzed, the most cited ethical concerns were the risk of accidents, lack of reliability, loss of control, risk of deception, risk of social isolation, data confidentiality, and liability in case of safety problems. Recommendations included collecting the opinion of target users, collecting their consent, and training professionals in the use of RCSs. Proper data management, anonymization, and encryption appeared to be essential to protect RCS users’ personal data. Conclusions Our analysis supports the interest in using RCSs for older adults because of their potential contribution to individuals’ quality of life and well-being. This analysis highlights many ethical issues linked to the use of RCSs for health-related goals. Future studies should consider the organizational consequences of the implementation of RCSs and the influence of cultural and socioeconomic specificities of the context of experimentation. We suggest implementing a scalable ethical and regulatory framework to accompany the development and implementation of RCSs for various aspects related to the technology, individual, or legal aspects.
Conference Paper
Full-text available
In this paper we describe a platform that integrates gaming and coaching for adolescent patients with type 1 diabetes and results from user evaluations of the platform. The purpose of the platform is to support patients in diabetes self-management through educational game playing, monitoring and motivational feedback, and to support patients' care givers. We describe the design of the platform referring to principles from health care, persuasive system design and game design. The virtual coach is a game guide that can also provide personalized feedback about the user's daily care related activities which have value for making progress in the game world. We report about user evaluations in the wild which revealed that some assumptions made about how users are connected to the platform were not satisfied in reality, resulting in less optimal user experiences. We discuss challenges with suggestions for further development of integrated pervasive coaching and gamification platforms.
Article
Full-text available
We present the development of the user interfaces of a multi-device digital coaching service that provides tailored feedback to users concerning their physical activity level and medication intake. We present the outcomes of a survey study of user preferences regarding the situation, device and timing of feedback they receive from their personal attentive digital coach. There are clear preferences among the subjects for different types of messages on different devices. Results were implemented in a first prototype. We present the results of a user evaluations with a real version of the digital health coach and we compare them with the results of the survey study.
Article
Full-text available
This research investigates the meaning of “human-computer relationship” and presents techniques for constructing, maintaining, and evaluating such relationships, based on research in social psychology, sociolinguistics, communication and other social sciences. Contexts in which relationships are particularly important are described, together with specific benefits (like trust) and task outcomes (like improved learning) known to be associated with relationship quality. We especially consider the problem of designing for long-term interaction, and define relational agents as computational artifacts designed to establish and maintain long-term social-emotional relationships with their users. We construct the first such agent, and evaluate it in a controlled experiment with 101 users who were asked to interact daily with an exercise adoption system for a month. Compared to an equivalent task-oriented agent without any deliberate social-emotional or relationship-building skills, the relational agent was respected more, liked more, and trusted more, even after four weeks of interaction. Additionally, users expressed a significantly greater desire to continue working with the relational agent after the termination of the study. We conclude by discussing future directions for this research together with ethical and other ramifications of this work for HCI designers.
Article
Full-text available
Health care provision is facing resourcing challenges which will further increase in the 21st century. Health care mediated by technology is widely seen as one important element in the struggle to maintain existing standards of care. Personal health monitoring and treatment systems with a high degree of autonomic operation will be required to support self-care. Such systems must provide many services and in most cases must incorporate feedback to patients to advise them how to manage the daily details of their treatment and lifestyle changes. As in many other areas of healthcare, patient compliance is however an issue. In this experiment we apply machine learning techniques to three corpora containing data from trials of body worn systems for activity monitoring and feedback. The overall objective is to investigate how to improve feedback compliance in patients using personal monitoring and treatment systems, by taking into account various contextual features associated with the feedback instances. In this article we describe our first machine learning experiments. The goal of the experiments is twofold: to determine a suitable classification algorithm and to find an optimal set of contextual features to improve the performance of the classifier. The optimal feature set was constructed using genetic algorithms. We report initial results which demonstrate the viability of this approach.
Article
Full-text available
‘Tailoring’ refers to any of a number of methods for creating communications individualized for their receivers, with the expectation that this individualization will lead to larger intended effects of these communications. Results so far have been generally positive but not consistently so, and this paper seeks to explicate tailoring to help focus future research. Tailoring involves either or both of two classes of goals (enhancing cognitive preconditions for message processing and enhancing message impact through modifying behavioral determinants of goal outcomes) and employs strategies of personalization, feedback and content matching. These goals and strategies intersect in a 2 × 3 matrix in which some strategies and their component tactics match better to some goals than to others. The paper illustrates how this framework can be systematically applied in generating research questions and identifying appropriate study designs for tailoring research.
Conference Paper
The potential for sensor-enabled mobile devices to proactively present information when and where users need it ranks among the greatest promises of ubiquitous computing. Unfortunately, mobile phones, PDAs, and other computing devices that compete for the user's attention can contribute to interruption irritability and feelings of information overload. Designers of mobile computing interfaces, therefore, require strategies for minimizing the perceived interruption burden of proactively delivered messages. In this work, a context-aware mobile computing device was developed that automatically detects postural and ambulatory activity transitions in real time using wireless accelerometers. This device was used to experimentally measure the receptivity to interruptions delivered at activity transitions relative to those delivered at random times. Messages delivered at activity transitions were found to be better received, thereby suggesting a viable strategy for context-aware message delivery in sensor-enabled mobile computing devices.
A literature review of real-time, tailored coaching systems for physical activity
  • H Op Den Akker
  • V M Jones
  • H J Hermens
H. op den Akker, V. M. Jones, and H. J. Hermens. A literature review of real-time, tailored coaching systems for physical activity. User Modeling and User-Adapted Interaction, Special Issue on Personalization and Behaviour Change (submitted), 2013.