ArticlePDF Available

Integration of Hospital Room Hospitality Features onto Patient-Controlled Tablet Computers (Preprint)

Authors:
  • Sutter Health Palo Alto Medical Foundation Research Institute

Abstract and Figures

Background: Patient portals tethered to electronic health records can improve patient experience, activation, and outcomes. However, adoption of inpatient portals has been challenging. One way to potentially increase inpatient portal usage is to integrate it with a room control (RC) app on a common tablet computer. Objective: The aim of this study was to perform a retrospective analysis of patient usage of an RC app provided on tablet computers in patient rooms of our new inpatient tower. Methods: We identified all patients who were admitted for >24 hours to our new inpatient tower over a 90-day period from September 1 to November 30, 2017. After excluding newborn patients from our analysis, we then identified patients who used the RC app at least one time during their admission. We linked these data to patient demographics (including age, sex, and race) and admitting service. We then performed univariable and multivariable logistic regression to assess patterns of RC app usage. Results: A total of 3411 patients were admitted over the course of the study period; 2242/3411 (65.73%) used the RC app during their hospitalization. Compared with white patients, other/mixed/unknown race and Asian, Hawaiian, Pacific Islander, American Indian race were significantly associated with increased use of the RC app in a multivariable analysis. Increasing age was significantly associated with increased usage of the RC app. Usage of the RC app also varied by admitting services. Compared with general medicine, bone marrow transplant and general surgery patients had increased usage of the RC app. Conversely, critical care, medical specialties, neurology, surgical subspecialties, and obstetrics/gynecology were all associated with decreased usage of the RC app. Conclusions: Our study shows that one-third of patients are not using the RC app for critical room functions. Future initiatives to increase RC usage should take these populations into consideration. Contrary to common belief, older patients may use tablet-enabled RCs just as often, if not more often, than younger patients. Certain admitting services, such as neurology and surgical subspecialties, may have had lower usage rates owing to accessibility issues. Our study allows hospitals to tailor support for specific patient populations to increase RC app usage.
Content may be subject to copyright.
By Ming Tai-Seale, N. Lance Downing, Veena Goel Jones, Richard V. Milani, Beiqun Zhao, Brian Clay,
Christopher Demuth Sharp, Albert Solomon Chan, and Christopher A. Longhurst
Technology-Enabled Consumer
Engagement: Promising Practices
At Four Health Care Delivery
Organizations
ABSTRACT
Patientsjourneys across the care continuum can be improved
with patient-centered technology integrated into the care process.
Misaligned financial incentives, change management challenges, and
privacy concerns are some of the hurdles that have prevented health
systems from deploying technology that engages patients along the care
continuum. Despite these sociotechnical challenges, some health care
organizations have developed innovative approaches to engaging patients.
We describe promising technology-enabled consumer engagement
practices at two community-based delivery organizations and two
academic medical centers to demonstrate the approaches, sociotechnical
challenges, and outcomes associated with their implementation.
Leadership commitment and payer policies that align with the
quadruple aimenhancing patient experience, improving population
health, reducing costs, and improving the work life of health care
providerswould encourage further deployment and lead to greater
consumer engagement along the care continuum.
The original aims of the federal
meaningful-use legislation for the
development and dissemination of
health information technology in-
cluded patient and family engage-
ment.1,2 While consumers book flights and make
financial transactions from mobile devices, their
health care experience varies remarkably de-
pending on the degree to which patient-centered
technology is integrated into that experience.
It has been over twenty years since some pa-
tients gained secure online access to their health
information, such as laboratory test results, by
way of patient portals tethered to institutional
electronic health records (EHRs).35These por-
tals are intended to provide patients and their
caregivers with timely electronic access to their
health care information. Recent enhancements
enable patients to also enjoy the convenience of
scheduling appointments online, securely mes-
saging their care teams, and reviewing clinic
notes.6Many patients can access these tools
from their mobile devices. Requirements
for privacy and security pose challenges for
usability,3,4,7,8 however, and call for creative sol-
utions that would reduce user burden without
compromising security.
While most portals are optimized for outpa-
tients, an increasing number of health care or-
ganizations are implementing these solutions in
the inpatient setting, where patients have unmet
information and communication needs9,10 and
also value having some control over their physi-
cal environment.11 Patient-centered technology
deployed in this setting can help meet those pa-
tient needs by identifying the care team and pro-
viding real-time access to test results, medication
information, and hospitality amenities.4,5,12 The
literature is relatively silent, however, on how
health care organizations can improve hospital-
doi: 10.1377/hlthaff.2018.05027
HEALTH AFFAIRS 38,
NO. 3 (2019): 383390
©2019 Project HOPE
The People-to-People Health
Foundation, Inc.
Ming Tai-Seale (mtaiseale@
ucsd.edu) is a professor in the
Department of Family
Medicine and Public Health at
the University of California
San Diego (UCSD) School of
Medicine, director of
outcomes analysis and
scholarship at UC San Diego
Health, and director of
research at UCSD Health
Sciences International,
in La Jolla.
N. Lance Downing is a clinical
assistant professor of
medicine at the Stanford
School of Medicine and
program director for the
Stanford Program in
AI-Assisted Care, both in Palo
Alto, California.
Veena Goel Jones is medical
director of digital patient
experience and a pediatric
hospitalist at Sutter Health
and an adjunct clinical
assistant professor of
pediatrics at the Stanford
School of Medicine.
Richard V. Milani is chief
clinical transformation officer
at Ochsner Health System in
New Orleans, Louisiana.
Beiqun Zhao is a National
Library of Medicine/National
Institutes of Health
biomedical informatics fellow
and a general surgery resident
at UC San Diego Health.
Brian Clay is a chief medical
information officer at UC San
Diego Health and a clinical
professor of medicine at the
UCSD School of Medicine.
March 2019 38:3 Health Affairs 383
Patients
&
Consumers
Downloaded from HealthAffairs.org on March 04, 2019.
Copyright Project HOPE—The People-to-People Health Foundation, Inc.
For personal use only. All rights reserved. Reuse permissions at HealthAffairs.org.
ity features of inpatient care while enhancing
patient and family engagement in the care proc-
ess.13 Hospitals have been encouraged to bridge
the digital divide (the differences in use of digital
technology between patients of different ages,
races, incomes, and education levels)14 by pro-
viding technological solutions to all patients.
However, it is relatively unknown how patients
and families may use hospital-provisioned mo-
bile devices to control their inpatient rooms and
access the inpatient patient health portal.
The goal of this article is threefold: to describe
consumer engagement technology projects at
four institutions, including two integrated deliv-
ery networks (Ochsner Health System and Sutter
Health) and two academic medical centers (Stan-
ford Health Care and University of California
[UC] San Diego Health); highlight the sociotech-
nical challenges and lessons learned (positive
and negative) from these efforts; and synthesize
the case studies in the context of patientsjour-
neys across the continuum of care, comparing
them and suggesting directions for advancing
consumer engagement.
Ochsner Health System
Ochsner Health System is a not-for-profit inte-
grated delivery system in Louisiana that serves
over 700,000 patients a year. Ochsner employs
over 1,200 physicians and operates over ninety
clinics and twenty hospitals, assuming varying
degrees of financial risk for approximately
30 percent of the patients seen.
In 2015 Ochsner focused on reengineering
care between office visits for ambulatory care
patients with chronic disease. Because Louisiana
ranked fourth in the nation in hypertension
prevalence, Ochsner first sought to develop a
new model for delivering chronic disease care
to patients by leveraging technology and sharing
information with the goal of improving hyper-
tension control rates.
In the initial pilot in New Orleans, Baton
Rouge, and Covington, patients with uncon-
trolled hypertension were enrolled in the Hyper-
tension Digital Medicine Program through or-
ders from their providers. Patients completed
online surveys through MyChart (a widely used
patient portal product sold by Epic Systems) that
evaluated diet, physical activity, health literacy,
medication adherence, patient activation,15 so-
cial determinants of health16 (including medica-
tion affordability, number of people living in the
home, and caregiver support), and depression.
Along with clinical data from the EHR, these
patient-reported data were used to create a
unique patient phenotype for each patient and
guide individualized interventions. Patients
were provided with an electronic blood pressure
device that transmitted home blood pressure
readings directly into the EHR as they were tak-
en. To meet the needs of many patients who were
unfamiliar with digital tools, Ochsner created
the O Bar, modeled after service bars in comput-
er stores, at primary care sites. The O Bar pro-
vides initial setup of the home blood pressure
device plus health education, training, and tech-
nical support in the use of connected home de-
vices and health apps.17 Patients were asked to
take no less than one blood pressure reading per
week. If the care team had not received a reading
for eight days, patients would receive an auto-
mated text alerting them that a blood pressure
measurement was needed.
Doctoral pharmacists and health coaches are
integral members of the care teamcalled an
integrated practice unitthat provides patient
education, drug management, and lifestyle rec-
ommendations as per hypertension treatment
guidelines. In addition, custom visual tools were
developed within the EHR that describe the
patients social determinants,16 trending blood
pressure over time, hypertension-related co-
morbidities, patient activation level,15 health
literacy, and relevant lab results that assist in
optimizing the effectiveness and efficiency of
the care team. Care team members contact pa-
tients by phone and review screening results and
treatment options for improving blood pressure
control. Patients are encouraged to work with
the care team to cocreate the treatment plan
by choosing among various lifestyle and medica-
tion options.18 Besides direct contacts by the care
team, patients receive monthly reports by the
patient portal and postal mail that describe their
progress to date, along with additional tips to
create better control.
Compared to propensity scorematched con-
trols who received usual care, at six months digi-
tal medicine patients had more blood pressure
measurements recorded in the EHR (93.0 versus
1.6) (exhibit 1). They had more frequent inter-
actions with their care team, or clinical touches
(130 versus 12). Furthermore, they demonstrat-
ed greater medication adherence as measured by
the proportion of days covered, a leading method
used to calculate medication adherence at a
population level.19,20 Medication adherence im-
proved 14 percent among patients in the digital
medicine program and declined 2 percent
among patients in usual care. Digital medicine
patients also achieved greater blood pressure
control (79 percent versus 26 percent) and ex-
hibited higher levels of satisfaction (84 percent
versus 72 percent). Moreover, primary care
physicians experienced a 29 percent reduction
in the number of in-clinic visits from participat-
Christopher Demuth Sharp is
chief medical information
officer at Stanford Health
Care and a clinical associate
professor at the Stanford
School of Medicine.
Albert Solomon Chan is chief
of digital patient experience
and an investigator at Sutter
Health and an adjunct
professor at the Stanford
Center for Biomedical
Informatics Research,
Stanford School of Medicine.
Christopher A. Longhurst is
chief information officer and
associate chief medical
officer at UC San Diego
Health, and a clinical
professor of medicine and
pediatrics at the UCSD School
of Medicine.
Patients
&
Consumers
384 Health Affairs March 2019 38:3
Downloaded from HealthAffairs.org on March 04, 2019.
Copyright Project HOPE—The People-to-People Health Foundation, Inc.
For personal use only. All rights reserved. Reuse permissions at HealthAffairs.org.
ing patients, thus reducing their workloads and
enabling greater access for other patients (data
not shown).
In 2016 the program was expanded to all
Ochsner locations, and it now has over 3,000
active participants. Furthermore, it has created
the infrastructure for additional programs in
managing other chronic diseases, including
diabetes and chronic obstructive pulmonary dis-
ease. Patients and providers alike have found the
program to be life changing. The chair of primary
care told coauthor Richard Milani: This has dra-
matically changed how we approach chronic dis-
ease care. We forgot what help looked like until
this program.
Sutter Health
Sutter Health is a not-for-profit health care
delivery system that serves over three million
patients annually. In response to consumer de-
mand for care opportunities beyond the office
setting, in 2001 the Palo Alto Medical Founda-
tion, a Sutter Health affiliate, became the first
health system in the nation to implement
MyChart, Epic Systemsvendor-based patient
portal.7Sutters experience provides lessons
learned about engaging patients, addressing un-
intended consequences as portal engagement
matures, and ultimately the positive clinical ben-
efits of such engagement.
In contrast to the national experience, where
only a limited percentage of patients use patient
portals,21 as of July 2018 over 79 percent of pa-
tients seeking ambulatory care at Sutter Health
had enrolled in the portal. Systemwide engage-
ment of all stakeholders is key. Executive
commitment is exemplified by inclusion of en-
rollment tracking on a dashboard. Clinical oper-
ations leaders track nursing staff performance
on enrollment of patients during clinical en-
counters. Peer review reports transparently
show patient portal adoption rates per clinician.
Delivering tangible patient and clinical value is
critical to sustaining engagement. One of the
most important functions provided by a patient
portal is enabling patients to securely message
their clinicians and supporting clinicians to an-
swer them in a timely way.7,22 Initially, patients
were asked to pay a $5 monthly fee to use the
messaging function, and 13 percent of patients
who were enrolled in the portal paid the fee and
engaged in secure messaging. A survey of portal
users suggested that 65 percent of these patients
had reduced one or more office visits annually,
and over 70 percent were satisfied with the mes-
saging service.5,22
In response to market competition, Sutter re-
moved the monthly user fee for secure messag-
ing for Palo Alto Medical Foundation patients,
increasing the messaging-eligible population
from 13 percent to 100 percent of enrolled pa-
tients. Sutter used a three-pronged approach to
enable clinicians to respond in a timely fashion
to the anticipated increased volume of messages.
First, to support change management, multiple
town hall meetings were held to engage clini-
cians in developing solutions. Second, medical
assistants or nurses were tasked with addressing
patient messages first when appropriate, and
clinical guides for addressing common patient
message themes were provided to clinicians.
Third, to recognize the value of the work provid-
ed by the clinicians, an incentive program was
established to reward the answering of messages
within one business day. In 2011 the average
response time dropped to about four hours, de-
spite a sixfold increase in messaging volume.
Patients used the portal to exchange almost six-
teen million secure messages with clinicians in
2017, and over 90 percent of patient-initiated
messages were answered within one business
day.
Other components of Sutters patient portal
include online appointment scheduling,
automated wait-listing of appointments, and
booking of same-day video visits for low-acuity
Exhibit 1
Six-month outcomes for patients of Ochsner Health System enrolled in the Hypertension
Digital Medicine Program, compared to those for propensity scorematched patients in
usual care
SOURCE Authorsanalysis of outcome data for patients of Ochsner Health System enrolled in the
Hypertension Digital Medicine Program over three years. NOTES The program is explained in the text.
Clinical touches include outpatient visits; patient portal communications between provider and
patient; letters, calls, and texts; and patient-generated health data transmitted to the health team.
All differences in outcomes between the two groups were significant (p<0:05 for percentage of
days of medication adherence, explained in the text, and satisfaction; p<0:01 for all other differ-
ences). BP is blood pressure.
March 2019 38:3 Health Affairs 385
Downloaded from HealthAffairs.org on March 04, 2019.
Copyright Project HOPE—The People-to-People Health Foundation, Inc.
For personal use only. All rights reserved. Reuse permissions at HealthAffairs.org.
conditions seven days a week. The wait-listing
function enabled wait-listed patients to see pri-
mary care clinicians fifteen days earlier and to
see specialists twenty-six days earlier than ini-
tially scheduled. The number of video visits for
low-acuity conditions has grown eightfold since
launch in March 2018.
To help patients engage in self-management of
their health, patient-centric decision support
tools concurrently alert clinicians in the EHR
and patients in the portal to address screening
and disease monitoring concordant with
evidence-based recommendations. Guideline-
concordant reminders of hemoglobin A1c moni-
toring among patients with diabetes improved
the rate of A1c test completion by 33.9 percent
(p<0:01).23 In a clinical trial of online disease
management delivered via the patient portal,
patients with previously uncontrolled diabetes
had a significant reduction in HbA1c at six
months, compared to usual care (a reduction
of 1.32 percent versus one of 0.66 percent;
p<0:001).24
Sustainment of patient engagement is facili-
tated by a dedicated service center that provides
support twelve hours a day, five days a week. In
2017 there were over 400,000 customer service
support encounters with patients via phone,
chat, and email to facilitate continuous access
to the portal. An average of approximately
450,000 unique users log into the portal
2,500,000 times per month.
Stanford Health Care
Stanford Health Care is a not-for-profit multihos-
pital health system that includes more than 100
affiliated faculty and community-based clinics.
As Stanford Health Care grew from a single ter-
tiary medical center to a regional health system
with community primary and specialty care, dig-
ital engagement with patients became increas-
ingly important to provide efficient access to
administrative services, connect with patients
between visits, satisfy a growing demand for ac-
cess to health data, and enable remote monitor-
ing of high-risk patients.9,25 Stanfords priorities
were to increase patient portal enrollment and
usage, enable patients to access their own medi-
cal data and records, and monitor and respond to
patientssymptoms between visits.
While patient portals have grown in function-
ality, sign-up rates are often low owing to rigor-
ous but onerous identity verification processes.
To facilitate enrollment, Stanford automatically
verifies patient identity during portal enroll-
ment using a process similar to credit verifica-
tion, in which the patient answers a series of
questions based on publicly available data such
as the most recent home addresses instead of
standard in-person verification. Stanford also
developed a novel method to issue a text-based
instant invitation to sign up for the patient portal
directly from the EHR to the patients mobile
phone. In combination with effort by front-office
staff, these automatic processes have led to
72 percent enrollment overall and 87 percent
within primary careamong the highest in the
nation.
Stanford customized its EHR-based patient
portal, the Stanford MyHealth application, to
provide novel features such as technology that
automates patient check-ins upon arrival at a
clinic and provides an indoor navigational tool
to enable patients to find their way around the
hospital. The custom platform also allows pa-
tients to access their health data via mobile
and web-based apps, including laboratory, radi-
ology, and pathology information that was pre-
viously difficult for patients to obtain despite a
legal right to these data.
In an effort to expand patientsaccess to their
own health information,6Stanford shares doc-
torsnotes with patients across virtually all pro-
viders, with the exception of mental health care
providers. This functional enhancement has led
to high readership rates, with nearly 35 percent
of all doctorsnotes viewed by patients overall
and 42 percent within cancer and primary care.
This patient-facing feature required intensive
change management to overcome physician anx-
iety. The doctors note has historically been a
provider-centric document, and though patients
have legal access to their record, enabling online
access for patients is a relatively new concept. To
generate support, Stanford engaged providers
on multiple fronts, including physician leaders
(for example, the chief medical officer and de-
partment chairs), front-line physicians, and
their full multidisciplinary care teams. Upon
implementation, providers voiced virtually no
negative feedback, and there was no noticeable
increase in patientsconcerns.
Recognizing that emotional distress is com-
monly unidentified among patients receiving
treatment for cancer, Stanford implemented a
process to systematically survey such patients
for unaddressed symptoms, distress, and needs
through the patient portal as a standard element
of visit preparation. Positive responses triggered
clinical decision support to remind clinicians to
offer supportive services, addressing unmet
symptom-driven needs. A spectrum of examples
was uncoveredfrom minor transportation is-
sues to major financial hardship, and from
anxiety to suicidality. In a survey of 54,000 pa-
tients with cancer, about 40 percent of the
roughly 13,000 patients who responded re-
Patients
&
Consumers
386 Health Affairs March 2019 38:3
Downloaded from HealthAffairs.org on March 04, 2019.
Copyright Project HOPE—The People-to-People Health Foundation, Inc.
For personal use only. All rights reserved. Reuse permissions at HealthAffairs.org.
ported experiencing distress. These responses
precipitated more than 6,000 referrals for psy-
chotherapy, case management, nutrition, and
other services. In all, this process engages the
patient in preparing ahead of the visit, informs
the care team of unmet needs, and helps patients
connect with their care teams.
UC San Diego Health
UC San Diego Health maintains two geographi-
cally separate hospitals with a combined capacity
of 808 beds. It employs almost 9,000 staff and
physicians, with over 30,000 discharges and
750,000 outpatient visits annually. In 1996 it
implemented a home-grown patient portal called
PCASSO,3,4 and in 2008 it rolled out an EHR-
integrated patient portal.
In its newly constructed 364-bed Jacobs Medi-
cal Center, in 2016 UC San Diego Health hard-
wired inpatient rooms to embed digital technol-
ogy for engaging patients during their inpatient
stays. Tablet computers in each patient room
give patients access to room controls (lights,
shades, thermostat, and entertainment system),
educational content, and an inpatient patient
portal (MyChart Bedside, from Epic Systems).
From their beds, patients can access test results,
photographs of their health care team, a sched-
ule of medications and upcoming procedures,
and prescribed educational materials.
To understand the take-up of room control
features and the inpatient portal on tablets,
UC San Diego Health studied 3,411 inpatient
stays (excluding 789 newborn stays) between
September 1 and November 30, 2017. In two-
thirds of the stays, patients used the room con-
trol feature, and in one-third, patients accessed
the inpatient patient portal (exhibit 2). After
multiple factors were controlled for, logistic re-
gression analysis suggests that the odds of using
the inpatient patient portal among room control
users were 1.65 times greater than the odds for
patients who didnt use the tablet for room con-
trol. This suggests that the tablet has served as a
conduit that nudged more patients to use the
patient portal.
It is worth noting, however, that patients used
the inpatient patient portal differentially by age
and race, even after service areas were controlled
for. The odds of using the portal among non-
white patients were 0.84 times the odds among
white patients. Compared to younger patients,
older patients also had lower odds of using the
portal (odds ratio: 0.64).
While the costs of tablets were relatively low in
the context of building a new state-of-the-art
hospital, scaling up the use of tablets was not
Exhibit 2
Patient characteristics associated with use of bedside digital room control and inpatient patient portal on tablet
computers in inpatient settings at UC San Diego Health
Used bedside
room control
Used inpatient
patient portal
Sample size
(N=3,411) No. % No. %
Odds ratios of using
inpatient patient portal
Used bedside room control 2,242 2,242 100 815 36 1.65***
Sex
Male 920 700 76 316 34 1.06
Female 2,491 1,542 62 781 31 Ref
Age (years)
Younger patients (264) 2,694 1,713 64 898 33 Ref
Older patients (65) 717 529 74 199 28 0.64***
Race
White 2,009 1,286 64 652 32 Ref
Nonwhite 1,402 956 68 445 32 0.84**
Hospital service area
Obstetrics and gynecology 1,599 860 54 488 31 Ref
General medicine 475 378 80 192 40 1.56***
Bone marrow transplant 241 228 95 165 68 4.65***
Critical care 78 27 35 27 35 1.51
General surgery 456 419 92 118 26 0.72**
Medical specialty 79 14 18 17 22 0.86
Neurology 113 70 62 16 14 0.42***
Surgical subspecialty 370 246 66 74 20 0.60***
SOURCE Authorsanalysis of data for 2017 from UC San Diego Health on inpatient stays. **p<0:05 ***p<0:01
March 2019 38:3 Health Affairs 387
Downloaded from HealthAffairs.org on March 04, 2019.
Copyright Project HOPE—The People-to-People Health Foundation, Inc.
For personal use only. All rights reserved. Reuse permissions at HealthAffairs.org.
as simple as flipping a switch. Integrating pa-
tientstablet use into clinical staff work flow
can be challenging.26 Keeping information on
the care team up-to-date and reflected in the
tablets can also be difficult. This can be particu-
larly difficult for academic medical centers where
residents provide significant patient care. In-
cluding residentsinformation and pictures in
the care team profile will require nontrivial ef-
forts. Continued engagement by clinical staff
with patients and the allocation of resources to
provide technical support to clinicians is neces-
sary to transform the inpatient care setting from
a traditional clinician-centric culture to a pa-
tient-centric culture.
In early 2018 UC San Diego Health, along with
Ochsner, became one of the first organizations
to adopt a new digital tool produced by Apple27
that makes it possible for patients to integrate
data from multiple sourcesfor example, their
personal devices and multiple health care deliv-
ery organizations from which they receive ser-
vices, in addition to the data from their primary
health care organization. A UC San Diego Health
survey of the first 425 users of the tool suggested
that 90 percent of these early adopters reported
improvements in understanding their own
health; sharing health information with care-
givers, family, or friends; and facilitation of con-
versations with clinicians.28
Patient portals are being leveraged to further
improve transparency of patient priorities to
clinicians at UC San Diego Health, and also at
Sutter. In a study funded by the Patient-Centered
Outcomes Research Institute, patients are invit-
ed to contribute to setting ambulatory care visit
agendas, using the patient portal to inform their
primary care physicians of their top priorities
before their visits.29
Discussion
As patients enjoy more user-friendly technology
in nonhealth areas of their lives, they expect the
same type of consumer-friendly technology in
health care. The innovations from the academic
and community-based delivery organizations de-
scribed in this article mirror some of the modern
conveniences available in the consumer market-
place. The online appendix exhibit describes and
summarizes the technology-enabled consumer
engagement approaches at the four organiza-
tions as patients encounter health care providers
at home, in outpatient clinics, and in hospitals.30
While each institution stands out in particular
areas, no institution has adopted these tools and
processes in all areas.
At home, consumers expect to be able to sched-
ule appointments online, securely message their
care teams, and review clinical results. All four
organizations have implemented these features
in the patient portal, with 4579 percent of their
patients using them. User interface redesign has
enabled some of the organizations to authenti-
cate users in real time, thereby greatly removing
friction in patient portal enrollment. Notably, all
four organizations have adopted OpenNotes
which, while engaging patients,6brings unique
physician change management challenges.31
Two of the organizations (UC San Diego Health
and Sutter) are going further, with funding from
the Patient-Centered Outcomes Research Insti-
tute, to examine the potential impact of improv-
ing transparency of patient priorities to clini-
cians using the patient portal.29
Several organizations have home monitoring
using patient portal technology. The provision of
transmittable blood pressure and weight moni-
toring along with a physical service bar or digital
service center enables access to these valuable
technologies for patients with chronic condi-
tions. All four organizations are also offering
virtual care32 that is accessible through mobile
patient portal applications or online.
In the clinic, consumers are being offered
way-finding technology on their mobile devices.
Mobile check-in offers the convenience of
saving your spot in lineand the ability to pri-
vately complete previsit questionnaires, as well
as directly paying for services without needing to
interact with any clinic staff.
For hospitalized patients, institutions are in-
creasingly looking to empower patients by pro-
viding access to inpatient patient portals that can
facilitate communication; provide easy access to
hospitality amenities; and deliver education to
advance safe, coordinated, and dignified patient-
centered care.12,26 Further patient engagement
enhancements can be built upon the early suc-
cesses in uptake of room control features to
transform the culture of inpatient care setting
from clinician-centric to patient-centric. While
hospital-provisioned devices are an equalizing
enablement for many patients, patients with un-
met needs because of older age, nonwhite race,
and serious illnesses should receive additional
individualized supportnot only for physical
comfort, but also for meaningful engagement
in their care at levels consistent with their pref-
erences and needs. It is important to prevent
overdependence on technology that could exac-
erbate perceived isolation and patientsunmet
needs for human connection and interaction.9
Additional research is needed to assess the im-
pact of room control features and inpatient pa-
tient portals provided on tablets on outcomes
that matter to patients and families during their
inpatient stays and beyond.
Patients
&
Consumers
388 Health Affairs March 2019 38:3
Downloaded from HealthAffairs.org on March 04, 2019.
Copyright Project HOPE—The People-to-People Health Foundation, Inc.
For personal use only. All rights reserved. Reuse permissions at HealthAffairs.org.
Policy Implications
Federal resources have facilitated consumer en-
gagement by health care delivery organizations.
For example, Sutter leveraged funding from
meaningful use on some of its digital consumer
engagement tools. Other organizations used
grants to purchase initial equipment for televi-
sits. In 2018 the four organizations implemented
interoperable personal health records capabili-
ties using the open Apple Health Record appli-
cation programming interface.28 In addition to
empowering patients to aggregate their records
from multiple health systems, this will enable all
four organizations to attest to meeting 2018
stage 3 standards for meaningful use in the Cen-
ters for Medicare and Medicaid ServicesMerit-
based Incentive Payment System.
The long-term sustainability and scalability of
these initiatives depend on payerscommitment
to the quadruple aimenhancing patient expe-
rience, improving population health, reducing
costs, and improving the work life of health care
providers.33 Organizations may lack incentives
to scale virtual visits, for example, in a fee-
for-service environmentdespite recognized
benefits of virtual visits in preventing avoidable
emergency department visits and hospital ad-
missions, increasing the capacity of mental
health care providers, and allowing for telemo-
nitoring after hospital discharge.34 Private
payers require documentation unique to video
visits. The field is evolving, however, as Medicare
will begin to reimburse providers for conducting
video visits, reviewing brief communication
technologybased services such as virtual
check-ins, and remotely evaluating recorded vid-
eo or images submitted by the patient.35
Although Medicare has created a new mecha-
nism to pay for team-based care, it charges
patients a 20 percent monthly copayment for
remote monitoring and chronic care manage-
ment services. Ochsner decided to not bill the
Centers for Medicare and Medicaid Services for
its Hypertension Digital Medicine Program,
although it included chronic care management
and remote monitoring, because Ochsner did
not want to increase its patientsfinancial bur-
den. Its success in significantly increasing
the rate of blood pressure control, medication
adherence, and satisfaction with care among pa-
tients, however, has resulted in payment from
commercial insurance in recognition of its per-
formance. When payers benefit from providers
use of technology to engage patients and its sub-
sequent savings, payers should share the savings
with the health care delivery organizations.
A direct business case for patient engagement
cannot always be made, however. Indeed, most
of the strategies described here do not directly
contribute to revenue and are often costly. It is
difficult to quantify the value of patient satisfac-
tion in a competitive health care market and hard
to gauge patient engagementlet alone its mon-
etary value. However, in many metropolitan
areas there is increasing competition among
health care systems, and consumer engagement
is an important differentiator and may even be a
basic requirement. Despite lack of direct finan-
cial benefit, these four health systems have in-
vested in consumer-facing technologies to better
connect with their patients, reduce the friction of
obtaining care, and serve the needs of patients.
The technology-enhanced journey to a patient-
centered world is achievable with organizational
commitment to implementing patient-centered
care. Use of digital tools to enhance consumer
engagement and transparency could not only
improve patient health outcomes and experience
with care, but could also grow health care organ-
izationsmarket share.
The authors thank Jeremy Sutton, James
Read, and Lisa Moore for their support.
Research reported in this article was
partially funded through a Patient-
Centered Outcomes Research Institute
(PCORI) Award (No. IHS-1608-35689-IC).
NOTES
1HealthIT.gov. Meaningful use [In-
ternet]. Washington (DC): Depart-
ment of Health and Human Services;
[content last reviewed 2019 Jan 9;
cited 2019 Jan 30]. Available from:
https://www.healthit.gov/topic/
meaningful-use-and-macra/
meaningful-use/
2Carman KL, Dardess P, Maurer M,
Sofaer S, Adams K, Bechtel C, et al.
Patient and family engagement: a
framework for understanding the
elements and developing interven-
tions and policies. Health Aff (Mill-
wood). 2013;32(2):22331.
3Masys D, Baker D, Butros A, Cowles
KE. Giving patients access to their
medical records via the internet: the
PCASSO experience. J Am Med In-
form Assoc. 2002;9(2):18191.
4Masys DR. Effects of current and
future information technologies on
the health care workforce. Health Aff
(Millwood). 2002;21(5):3341.
5Halamka JD, Mandl KD, Tang PC.
Early experiences with personal
health records. J Am Med Inform
Assoc. 2008;15(1):17.
6Fossa AJ, Bell SK, DesRoches C.
OpenNotes and shared decision
making: a growing practice in clini-
cal transparency and how it can
support patient-centered care. J Am
March 2019 38:3 Health Affairs 389
Downloaded from HealthAffairs.org on March 04, 2019.
Copyright Project HOPE—The People-to-People Health Foundation, Inc.
For personal use only. All rights reserved. Reuse permissions at HealthAffairs.org.
Med Inform Assoc. 2018;25(9):
11539.
7Tang PC, Lansky D. The missing link:
bridging the patient-provider health
information gap. Health Aff (Mill-
wood). 2005;24(5):12905.
8Zhao JY, Song B, Anand E, Schwartz
D, Panesar M, Jackson GP, et al.
Barriers, facilitators, and solutions
to optimal patient portal and per-
sonal health record use: a systematic
review of the literature. AMIA Annu
Symp Proc. 2018;2017:191322.
9Dalal AK, Bates DW, Collins S. Op-
portunities and challenges for im-
proving the patient experience in the
acute and postacute care setting us-
ing patient portals: the patients
perspective. J Hosp Med. 2017;
12(12):10126.
10 Kaziunas E, Hanauer DA, Ackerman
MS, Choi SW. Identifying unmet in-
formational needs in the inpatient
setting to increase patient and care-
giver engagement in the context of
pediatric hematopoietic stem cell
transplantation. J Am Med Inform
Assoc. 2016;23(1):94104.
11 Wu Z, Robson S, Hollis B. The ap-
plication of hospitality elements in
hospitals. J Healthc Manag. 2013;
58(1):4762, discussion 623.
12 Grossman LV, Choi SW, Collins S,
Dykes PC, OLeary KJ, Rizer M, et al.
Implementation of acute care patient
portals: recommendations on utility
and use from six early adopters. J Am
Med Inform Assoc. 2018;25(4):
3709.
13 Kelly MM, Coller RJ, Hoonakker PL.
Inpatient portals for hospitalized
patients and caregivers: a systematic
review. J Hosp Med. 2018;13(6):
40512.
14 Brodie M, Flournoy RE, Altman DE,
Blendon RJ, Benson JM, Rosenbaum
MD. Health information, the Inter-
net, and the digital divide. Health Aff
(Millwood). 2000;19(6):25565.
15 Hibbard JH, Stockard J, Mahoney
ER, Tusler M. Development of the
Patient Activation Measure (PAM):
conceptualizing and measuring ac-
tivation in patients and consumers.
Health Serv Res. 2004;39(4 Pt 1):
100526.
16 Needham BL, Epel ES, Adler NE,
Kiefe C. Trajectories of change in
obesity and symptoms of depression:
the CARDIA study. Am J Public
Health. 2010;100(6):10406.
17 Milani RV, Bober RM, Lavie CJ. The
role of technology in chronic disease
care. Prog Cardiovasc Dis. 2016;
58(6):57983.
18 Milani RV, Lavie CJ, Bober RM,
Milani AR, Ventura HO. Improving
hypertension control and patient
engagement using digital tools. Am J
Med. 2017;130(1):1420.
19 Centers for Disease Control and
Prevention. Calculating proportion
of days covered (PDC) for anti-
hypertensive and antidiabetic medi-
cations: an evaluation guide for
grantees [Internet]. Atlanta (GA):
CDC; 2015 Aug 31 [cited 2019 Jan
24]. Available from: https://
www.cdc.gov/dhdsp/docs/med-
adherence-evaluation-tool.pdf
20 Centers for Medicare and Medicaid
Services. 2017 Medicare-Medicaid
plan performance data technical
notes [Internet]. Baltimore (MD):
CMS; [updated 2017 Jun 23; cited
2019 Jan 24]. Available from:
https://www.cms.gov/Medicare-
Medicaid-Coordination/Medicare-
and-Medicaid-Coordination/
Medicare-Medicaid-Coordination-
Office/FinancialAlignment
Initiative/Downloads/MMP
PerformanceDataTechNotes
CY2017_06262017.pdf
21 Anthony DL, Campos-Castillo C, Lim
PS. Who isnt using patient portals
and why? Evidence and implications
from a national sample of US adults.
Health Aff (Millwood). 2018;37(12):
194854.
22 Tang PC, Black W, Young CY. Pro-
posed criteria for reimbursing
eVisits: content analysis of secure
patient messages in a personal
health record system. AMIA Annu
Symp Proc. 2006:7648.
23 Panattoni L, Chan A, Yang Y, Olson
C, Tai-Seale M. Nudging physicians
and patients with autopend clinical
decision support to improve diabetes
management. Am J Manag Care.
2018;24(10):47983.
24 Tang PC, Overhage JM, Chan AS,
Brown NL, Aghighi B, Entwistle MP,
et al. Online disease management of
diabetes: Engaging and Motivating
Patients Online with Enhanced
ResourcesDiabetes (EMPOWER-
D), a randomized controlled trial.
J Am Med Inform Assoc. 2013;
20(3):52634.
25 Andrade SE, Kahler KH, Frech F,
Chan KA. Methods for evaluation of
medication adherence and persis-
tence using automated databases.
Pharmacoepidemiol Drug Saf.
2006;15(8):56574, discussion
5757.
26 Collins SA, Rozenblum R, Leung WY,
Morrison CR, Stade DL, McNally K,
et al. Acute care patient portals: a
qualitative study of stakeholder
perspectives on current practices. J
Am Med Inform Assoc. 2017;24(e1):
e917.
27 Apple [Internet]. Cupertino (CA):
Apple; 2018. Press release, Apple
announces effortless solution
bringing health records to iPhone;
[updated 2018 Jan 24; cited 2019
Jan 24]. Available from: https://
www.apple.com/newsroom/2018/
01/apple-announces-effortless-
solution-bringing-health-records-
to-iPhone/
28 Dameff C, Clay B, Longhurst CA.
Personal health records: more
promising in the smartphone era?
JAMA. 2019 Jan 11. [Epub ahead
of print].
29 Patient-Centered Outcomes Re-
search Institute. Comparing three
approaches to improve communica-
tion between patients and their
doctors [Internet]. Washington
(DC): PCORI; [last updated 2019 Jan
4; cited 2019 Jan 24]. Available from:
https://www.pcori.org/research-
results/2016/comparing-three-
approaches-improve-
communication-between-
patients-and-their
30 To access the appendix, click on the
Details tab of the article online.
31 Delbanco T, Walker J, Bell SK, Darer
JD, Elmore JG, Farag N, et al. In-
viting patients to read their doctors
notes: a quasi-experimental study
and a look ahead. Ann Intern Med.
2012;157(7):46170.
32 Cheung L, Leung TI, Ding VY, Wang
JX, Norden J, Desai M, et al.
Healthcare service utilization under
a new virtual primary care delivery
model. Telemed J E Health. 2018 Sep
7. [Epub ahead of print].
33 Bodenheimer T, Sinsky C. From tri-
ple to quadruple aim: care of the
patient requires care of the provider.
Ann Fam Med. 2014;12(6):5736.
34 Leff B, Soones T, DeCherrie L. The
hospital at home program for older
adults. JAMA Intern Med. 2016;
176(11):17245.
35 CMS.gov. Proposed policy, payment,
and quality provisions changes to
the Medicare Physician Fee Schedule
for calendar year 2019 [Internet].
Baltimore (MD): Centers for Medi-
care and Medicaid Services; 2018 Jul
12 [cited 2019 Jan 24]. (Fact Sheet).
Available from: https://www.cms
.gov/newsroom/fact-sheets/
proposed-policy-payment-and-
quality-provisions-changes-
medicare-physician-fee-schedule-
calendar-year-3
Patients
&
Consumers
390 Health Affairs March 2019 38:3
Downloaded from HealthAffairs.org on March 04, 2019.
Copyright Project HOPE—The People-to-People Health Foundation, Inc.
For personal use only. All rights reserved. Reuse permissions at HealthAffairs.org.
Tai-Seale M, Downing NL, Jones VG, Milani RV, Zhao B, Clay B, et al. Technology-enabled consumer engagement: promising practices at four health care delivery organizations.
Health Aff (Millwood). 2019;38(3).
Appendix Exhibit. Summary of Tech-Enabled Consumer Engagement Approaches in Four Systems
Care location
Tech-Enabled
Engagement
Ochsner Health
Stanford HealthCare
Sutter Health
At Home
Patient portal
Easy activation,
50% active users
Text based invitation
from the EHR, 72%
active users
Point of care patient portal
enrollment, text based
invitation from the EHR,
online activation, 79%
active users
OpenNotes
2016 System-wide
2017 system-wide
2018, 2 of 5 medical
foundations (Sutter
Medical Foundation and
Sutter Gould Medical
Foundation)
Virtual care
Virtual visits with
Pharmacists/
Health Coaches
Virtual care clinic
System-wide video visits
for non-urgent conditions
Interoperable patient
health records
iOS application programming interface automates both the retrieval of health record data from multiple
healthcare organizations and the communication of clinical information (such as blood glucose levels from
wearable devices) to those organizations. Patients have View/Download/Transmit capabilities.
Outpatient Clinic
Wayfinding
Email reminder with
external directions to
building
Mobile app, external
directions to buildings
and internal directions
within buildings
Mobile app, external
direction to buildings and
internal directions in one
hospital and one medical
office building
Digitally supported
service
O Bar sets up
transmission capable
BP-monitoring devices
for patients.
Supportive services for
patients undergoing
cancer treatment
Transmission capable BP
and weight monitoring,
personalized health
coaching
Inpatient Hospital
Bedside digital room
control and access to
personal health record
Tablets being
implemented in two
hospitals
Source: Authors’ analysis of consumer engagement technologies used in each organization.
... Hotel-like hospitality services Edwards et al. (2000);Han and Hwang (2013) Zhao et al. (2019) this review), which offers healthcare and hospitality services matching visitor cognitive filters (patient-guest in this review), to improve the tourist healthcare experience (PGE in this review). ...
... Multiple factors may foster FIC, such as on-demand doctor consultation, choice of food and beverages, on-call concierge service, convenience in accessing service from hospitable healthcare staff, controllable mood lighting in the room, control over technological access to entertainment, music, and television, and on-demand salon and spa Suess and Mody, 2018). Technological control over patient room amenities, such as tablet controllable television, room lighting, and curtain movement, increases patient positive feelings of control of the environment while experiencing confinement in a hospital bed (Zhao et al., 2019). From the perspective of a hospitable telemedicine experience in the hospitality context, FIC of accessing reliable doctor service with ease and convenience improved individuals' experience of clearly receiving the service content (Cheng et al., 2021). ...
... From the perspective of a hospitable telemedicine experience in the hospitality context, FIC of accessing reliable doctor service with ease and convenience improved individuals' experience of clearly receiving the service content (Cheng et al., 2021). Convenience in accessing patient medical records at any time, such as patient control provided on a tablet in the patient's room, without making calls to nursing staff, greatly improves the patient experience during health treatment (Zhao et al., 2019). ...
Article
The healthcare industry is increasingly interested in using the power of hospitality to improve the patient experience. However, the conceptual understanding of hospitality in healthcare remained shallow, mixed, and fragmented in previous studies. To reconceptualize and push the boundaries of hospitality in healthcare, we analyzed 73 literature items published between the years 2000 and 2022, adopting the scoping review approach. We unearthed the conceptual understanding of healthcare hospitality alongside the antecedents and outcomes of hospital-hotel choice that may impact patient-guest experience (PGE), health and well-being (HWB), and behavioral intention. A conceptual framework is presented to show that patient-guest hospital-hotel choice is based on service attractions that hinge on healthcare and hospitality service operations, which may determine PGE, HWB, and behavioral intention. Besides theoretical contributions, this review offers important practical implications, with examples, for the healthcare industry as it struggles to improve the patient experience.
... On the other hand, although there is a standardized tool to evaluate mobile application usability, researchers generally did not prefer using these questionnaires. Specific patient-reported outcomes (e.g., mHealth App Usability Questionnaire, Telehealth Usability Questionnaire) can further strengthen the effectiveness analyses of mobile tools regarding usability (Özden et al., 2021;Zhao et al., 2019). ...
Article
Objective: Mobile applications have been used frequently in post-operative orthopaedic rehabilitation in recent years. However, no systematic review has emphasized the importance of mobile applications in the rehabilitation process after total knee arthroplasty (TKA). This systematic review and meta-analysis aimed to evaluate the effectiveness of mobile application-based rehabilitation practices in patients with TKA. Material and Methods: PubMed, Web-of-Science, Scopus, ScienceDirect and Cochrane databases were searched. The Physiotherapy Evidence Database (PEDro) and the Revised Cochrane risk-of-bias tool randomized trials 2 (RoB2) tools were used to demonstrate the methodological quality and risk of bias. Results: A total of 584 articles were screened. Finally, six papers were included in the systematic review. PEDro scores ranged from 4 to 7 (median: 5.5), indicating fair to good methodological quality. All studies were classified as “some concerns” in RoB2. Mobile application-based rehabilitation demonstrated better scores on pain, range of motion (ROM), objective and subjective function, satisfaction and compliance in general. Meta-analysis proved that mobile application-based telerehabilitation demonstrated better results on subjective function (ES:0.57, 95% CI: 0.11-1.02). Conclusion: Compared to conventional rehabilitation, application-based telerehabilitation provides more effective results in function, pain and ROM. Furthermore, mobile application-based rehabilitation should also be considered regarding patient satisfaction and compliance.
... In contrast to the increasing popularity of research on smartwatch app usage, only few studies have investigated app usage on tablet computers, even though 75% of tablet users have downloaded an app to their device, and 38% use 6 or more tablet apps every week (Purcell, 2011). Studies that have examined app use on tablets have focused on rather narrow applied settings like classrooms and hospitals (Amelink et al., 2012;Diliberto-Macaluso & Hughes, 2016;Rick, 2012;Zhao et al., 2019). Given the greater similarity between the tablet and smartphone user interface, the smartphone app data collection and analysis methods described in this chapter are likely to be more generalizable to tablets than smartwatches. ...
Chapter
App usage data provide some of the most psychologically rich information one can collect using mobile sensing methods. Here, we discuss how data from the applications ( “apps”) people use to enhance the functionality of their mobile devices can advance research in all subdisciplines of psychology. First, we describe prior psychological work on app usage behavior. Next, we provide a detailed guide for researchers interested in working with app usage data. Specifically, we discuss different ways to 1) collect app usage data (e.g., usage logs, screenshots), 2) categorize individual apps and app categories, 3) analyze app usage data (e.g., considering app adoption, usage quantities, sequences, within-app behavior), and 4) enrich app usage data (e.g., using web APIs, experience sampling). We conclude by discussing technical and ethical challenges posed by app usage research, as well as an outlook on the future of app usage on new kinds of mobile devices.
... The patient's experience scores may also be related to more objective clinical quality measurements. As confirmed by the numerous studies, the hospitals that have a better collaboration with patients may also achieve higher rates of compliance with clinical healthcare standards and follow-up operation standards (Lim et al., 2020;Zhao et al., 2019;Lyu et al., 2013;Glickman et al., 2010). Heidegger et al. (2006) focused on an examination of the patient satisfaction with anaesthesia care. ...
Article
Full-text available
Research background: The patients' confidence in physicians, as well as in healthcare personnel in general, is an important determinant of the patients' satisfaction and their loyalty. The patients' confidence as well as their overall satisfaction is influenced by many determinants, which are in a causal relation. Purpose of the article: The main aim of the study is to find out which socio-demographic factors influence the confidence of inpatients in physicians, nurses, other medical personnel, as well as in the treatment as such. The inpatients´ confidence is considered as an important dimension of the inpatients' satisfaction. Methods: The questionnaire consists of 112 structured and semi-structured survey questions. It was inspired by the HCAHPS survey. The questionnaire was distributed both on-line and in paper form in the Czech Republic. The dataset consists of 1,479 observations (899 females and 580 males). The descriptive statistics and binary logistic regression were used to process all data. Oeconomia Copernicana, 12(3), 821-848 822 Findings & value added: The research revealed significant differences in the confidence of inpatients in physicians in relation to the physicians' communication styles regarding the inpa-tient's gender. Males are more tolerant to the communication styles of physicians than women. There exists a relatively strong linear relationship between confidence in physicians, nurses, other healthcare professionals, and confidence in a treatment. Also, it was determined that in cases when a physician talks about an inpatient as if she/he is not there, the patient's confidence in the medical personnel is reduced by 65%. Overall confidence in medical personnel is also gender biased i.e., in 87% of cases, women are more likely to have a higher confidence in medical personnel than men. The age of inpatients is not statistically significant and its impact on a confidence in medical personnel is neglectable.
... (9)(10)(11) Despite known benefits, adoption rates of inpatient portals remain low. (12,13) The level and timeliness of information shared with patients via the portal is often restricted, (14) and patients have identified several design, acceptance, and usability issues. (15)(16)(17) Researchers have also recognized disparities in portal use. ...
Article
Inpatient portals could help patients engage in their hospital care, yet several design, usability, and adoption issues prevent this technology from fulfilling its potential. Despite patients having needs that extend beyond the scope of existing inpatient portals, we know less about how to design such portals that support them. To learn about effective designs, we created three mid-fidelity prototypes representing novel approaches for inpatient portal design. Then, we conducted interviews with 21 pediatric and adult inpatients to gather their feedback on these prototypes. Participants shared how the prototypes addressed the following needs: forming active partnerships, navigating relationships and power dynamics with clinicians, understanding complexity of care, contextualizing health information, increasing efficiency of communication, and preventing lost information. We discuss two key implications-supporting patients' agency and dynamic needs throughout their hospital care-for the future of inpatient portal designs.
... Given the heterogeneity in definitions and methods used for assessing the usability of mHealth apps, one group has recently developed and validated the 21-item mHealth App Usability Questionnaire (MAUQ) [24]. This tool explores 3 domains of usability, which are in line with the ISO definition: (1) ease of use and satisfaction, akin to ISO satisfaction; (2) system information arrangement, akin to ISO efficiency; and (3) usefulness, akin to ISO effectiveness. ...
Article
Full-text available
Background Mobile health (mHealth) apps are increasingly used postoperatively to monitor, educate, and rehabilitate. The usability of mHealth apps is critical to their implementation. Objective This systematic review evaluates the (1) methodology of usability analyses, (2) domains of usability being assessed, and (3) results of usability analyses. Methods The A Measurement Tool to Assess Systematic Reviews checklist was consulted. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses reporting guideline was adhered to. Screening was undertaken by 2 independent reviewers. All included studies were assessed for risk of bias. Domains of usability were compared with the gold-standard mHealth App Usability Questionnaire (MAUQ). Results A total of 33 of 720 identified studies were included for data extraction. Of the 5 included randomized controlled trials (RCTs), usability was never the primary end point. Methodology of usability analyses included interview (10/33), self-created questionnaire (18/33), and validated questionnaire (9/33). Of the 3 domains of usability proposed in the MAUQ, satisfaction was assessed in 28 of the 33 studies, system information arrangement was assessed in 11 of the 33 studies, and usefulness was assessed in 18 of the 33 studies. Usability of mHealth apps was above industry average, with median System Usability Scale scores ranging from 76 to 95 out of 100. Conclusions Current analyses of mHealth app usability are substandard. RCTs are rare, and validated questionnaires are infrequently consulted. Of the 3 domains of usability, only satisfaction is regularly assessed. There is significant bias throughout the literature, particularly with regards to conflicts of interest. Future studies should adhere to the MAUQ to assess usability and improve the utility of mHealth apps.
Article
Full-text available
Importance: Inpatient portals provide patients with clinical data and information about their care and have the potential to influence patient engagement and experience. Although significant resources have been devoted to implementing these portals, evaluation of their effects has been limited. Objective: To assess the effects of patient training and portal functionality on use of an inpatient portal and on patient satisfaction and involvement with care. Design, setting, and participants: This randomized clinical trial was conducted from December 15, 2016, to August 31, 2019, at 6 noncancer hospitals that were part of a single health care system. Patients who were at least 18 years of age, identified English as their preferred language, were not involuntarily confined or detained, and agreed to be provided a tablet to access the inpatient portal during their stay were eligible for participation. Data were analyzed from May 1, 2019, to March 15, 2021. Interventions: A 2 × 2 factorial intervention design was used to compare 2 levels of a training intervention (touch intervention, consisting of in-person training vs built-in video tutorial) and 2 levels of portal function availability (tech intervention) within an inpatient portal (all functions operational vs a limited subset of functions). Main outcomes and measures: The primary outcomes were inpatient portal use, measured by frequency and comprehensiveness of use, and patients' satisfaction and involvement with their care. Results: Of 2892 participants, 1641 were women (56.7%) with a median age of 47.0 (95% CI, 46.0-48.0) years. Most patients were White (2221 [76.8%]). The median Charlson Comorbidity Index was 1 (95% CI, 1-1) and the median length of stay was 6 (95% CI, 6-7) days. Notably, the in-person training intervention was found to significantly increase inpatient portal use (incidence rate ratio, 1.34 [95% CI, 1.25-1.44]) compared with the video tutorial. Patients who received in-person training had significantly higher odds of being comprehensive portal users than those who received the video tutorial (odds ratio, 20.75 [95% CI, 16.49-26.10]). Among patients who received the full-tech intervention, those who also received the in-person intervention used the portal more frequently (incidence rate ratio, 1.36 [95% CI, 1.25-1.48]) and more comprehensively (odds ratio, 22.52; [95% CI, 17.13-29.62]) than those who received the video tutorial. Patients who received in-person training had higher odds (OR, 2.01 [95% CI, 1.16-3.50]) of reporting being satisfied in the 6-month postdischarge survey. Similarly, patients who received the full-tech intervention had higher odds (OR, 2.06 [95%CI, 1.42-2.99]) of reporting being satisfied in the 6-month postdischarge survey. Conclusions and relevance: Providing in-person training or robust portal functionality increased inpatient engagement with the portal during the hospital stay. The effects of the training intervention suggest that providing personalized training to support use of this health information technology can be a powerful approach to increase patient engagement via portals. Trial registration: ClinicalTrials.gov Identifier: NCT02943109.
Article
Full-text available
Patients' journeys across the care continuum can be improved with patient-centered technology integrated into the care process. Misaligned financial incentives, change management challenges, and privacy concerns are some of the hurdles that have prevented health systems from deploying technology that engages patients along the care continuum. Despite these sociotechnical challenges, some health care organizations have developed innovative approaches to engaging patients. We describe promising technology-enabled consumer engagement practices at two community-based delivery organizations and two academic medical centers to demonstrate the approaches, sociotechnical challenges, and outcomes associated with their implementation. Leadership commitment and payer policies that align with the quadruple aim-enhancing patient experience, improving population health, reducing costs, and improving the work life of health care providers-would encourage further deployment and lead to greater consumer engagement along the care continuum.
Article
Full-text available
As health care delivery organizations shift from implementation of electronic health records to optimization of these systems, the persistent problem of patient data interoperability is becoming increasingly relevant. Interest in accessing medical information from hospital records and databases and providing convenient patient-controlled portable records is increasing. Technology companies are seeking to develop innovative solutions to meet these demands.
Article
Full-text available
Background: For older adults, physical activity is vital for maintaining their health and ability to live independently. Home-based programs can help them achieve the recommended exercise frequency. An application for a tablet computer was developed to support older adults in following a personal training program. It featured goal setting, tailoring, progress tracking, and remote feedback. Objective: In line with the Medical Research Council Framework, which prescribes thorough testing before evaluating the efficacy with a randomized controlled trial, the aim of this study was to assess the usability of a tablet-based app that was designed to support older adults in doing exercises at home. Methods: A total of 15 older adults, age ranging from 69 to 99 years old, participated in a usability study that utilized a mixed-methods approach. In a laboratory setting, novice users were asked to complete a series of tasks while verbalizing their ongoing thoughts. The tasks ranged from looking up information about exercises and executing them to tailoring a weekly exercise schedule. Performance errors and time-on-task were calculated as proxies of effective and efficient usage. Overall satisfaction was assessed with a posttest interview. All responses were analyzed independently by 2 researchers. Results: The participants spent 13-85 seconds time-on-task. Moreover, 79% (11/14)-100% (14/14) participants completed the basic tasks with either no help or after having received 1 hint. For expert tasks, they needed a few more hints. During the posttest interview, the participants made 3 times more positive remarks about the app than negative remarks. Conclusions: The app that was developed to support older adults in doing exercises at home is usable by the target audience. First-time users were able to perform basic tasks in an effective and efficient manner. In general, they were satisfied with the app. Tasks that were associated with behavior execution and evaluation were performed with ease. Complex tasks such as tailoring a personal training schedule needed more effort. Learning effects, usefulness, and long-term satisfaction will be investigated through longitudinal follow-up studies.
Article
Full-text available
Patient portal and personal health record adoption and usage rates have been suboptimal. A systematic review of the literature was performed to capture all published studies that specifically addressed barriers, facilitators, and solutions to optimal patient portal and personal health record enrollment and use. Consistent themes emerged from the review. Patient attitudes were critical as either barrier or facilitator. Institutional buy-in, information technology support, and aggressive tailored marketing were important facilitators. Interface redesign was a popular solution. Quantitative studies identified many barriers to optimal patient portal and personal health record enrollment and use, and qualitative and mixed methods research revealed thoughtful explanations for why they existed. Our study demonstrated the value of qualitative and mixed research methodologies in understanding the adoption of consumer health technologies. Results from the systematic review should be used to guide the design and implementation of future patient portals and personal health records, and ultimately, close the digital divide.
Article
Full-text available
Efforts to improve the patient experience are increasingly focusing on engaging patients and their "care partners" by using patient portals. The Acute Care Patient Portal Task Force was supported by the Gordon and Betty Moore Foundation to convene a national meeting of an interdisciplinary group of stakeholders, including patient advocates, to consider how the acute and postacute care patient experience can be improved by using patient-facing technologies. We identified key opportunities and challenges for enhancing cognitive support, promoting respect while maintaining boundaries, and facilitating patient and family empowerment through the lens of the patient. Institutions, clinicians, and vendors would benefit tremendously by considering these 3 patient-centered themes when partnering with patients and family advisors to implement and realize the full potential of patient portals to enhance the acute and postacute care experience.
Article
Objectives: To determine the impact on routine glycated hemoglobin (A1C) laboratory test completion of incorporating an autopend laboratory order functionality into clinical decision support, which (1) routed provider alerts to a separate electronic folder, (2) automatically populated preauthorization forms, and (3) linked the timing and content of electronic patient health maintenance topic (HMT) reminders to the provider authorization. Study design: Observational pre-post study from November 2011 (1 year before autopend) through June 2014 (1.5 years after). Methods: The study included HMT reminders concerning an A1C test for patients with type 1 or type 2 diabetes (N = 15,630 HMT reminders; 8792 patients) in a large multispecialty ambulatory healthcare system. A Cox proportional hazard model, adjusted for patient and provider demographics, estimated the likelihood of laboratory test completion based on 3 HMT reminder characteristics: preautopend versus postautopend period, read versus unread, and the patient's time to reading. Results: In the postautopend period, the median time for patients to read reminders decreased (1 vs 3 days; P <.001) and the median time to complete laboratory tests decreased (40 vs 48 days; P <.001). Comparing preautopend HMT reminders with a similar time to reading, the likelihood of A1C laboratory test completion increased after autopend by between 21.1% (hazard ratio [HR], 1.211; P = .050), when time to reading was 57 days, and 33.9% (HR, 1.339; P = .003), when time to reading was 0 days. This result included 68% of the reminders. There was no statistical difference in A1C laboratory test completion for unread reminders in the preautopend versus postautopend period. Conclusions: Automated patient-centered decision support can improve guideline-concordant monitoring of A1C among patients with diabetes, particularly among patients who read reminders in a timely fashion.
Article
Patient portals that provide secure online access to medical record information and provider communication can improve health care. Yet new technologies can exacerbate existing disparities. We analyzed information about 2,325 insured respondents to the nationally representative 2017 Health Information National Trends Survey to examine characteristics of portal nonusers and reasons for nonuse. Sixty-three percent reported not using a portal during the prior year. In multivariable analysis, we found that nonusers were more likely to be male, be on Medicaid, lack a regular provider, and have less than a college education, compared to users. Similar disparities existed in who reported being offered access to a portal, with nonwhites also less likely to report being offered access. Reasons for nonuse included the desire to speak directly to providers and privacy concerns, both of which require recognition of the important role of provider communication and patient-provider relationships.
Article
Background: Telemedicine holds great promise for changing healthcare delivery. While telemedicine has been used significantly in the direct-to-consumer setting, the use of telemedicine in a preventive primary care setting is not well studied. Introduction: ClickWell Care (CWC) is the first known implementation of a technology-enabled primary care model. We wanted to quantify healthcare utilization of primary care by patient characteristics and modality of care delivery. Materials and methods: Our study population included those who completed a visit to a CWC clinic between January 1, 2015 and September 30, 2015. We compared patients based on utilization of CWCs in-person and virtual visits across the following domains: patient demographics, distance from clinic, responses to a Health Risk Assessment, and top 10 conditions treated. Results: Thousand two hundred seven patients completed a visit with a CWC physician in 2015. Nearly three-quarters of our patients were ≤40 years and sex was significantly different (p = 0.015) between visit cohorts. The greatest representation of men (47%) was seen in the virtual-only cohort. Patients' proximity to the clinic was also significantly different across visit cohorts (p = 0.018) with 44% of in-person-only and 34% of virtual-only patients living within 5 miles of Stanford Hospital. Discussion: We found men were more likely to engage in virtual-only care. Young patients are willing to accept virtual care although many prefer to complete an in-person visit first. Conclusions: Our findings suggest that a "bricks-and-clicks" care model where telemedicine is supported by a brick-and-mortar location may be an effective way to leverage telemedicine to deliver primary care.
Article
Patient portals, web-based personal health records linked to electronic health records (EHRs), provide patients access to their healthcare information and facilitate communication with providers. Growing evidence supports portal use in ambulatory settings; however, only recently have portals been used with hospitalized patients. Our objective was to review the literature evaluating the design, use, and impact of inpatient portals, which are patient portals designed to give hospitalized patients and caregivers inpatient EHR clinical information for the purpose of engaging them in hospital care. Literature was reviewed from 2006 to 2017 in PubMed, Web of Science, CINALPlus, Cochrane, and Scopus to identify English language studies evaluating patient portals, engagement, and inpatient care. Data were analyzed considering the following 3 themes: inpatient portal design, use and usability, and impact. Of 731 studies, 17 were included, 9 of which were published after 2015. Most studies were qualitative with small samples focusing on inpatient portal design; 1 nonrandomized trial was identified. Studies described hospitalized patients' and caregivers' information needs and design recommendations. Most patient and caregiver participants in included studies were interested in using an inpatient portal, used it when offered, and found it easy to use and/or useful. Evidence supporting the role of inpatient portals in improving patient and caregiver engagement, knowledge, communication, and care quality and safety is limited. Included studies indicated providers had concerns about using inpatient portals; however, the extent to which these concerns have been realized remains unclear. Inpatient portal research is emerging. Further investigation is needed to optimally design inpatient portals to maximize potential benefits for hospitalized patients and caregivers while minimizing unintended consequences for healthcare teams.
Article
Objective: To provide recommendations on how to most effectively implement advanced features of acute care patient portals, including: (1) patient-provider communication, (2) care plan information, (3) clinical data viewing, (4) patient education, (5) patient safety, (6) caregiver access, and (7) hospital amenities. Recommendations: We summarize the experiences of 6 organizations that have implemented acute care portals, representing a variety of settings and technologies. We discuss the considerations for and challenges of incorporating various features into an acute care patient portal, and extract the lessons learned from each institution's experience. We recommend that stakeholders in acute care patient portals should: (1) consider the benefits and challenges of generic and structured electronic care team messaging; (2) examine strategies to provide rich care plan information, such as daily schedule, problem list, care goals, discharge criteria, and post-hospitalization care plan; (3) offer increasingly comprehensive access to clinical data and medical record information; (4) develop alternative strategies for patient education that go beyond infobuttons; (5) focus on improving patient safety through explicit safety-oriented features; (6) consider strategies to engage patient caregivers through portals while remaining cognizant of potential Health Insurance Portability and Accountability Act (HIPAA) violations; (7) consider offering amenities to patients through acute care portals, such as information about navigating the hospital or electronic food ordering.