ArticlePDF Available

Implementation of Evidence- Based Services for Weight at Specialty Mental Health Clinics

Authors:
Implementation of Evidence-
Based Services for Weight at
Specialty Mental Health Clinics
Amy N. Cohen, PhD
Alexander S. Young, MD, MSHS
Alison B. Hamilton, PhD, MPH
Kirk McNagny, MD
Anna Teague, MD
Christopher Reist, MD
Schizophrenia
Most common serious mental illness
Chronic disorder of thought
Cognitive deficits: attention, memory,
information processing, executive functioning
Prevalence of 1%
10% of all permanently disabled people
Evidence-based practices (EBPs) exist
EQUIP:
Enhancing QUality In Psychosis
Funded by VA HSR&D QUERI
EQUIP Design
Long Beach
Los Angeles
Waco Temple Houston Shreveport
Bronx
Northport
3-year clinic-level controlled trial
4 Regions: 1 control, 1 intervention in each
201 providers, 801 patients
EQUIP Design continued
Intervention: implement chronic illness
care model to increase use of EBPs for
individuals with schizophrenia
Control: usual care
EQUIP Specific Aims
Assist enrolled regions to implement and sustain evidence-
based care for schizophrenia
Evaluate the effect (relative to usual care) of care model
implementation on provider competency, treatment
appropriateness, patient outcomes, and service utilization.
Using mixed methods, evaluate processes of and variations
in care model implementation and effectiveness.
“Diagnostic” of the
existing context
(baseline
assessment)
organizational
readiness for
change
expectations of
project
existing services
and structure of
care
“Actuality” of implementation
barriers to change
adjustments to
interventions
Uses results of all
other FE stages
key stakeholder
experiences
could rediagnose
the context
Stages of Formative Evaluation
Post-Implementation
Pre-Implementation
Implementation
Monitoring impacts &
indicators of progress
toward goals
dose & intensity of
intervention
field notes
documents
(minutes, etc.)
ORC & Burnout
Inventory
key stakeholder
interviews
field notes
Quality Coordinator logs
documents
key stakeholder
interviews
QI tools
field notes
key stakeholder
interviews
ORC & Burnout
Inventory
Data for Formative Evaluation
Post-Implementation
Pre-Implementation Implementation
Simpson Transfer Model
Exposure Step
Strategies/Tools
Secure commitment
Identify and prioritize local needs; values
Choose care targets; history with targets
Institutional & Personal Readiness
Climate to Change
Begin tailoring intervention
Packaging
Institutional and Personal
Readiness for Change
TCU Organizational Readiness for Change (ORC) scale; Available at http://www.ibr.tcu.edu
Adoption Step
Strategies/Tools
Regional Implementation Teams
Opinion leaders
Continue tailoring
Continue to secure commitment, address needs and
values
Implementation Step
Strategies/Tools
Routine assessment of patients (who is appropriate for
the service)
Nurse care manager
Shared cost; local site to assist in identification
Care Management software
Education
Discuss and start using provider supports & incentives
Routine Assessment of Patient
Needs and Preferences
Audio, computer
assisted
self-interviewing
Kiosk in waiting
room for patients’
use at every visit
Patient Assessment System
Routine Assessment of Patient
Needs and Preferences
Patient Assessment System
Routine Education of Patients
Routine Monitoring
for Care Managers
Education of
Clinicians
By local experts and
opinion leaders
Care Reorganization
Developed new care flow diagram that included
weighing of each patient at each visit (scale at kiosk)
immediate information on weight/BMI for this session
and last 2 sessions (kiosk report, care management
tracking)
routinized referral to in-clinic wellness program
routinized feedback on progress towards goals
(appropriate referrals, attendance)
Care Reorganization continued
Trained staff to lead evidence-based wellness program
(16 sessions)
Freed up staff time to deliver program
Provided scales, tape measures
Identified room large enough for groups
Identified other weight and excercise programs that exist
at the medical center
Practice Step
Strategies/Tools
Monthly Quality Meeting/Quality Reports
Quarterly conference calls re: targets
Continue Implementation Team Meetings
Continue tailoring from formative evaluation data and
provider and leader input
Finalize provider supports and incentives
Sustainability
Strategies/Tools
Stakeholder feedback discussions
Job descriptions
Kiosk integrated into regular care
Patient Characteristics (n=801)
Average age = 54
92% male
Duration of schizophrenia = 26 years
Average BMI = 30.1
30% have diabetes
Results: Process
Clinician competencies
variable, often low, regarding weight services
Organization
strong support
collaboration between services was difficult (nutrition,
primary care wellness programs, specialty mental
health)
Managers used data to reorganize care
trained clinical staff to provide services
set up weight groups to coincide with busy clinics
Results: Summative
Weight Service Utilization
Overweight individuals at implementation sites
were 2.3 times more likely to increase utilization
compared to individuals at control sites.
Results: Summative
Weight Service Utilization
Average number of weight appointments
Pre-study
During study
Implementation Sites
2
11
Control Sites
2
2
Results: Summative
Weight changes
Implementation group was on average 13.4 +/- 7.6
lbs lighter than the control group at the end of
the intervention (F=4.83, p=.03).
The model explained 86% of the variation in
weight at the end of the study.
Provider Comments
“The availablity of the computer has made it
easy for [patients] to monitor how they’re
doing with [their weight].”
“We weren’t doing a bad job before, but now
we are doing an enhanced job.”
There was concern about sustainability.
Another commented that giving data to
clinicians was essential.
Conclusions
Explanatory theory (STM) helped guide study and
reports
Successful research-operations partnership allowed
for implementation to match VA operational goals and
be tailored to local context
Care reorganization and implementation strategies and
tools increased availability of appropriate wellness
services and improved patient outcomes
EQUIP Team
VISN 16
Anna Teague, MD (PI: Houston)
Dean Robinson, MD (PI: Shreveport)
Deborah Mullins, PhD
Ann Feder, CSW
Kathy Henderson, MD
Avila Steele, PhD
Christy Gamez-Galka, PhD
VISN 3
Eran Chemerinski, MD (PI: Bronx)
Charlene Thomesen, MD (PI: Northport)
Claire Henderson, MD
Deborah Kayman, PhD
Helen Rasmussen, PhD
VISN 22
Christopher Reist, MD (PI: Long Beach)
Kirk McNagny, MD
Larry Albers, MD
David Franklin, PsyD, MPH
Stacey Maruska, LCSW
VISN 17
Max Shubert, MD (PI: Central Texas)
Paul Hicks, MD
Wendell Jones, MD
Staley Justice, MSW
Sherry Fairchild, PhD
Alexander S. Young, MD, MSHS (PI)
Jennifer Pope, BS
Patricia Parkerton, PhD
Youlim Choi
Amy N. Cohen, PhD (co-PI)
Alison Hamilton, PhD, MPH
Stone Shih
Paul Jung
Los Angeles MIRECC (Coordinating Site)
Acknowledgements
VA HSR&D and QUERI (RCD 00-033, CPI 99-383, MHS 03-
218)
VA Desert Pacific Mental Illness Research, Education and
Clinical Program (MIRECC)
NIMH UCLA-RAND Center for Research on Quality in
Managed Care
For further information
Amy Cohen
Amy.cohen@va.gov
MIRECC, West Los Angeles VA Healthcare Center,
11301 Wilshire Blvd. (210A), Los Angeles CA 90073
References
Young AS, Forquer SL, Tran A, Starzynski M, Shatkin J: Identifying clinical
competencies that support rehabilitation and empowerment in individuals with
severe mental illness. Journal of Behavioral Health Services & Research. 2000; 27:
321-333.
Chinman M, Young AS, Schell T, Hassell J, Mintz J: Computer-assisted self-
assessment in persons with severe mental illness. Journal of Clinical Psychiatry.
2004; 65: 1343-1351.
Chinman M, Hassell J, Magnabosco J, Nowlin-Finch N, Marusak S, Young AS: The
feasibility of computerized patient self-assessment at mental health clinics.
Administration and Policy in Mental Health. 2007; 34: 401-9.
Brown AH, Cohen AN, Chinman MJ, Kessler C, Young AS: EQUIP: Implementing
Chronic Care Principles and Applying Formative Evaluation Methods to Improve
Care for Schizophrenia. Implementation Science. 2008; 3: 9.
Young AS, Niv N, Cohen AN, Kessler C, McNagny K: The appropriateness of
routine medication treatment for schizophrenia. Schizophrenia Bulletin. 2008;
advance access.
Hamilton AB, Cohen AN, Young AS. Organizational Readiness in Specialty Mental
Health Care. Journal of General Internal Medicine. 2010; 25: 27-31.
Cohen, AN, Glynn, SM, Hamilton, AB, Young, AS. Implementation of a Family
Intervention for Individuals with Schizophrenia. Journal of General Internal
Medicine. 2010; 25: 32-37.
ResearchGate has not been able to resolve any citations for this publication.
Article
Full-text available
Families are rarely included in clinical care despite research showing that family involvement has a positive effect on individuals with schizophrenia by reducing relapse, improving work functioning, and social adjustment. The VA QUERI study, EQUIP (Enhancing QUality of care In Psychosis), implemented family services for this population. At two VA medical centers, veterans with schizophrenia and their clinicians were interviewed separately at baseline and 15 months. A family intervention was implemented, and a process evaluation of the implementation was conducted. Veterans with schizophrenia (n = 173) and their clinicians (n = 29). Consent to contact family was obtained, mailers to engage families were sent, families were prioritized as high need for family services, and staff volunteers were trained in a brief three-session family intervention. Of those enrolled, 100 provided consent for family involvement. Seventy-three of the 100 were sent a mailer to engage them in care; none became involved. Clinicians were provided assessment data on their patients and notified of 50 patients needing family services. Of those 50, 6 families were already involved, 34 were never contacted, and 10 were contacted; 7 new families became involved in care. No families were referred to the family psychoeducational program. Uptake of the family intervention failed due to barriers from all stakeholders. Families did not respond to the mailer, patients were concerned about privacy and burdening family, clinicians had misperceptions of family-patient contact, and organizations did not free up time or offer incentives to provide the service. If a full partnership with patients and families is to be achieved, these barriers will need to be addressed, and a family-friendly environment will need to be supported by clinicians and their organizations. Applicability to family involvement in other disorders is discussed.
Article
Full-text available
Implementing quality improvement efforts in clinics is challenging. Assessment of organizational "readiness" for change can set the stage for implementation by providing information regarding existing strengths and deficiencies, thereby increasing the chance of a successful improvement effort. This paper discusses organizational assessment in specialty mental health, in preparation for improving care for individuals with schizophrenia. To assess organizational readiness for change in specialty mental health in order to facilitate locally tailored implementation strategies. EQUIP-2 is a site-level controlled trial at nine VA medical centers (four intervention, five control). Providers at all sites completed an organizational readiness for change (ORC) measure, and key stakeholders at the intervention sites completed a semi-structured interview at baseline. At the four intervention sites, 16 administrators and 43 clinical staff completed the ORC, and 38 key stakeholders were interviewed. The readiness domains of training needs, communication, and change were the domains with lower mean scores (i.e., potential deficiencies) ranging from a low of 23.8 to a high of 36.2 on a scale of 10-50, while staff attributes of growth and adaptability had higher mean scores (i.e., potential strengths) ranging from a low of 35.4 to a high of 41.1. Semi-structured interviews revealed that staff perceptions and experiences of change and decision-making are affected by larger structural factors such as change mandates from VA headquarters. Motivation for change, organizational climate, staff perceptions and beliefs, and prior experience with change efforts contribute to readiness for change in specialty mental health. Sites with less readiness for change may require more flexibility in the implementation of a quality improvement intervention. We suggest that uptake of evidence-based practices can be enhanced by tailoring implementation efforts to the strengths and deficiencies of the organizations that are implementing quality improvement changes.
Article
Full-text available
Although national guidelines specify appropriate strategies for the treatment of schizophrenia, this disorder presents challenges to clinicians and health-care organizations. To improve care, it is useful to understand how often patients receive appropriate treatment. Most research evaluating treatment was performed when first-generation antipsychotic medications were the modal treatment. Given that most prescriptions are now for second-generation medications, this study describes current clinical problems and the appropriateness of treatment in routine practice. Between 2002 and 2004, a random sample of patients (n = 398) were interviewed at baseline and 1 year at 3 Department of Veterans Affairs mental health clinics. Symptoms and side effects were assessed. Analyses examined whether prescribing were consistent with guidelines in patients with significant psychosis, depression, parkinsonism, akathisia, tardive dyskinesia, or elevated weight. Few patients met criteria for depression, parkinsonism, or akathisia. A total of 44% of patients had significant psychosis, 11% had tardive dyskinesia, and 46% were overweight. Medication was appropriate in 27% of patients with psychosis, 25% of patients with tardive dyskinesia, and 2% of patients with elevated weight. Management of elevated weight improved modestly over time. Treatment was more likely to improve for patients whose psychiatrists had more than 12 patients with schizophrenia in their caseload. Compared with the 1990s, outpatients are more likely to have significant psychosis. The rate of appropriate treatment of psychosis is unchanged. Weight gain has become a prevalent side effect, yet treatment is rarely changed in response to weight. There is a need for interventions that improve management of psychosis and weight.
Article
Full-text available
Individuals with severe mental illness often do not receive appropriate treatment or rehabilitation. One approach to improving their care begins by identifying competencies that clinicians should possess. This project developed a set of core clinical competencies that pertain to community-based care and support the goals of empowerment and rehabilitation. Development of the competency set began with review of existing literature and competency statements, and focus groups and interviews with clients, family members, clinicians, managers, experts, and advocates. Representatives from each of these groups participated in a national panel and used a structured process to identify 37 final competencies. Panel members agreed that these competencies are very important in determining outcomes and often are not present in current clinicians. This project demonstrates that it is possible to develop a core competency set that can be strongly supported by diverse groups of stakeholders. These competencies may be useful in clinician training, recruitment, and credentialing efforts.
Article
Full-text available
Improving the quality of care for severe mental illness (SMI) has been difficult because patients' clinical information is not readily available. Audio computer-assisted self-interviewing (ACASI) supports data collection by asking patients waiting for appointments clinical questions visually and aurally. It has improved outcomes for many disorders. While reliable and accurate for SMI in research settings, this study assesses questions about ACASI's feasibility in usual care. Patient and provider surveys and provider focus groups after 12 months of ACASI implementation. Two outpatient mental health clinics in Los Angeles, one run by the Department of Veterans Affairs and the other by Los Angeles County Department of Mental Health. 266 patients with SMI and 14 psychiatrists. Patients completed an ACASI survey on symptoms, drug use, medication adherence and side-effects by internet using a touch-screen monitor. A 1-page report summarizing each patient's results was printed and given to providers by patients during appointments. Feedback surveys (patients and psychiatrists) and focus groups and interviews (psychiatrists) assessed usability, usefulness, effects on treatment, and barriers to sustaining ACASI. Patients believed the PAS was enjoyable, easy to learn and use, and that it improved communication with their psychiatrists. Providers believed the PAS was easy to use, had a small impact on care, could be improved by being more detailed and comprehensive, and requires outside support to continue its use. ACASI was easy to use and enhanced communication. Systems like this can be a valuable part of quality improvement projects.
Article
Full-text available
This paper presents a case study that demonstrates the evolution of a project entitled "Enhancing QUality-of-care In Psychosis" (EQUIP) that began approximately when the U.S. Department of Veterans Affairs' Quality Enhancement Research Initiative (QUERI), and implementation science were emerging. EQUIP developed methods and tools to implement chronic illness care principles in the treatment of schizophrenia, and evaluated this implementation using a small-scale controlled trial. The next iteration of the project, EQUIP-2, was further informed by implementation science and the use of QUERI tools. This paper reports the background, development, results and implications of EQUIP, and also describes ongoing work in the second phase of the project (EQUIP-2). The EQUIP intervention uses implementation strategies and tools to increase the adoption and implementation of chronic illness care principles. In EQUIP-2, these strategies and tools are conceptually grounded in a stages-of-change model, and include clinical and delivery system interventions and adoption/implementation tools. Formative evaluation occurs in conjunction with the intervention, and includes developmental, progress-focused, implementation-focused, and interpretive evaluation. Evaluation of EQUIP provided an understanding of quality gaps and how to address related problems in schizophrenia. EQUIP showed that solutions to quality problems in schizophrenia differ by treatment domain and are exacerbated by a lack of awareness of evidence-based practices. EQUIP also showed that improving care requires creating resources for physicians to help them easily implement practice changes, plus intensive education as well as product champions who help physicians use these resources. Organizational changes, such as the addition of care managers and informatics systems, were shown to help physicians with identifying problems, making referrals, and monitoring follow-up. In EQUIP-2, which is currently in progress, these initial findings were used to develop a more comprehensive approach to implementing and evaluating the chronic illness care model. In QUERI, small-scale projects contribute to the development and enhancement of hands-on, action-oriented service-directed projects that are grounded in current implementation science. This project supports the concept that QUERI tools can be useful in implementing complex care models oriented toward evidence-based improvement of clinical care.
Article
It has been difficult to improve care for severe mental illness (SMI) in usual care settings because clinical information is not reliably and efficiently managed. Methods are needed for efficiently collecting this information to evaluate and improve health care quality. Audio computer-assisted self-interviewing (ACASI) can facilitate this data collection and has improved outcomes for a number of disorders, suggesting the need to test its accuracy and reliability in people with SMI. Ninety patients with DSM-IV schizophrenia or schizoaffective disorder (N = 45) or bipolar disorder (N = 45) recruited between Oct. 15, 2002, and July 1, 2003, were randomly assigned to 1 of 2 study groups and completed 2 standardized symptom surveys (Revised Behavior and Symptom Identification Scale and the symptom severity scale of the Schizophrenia Outcomes Module 2) 20 minutes apart in a crossover study design. Half of the patients first completed the scales via an in-person interview, and the other half first completed the scales via an ACASI survey self-administered through an Internet browser using a touchscreen developed to meet the cognitive needs of people with SMI. We evaluated attitudes toward ACASI, understanding of the ACASI survey, internal consistency, correlations between the ACASI and interview modes, concurrent validity, and a possible administration mode bias. All ACASI and in-person interview scales had similar internal reliability, high correlations (r = 0.78-1.00), and mean scores similar enough as not to be different at p < .05. A large majority rated the ACASI survey as easier, more enjoyable, more preferable if monthly completion of a survey were required, and more private, and 97% to 99% perfectly answered questions about how to use it. ACASI data collection is reliable among people with bipolar disorder and schizophrenia and could be a valuable tool to improve their care.