ArticlePDF Available

Real-time pharmacy surveillance and clinical decision support to reduce adverse drug events in acute kidney injury: A randomized, controlled trial

Authors:

Abstract and Figures

Objectives: Clinical decision support (CDS), such as computerized alerts, improves prescribing in the setting of acute kidney injury (AKI), but considerable opportunity remains to improve patient safety. The authors sought to determine whether pharmacy surveillance of AKI patients could detect and prevent medication errors that are not corrected by automated interventions. Methods: The authors conducted a randomized clinical trial among 396 patients admitted to an academic, tertiary care hospital between June 1, 2010 and August 31, 2010 with an acute 0.5 mg/dl change in serum creatinine over 48 hours and a nephrotoxic or renally cleared medication order. Patients randomly assigned to the intervention group received surveillance from a clinical pharmacist using a web-based surveillance tool to monitor drug prescribing and kidney function trends. CDS alerting and standard pharmacy services were active in both study arms. Outcome measures included blinded adjudication of potential adverse drug events (pADEs), adverse drug events (ADEs) and time to provider modification or discontinuation of targeted nephrotoxic or renally cleared medications. Results: Potential ADEs or ADEs occurred for 104 (8.0%) of control and 99 (7.1%) of intervention patient-medication pairs (p=0.4). Additionally, the time to provider modification or discontinuation of targeted nephrotoxic or renally cleared medications did not differ between control and intervention patients (33.4 hrs vs. 30.3hrs, p=0.3). Conclusions: Pharmacy surveillance had no incremental benefit over previously implemented CDS alerts
Content may be subject to copyright.
Real-time pharmacy surveillance and clinical decision support to
reduce adverse drug events in acute kidney injury: a
randomized, controlled trial
Allison B. McCoy, PhD
1
, Zachary L. Cox, PharmD, BCPS
2,3
, Erin B. Neal, PharmD, BCPS
2
,
Lemuel R. Waitman, PhD
4
, Neeraja B. Peterson, MD, MSc
5
, Gautam Bhave, MD, PhD
6
,
Edward D. Siew, MD
6
, Ioana Danciu, BE
1
, Julia B. Lewis, MD
6
, and Josh F. Peterson, MD,
MPH
1,5,7
1
Department of Biomedical Informatics, Vanderbilt University School of Medicine, Nashville, TN
2
Department of Pharmacy, Vanderbilt University Medical Center, Nashville, TN
3
College of Pharmacy, Lipscomb University, Nashville, TN
4
Department of Biostatistics, University of Kansas Medical Center, Kansas City, KS
5
Division of General Internal Medicine and Public Health, Department of Medicine, Vanderbilt
University Medical Center, Nashville, TN
6
Division of Nephrology, Department of Medicine, Vanderbilt University Medical Center, Nashville,
TN
7
Geriatric Research Education Clinical Center (GRECC), VA Tennessee Valley Healthcare
System, Nashville, TN
Abstract
Objectives—Clinical decision support (CDS), such as computerized alerts, improves prescribing
in the setting of acute kidney injury (AKI), but considerable opportunity remains to improve
patient safety. The authors sought to determine whether pharmacy surveillance of AKI patients
could detect and prevent medication errors that are not corrected by automated interventions.
Methods—The authors conducted a randomized clinical trial among 396 patients admitted to an
academic, tertiary care hospital between June 1, 2010 and August 31, 2010 with an acute 0.5 mg/
dl change in serum creatinine over 48 hours and a nephrotoxic or renally cleared medication order.
Patients randomly assigned to the intervention group received surveillance from a clinical
pharmacist using a web-based surveillance tool to monitor drug prescribing and kidney function
trends. CDS alerting and standard pharmacy services were active in both study arms. Outcome
measures included blinded adjudication of potential adverse drug events (pADEs), adverse drug
events (ADEs) and time to provider modification or discontinuation of targeted nephrotoxic or
renally cleared medications.
Corresponding author’s current affiliation and address: School of Biomedical Informatics, The University of Texas Health Science
Center at Houston (UTHealth), UT Houston-Memorial Hermann Center for Healthcare Quality and Safety, 6410 Fannin St, UPB
1100, Houston, TX 77030, (713) 500-6931, allison.b.mccoy@uth.tmc.edu.
Conflicts of Interest
The authors declare that they have no conflicts of interest in the research.
Protection of Human and Animal Subjects
This study was approved by the Vanderbilt Institutional Review Board.
NIH Public Access
Author Manuscript
Appl Clin Inform
. Author manuscript; available in PMC 2012 June 18.
Published in final edited form as:
Appl Clin Inform
. 2012 January 1; 3(2): 221–238. doi:10.4338/ACI-2012-03-RA-0009.
NIH-PA Author Manuscript NIH-PA Author Manuscript NIH-PA Author Manuscript
Results—Potential ADEs or ADEs occurred for 104 (8.0%) of control and 99 (7.1%) of
intervention patient-medication pairs (p=0.4). Additionally, the time to provider modification or
discontinuation of targeted nephrotoxic or renally cleared medications did not differ between
control and intervention patients (33.4 hrs vs. 30.3 hrs, p=0.3).
Conclusions—Pharmacy surveillance had no incremental benefit over previously implemented
CDS alerts
Keywords
Decision Support Systems; Clinical; Electronic Health Records; Randomized Controlled Trial;
Medication Errors/prevention & control; Adverse Drug Reaction Reporting Systems
1. Background
Clinical decision support (CDS) within electronic medical records (EMRs) and
computerized provider order entry (CPOE) systems has a high potential for reducing
medication errors [1–4]. Despite some success, substantial numbers of residual adverse drug
events (ADEs) and potential adverse drug events (pADEs) remain, suggesting that further
improvements of patient safety will require additional types of well-integrated interventions.
Furthermore, recent evaluations of CDS point out the risks of the technology, including
provider fatigue and dissatisfaction, and unintended adverse consequences [5–9].
Clinical pharmacy services have traditionally addressed medication safety for hospitalized
patients by reviewing medication orders prior to dispensing or rounding with inpatient
teams, and the support of a clinical pharmacist has been shown to improve prescribing in
multiple settings [10–17]. Pharmacy surveillance has also been shown to detect and
potentially prevent ADEs [18–21]. However, the incremental benefit of pharmacy
surveillance when added to CDS in reducing ADEs is unknown.
We developed a real-time surveillance tool for medication errors in order to integrate CDS
with clinical pharmacy surveillance. The tool recognized high-risk prescribing in patients
with acute kidney injury (AKI) and directed a clinical pharmacist to intervene on the highest
risk patients, including those where providers were not responding to alerts from an existing
CDS system [22]. AKI affects patients and medication regimens across all hospitalized units
and prescribing is not well standardized, though CDS has been shown to benefit patients
with impaired or rapidly changing renal function [21–26]. We hypothesized that real-time
surveillance by a clinical pharmacist using the web-based tool would improve the
management of renally-dosed medications. To test this, we conducted a prospective,
randomized, controlled study, comparing the effect of enhanced clinical pharmacist
surveillance of patients in the intervention group with existing CDS and standard pharmacy
services on the occurrence, preventability, and severity of ADEs.
2. Methods
2.1. Study Design and Participants
We performed a parallel group randomized, controlled trial during June 1, 2010 through
August 31, 2010 at Vanderbilt University Hospital, a large academic, tertiary care facility
with universal utilization of CPOE and extensive integrated CDS [1,25,27–30]. The study
included all admitted adult patients who experienced a 0.5 mg/dl increase or decrease in
serum creatinine over 48 hours of hospitalization following an active, recurring order for
one or more targeted nephrotoxic or renally cleared medications (Table I); these criteria
were selected by a local expert nephrology panel to identify significant renal function
McCoy et al.
Page 2
Appl Clin Inform
. Author manuscript; available in PMC 2012 June 18.
NIH-PA Author Manuscript NIH-PA Author Manuscript NIH-PA Author Manuscript
changes which should trigger reassessment of drug therapy. It included all patients who
were eligible to receive a previously implemented CDS alert for AKI [22].
Prior to randomization, we excluded patients with end-stage renal disease who received
dialysis prior to the first serum creatinine change event or were previously identified as a
chronic dialysis patient in the inpatient order entry records. In addition, we excluded patients
cared for on services with existing specialty pharmacy support including nephrology
services and renal, liver, and bone marrow transplant services. Finally, prior to analysis, a
blinded outcomes assessment pharmacist evaluated cases for additional exclusion criteria
that could not be determined electronically at the time of randomization, including chronic
dialysis patients, transplant patients, palliative care patients, false lab measurements, and no
medication administrations. This study was approved by the Vanderbilt Institutional Review
Board.
2.2. Surveillance Tool Intervention
The surveillance tool is a dynamic web application, populated by real-time clinical databases
and CDS log files, designed to complement traditional CDS and clinical pharmacy services
by facilitating monitoring and intervention for high risk patients. The tool consists of two
primary view types: the surveillance view and the patient detail view. The surveillance view
displays patient details such as demographics, providing service, and hospital location, in
addition to most recent creatinine values and alerts about declining or improving renal
function, for all currently admitted, eligible patients, allowing pharmacists to identify
patients at high risk for harm (Figure 1). The patient detail view (Figure 2) displays a graph
of events of interest and a detailed, sortable timeline of orders, order administrations,
laboratory values, and CDS logs during the patient’s admission for an individual patient,
presented in reverse chronological order to give context for the CDS logs. This view also
allows staff to enter notes directly into the EMR and to save comments for reference to other
surveillance users.
Prior to formally evaluating the surveillance tool for AKI, we performed a four month pilot
implementation. Study personnel independently reviewed select cases, discussed the
potential for intervention based on patient and drug factors, and assessed the usefulness of
the surveillance tool. Based on the feedback, we made iterative changes to the targeted
medication list and the inclusion criteria for both the surveillance tool and AKI CDS.
During the trial, the clinical pharmacist for internal medicine (EN) served as the study
pharmacist for the intervention, reviewing the surveillance tool to evaluate patients during
each workday. For patients determined to be experiencing AKI and needing an intervention,
the study pharmacist contacted the primary provider using a text page, verbal
communication, or an EMR note to recommend changes in care. All interactions, including
patient’s classification of AKI, communication with provider, recommendations provided,
and actions taken, were recorded with a timestamp in a structured form within the
surveillance tool for later analysis.
Both control and intervention patients received standard CDS and clinical pharmacy services
for all hospitalized patients. Active CDS included guided dosing advisors and CPOE alerts
for AKI, which have been described previously [22,27]. A clinical pharmacist rounded on
some medical and surgical teams, including the majority of the ICU services, and
intermittently on non-ICU services to answer provider questions, independently review
medication regimens, and offer verbal recommendations directly to providers during order
entry. Clinical pharmacists at the study institution did not typically interact with CPOE
based CDS as part of their usual workflow; in rare circumstances, a rounding pharmacist
might encounter the AKI CDS when entering medication orders on behalf of providers. Staff
McCoy et al.
Page 3
Appl Clin Inform
. Author manuscript; available in PMC 2012 June 18.
NIH-PA Author Manuscript NIH-PA Author Manuscript NIH-PA Author Manuscript
pharmacists also reviewed medication orders prior to dispensing during the trial, but these
pharmacists did not also monitor laboratory results or changes in serum creatinine.
2.3. Randomization
Patients were automatically assigned to a study group using a pseudo-random number
function within the surveillance tool at the time that he or she first met eligibility criteria and
remained in the assigned group until discharge.
2.4. Outcomes
Our primary outcome was the rate of AKI-related ADEs and pADEs within the intervention
group compared to the concurrent control group. All study events originated from non-
intercepted medication errors with a potential for injury that were active at the onset of AKI
and continued for at least 24 hours. We report only on ADEs and pADEs associated with
renal function, either through direct nephrotoxicity or with a well-described toxicity related
to drug accumulation. For example, an active order for a recurring administration of a non-
steroidal anti-inflammatory drug during the 24 hours after the initial change in serum
creatinine was rated as a pADE, and an episode of bleeding after administration of
enoxaparin unadjusted for renal function was rated as an ADE. A subcategory of ADEs,
“lab-only” ADEs, was defined as highly elevated drug levels or electrolyte abnormalities
consistent with previous ADE literature [31]. We evaluated provider behavior as our
secondary outcome, measuring the time to provider reaction to the AKI event. We calculated
the time from the first change in serum creatinine to modification or discontinuation of
targeted medications ordered prior to the change [22] and the time from the initial order to
modification or discontinuation of targeted medications ordered after the change. We
assessed all outcomes after completion of the inpatient encounter (either by death or
discharge); pADEs or ADEs occurring after patient discharge were not included in the
analysis as outpatient follow-up was not routinely available for all patients.
Outcomes assessors were blinded to patient intervention status [32]. A study pharmacist
(ZC) reviewed all enrolled cases to identify potential study events. The pharmacist recorded
comorbidities present prior to AKI and reviewed each targeted medication order for a
potential error or subsequent injury, drawing from the pre-specified lists of drugs (Table I)
and potential AKI-related adverse events. An outcomes assessment adjudication committee
composed of a nephrologist and an internal medicine physician (GB, NP) independently
reviewed cases categorized as having at least one pADE or ADE, using methods previously
applied to rate preventability and severity [33–35]. An additional nephrologist (ES)
reviewed cases when disagreement occurred. Any residual disagreements within the
committee were resolved by joint discussion.
We also measured outcomes describing the use of the surveillance tool. These included
number of patients appearing on the tool, number of data items (e.g. drugs, labs, and CDS
interactions of interest) for patients, time of day the tool was viewed, duration of views,
number of patients with comments or EMR notes submitted, and the number of patients for
which pharmacists intervened. We also evaluated comments and EMR notes recorded
through the tool.
2.5. Sample Size
We estimated the sample size based on the rate of non-adjudicated medication errors
measured from a retrospective database of medication orders and laboratory values, which
had a median of 52.5 patient-medication pair events each week and a 45.4% baseline
response rate. The planned 13 week trial produced 94% power to detect a 30% reduction in
McCoy et al.
Page 4
Appl Clin Inform
. Author manuscript; available in PMC 2012 June 18.
NIH-PA Author Manuscript NIH-PA Author Manuscript NIH-PA Author Manuscript
non-adjudicated errors, which we determined to be feasible after a previous analysis of the
existing CDS found a significant opportunity for improvement [9].
2.6. Statistical Methods
We used the Pearson chi-square test for categorical variables and the t-test for continuous
variables to perform univariate comparisons between the control and intervention groups. To
evaluate provider behavior, we applied survival analysis methods for time to provider
response, defined as a modification or discontinuation of a targeted drug order by any
provider. For this analysis, we defined patient discharge or death as a censoring event. For
medications ordered prior to the triggering event, follow-up started at the time of the
triggering serum creatinine change, and for medications ordered after the triggering event,
follow-up started at the time the medication was ordered. We used the log-rank test to
measure the difference between control and intervention groups and provide Kaplan-Meier
plots for visualization of the time to event data. Analyses were conducted with Stata 9.2.
3. Results
3.1. Study Population
Figure 3 is a diagram of the selection steps for allocating patients to control or intervention
and application of inclusion and exclusion criteria. During the three month trial period,
1,488 of 11,128 admitted adults experienced a triggering change of serum creatinine over 48
hours. We enrolled 540 cases; 278 were randomized to the control group, and 262 were
randomized to the intervention group. The blinded outcomes assessment pharmacist
identified 82 control and 62 intervention cases that met additional exclusion criteria that
could not be determined electronically at the time of randomization; we included 396 cases
in the final outcomes assessment. We compared demographic characteristics, including age,
sex, race, admitting service, and admission to an intensive care unit, and comorbidities,
which the initial outcomes assessment study pharmacist classified, between the control and
intervention groups to ensure that the study groups were similar (Table II). We found no
statistical difference between groups for any variable evaluated.
3.2. Evaluation of Adverse Drug Events
We evaluated 196 control cases with 1303 medication orders and 200 intervention cases
with 1396 medication orders. Agreement between the two outcomes adjudication physicians
was 93.97% for pADEs (kappa=0.88) and 96.55% for ADEs (kappa=0.93). Table III depicts
the detailed breakdown of pADEs and ADEs after adjudication and consensus. The
adjudication committee determined 76 (38.8%) control and 67 (33.5%) intervention cases
experienced a pADE or ADE (RR=0.86 [0.66, 1.12], p=0.3) and 104 (7.98%) control and 99
(7.09%) intervention medication orders had an associated pADE or ADE (RR=0.88 [0.68,
1.16], p=0.4). Among cases who experienced at least one pADE or ADE in the control
group, 55 (72.4%) experienced one, 15 (19.7%) experienced two, 5 (6.6%) experienced
three, and 1 (1.32%) experienced four events; in the intervention group, 41 (61.2%)
experienced one, 20 (29.9%) experienced two, and 6 (9.0%) experienced three events.
The total events included 52 (26.5%) control and 46 (23.0%) intervention cases
experiencing a pADE (RR=0.87 [0.61, 1.22], p=0.4), and 68 (5.22%) control and 63 (4.51%)
intervention medication orders having an associated pADE (RR=0.86 [0.62, 1.21], p=0.4).
Frequent responses for pADEs categorized as “other” included “dose and interval change
inappropriate for trough level” and “interacted with another prescribed medication”.
Lab-only ADEs occurred for 13 (6.6%) control and 16 (8.0%) intervention cases (RR=1.21
[0.60, 2.44], p=0.6); 14 (1.07%) control and 16 (1.15%) intervention medication orders had
McCoy et al.
Page 5
Appl Clin Inform
. Author manuscript; available in PMC 2012 June 18.
NIH-PA Author Manuscript NIH-PA Author Manuscript NIH-PA Author Manuscript
an associated lab-only ADE (RR=1.07 [0.52, 2.18], p=0.9). Actual ADEs occurred for 22
(11.2%) control and 19 (9.5%) intervention cases (RR=0.85 [0.47, 1.51], p=0.6); 22 (1.69%)
control and 20 (1.43%) intervention medication orders had an associated actual ADE
(RR=0.85 [0.47, 1.55], p=0.6). Severity and preventability of pADEs and ADEs was not
significant between control and intervention groups (Table IV).
Among drugs or drug groups with at least ten orders in the control and intervention groups,
errors most commonly occurred for vancomycin, beta lactam antibiotics, angiotensin-
converting enzyme (ACE) inhibitors, nonsteroidal anti-inflammatory drugs (NSAIDs),
quinolones, and angiotensin II receptor blockers (ARBs) comprising 22.2%, 15.3%, 12.3%,
9.4%, 8.9%, and 5.4% of orders resulting in a pADE or ADE respectively.
3.3. Evaluation of Provider Responses
For medications active at the time of patient’s triggering serum creatinine change or ordered
after the event, we compared the time to provider response, defined as drug modification or
discontinuation, using the log-rank test. While the time to response was shorter in the
intervention group compared to the control group for medications, overall response times
were highly variable, and we did not find any statistically significant differences between
the control and intervention groups. Table V shows the resulting median times to response,
hazard ratios, and p-values. Kaplan-Meier curves for these results are shown in Figure 4.
3.4. Study Pharmacist Interactions with the Surveillance Tool
During the 3-month study period, 273 intervention patients appeared on the surveillance
tool. The study pharmacist viewed the surveillance tool on 67 days (56 weekdays). Of the
displayed intervention patients, 234 (85.7%) were reviewed by the study pharmacist, with an
average of 10.75 patients reviewed each day the surveillance tool was monitored.
Monitoring occurred between 08:00 and 16:00, although the study pharmacist primarily
checked the surveillance tool in the afternoon, after providing teams had completed rounds,
updated medication orders, and entered EMR notes, and laboratory results had returned.
During a week of direct observation, the pharmacist spent 71 minutes monitoring the
surveillance tool on Monday, and a mean of 16.75 minutes on the remaining days (25 on
Tuesday, 9 on Wednesday, 15 on Thursday, and 18 on Friday).
The study pharmacist recommended an intervention for 43 (18.4%) cases, including 70
medication-specific recommendations and 8 patient-specific recommendations. Most cases
without an intervention did not require a dose change; frequencies of recommended patient
and medication interventions are described in Table VI. Medication recommendations
categorized as “other” (9 medications) included correcting the patient’s weight, holding the
medication, and monitoring for sedation. Patient recommendations categorized as “other” (2
cases) included redrawing serum creatinine, monitoring for sedation and treatment failure,
discontinuing oral potassium, and adding height and weight.
The study pharmacist most frequently indicated use of text pages and verbal communication
to contact the providing team; recorded contact included 26 text pages, 28 verbal
communications, and 1 EMR note. EMR notes were used when the providing team was
unavailable (e.g. providing team does not have an attending on campus, or provider did not
respond to text page). Providers agreed to make the recommended changes for 24
interventions (77% of recorded responses), the study pharmacist made changes to the orders
directly in the CPOE system for 5 interventions (16%), and the provider disagreed with
recommendation for 2 interventions (6%). The study pharmacist submitted 157 surveillance
tool comments for 102 cases. The comments frequently summarized patient comorbidities,
McCoy et al.
Page 6
Appl Clin Inform
. Author manuscript; available in PMC 2012 June 18.
NIH-PA Author Manuscript NIH-PA Author Manuscript NIH-PA Author Manuscript
laboratory values and trends, and indications; served as reminders for continued monitoring;
and elaborated recommendations.
4. Discussion
We performed a prospective, randomized comparative effectiveness trial to determine
whether pharmacy surveillance improved medication safety during AKI when compared to
clinical decision support alone. Despite appropriate interventions made by the study
pharmacist, we found no significant improvements in the primary outcome, potential and
actual ADEs, or the process outcome of timely medication adjustments. Overall, the number
of interventions within the CDS far exceeded the interventions by the pharmacist, reflecting
the ability for CDS to be active at all times and intervene more frequently and promptly. The
findings suggest that, when implemented in a setting with comprehensive CDS, more
intensive surveillance by a clinical pharmacist may be necessary to further improve the
safety of prescribing during AKI.
The interventions of a clinical pharmacist have been found to be valuable in a variety of
settings with manual medication dosing, significantly reducing rates of medication errors
and ADEs [10–16]. However, one prior study has suggested no incremental benefit in ADE
prevention with a rounding pharmacist when compared to order entry with CDS [36].
Similar to these findings, existing CDS during our intervention, including initial dosing of
nephrotoxic and renally cleared drugs, CDS for monitoring of these medications within
CPOE, and surveillance by other pharmacists in the event of changing laboratory values,
resulted in a large percentage of already prevented errors. While some studies have found
that surveillance successfully identifies pADEs and ADEs, they have not evaluated the
effect of systems on actual error prevention [18–20,37–41]. Some investigators have
evaluated the use of retrospective CDS surveillance and real-time aggregate CDS
surveillance [42,43], but no prior study has evaluated the effect of surveillance of CDS in
real time on patient or process outcomes. The restriction of our intervention and analysis to
ADEs only related to AKI also makes it difficult to compare our results to these studies,
which measured all types of ADEs. However, pharmacy use of the surveillance tool for
monitoring AKI patients and CDS was similar to use described for a similar tool for
aminoglycosides and anticoagulants [44]. Our study also differs from prior research in that
we evaluated the surveillance tool in a setting with extensive existing CDS and clinical
pharmacy support.
Other real-time surveillance approaches may be more successful. An alternate workflow,
such as use of a distributed surveillance tool by front-line pharmacists approving and
dispensing medication orders or by pharmacists or other providers participating in rounds
might allow earlier, more frequent prevention of medication errors and reduction of ADEs.
Because errors still occurred for patients that received an intervention, the timing of the
surveillance and the ability of a single clinical pharmacist to monitor all at-risk patients may
not have been appropriate. Greater integration of CDS and pharmacist interactions, with
communication features, such that physicians and pharmacists could act as a coordinated
team might further impact the results. Finally, implementation of surveillance may have a
larger impact in institutions without such extensive CDS and clinical pharmacy services.
Several limitations are present. We conducted the trial in an academic, tertiary care medical
center with extensive experience in CDS and clinical pharmacy services, which may have
reduced the opportunity for surveillance to be effective. Application of the technology in a
community hospital setting may yield a different result, particularly given the high number
of medication errors related to renal function that have been previously reported in
community settings [45]. Reproducing the surveillance tool requires integration of several
McCoy et al.
Page 7
Appl Clin Inform
. Author manuscript; available in PMC 2012 June 18.
NIH-PA Author Manuscript NIH-PA Author Manuscript NIH-PA Author Manuscript
advanced clinical systems, which many facilities have not implemented. However, most of
the functionality can be recreated with access to common electronic sources of data,
including patient census, laboratory, and order-entry [20]. The application of the technology
to other domains outside of medication management during AKI should also be investigated.
One methodological contribution to a negative result includes the possibility of crossover
between study arms, since contacted physicians may care for patients randomized to both
the intervention and control groups. While overlap of clinical pharmacy coverage occurred,
only 3 control (1.5%) and 6 (3.0%) intervention cases were potentially exposed to the
intervention pharmacist in the course of completing routine clinical duties. The study was
also underpowered to detect smaller differences in ADE rates. A larger study with a higher
intensity of surveillance is more likely to demonstrate a significant difference in patient
outcomes. Finally, the inability of the system to electronically identify all patients meeting
the exclusion criteria is a limitation of the CDS and affects the generalizability of the results.
Because the exclusions were designed to eliminate patients at low risk of AKI-related
ADEs, including these in the analysis would likely lower the event rates in both groups.
5. Conclusion
In conclusion, we evaluated through a randomized trial the comparative effectiveness of
real-time clinical pharmacist surveillance and existing CDS for patients with AKI. Despite
interventions made by the study pharmacist and a trend toward improved outcomes during
surveillance, we found no statistically significant improvements in occurrence of potential
ADEs or ADEs or in provider responses between control and intervention groups. The study
emphasizes that, while CDS is effective at preventing pADEs and ADEs in patients with
AKI, further research is necessary to determine whether surveillance can improve CDS
performance.
Acknowledgments
The authors were funded in part by National Library of Medicine grants T15 LM007450 and R01 LM009965.
Some data collection was supported by NCRR/NIH grant UL1 RR024975. The authors thank Aihua Bian for her
statistical review of the manuscript.
References
1. Miller RA, Waitman LR, Chen S, Rosenbloom ST. The anatomy of decision support during
inpatient care provider order entry (CPOE): empirical observations from a decade of CPOE
experience at Vanderbilt. J Biomed Inform. 2005 Dec; 38(6):469–85. [PubMed: 16290243]
2. Galanter WL, Polikaitis A, DiDomenico RJ. A trial of automated safety alerts for inpatient digoxin
use with computerized physician order entry. J Am Med Inform Assoc. 2004 Aug; 11(4):270–7.
[PubMed: 15064288]
3. Bates DW, Teich JM, Lee J, Seger D, Kuperman GJ, Ma’Luf N, et al. The impact of computerized
physician order entry on medication error prevention. J Am Med Inform Assoc. 1999 Aug; 6(4):
313–21. [PubMed: 10428004]
4. Bates DW, O’Neil AC, Boyle D, Teich J, Chertow GM, Komaroff AL, et al. Potential identifiability
and preventability of adverse events using information systems. J Am Med Inform Assoc. 1994;
1(5):404–11. [PubMed: 7850564]
5. van der Sijs H, Aarts J, Vulto A, Berg M. Overriding of Drug Safety Alerts in Computerized
Physician Order Entry. J Am Med Inform Assoc. 2006 Mar 1; 13(2):138–47. [PubMed: 16357358]
6. Koppel R, Metlay JP, Cohen A, Abaluck B, Localio AR, Kimmel SE, et al. Role of computerized
physician order entry systems in facilitating medication errors. JAMA. 2005 Mar 9; 293(10):1197–
203. [PubMed: 15755942]
McCoy et al.
Page 8
Appl Clin Inform
. Author manuscript; available in PMC 2012 June 18.
NIH-PA Author Manuscript NIH-PA Author Manuscript NIH-PA Author Manuscript
7. Ash JS, Sittig DF, Dykstra R, Campbell E, Guappone K. The unintended consequences of
computerized provider order entry: findings from a mixed methods exploration. Int J Med Inform.
2009 Apr; 78( Suppl 1):S69–76. [PubMed: 18786852]
8. Sittig DF, Singh H. Defining health information technology-related errors: new developments since
to err is human. Arch Intern Med. 2011 Jul 25; 171(14):1281–4. [PubMed: 21788544]
9. McCoy AB, Waitman LR, Lewis JB, Wright JA, Choma DP, Miller RA, et al. A framework for
evaluating the appropriateness of clinical decision support alerts and responses. J Am Med Inform
Assoc. 2012 May 1; 19(3):346–52. [PubMed: 21849334]
10. Kucukarslan SN, Peters M, Mlynarek M, Nafziger DA. Pharmacists on rounding teams reduce
preventable adverse drug events in hospital general medicine units. Arch Intern Med. 2003 Sep 22;
163(17):2014–8. [PubMed: 14504113]
11. Leape LL, Cullen DJ, Clapp MD, Burdick E, Demonaco HJ, Erickson JI, et al. Pharmacist
participation on physician rounds and adverse drug events in the intensive care unit. JAMA. 1999
Jul 21; 282(3):267–70. [PubMed: 10422996]
12. Kaushal R, Bates DW, Abramson EL, Soukup JR, Goldmann DA. Unit-based clinical pharmacists’
prevention of serious medication errors in pediatric inpatients. Am J Health Syst Pharm. 2008 Jul
1; 65(13):1254–60. [PubMed: 18574016]
13. Schnipper JL, Kirwin JL, Cotugno MC, Wahlstrom SA, Brown BA, Tarvin E, et al. Role of
pharmacist counseling in preventing adverse drug events after hospitalization. Arch Intern Med.
2006 Mar 13; 166(5):565–71. [PubMed: 16534045]
14. Fertleman M, Barnett N, Patel T. Improving medication management for patients: the effect of a
pharmacist on post-admission ward rounds. Qual Saf Health Care. 2005 Jun; 14(3):207–11.
[PubMed: 15933319]
15. Falconnier AD, Haefeli WE, Schoenenberger RA, Surber C, Martin-Facklam M. Drug dosage in
patients with renal failure optimized by immediate concurrent feedback. J Gen Intern Med. 2001
Jun; 16(6):369–75. [PubMed: 11422633]
16. Brown G. Assessing the clinical impact of pharmacists’ interventions. Am J Hosp Pharm. 1991
Dec; 48(12):2644–7. [PubMed: 1814210]
17. Bladh L, Ottosson E, Karlsson J, Klintberg L, Wallerstedt SM. Effects of a clinical pharmacist
service on health-related quality of life and prescribing of drugs: a randomised controlled trial.
BMJ Qual Saf. 2011 Sep; 20(9):738–46.
18. Kilbridge PM, Alexander L, Ahmad A. Implementation of a system for computerized adverse drug
event surveillance and intervention at an academic medical center. J Clin Outcomes Manage.
2006; 13(2):94–100.
19. Classen DC, Pestotnik SL, Evans RS, Burke JP. Computerized surveillance of adverse drug events
in hospital patients. JAMA. 1991 Nov 27; 266(20):2847–51. [PubMed: 1942452]
20. Jha AK, Laguette J, Seger A, Bates DW. Can surveillance systems identify and avert adverse drug
events? A prospective evaluation of a commercial application. J Am Med Inform Assoc. 2008 Oct;
15(5):647–53. [PubMed: 18579834]
21. Evans RS, Pestotnik SL, Classen DC, Burke JP. Evaluation of a computer-assisted antibiotic-dose
monitor. Ann Pharmacother. 1999 Oct; 33(10):1026–31. [PubMed: 10534212]
22. McCoy AB, Waitman LR, Gadd CS, Danciu I, Smith JP, Lewis JB, et al. A computerized provider
order entry intervention for medication safety during acute kidney injury: a quality improvement
report. Am J Kidney Dis. 2010 Nov; 56(5):832–41. [PubMed: 20709437]
23. Chertow GM, Lee J, Kuperman GJ, Burdick E, Horsky J, Seger DL, et al. Guided Medication
Dosing for Inpatients With Renal Insufficiency. JAMA. 2001 Dec 12; 286(22):2839–44. [PubMed:
11735759]
24. Sellier E, Colombet I, Sabatier B, Breton G, Nies J, Zapletal E, et al. Effect of alerts for drug
dosage adjustment in inpatients with renal insufficiency. J Am Med Inform Assoc. 2009 Apr;
16(2):203–10. [PubMed: 19074305]
25. Rind DM, Safran C, Phillips RS, Wang Q, Calkins DR, Delbanco TL, et al. Effect of computer-
based alerts on the treatment and outcomes of hospitalized patients. Arch Intern Med. 1994 Jul 11;
154(13):1511–7. [PubMed: 8018007]
McCoy et al.
Page 9
Appl Clin Inform
. Author manuscript; available in PMC 2012 June 18.
NIH-PA Author Manuscript NIH-PA Author Manuscript NIH-PA Author Manuscript
26. Field TS, Rochon P, Lee M, Gavendo L, Baril JL, Gurwitz JH. Computerized clinical decision
support during medication ordering for long-term care residents with renal insufficiency. J Am
Med Inform Assoc. 2009 Aug; 16(4):480–5. [PubMed: 19390107]
27. Cox ZL, Nelsen CL, Waitman LR, McCoy JA, Peterson JF. Effects of clinical decision support on
initial dosing and monitoring of tobramycin and amikacin. Am J Health Syst Pharm. 2011 Apr 1;
68(7):624–32. [PubMed: 21411805]
28. Geissbühler A, Miller RA. A new approach to the implementation of direct care-provider order
entry. Proc AMIA Annu Fall Symp. 1996:689–93. [PubMed: 8947753]
29. Giuse DA. Supporting communication in an integrated patient record system. AMIA Annu Symp
Proc. 2003:1065. [PubMed: 14728568]
30. Phillips I, Nelsen C, Peterson J, Sullivan T, Waitman L. Improving aminoglycoside dosing through
computerized clinical decision support and pharmacy therapeutic monitoring systems. AMIA
Annu Symp Proc. 2008:1093. [PubMed: 18999099]
31. Gurwitz JH, Field TS, Harrold LR, Rothschild J, Debellis K, Seger AC, et al. Incidence and
preventability of adverse drug events among older persons in the ambulatory setting. JAMA. 2003
Mar 5; 289(9):1107–16. [PubMed: 12622580]
32. McCoy, A.; Peterson, JF. The Greasemonkey Firefox Add-On for Altering Display of Data in a
Web-Based Electronic Medical Record. AMIA Annu Symp Proc; 2011. p. 1884
33. Bates DW, Leape LL, Petrycki S. Incidence and preventability of adverse drug events in
hospitalized adults. J Gen Intern Med. 1993 Jun; 8(6):289–94. [PubMed: 8320571]
34. Pippins JR, Gandhi TK, Hamann C, Ndumele CD, Labonville SA, Diedrichsen EK, et al.
Classifying and predicting errors of inpatient medication reconciliation. J Gen Intern Med. 2008
Sep; 23(9):1414–22. [PubMed: 18563493]
35. Leape LL, Bates DW, Cullen DJ, Cooper J, Demonaco HJ, Gallivan T, et al. Systems Analysis of
Adverse Drug Events. JAMA. 1995 Jul 5; 274(1):35–43. [PubMed: 7791256]
36. Bates DW, Leape LL, Cullen DJ, Laird N, Petersen LA, Teich JM, et al. Effect of computerized
physician order entry and a team intervention on prevention of serious medication errors. JAMA.
1998 Oct 21; 280(15):1311–6. [PubMed: 9794308]
37. Jha AK, Kuperman GJ, Teich JM, Leape L, Shea B, Rittenberg E, et al. Identifying adverse drug
events: development of a computer-based monitor and comparison with chart review and
stimulated voluntary report. J Am Med Inform Assoc. 1998 Jun; 5(3):305–14. [PubMed: 9609500]
38. Kane-Gill SL, Visweswaran S, Saul MI, Wong A-KI, Penrod LE, Handler SM. Computerized
detection of adverse drug reactions in the medical intensive care unit. Int J Med Inform. 2011 Aug;
80(8):570–8. [PubMed: 21621453]
39. Kilbridge PM, Noirot LA, Reichley RM, Berchelmann KM, Schneider C, Heard KM, et al.
Computerized surveillance for adverse drug events in a pediatric hospital. J Am Med Inform
Assoc. 2009 Oct; 16(5):607–12. [PubMed: 19567791]
40. Tinoco A, Evans RS, Staes CJ, Lloyd JF, Rothschild JM, Haug PJ. Comparison of computerized
surveillance and manual chart review for adverse events. J Am Med Inform Assoc. 2011 Aug;
18(4):491–7. [PubMed: 21672911]
41. Forster AJ, Worthington JR, Hawken S, Bourke M, Rubens F, Shojania K, et al. Using prospective
clinical surveillance to identify adverse events in hospital. BMJ Qual Saf. 2011 Sep; 20(9):756–63.
42. Reynolds, G.; Boyer, D.; Mackey, K.; Povondra, L.; Cummings, A. Alerting Strategies in
Computerized Physician Order Entry: A Novel Use of a Dashboard-style Analytics Tool in a
Childrens Hospital. AMIA Annu Symp Proc; 2008. p. 1108
43. Zimmerman, CR.; Jackson, A.; Chaffee, B.; O’Reilly, M. A dashboard model for monitoring alert
effectiveness and bandwidth. AMIA Annu Symp Proc; 2007. p. 1176
44. Waitman LR, Phillips IE, McCoy AB, Danciu I, Halpenny RM, Nelsen CL, et al. Adopting real-
time surveillance dashboards as a component of an enterprisewide medication safety strategy. Jt
Comm J Qual Patient Saf. 2011 Jul; 37(7):326–32. [PubMed: 21819031]
45. Hug BL, Witkowski DJ, Sox CM, Keohane CA, Seger DL, Yoon C, et al. Adverse drug event rates
in six community hospitals and the potential impact of computerized physician order entry for
prevention. J Gen Intern Med. 2010 Jan; 25(1):31–8. [PubMed: 19894081]
McCoy et al.
Page 10
Appl Clin Inform
. Author manuscript; available in PMC 2012 June 18.
NIH-PA Author Manuscript NIH-PA Author Manuscript NIH-PA Author Manuscript
Clinical Relevance Statement
Although a variety of informatics approaches to reducing adverse drug events exist, each
can be costly to implement and maintain, and institutions or practitioners must often
decide which is more advantageous. We sought to determine whether pharmacy
surveillance was effective when compared to traditional clinical decision support alerts.
McCoy et al. Page 11
Appl Clin Inform
. Author manuscript; available in PMC 2012 June 18.
NIH-PA Author Manuscript NIH-PA Author Manuscript NIH-PA Author Manuscript
Figure 1.
McCoy et al. Page 12
Appl Clin Inform
. Author manuscript; available in PMC 2012 June 18.
NIH-PA Author Manuscript NIH-PA Author Manuscript NIH-PA Author Manuscript
Figure 2.
McCoy et al. Page 13
Appl Clin Inform
. Author manuscript; available in PMC 2012 June 18.
NIH-PA Author Manuscript NIH-PA Author Manuscript NIH-PA Author Manuscript
Figure 3.
McCoy et al. Page 14
Appl Clin Inform
. Author manuscript; available in PMC 2012 June 18.
NIH-PA Author Manuscript NIH-PA Author Manuscript NIH-PA Author Manuscript
Figure 4.
McCoy et al. Page 15
Appl Clin Inform
. Author manuscript; available in PMC 2012 June 18.
NIH-PA Author Manuscript NIH-PA Author Manuscript NIH-PA Author Manuscript
NIH-PA Author Manuscript NIH-PA Author Manuscript NIH-PA Author Manuscript
McCoy et al. Page 16
Table I
Targeted nephrotoxic or renally cleared medications for surveillance
Medications to Avoid Medications to Adjust Medications to Review
ACARBOSE
*
ACYCLOVIR (>400mg Q12H)
ADEFOVIR
*
ACETAZOLAMIDE
*
ALLOPURINOL (>100mg Q24H)
ALENDRONATE
+
ACETOHEXAMIDE
*
AMANTADINE
AMOXICILLIN
+
AMIKACIN AZTREONAM AMOXICILLIN-CLAVULANATE
AMPHOTERICIN B
*
BACTRIM (>1 DS tablet BID) AMPICILLIN
BENAZEPRIL
*
CARBOPLATIN
*
AZITHROMYCIN+
CANDESARTAN
*
CISPLATIN
*
BRETYLIUM
CAPREOMYCIN
*
COLCHICINE (>0.6mg Q24H)
BUMETANIDE
+
CAPTOPRIL
*
CYCLOSERINE
CEFACLOR
+
CELECOXIB
*
DAPTOMYCIN CEFAZOLIN
CHLORPROPAMIDE
*
DIDANOSINE CEFEPIME
CIDOFOVIR
*
DIGITOXIN CEFOTAXIME
CYCLOPHOSPHAMIDE
*
DIGOXIN CEFOTETAN
CYCLOSPORINE
DOFETILIDE CEFOXITIN
CYTARABINE
*
DORIPENEM CEFTAZIDIME
DICLOFENAC SODIUM
*
EPTIFIBATIDE CEFUROXIME
DIFLUNISAL
*
ERTAPENEM
CEFUROXIME
+
ENALAPRIL
*
ETOPOSIDE
*
CEPHALEXIN
+
ENALAPRILAT
*
FAMCICLOVIR CHLOROQUINE
ENOXAPARIN
*
(>30mg Q24H)
FLUCYTOSINE CIPROFLOXACIN
ETODOLAC
*
FOSCARNET
CLARITHROMYCIN
+
EXENATIDE
*
GANCICLOVIR CLOFIBRATE
FENOPROFEN
*
GANCICLOVIR
Contrast Dye
+
FLURBIPROFEN
*
IMIPENEM-CILASTATIN DISOPYRAMIDE
FONDAPARINUX ITRACONAZOLE DOXACURIUM INJ
FOSINOPRIL
*
LACOSAMIDE
*
ETHACRYNATE
+
GALLAMINE
*
MEROPENEM ETHAMBUTOL
GENTAMICIN INJ
METOCLOPRAMIDE
*
FLECAINIDE
GLYBURIDE
*
MITOMYCIN
*
FLUCONAZOLE (>100mg Q24H)
IBUPROFEN
*
PENICILLIN-VK
FUROSEMIDE
+
IFOSFAMIDE
*
PENTOSTATIN
*
GEMFIBROZIL
+
IMMUNE GLOBULIN
*
PRAMIPEXOLE
*
HYDROMORPHONE
+
INDOMETHACIN
*
PREGABALIN
*
HYDROXYUREA
*
IRBESARTAN
*
PROCAINAMIDE
IBANDRONATE
+
Appl Clin Inform
. Author manuscript; available in PMC 2012 June 18.
NIH-PA Author Manuscript NIH-PA Author Manuscript NIH-PA Author Manuscript
McCoy et al. Page 17
Medications to Avoid Medications to Adjust Medications to Review
KETOPROFEN
*
PYRIDOSTIGMINE
IDARUBICIN
*
KETOROLAC
*
SOTALOL
*
INDINAVIR
LISINOPRIL
*
STAVUDINE LAMIVUDINE
LITHIUM
TOPOTECAN
*
LEVOFLOXACIN
LOSARTAN
*
VALACYCLOVIR
MELPHALAN
*
MELOXICAM
*
VALGANCICLOVIR (>450mg Q24H) METOCURINE
MEPERIDINE
*
VANCOMYCIN MIVACURIUM
MORPHINE
*
VORICONAZOLE
MORPHINE
*
NEOSTIGMINE
*
NEOSTIGMINE
*
NORFLOXACIN NORFLOXACIN
OFLOXACIN OFLOXACIN
PAMIDRONATE
+
PAMIDRONATE
+
PENICILLIN-G PENICILLIN-G
PIPERACILLIN PIPERACILLIN
PYRAZINAMIDE PYRAZINAMIDE
QUINIDINE QUINIDINE
RIFAMPIN
+
RIFAMPIN
+
RISEDRONATE
+
RISEDRONATE
+
TEMOZOLOMIDE
*
TEMOZOLOMIDE
*
TENOFOVIR
*
TENOFOVIR
*
TICARCILLIN TICARCILLIN
TOCAINIDE TOCAINIDE
TORSEMIDE
+
TORSEMIDE
+
ZIDOVUDINE ZIDOVUDINE
ZOLEDRONIC ACID
+
ZOLEDRONIC ACID
+
*
Medication only targeted for increasing serum creatinine intervention.
+
Medication was not targeted for intervention, displayed only on surveillance tool for context.
§
Medication was not targeted for patients admitted to a renal or transplant services.
Appl Clin Inform
. Author manuscript; available in PMC 2012 June 18.
NIH-PA Author Manuscript NIH-PA Author Manuscript NIH-PA Author Manuscript
McCoy et al. Page 18
Table II
Study population demographics for analyzed acute kidney injury surveillance cases
Control Cases n = 196 Intervention Cases n = 200 P
Age (y) 58.3 (15.7) 60.7 (16.8) 0.2
Sex (%)
Women 39.2 47.0 0.1
Men 60.7 53.0 0.1
Race (%)
White 83.2 79.0 0.3
Black 10.2 17.0 0.05
Hispanic 1.5 0.5 0.3
Other 2.0 1.0 0.4
Unknown 3.1 3.0 0.9
Admitting Service (%)
Cardiology 20.9 15.0 0.1
Critical Care 11.2 17.5 0.08
Geriatrics 2.6 2.5 0.9
Hematology/oncology 8.2 7.5 0.8
Hepatology 2.6 1.5 0.4
Infectious disease 1.5 3.0 0.3
Medicine 12.8 12.5 0.9
Orthopedics 5.1 6.0 0.7
Other 2.0 4.5 0.2
Surgery 26.0 22.5 0.4
Trauma 7.1 7.5 0.9
Intensive Care Unit (%) 54.6 58.5 0.4
Comorbidities (%)
Cancer 28.6 22.5 0.2
Cerebrovascular disease 11.7 14.5 0.4
Congestive heart failure 24.5 26.0 0.7
Coronary artery disease 32.7 34.0 0.8
Diabetes 35.7 41.5 0.2
End-stage liver disease 4.6 4.0 0.8
Hypertension 62.2 67.0 0.3
Mechanical ventilation 29.6 25.5 0.3
Peripheral vascular disease 3.6 7.5 0.09
Values shown as mean ± standard deviation or percentage.
Appl Clin Inform
. Author manuscript; available in PMC 2012 June 18.
NIH-PA Author Manuscript NIH-PA Author Manuscript NIH-PA Author Manuscript
McCoy et al. Page 19
Table III
Evaluation of potential adverse drug events and adverse drug events
Control n=1303 Intervention n=1396 P
Potential adverse drug events 68 (5.22%) 63 (4.51%) 0.4
Contraindicated use for > 24 hours 24 14 0.1
No dose adjustment for > 24 hours 10 15 0.2
No interval adjustment for > 24 hours 31 30 0.7
Ineffective at low creatinine clearance 1 3 0.4
No drug level monitoring 5 4 0.9
No creatinine monitoring 0 3 0.09
Other 7 2 0.07
Lab-only adverse drug events 14 (1.07%) 16 (1.15%) 0.9
Hyperkalemia 1 1 0.9
Hypokalemia 0 0 -
Hypernatremia 0 0 -
Hyponatremia 0 0 -
Toxic drug levels 9 9 0.9
Subtherapeutic drug levels 5 6 0.9
Hypoglycemia (asymptomatic) 0 0 -
Adverse drug events 22 (1.69%) 20 (1.43%) 0.6
Bradyarrhythmia 0 0 -
Hypotension 7 6 0.7
QT Prolongation 0 2 0.2
Cognitive changes/somnolence 1 4 0.2
Delirium 1 0 0.3
Extrapyramidal symptoms/movement disorders 0 1 0.3
Oversedation 3 2 0.6
Seizure 0 0 --
Rash 0 1 0.3
Hypoglycemia (symptomatic) 0 0 --
Pancreatitis 0 0 --
Diarrhea 0 0 --
Anemia 0 0 --
Lactic acidosis 0 0 --
Major bleed 0 1 0.3
Minor bleed 3 2 0.6
Neutropenia 0 0 --
Thrombocytopenia 0 0 --
Neuromuscular control 0 0 --
Vision changes 0 0 --
Hearing loss 0 0 --
Appl Clin Inform
. Author manuscript; available in PMC 2012 June 18.
NIH-PA Author Manuscript NIH-PA Author Manuscript NIH-PA Author Manuscript
McCoy et al. Page 20
Control n=1303 Intervention n=1396 P
Tinnitus 0 0 --
Acute kidney injury (AKIN Stage 2 or 3) 5 4 0.7
Crystalurea 0 1 0.3
Renal replacement therapy 0 0 --
Volume overload 0 0 --
Respiratory depression 1 1 0.9
Death 0 1 0.3
Abbreviations: AKIN = Acute Kidney Injury Network
Events represent patient-medication pairs.
More than one event may have been recorded for a patient-medication pair.
Appl Clin Inform
. Author manuscript; available in PMC 2012 June 18.
NIH-PA Author Manuscript NIH-PA Author Manuscript NIH-PA Author Manuscript
McCoy et al. Page 21
Table IV
Evaluation of potential adverse drug events and adverse drug events
Control n=1303 Intervention n=1396 p
Potential adverse drug events
Significant 20 26 0.2
Serious 42 31
Life threatening 3 6
Fatal 1 0
Lab-only adverse drug events
Significant 0 0 0.5
Serious 10 13
Life threatening 4 3
Fatal 0 0
Not preventable 3 5 0.5
Preventable 11 11
Adverse drug events
Significant 0 2 0.1
Serious 16 8
Life threatening 6 9
Fatal 0 1
Not preventable 6 7 0.6
Preventable 16 13
Events represent patient-medication pairs.
Appl Clin Inform
. Author manuscript; available in PMC 2012 June 18.
NIH-PA Author Manuscript NIH-PA Author Manuscript NIH-PA Author Manuscript
McCoy et al. Page 22
Table V
Evaluation of surveillance and provider response
Control Intervention
Hazard Ratio (95% CI) Pn Median Hours to Response (IQR) n Median Hours to Response (IQR)
Ordered prior to AKI 332 25.9 (6.0, 49.5) 374 18.3 (5.6, 47.2) 1.0 (0.9, 1.2) 0.2
Medications to avoid 104 26.6 (5.1, 55.1) 111 13.4 (3.3, 42.0) 1.1(0.8, 1.5) 0.8
Medications to adjust 102 14.9 (4.8, 46.8) 114 25.0 (5.5, 58.6) 1.0 (0.8, 1.4) 0.9
Medications to review 126 27.0 (7.8, 44.9) 149 24.1 (7.8, 44.3) 0.9 (0.7, 1.2) 0.6
Ordered after AKI 576 34.8 (11.6, 73.5) 625 32 (13.7, 73.0) 1.1 (1.0, 1.2) 0.2
Medications to avoid 173 25.9 (10.0, 63.9) 148 31.3 (10.4, 70.1) 1.0 (0.8, 1.3) 0.9
Medications to adjust 159 38.0 (14.4, 82.3) 217 27.2 (10.4, 69.5) 1.2 (0.9, 1.5) 0.2
Medications to review 244 43.8 (13.8, 72.0) 260 35.6 (19.9, 72.0) 1.1, (0.9, 1.3) 0.5
Abbreviations: AKI = acute kidney injury, IQR = interquartile ranges
Appl Clin Inform
. Author manuscript; available in PMC 2012 June 18.
NIH-PA Author Manuscript NIH-PA Author Manuscript NIH-PA Author Manuscript
McCoy et al. Page 23
Table VI
Study pharmacist recommendations
Total Responses
No intervention recommended 509
Dialysis 2
Transplant 0
False lab measurement 15
Transient acute kidney injury 8
No active orders 84
Palliative care 4
No dose change required 394
Other 2
Patient intervention recommended 8
Monitor serum creatinine 3
Monitor serum potassium 0
Monitor other 3
Other 2
Medication Recommendations 70
Increase dose 13
Increase interval 8
Decrease dose 9
Decrease interval 11
Discontinue medication 14
Consider alternate medication 7
Monitor therapeutic drug levels 13
Other 6
Appl Clin Inform
. Author manuscript; available in PMC 2012 June 18.
... From seven recently published systematic reviews on interventions to improve medication safety in older patients [12][13][14][15][16][17][18], we identified six published studies in which ADE-related measures were used as outcomes to evaluate the effect of medication review for older inpatients [43][44][45][46][47][48]. Schmader and colleagues [43] measured ADRs and found no change in all ADRs (P = 0.12) or serious ADRs (P = 0.41) after introducing a geriatric evaluation and management intervention for medical or surgical inpatients. ...
... They found a 20% reduction in all ADRs (p < 0.03). Lastly, McCoy and colleagues [48] evaluated an intervention consisting of a real-time pharmacy surveillance and a CDSS to reduce hospital-acquired ADEs in the setting of acute kidney injury (AKI). They found that the pharmacy surveillance on top of a CDSS had no significant effect on AKI-related potential ADEs or actual ADEs (p = 0.4). ...
... Lack of statistical power [43,48], no assessment of ADE preventability [43,47], as well as short exposure to the intervention [43,44], may explain the absence of an effect on ADE incidence in study by Schmader and colleagues and McCoy and colleagues [43,48], and only a modest reduction in ADEs in study by Trivalle and colleagues and Wehling and colleagues [44,47]. O'Connor and colleagues [45] and O'Sullivan and colleagues [46] did not report an assessment of local ADEs and/or risk analyses with physicians as input for the chosen interventions, which may explain a lower impact of their intervention (48 and 34% reduction in hospital-acquired pADEs in O'Connor and O'Sullivan, respectively) in comparison to our intervention (51% reduction in hospital-acquired pADEs). ...
Article
Full-text available
Abstract Background The effectiveness of interventions to improve medication safety in older inpatients is unclear, given a paucity of properly designed intervention studies applying clinically relevant endpoints such as hospital-acquired preventable Adverse Drug Events (pADEs) and unrecognized Adverse Drug Events (uADEs). Therefore, we conducted a quality improvement study and used hospital-acquired pADEs and uADEs as main outcomes to assess the effect of an intervention aimed to improve medication safety in older inpatients. Method The study followed an interrupted time series design and consisted of three equally spaced sampling points during baseline and during intervention measurements. Each sampling point included between 80 to 90 patients. A total of 500 inpatients ≥65 years and admitted to internal medicine wards of three Dutch hospitals were included. An expert team retrospectively identified and assessed ADEs via a structured patient chart review. The findings from baseline measurement and meetings with the internal medicine and hospital pharmacy staff were used to design the intervention. The intervention consisted of a structured medication review by hospital pharmacists, followed by face-to-face feedback to prescribers, on average 3 days per week. Results The rate of hospital-acquired pADEs per 100 hospitalizations was reduced by 50.6% (difference 16.8, 95% confidence interval (CI): 9.0 to 24.6, P
... A substantial proportion of studies (over 30%) reported insignificant results or included negative findings, allowing us to compare and contrast ICMOs for these systems. 23,25,32,34,37,38,40,42,43,[45][46][47]50,53,54,61,62,70,72,73,77,85,89,93,99,101,108 A large majority of the codes arose from CP-FIT, though some nuanced codes building on CP-FIT were identified inductively (see Supplementary Files S5 and S6). 5 When compared with the other mechanisms within CP-FIT, actionability appeared to be the most important mechanism in producing clinical improvements. [99][100][101][102][103][104][105][106][107][108] Actionability is the ability of e-A&F systems to directly facilitate behaviors for users. ...
... [99][100][101][102][103][104][105][106][107][108] Other mechanisms within CP-FIT (eg, reduced complexity, perceived relative advantage, see Supplementary File S6 for full descriptions and explanations) often contributed to successful e-A&F systems, but were less important as influencing factors, and were insufficient to produce clinical improvements alone. 23,25,32,34,37,38,40,42,43,[45][46][47]50,53,54,61,62,70,72,73,77,85,89,93,99,101,108,109 Contextual factors were also key effect modifiers of e-A&F systems, as they significantly enabled or limited implementation and engagement with each system. 21 Three key e-A&F intervention factors were identified that enhanced actionability and were more likely to result in clinical improvements: ...
... Doctors only [24][25][26][31][32][33]37,42,48,[60][61][62][63]69,71,74,79,80,84,89,92,93,[95][96][97]99,101,103,104 Doctors and nurses 27,40,41,51,54,67,78,91,105 Doctors and pharmacists 28,57,65,81,98 Doctors, nurses, and pharmacists 21,56,75,77,86,94 Doctors, nurses, and allied health 22,35,39,43,50,53,70,107 Nurses only 52,59,73 Pharmacists only 72 Note: A descriptive summary of the differing features and characteristics of e-A&F systems based on clinical performance feedback intervention theory. low usage and high dropout. ...
Article
Full-text available
Objectives: (1) Systematically review the literature on computerized audit and feedback (e-A&F) systems in healthcare. (2) Compare features of current systems against e-A&F best practices. (3) Generate hypotheses on how e-A&F systems may impact patient care and outcomes. Methods: We searched MEDLINE (Ovid), EMBASE (Ovid), and CINAHL (Ebsco) databases to December 31, 2020. Two reviewers independently performed selection, extraction, and quality appraisal (Mixed Methods Appraisal Tool). System features were compared with 18 best practices derived from Clinical Performance Feedback Intervention Theory. We then used realist concepts to generate hypotheses on mechanisms of e-A&F impact. Results are reported in accordance with the PRISMA statement. Results: Our search yielded 4301 unique articles. We included 88 studies evaluating 65 e-A&F systems, spanning a diverse range of clinical areas, including medical, surgical, general practice, etc. Systems adopted a median of 8 best practices (interquartile range 6-10), with 32 systems providing near real-time feedback data and 20 systems incorporating action planning. High-confidence hypotheses suggested that favorable e-A&F systems prompted specific actions, particularly enabled by timely and role-specific feedback (including patient lists and individual performance data) and embedded action plans, in order to improve system usage, care quality, and patient outcomes. Conclusions: e-A&F systems continue to be developed for many clinical applications. Yet, several systems still lack basic features recommended by best practice, such as timely feedback and action planning. Systems should focus on actionability, by providing real-time data for feedback that is specific to user roles, with embedded action plans. Protocol registration: PROSPERO CRD42016048695.
... One of the explains of this disappointing result is that electronic AKI alert systems do not really change the clinical managements of AKI [12]. Actually, frequent automatic alerts are likely to cause alert fatigue, which means clinicians become desensitized to alerts and fail to response effectively [18]. ...
Preprint
Full-text available
Background: Acute kidney injury (AKI) is an important adverse event of hospitalized patients that associates high mortality and high medical cost. While accurate diagnosis and timely management of AKI is essential for improving the outcomes of in-hospital AKI, delayed diagnosis or misdiagnosis by clinicians hinders the advance in the care of AKI. To ameliorate this problem, several electronic AKI alert systems had been proposed, which had shown inconsistent effects on the outcomes of AKI. Before electronic systems could improve the outcomes of AKI, an important issue to be elucidated is to confirm their diagnostic accuracy. The purpose of the present study is to establish an easy-to-construct Computerized Algorithm for the diagnosis of renal impairment and to test its accuracy. Methods: The present study retrospectively included 1551 hospitalized patients with serum creatinine (SCr) of > 1.3 mg/dL in Wanfang Hospital. A Computerized Algorithm was constructed to identify AKI events and CKD cases among these patients. Previous SCr tests were reviewed to define the baseline SCr level. Increased SCr level of > 1.5 times from baseline was defined as AKI. Estimated glomerular filtration rate (eGFR) of < 60 mL/min/1.73m2 for > 90 days was defined as CKD. The standard diagnoses were made by experienced nephrologists according to the same criteria. The discharge diagnoses made by the attending physician was defined as clinician’s diagnoses. The diagnoses made by Computerized Algorithm and the clinicians were compared with the researcher’s diagnoses to define their accuracy. Results: Of the included patients, the mean age was 73.0 years old; the in-hospital mortality was 14.8%; AKI was present in 28.6% of the patients. Regarding the diagnostic accuracy for AKI, the Computerized Algorithm achieved a sensitivity of 85.6% and a specificity of 98.8%. The main cause of false negative (FN) AKI diagnosis was that AKI occurred earlier than the outpatient visiting before the indexed hospitalization. Regarding the diagnostic accuracy for CKD, the Computerized Algorithm achieved a sensitivity of 94.7% and a specificity of 100%. The cause of FN CKD diagnosis was exclusively lack of previous eGFR records. Compared to the clinician’s diagnoses, the Computerized Algorithm exhibited significantly superior accuracy than the clinician’s diagnoses in both AKI (95.0% versus 57.0%) and CKD (96.5% versus 73.6%). Conclusions: We developed a simple and easy-to-construct Computerized Algorithm for the diagnosis of renal impairment, which significantly improved the diagnostic accuracy of AKI and CKD than clinicians did. In future, an algorithmic approach for differential diagnosis of AKI and decision guide with be incorporated into this system.
... CDSS studies with patients at a high risk of AKI mainly include critically ill patients receiving nephrotoxins. The use of CDSS in these cases improved AKI documentation, recognition and response time 21,[24][25][26][27][28] , and reduced nephrotoxin administration 27,[29][30][31] . Of note, in most studies of such screening tools, the focus on achieving high alert sensitivity led to high numbers of false positives, which can cause alert fatigue and might dilute any improvements in relevant outcomes 32 . ...
Article
Acute kidney injury (AKI), which is a common complication of acute illnesses, affects the health of individuals in community, acute care and post-acute care settings. Although the recognition, prevention and management of AKI has advanced over the past decades, its incidence and related morbidity, mortality and health care burden remain overwhelming. The rapid growth of digital technologies has provided a new platform to improve patient care, and reports show demonstrable benefits in care processes and, in some instances, in patient outcomes. However, despite great progress, the potential benefits of using digital technology to manage AKI has not yet been fully explored or implemented in clinical practice. Digital health studies in AKI have shown variable evidence of benefits, and the digital divide means that access to digital technologies is not equitable. Upstream research and development costs, limited stakeholder participation and acceptance, and poor scalability of digital health solutions have hindered their widespread implementation and use. Here, we provide recommendations from the Acute Disease Quality Initiative consensus meeting, which involved experts in adult and paediatric nephrology, critical care, pharmacy and data science, at which the use of digital health for risk prediction, prevention, identification and management of AKI and its consequences was discussed.
... After reviewing the titles and abstracts according to the eligibility criteria, 17 records were selected for full text assessment, four of which were later excluded given that their intervention [37] or study designs [17,24,38] mismatched the inclusion criteria. Two others were also excluded owing to applying CDSS to the control group and measuring the effects of complementary interventions on CDSSs [39,40]. Finally, a total of 11 studies met all inclusion criteria [41][42][43][44][45][46][47][48][49][50][51]. ...
Article
Objectives: This systematic review was conducted to investigate the characteristics and effects of clinical decision support systems (CDSSs) on clinical and process-of-care outcomes of patients with kidney disease. Methods: A comprehensive systematic search was conducted in electronic databases to identify relevant studies published until November 2020. Randomized clinical trials evaluating the effects of using electronic CDSS on at least one clinical or process-of-care outcome in patients with kidney disease were included in this study. The characteristics of the included studies, features of CDSSs, and effects of the interventions on the outcomes were extracted. Studies were appraised for quality using the Cochrane risk-of-bias assessment tool. Results: Out of 8722 retrieved records, 11 eligible studies measured 32 outcomes, including 10 clinical outcomes and 22 process-of-care outcomes. The effects of CDSSs on 45.5% of the process-of-care outcomes were statistically significant, and all the clinical outcomes were not statistically significant. Medication-related process-of-care outcomes were the most frequently measured (54.5%), and CDSSs had the most effective and positive effect on medication appropriateness (18.2%). The characteristics of CDSSs investigated in the included studies comprised automatic data entry, real-time feedback, providing recommendations, and CDSS integration with the Computerized Provider Order Entry system. Conclusion: Although CDSS may potentially be able to improve processes of care for patients with kidney disease, particularly with regard to medication appropriateness, no evidence was found that CDSS affects clinical outcomes in these patients. Further research is thus required to determine the effects of CDSSs on clinical outcomes in patients with kidney diseases.
... [25][26][27][28] Similarly, to facilitate alert evaluations, institutions have implemented various dashboards that organize and present information from the EHR in a way that is easy to interpret. [29][30][31][32][33][34] Commercial products also exist to provide tools for evaluating CDS alerts. [35][36][37] Although some organizations have successfully implemented these tools and reduced the number of alerts and overrides, 38 other reports have found that many organizations are not following these recommendations, in part due to a lack of consensus for whether or not to turn off or modify, or how to modify, alerts. ...
Article
Full-text available
Objective: We describe the Clickbusters initiative implemented at Vanderbilt University Medical Center (VUMC), which was designed to improve safety and quality and reduce burnout through the optimization of clinical decision support (CDS) alerts. Materials and methods: We developed a 10-step Clickbusting process and implemented a program that included a curriculum, CDS alert inventory, oversight process, and gamification. We carried out two 3-month rounds of the Clickbusters program at VUMC. We completed descriptive analyses of the changes made to alerts during the process, and of alert firing rates before and after the program. Results: Prior to Clickbusters, VUMC had 419 CDS alerts in production, with 488 425 firings (42 982 interruptive) each week. After 2 rounds, the Clickbusters program resulted in detailed, comprehensive reviews of 84 CDS alerts and reduced the number of weekly alert firings by more than 70 000 (15.43%). In addition to the direct improvements in CDS, the initiative also increased user engagement and involvement in CDS. Conclusions: At VUMC, the Clickbusters program was successful in optimizing CDS alerts by reducing alert firings and resulting clicks. The program also involved more users in the process of evaluating and improving CDS and helped build a culture of continuous evaluation and improvement of clinical content in the electronic health record.
Article
Background: Rates of nephrotoxic AKI are not well described in adults due to lack of a clear definition, debate over which drugs should be considered nephrotoxins, and illness-related confounding. Nephrotoxic Injury Negated by Just-in Time Action (NINJA), a program that reduces rates of nephrotoxic AKI in pediatric populations, may be able to address these concerns, but whether NINJA can be effectively applied to adults remains unclear. Methods: In this retrospective cohort study conducted at the University of Iowa Hospital, we included adult patients admitted to a general hospital floor for ≥48 hours during 2019. The NINJA algorithm screened charts for high nephrotoxin exposure and AKI. After propensity score matching, Cox proportional hazard modeling was used to evaluate the relationship between nephrotoxic exposure and all-stage AKI, stage 2-3 AKI, or death. Additional analyses evaluated the most frequent nephrotoxins used in this population. Results: Of 11,311 patients, 1527 (16%) had ≥1 day of high nephrotoxin exposure. Patients with nephrotoxic exposures subsequently developed AKI in 29% of cases, and 22% of all inpatient AKI events met nephrotoxic AKI criteria. Common nephrotoxins were vancomycin, iodinated contrast dye, piperacillin-tazobactam, acyclovir, and lisinopril. After propensity score matching, Cox proportional hazard models for high nephrotoxin exposure were significantly associated with all AKI (hazard ratio [HR] 1.43, 1.19-1.72, P<0.001), stage 2-3 AKI (HR 1.78, 1.18-2.67, P=0.006), and mortality (HR 2.12, 1.09-4.11, P=0.03). Conclusions: Nephrotoxin exposure in adults is common and is significantly associated with AKI development, including stage 2-3 AKI.
Article
Full-text available
Background: A medication review can be defined as a structured evaluation of a patient's medication conducted by healthcare professionals with the aim of optimising medication use and improving health outcomes. Optimising medication therapy though medication reviews may benefit hospitalised patients. Objectives: We examined the effects of medication review interventions in hospitalised adult patients compared to standard care or to other types of medication reviews on all-cause mortality, hospital readmissions, emergency department contacts and health-related quality of life. Search methods: In this Cochrane Review update, we searched for new published and unpublished trials using the following electronic databases from 1 January 2014 to 17 January 2022 without language restrictions: the Cochrane Central Register of Controlled Trials (CENTRAL), MEDLINE, Embase, the Cumulative Index to Nursing and Allied Health Literature (CINAHL), ClinicalTrials.gov and the WHO International Clinical Trials Registry Platform (ICTRP). To identify additional trials, we searched the reference lists of included trials and other publications by lead trial authors, and contacted experts. Selection criteria: We included randomised trials of medication reviews delivered by healthcare professionals for hospitalised adult patients. We excluded trials including outpatients and paediatric patients. Data collection and analysis: Two review authors independently selected trials, extracted data and assessed risk of bias. We contacted trial authors for data clarification and relevant unpublished data. We calculated risk ratios (RRs) for dichotomous data and mean differences (MDs) or standardised mean differences (SMDs) for continuous data (with 95% confidence intervals (CIs)). We used the GRADE (Grades of Recommendation, Assessment, Development and Evaluation) approach to assess the overall certainty of the evidence. Main results: In this updated review, we included a total of 25 trials (15,076 participants), of which 15 were new trials (11,501 participants). Follow-up ranged from 1 to 20 months. We found that medication reviews in hospitalised adults may have little to no effect on mortality (RR 0.96, 95% CI 0.87 to 1.05; 18 trials, 10,108 participants; low-certainty evidence); likely reduce hospital readmissions (RR 0.93, 95% CI 0.89 to 0.98; 17 trials, 9561 participants; moderate-certainty evidence); may reduce emergency department contacts (RR 0.84, 95% CI 0.68 to 1.03; 8 trials, 3527 participants; low-certainty evidence) and have very uncertain effects on health-related quality of life (SMD 0.10, 95% CI -0.10 to 0.30; 4 trials, 392 participants; very low-certainty evidence). Authors' conclusions: Medication reviews in hospitalised adult patients likely reduce hospital readmissions and may reduce emergency department contacts. The evidence suggests that mediation reviews may have little to no effect on mortality, while the effect on health-related quality of life is very uncertain. Almost all trials included elderly polypharmacy patients, which limits the generalisability of the results beyond this population.
Article
Background: Medication errors are preventable events that may cause or lead to inappropriate medication use or patient harm while the medication is in the control of the healthcare professional or patient. Medication errors in hospitalised adults may cause harm, additional costs, and even death. Objectives: To determine the effectiveness of interventions to reduce medication errors in adults in hospital settings. Search methods: We searched CENTRAL, MEDLINE, Embase, five other databases and two trials registers on 16 January 2020. SELECTION CRITERIA: We included randomised controlled trials (RCTs) and interrupted time series (ITS) studies investigating interventions aimed at reducing medication errors in hospitalised adults, compared with usual care or other interventions. Outcome measures included adverse drug events (ADEs), potential ADEs, preventable ADEs, medication errors, mortality, morbidity, length of stay, quality of life and identified/solved discrepancies. We included any hospital setting, such as inpatient care units, outpatient care settings, and accident and emergency departments. Data collection and analysis: We followed the standard methodological procedures expected by Cochrane and the Effective Practice and Organisation of Care (EPOC) Group. Where necessary, we extracted and reanalysed ITS study data using piecewise linear regression, corrected for autocorrelation and seasonality, where possible. MAIN RESULTS: We included 65 studies: 51 RCTs and 14 ITS studies, involving 110,875 participants. About half of trials gave rise to 'some concerns' for risk of bias during the randomisation process and one-third lacked blinding of outcome assessment. Most ITS studies presented low risk of bias. Most studies came from high-income countries or high-resource settings. Medication reconciliation -the process of comparing a patient's medication orders to the medications that the patient has been taking- was the most common type of intervention studied. Electronic prescribing systems, barcoding for correct administering of medications, organisational changes, feedback on medication errors, education of professionals and improved medication dispensing systems were other interventions studied. Medication reconciliation Low-certainty evidence suggests that medication reconciliation (MR) versus no-MR may reduce medication errors (odds ratio [OR] 0.55, 95% confidence interval (CI) 0.17 to 1.74; 3 studies; n=379). Compared to no-MR, MR probably reduces ADEs (OR 0.38, 95%CI 0.18 to 0.80; 3 studies, n=1336 ; moderate-certainty evidence), but has little to no effect on length of stay (mean difference (MD) -0.30 days, 95%CI -1.93 to 1.33 days; 3 studies, n=527) and quality of life (MD -1.51, 95%CI -10.04 to 7.02; 1 study, n=131). Low-certainty evidence suggests that, compared to MR by other professionals, MR by pharmacists may reduce medication errors (OR 0.21, 95%CI 0.09 to 0.48; 8 studies, n=2648) and may increase ADEs (OR 1.34, 95%CI 0.73 to 2.44; 3 studies, n=2873). Compared to MR by other professionals, MR by pharmacists may have little to no effect on length of stay (MD -0.25, 95%CI -1.05 to 0.56; 6 studies, 3983). Moderate-certainty evidence shows that this intervention probably has little to no effect on mortality during hospitalisation (risk ratio (RR) 0.99, 95%CI 0.57 to 1.7; 2 studies, n=1000), and on readmissions at one month (RR 0.93, 95%CI 0.76 to 1.14; 2 studies, n=997); and low-certainty evidence suggests that the intervention may have little to no effect on quality of life (MD 0.00, 95%CI -14.09 to 14.09; 1 study, n=724). Low-certainty evidence suggests that database-assisted MR conducted by pharmacists, versus unassisted MR conducted by pharmacists, may reduce potential ADEs (OR 0.26, 95%CI 0.10 to 0.64; 2 studies, n=3326), and may have no effect on length of stay (MD 1.00, 95%CI -0.17 to 2.17; 1 study, n=311). Low-certainty evidence suggests that MR performed by trained pharmacist technicians, versus pharmacists, may have little to no difference on length of stay (MD -0.30, 95%CI -2.12 to 1.52; 1 study, n=183). However, the CI is compatible with important beneficial and detrimental effects. Low-certainty evidence suggests that MR before admission may increase the identification of discrepancies compared with MR after admission (MD 1.27, 95%CI 0.46 to 2.08; 1 study, n=307). However, the CI is compatible with important beneficial and detrimental effects. Moderate-certainty evidence shows that multimodal interventions probably increase discrepancy resolutions compared to usual care (RR 2.14, 95%CI 1.81 to 2.53; 1 study, n=487). Computerised physician order entry (CPOE)/clinical decision support systems (CDSS) Moderate-certainty evidence shows that CPOE/CDSS probably reduce medication errors compared to paper-based systems (OR 0.74, 95%CI 0.31 to 1.79; 2 studies, n=88). Moderate-certainty evidence shows that, compared with standard CPOE/CDSS, improved CPOE/CDSS probably reduce medication errors (OR 0.85, 95%CI 0.74 to 0.97; 2 studies, n=630). Low-certainty evidence suggests that prioritised alerts provided by CPOE/CDSS may prevent ADEs compared to non-prioritised (inconsequential) alerts (MD 1.98, 95%CI 1.65 to 2.31; 1 study; participant numbers unavailable). Barcode identification of participants/medications Low-certainty evidence suggests that barcoding may reduce medication errors (OR 0.69, 95%CI 0.59 to 0.79; 2 studies, n=50,545). Reduced working hours Low-certainty evidence suggests that reduced working hours may reduce serious medication errors (RR 0.83, 95%CI 0.63 to 1.09; 1 study, n=634). However, the CI is compatible with important beneficial and detrimental effects. Feedback on prescribing errors Low-certainty evidence suggests that feedback on prescribing errors may reduce medication errors (OR 0.47, 95%CI 0.33 to 0.67; 4 studies, n=384). Dispensing system Low-certainty evidence suggests that dispensing systems in surgical wards may reduce medication errors (OR 0.61, 95%CI 0.47 to 0.79; 2 studies, n=1775). Authors' conclusions: Low- to moderate-certainty evidence suggests that, compared to usual care, medication reconciliation, CPOE/CDSS, barcoding, feedback and dispensing systems in surgical wards may reduce medication errors and ADEs. However, the results are imprecise for some outcomes related to medication reconciliation and CPOE/CDSS. The evidence for other interventions is very uncertain. Powered and methodologically sound studies are needed to address the identified evidence gaps. Innovative, synergistic strategies -including those that involve patients- should also be evaluated.
Article
Full-text available
Despite the promise of health information technology (HIT), recent literature has revealed possible safety hazards associated with its use. The Office of the National Coordinator for HIT recently sponsored an Institute of Medicine committee to synthesize evidence and experience from the field on how HIT affects patient safety. To lay the groundwork for defining, measuring, and analyzing HIT-related safety hazards, we propose that HIT-related error occurs anytime HIT is unavailable for use, malfunctions during use, is used incorrectly by someone, or when HIT interacts with another system component incorrectly, resulting in data being lost or incorrectly entered, displayed, or transmitted. These errors, or the decisions that result from them, significantly increase the risk of adverse events and patient harm. We describe how a sociotechnical approach can be used to understand the complex origins of HIT errors, which may have roots in rapidly evolving technological, professional, organizational, and policy initiatives. Arch Intern Med. 2011;171(14):1281-1284
Article
Full-text available
Medication errors are common, and while most such errors have little potential for harm they cause substantial extra work in hospitals. A small proportion do have the potential to cause injury, and some cause preventable adverse drug events. To evaluate the impact of computerized physician order entry (POE) with decision support in reducing the number of medication errors. Prospective time series analysis, with four periods. All patients admitted to three medical units were studied for seven to ten-week periods in four different years. The baseline period was before implementation of POE, and the remaining three were after. Sophistication of POE increased with each successive period. Physician order entry with decision support features such as drug allergy and drug-drug interaction warnings. Medication errors, excluding missed dose errors. During the study, the non-missed-dose medication error rate fell 81 percent, from 142 per 1,000 patient-days in the baseline period to 26.6 per 1,000 patient-days in the final period (P < 0.0001). Non-intercepted serious medication errors (those with the potential to cause injury) fell 86 percent from baseline to period 3, the final period (P = 0.0003). Large differences were seen for all main types of medication errors: dose errors, frequency errors, route errors, substitution errors, and allergies. For example, in the baseline period there were ten allergy errors, but only two in the following three periods combined (P < 0.0001). Computerized POE substantially decreased the rate of non-missed-dose medication errors. A major reduction in errors was achieved with the initial version of the system, and further reductions were found with addition of decision support features.
Article
• Objective: To describe the design and implementation of and early experience with a computerized system for detecting and preventing adverse drug events (ADEs) in hospitalized patients. • Methods: A computer system utilizing a rules engine was programmed using a combination of rules from previous authors plus new rules, selected to detect both ADEs and evolving unsafe conditions. Potential events detected by the system were reviewed by medication safety pharmacists and scored for causality and severity; clinical pharmacists responsible for the care of hospital patients reviewed the alerts for opportunities to intervene and prevent harm. Rules were modified and added or subtracted based on experience during the early implementation period. • Results: Preliminary evaluation of system performance during the first 2 months of operation showed high inter-observer agreement in evaluation of alerts, demonstrating that the computer system and evaluation process functioned in a standardized, reproducible manner. The positive predictive value of rules ranged from 0 to 0.67. The system detected 260 ADEs, or 3.7 ADEs per 100 admissions. Interventions in care were initiated in 206 patients as a result of alerts from the system. Automated surveillance detected 90% of all ADEs detected by surveillance and voluntary reporting combined during this period. • Conclusion: A computerized ADE surveillance system can effectively perform the dual functions of providing a medication "safety net" as well as detecting and documenting ADEs.
Article
Objective —To identify and evaluate the systems failures that underlie errors causing adverse drug events (ADEs) and potential ADEs. Design —Systems analysis of events from a prospective cohort study. Participants —All admissions to 11 medical and surgical units in two tertiary care hospitals over a 6-month period. Main Outcome Measures —Errors, proximal causes, and systems failures. Methods —Errors were detected by interviews of those involved. Errors were classified according to proximal cause and underlying systems failure by multidisciplinary teams of physicians, nurses, pharmacists, and systems analysts. Results —During this period, 334 errors were detected as the causes of 264 preventable ADEs and potential ADEs. Sixteen major systems failures were identified as the underlying causes of the errors. The most common systems failure was in the dissemination of drug knowledge, particularly to physicians, accounting for 29% of the 334 errors. Inadequate availability of patient information, such as the results of laboratory tests, was associated with 18% of errors. Seven systems failures accounted for 78% of the errors; all could be improved by better information systems. Conclusions —Hospital personnel willingly participated in the detection and investigation of drug use errors and were able to identify underlying systems failures. The most common defects were in systems to disseminate knowledge about drugs and to make drug and patient information readily accessible at the time it is needed. Systems changes to improve dissemination and display of drug and patient data should make errors in the use of drugs less likely.(JAMA. 1995;274:35-43)
Article
Background: Hospital computing systems play an important part in the communication of clinical information to physicians. We sought to determine whether computer-based alerts for hospitalized patients can affect physicians' behavior and improve patients' outcomes.Methods: We performed a prospective time-series study to determine whether computerized alerts to physicians about rising creatinine levels in hospitalized patients receiving nephrotoxic or renally excreted medications led to more rapid adjustment or discontinuation of those medications, and to determine whether such alerts protected renal function.Results: Laboratory data were observed for 20 228 hospitalizations, with documentation of 1573 events (instances of rising creatinine levels during treatment with a nephrotoxic or renally excreted drug). During the intervention period, doses were adjusted or medications discontinued an average of 21.6 hours sooner after such an event (P<.0001). For patients receiving nephrotoxic medications during the intervention period, the relative risk of serious renal impairment was 0.45 (95% confidence interval, 0.22 to 0.94) as compared with the control period, and the mean serum creatinine level was 14.1 μmol/L (0.16 mg/dL) lower on day 3 (P<.01) and 25.6 μmol/L (0.29 mg/dL) lower on day 7 (P<.05) after an event. Forty-four percent of physicians who responded to a questionnaire said that the alerts had been helpful in the care of their patients, whereas 28% found them annoying. Sixty-five percent wished to continue receiving alerts.Conclusions: Computer-based alerts regarding patients with rising creatinine levels affect physician behavior, prevent serious renal impairment, preserve renal function, and are accepted by clinicians.(Arch Intern Med. 1994;154:1511-1517)
Article
Objective. —To develop a new method to improve the detection and characterization of adverse drug events (ADEs) in hospital patients.Design. —Prospective study of all patients admitted to our hospital over an 18-month period.Setting. —LDS Hospital, Salt Lake City, Utah, a 520-bed tertiary care center affiliated with the University of Utah School of Medicine, Salt Lake City.Patients. —We developed a computerized ADE monitor, and computer programs were written using an integrated hospital information system to allow for multiple source detection of potential ADEs occurring in hospital patients. Signals of potential ADEs, both voluntary and automated, included sudden medication stop orders, antidote ordering, and certain abnormal laboratory values. Each day, a list of all potential ADEs from these sources was generated, and a pharmacist reviewed the medical records of all patients with possible ADEs for accuracy and causality. Verified ADEs were characterized as mild, moderate, or severe and as type A (dose-dependent or predictable) or type B (idiosyncratic or allergic) reactions, and causality was further measured using a standardized scoring method.Outcome Measure. —The number and characterization of ADEs detected.Results. —Over 18 months, we monitored 36 653 hospitalized patients. There were 731 verified ADEs identified in 648 patients, 701 ADEs were characterized as moderate or severe, and 664 were classified as type A reactions. During this same period, only nine ADEs were identified using traditional detection methods. Physicians, pharmacists, and nurses voluntarily reported 92 of the 731 ADEs detected using this automated system. The other 631 ADEs were detected from automated signals, the most common of which were diphenhydramine hydrochloride and naloxone hydrochloride use, high serum drug levels, leukopenia, and the use of phytonadione and antidiarrheals. The most common symptoms and signs were pruritus, nausea and/or vomiting, rash, and confusion-lethargy. The most common drug classes involved were analgesics, anti-infectives, and cardiovascular agents.Conclusion. —We believe that screening for ADEs with a computerized hospital information system offers a potential method for improving the detection and characterization of these events in hospital patients.(JAMA. 1991;266:2847-2851)
Article
Context Usual drug-prescribing practices may not consider the effects of renal insufficiency on the disposition of certain drugs. Decision aids may help optimize prescribing behavior and reduce medical error.Objective To determine if a system application for adjusting drug dose and frequency in patients with renal insufficiency, when merged with a computerized order entry system, improves drug prescribing and patient outcomes.Design, Setting, and Patients Four consecutive 2-month intervals consisting of control (usual computerized order entry) alternating with intervention (computerized order entry plus decision support system), conducted in September 1997–April 1998 with outcomes assessed among a consecutive sample of 17 828 adults admitted to an urban tertiary care teaching hospital.Intervention Real-time computerized decision support system for prescribing drugs in patients with renal insufficiency. During intervention periods, the adjusted dose list, default dose amount, and default frequency were displayed to the order-entry user and a notation was provided that adjustments had been made based on renal insufficiency. During control periods, these recommended adjustments were not revealed to the order-entry user, and the unadjusted parameters were displayed.Main Outcome Measures Rates of appropriate prescription by dose and frequency, length of stay, hospital and pharmacy costs, and changes in renal function, compared among patients with renal insufficiency who were hospitalized during the intervention vs control periods.Results A total of 7490 patients were found to have some degree of renal insufficiency. In this group, 97 151 orders were written on renally cleared or nephrotoxic medications, of which 14 440 (15%) had at least 1 dosing parameter modified by the computer based on renal function. The fraction of prescriptions deemed appropriate during the intervention vs control periods by dose was 67% vs 54% (P<.001) and by frequency was 59% vs 35% (P<.001). Mean (SD) length of stay was 4.3 (4.5) days vs 4.5 (4.8) days in the intervention vs control periods, respectively (P = .009). There were no significant differences in estimated hospital and pharmacy costs or in the proportion of patients who experienced a decline in renal function during hospitalization.Conclusions Guided medication dosing for inpatients with renal insufficiency appears to result in improved dose and frequency choices. This intervention demonstrates a way in which computer-based decision support systems can improve care.
Article
Context Adverse drug events, especially those that may be preventable, are among the most serious concerns about medication use in older persons cared for in the ambulatory clinical setting.Objective To assess the incidence and preventability of adverse drug events among older persons in the ambulatory clinical setting.Design, Setting, and Patients Cohort study of all Medicare enrollees (30 397 person-years of observation) cared for by a multispecialty group practice during a 12-month study period (July 1, 1999, through June 30, 2000), in which possible drug-related incidents occurring in the ambulatory clinical setting were detected using multiple methods, including reports from health care providers; review of hospital discharge summaries; review of emergency department notes; computer-generated signals; automated free-text review of electronic clinic notes; and review of administrative incident reports concerning medication errors.Main Outcome Measures Number of adverse drug events, severity of the events (classified as significant, serious, life-threatening, or fatal), and whether the events were preventable.Results There were 1523 identified adverse drug events, of which 27.6% (421) were considered preventable. The overall rate of adverse drug events was 50.1 per 1000 person-years, with a rate of 13.8 preventable adverse drug events per 1000 person-years. Of the adverse drug events, 578 (38.0%) were categorized as serious, life-threatening, or fatal; 244 (42.2%) of these more severe events were deemed preventable compared with 177 (18.7%) of the 945 significant adverse drug events. Errors associated with preventable adverse drug events occurred most often at the stages of prescribing (n = 246, 58.4%) and monitoring (n = 256, 60.8%), and errors involving patient adherence (n = 89, 21.1%) also were common. Cardiovascular medications (24.5%), followed by diuretics (22.1%), nonopioid analgesics (15.4%), hypoglycemics (10.9%), and anticoagulants (10.2%) were the most common medication categories associated with preventable adverse drug events. Electrolyte/renal (26.6%), gastrointestinal tract (21.1%), hemorrhagic (15.9%), metabolic/endocrine (13.8%), and neuropsychiatric (8.6%) events were the most common types of preventable adverse drug events.Conclusions Adverse drug events are common and often preventable among older persons in the ambulatory clinical setting. More serious adverse drug events are more likely to be preventable. Prevention strategies should target the prescribing and monitoring stages of pharmaceutical care. Interventions focused on improving patient adherence with prescribed regimens and monitoring of prescribed medications also may be beneficial.