Figure 5 - uploaded by Cathy Modaro
Content may be subject to copyright.
(a) High-level flowchart provides an overview of the body MR imaging examination process, from scheduling through image acquisition. Team discussions of the flowchart and review of background data indicated that MR imaging room availability was the limiting factor to increasing the daily volume of body MR imaging examinations. DI = diagnostic imaging scheduler, MRI = MR imaging staff, PSC = patient service coordinator, Radiology = non – MR imaging radiology staff requesting scheduling of services for a particular patient, Tech = technologist. (b) Low-level flowchart extracted from a detailed master chart of the entire process shows only the technologist’s work flow. The shape of each box on the chart has a specific meaning: Ovals indicate start- and end-points, squares and rectangles indicate steps, and diamonds indicate decision- making points. A careful review of flowcharts can reveal important information affecting a process: Our team learned that a single technologist typically performed nearly all the steps in a given examination, including setup, image acquisition, and quality verification. 

(a) High-level flowchart provides an overview of the body MR imaging examination process, from scheduling through image acquisition. Team discussions of the flowchart and review of background data indicated that MR imaging room availability was the limiting factor to increasing the daily volume of body MR imaging examinations. DI = diagnostic imaging scheduler, MRI = MR imaging staff, PSC = patient service coordinator, Radiology = non – MR imaging radiology staff requesting scheduling of services for a particular patient, Tech = technologist. (b) Low-level flowchart extracted from a detailed master chart of the entire process shows only the technologist’s work flow. The shape of each box on the chart has a specific meaning: Ovals indicate start- and end-points, squares and rectangles indicate steps, and diamonds indicate decision- making points. A careful review of flowcharts can reveal important information affecting a process: Our team learned that a single technologist typically performed nearly all the steps in a given examination, including setup, image acquisition, and quality verification. 

Source publication
Article
Full-text available
In the coming decades, those who provide radiologic imaging services will be increasingly challenged by the economic, demographic, and political forces affecting healthcare to improve their efficiency, enhance the value of their services, and achieve greater customer satisfaction. It is essential that radiologists master and consistently apply basi...

Contexts in source publication

Context 1
... implementations also facilitate training. To continue with the hypothetical example, technologists can be rotated to a small group of MR imaging systems for intensive tutoring in a new protocol. Those who have difficulty in mastering the new protocol can be identified and assisted. We have found such an approach useful in training technologists both in MR imaging and in CT. During this phase, it is important to collect regular measurements and to consider adding new types of measurements that may be necessary to incorporate lessons learned. However, sensitivity is required to avoid imposing excessively burden- some requirements on project participants. Multiple changes will be made throughout the course of a process improvement project, and the exact timing of each change may be difficult to recall later. It is therefore important to record the time point at which specific changes are made, either in a log (Table 1) or on a time line (Figs 9, 10). The information in these records can then be compared with the regularly updated control chart to identify the effects of particular changes (Figs 4, 10). A unique feature of process improvement is that the steps just described can be repeated in a potentially endless series of PDSA cycles until the aim has been fulfilled or the project has been terminated or reformulated with a new aim. The letters in PDSA refer to p lanning how to implement chosen changes, implementing or “ d oing” the plan, s tudying the results of the implementation (eg, control chart and time line) to identify beneficial changes and to brainstorm about new changes, and a cting on that information to choose which changes should be implemented next (20). During each cycle, certain questions should be addressed: Does the project aim need to be modified? Are the current resources, expertise, team make-up, and project time frame still adequate? Is the sponsor being kept informed and still satisfied with the direction and rate of progress? Are new measurements and new data sources needed? Is data collection adequate? Is there “data collection fatigue” among the process participants? Did the implemented change or changes move the relevant measure benefi- cially “out of control?” Do the data suggest that an implementation of a change should be scaled up or a different change should be considered? What was learned during the last implementation? Were there any unexpected benefits of change or unexpected obstacles to change? Was communication adequate among those involved? Are those involved still enthusiastic? It is crucial to maintain morale during PDSA cycles. Positive results should be communicated to all those involved to show the value of the project and demonstrate progress. Negative results and how they are being handled should also be shared, not only to allow learning among participants but also to indicate that even negative feedback is valued and used. A final question to be asked is whether the project has reached a stopping point (the aim has been met, or the aim is unachievable and the project should be terminated). If the aim has been met, measurements should continue to be obtained for monitoring during a follow-up period of appropriate duration to ensure that the aim continues to be met. If not, PDSA cycles can be reinitiated. If the aim continues to be met, then the project can be closed. A closer consideration of our body MR imaging project log (Table 1), time line (Fig 9), control charts (Fig 4), and flowcharts (Fig 5) reveals how our project evolved through successive PDSA cycles. Our initial PDSA cycles were focused on streamlining the work flow by having technologists complete as many steps as possible before the MR imaging examination began (eg, prefilling of syringes with intravenous contrast material). A review of measurements and observations showed that the steps we modified were all performed by the same technologist and that we had only changed the order in which the steps were completed and had not improved efficiency. During subsequent PDSA cycles, we created and modified a new part-time position for a technologist who would “float” between MR imaging rooms. Because there was no budget or time to hire and train additional technologists, this change was implemented in a limited way with existing staff. The questionnaire in Figure 2 was used to document the examinations in which the “floating” technologist had assisted. In cases in which the “floating” technologist was used, the total MR imaging room time decreased on average by 4–5 minutes. At the same time, a newly created body MR imaging protocol committee was implementing modified protocols. Despite these changes, the control chart showing the daily volume of body MR imaging examinations (Fig 4a) showed no increase from the baseline volume. The daily average MR imaging room time for body MR imaging examinations (Fig 4b) showed steady decreases over the six most recent data points, but this change was two data points shy of statistical significance. Because the completion of the project and a formal presentation of the results were course requirements, the project was subsequently ...
Context 2
... our team created a paper-based questionnaire to collect detailed information from the MR imaging technologists (eg, the duration of occupancy of the MR imaging room, the time required for each sequential step performed during the MR imaging examination) (Fig 2). Problems that we encountered with this approach included missing, incomplete, or errone- ously completed questionnaires. Another alternative is to have a human observer monitor the process and record the results (16). In a time-motion study, a member of the project team shadows the technologist through every step in the MR imaging examination, tracking the time taken to complete each step and tallying the problems encountered. This method of data collection may result in higher data accuracy, but it is time and labor intensive and thus not suitable for con- tinuous monitoring. Before instituting changes in a process, it is important to clearly understand the current state (15). This means obtaining, charting, and analyzing baseline data collected over a sufficiently long period of time to avoid bias and to understand variations that are intrinsic to the process. Probably one of the most important tools for process improvement is the control chart (Figs 3, 4), which shows variation in a process over time. In the control chart, time is shown on the x-axis and a given measure on the y-axis. Beyond that basic structural principle, control charts may take many forms. One common form, the average and sigma (ie, SD) control chart (Figs 3, 4b), is used when the given measure charted per unit of time is an average. An example of such a measure would be the daily average duration of body MR imaging examinations. The control chart has a central horizontal line representing the overall mean, and “control” lines representing one, two, and three standard deviations above and below the mean. Another common type of control chart is the individual values and moving range chart, in which an individual value per unit of time and a moving range are shown simultaneously (Fig 4a). This type of control chart would be used to chart a single value (not an average) per unit of time. An example might be the total number of body MR imaging examinations performed in a given day (17–19). When analyzing a control chart, the goal is to determine whether the charted process is stable and in control (in which case variation is second- ary to chance) or out of control (in which case variation is secondary to assignable “special” or nonroutine causes) (19,20). An example of a special cause that might have decreased our daily volume of body MR imaging examinations would be downtime for repair of an MR imaging system. Similarly, in a project to improve the mammogra- phy ordering process, a telephone system upgrade might have caused the process to go out of control. Out-of-control variation in a process can be either beneficial or detrimental (19,20). However, at the start of a process improvement project, it is important that the process be in control. If it is not, then it must be brought into control before plans for process improvement are implemented, or it will be impossible to determine whether the measures implemented are responsible for subsequent variations in the process (17). There may be several signs that a process is out of control (Fig 3). Some examples include one data point more than 3 SDs above or below the mean, two of three successive points on the same side of the center line and more than 2 SDs above or below the mean, four of five successive points on the same side of the center line and more than 1 SD above or below the mean, and eight successive points on the same side of the center line (20). For our body MR imaging project, we created control charts (Fig 4) that were updated weekly. The charts showed the daily number of body MR imaging examinations (RIS data) and daily average MR imaging room time for body examinations (questionnaire data). These charts were disseminated by e-mail, discussed at weekly team meetings, and stored on a shared file server. The next step is to identify and prioritize opportunities for change by performing an in-depth evaluation of the specific process targeted for improvement. The purpose of process analysis is to obtain a thorough understanding of the process so as to identify the problems that inhibit achievement of the project aim. Three tools that are commonly used in process analysis are flowcharts, fishbone cause-and-effect diagrams, and tally sheets. We recommend that process analysis be performed at team meetings to best utilize the team members’ collective experience and special- ized knowledge about the process. Flowcharts are diagrams that show the steps in a process in their appropriate sequence (6,8–10,20). For complex processes, it may be necessary to create a “high-level,” simplified flowchart that can be supplemented by more detailed flowcharts of the individual stages, or groups of related steps, in the process (Fig 5). A thorough review of flowcharts by the project team can reveal rate-limiting steps and likely problems. Once a process is well understood, brainstorming may be useful to identify problems that may af- fect the success of the process improvement project. Cause-and-effect diagrams such as the fishbone diagram (Fig 6) can facilitate such brainstorming by helping conceptualize problems (6,10,20). Next, to facilitate decision making, data should be collected about the frequency of occurrence of each problem. Tally sheets are useful for recording instances of problems that are identified on a fishbone diagram (10,20). Problems described on the fishbone diagram can be listed and a tally taken of the instances of each problem over a given period of time. A centralized tally sheet maintained either as a digital shared file or as a paper-based master copy can be used by a technologist supervisor or a group of technologists to record instances of problems as they occur (Fig 7). Because our body MR imaging project involved scanners scattered throughout our institution, we instructed the technologists to record instances of problems by using the questionnaire shown in Figure 2. The results were then collated and tabulated. After opportunities for process change have been identified, the next step is to decide which changes should be made. The relative frequency of occurrence of each problem listed on the tally sheet may be calculated and the resultant percentages used to create a Pareto diagram to allow visualization of the most important problems (Figs 1, 7) (10,20). For example, our team’s review of a Pareto diagram indicated that issues affecting image quality (other than technologist error) and necessitating repeat imaging accounted for 73% of MR imaging examinations with a greatly prolonged duration (>2 SDs above the mean) (Fig 8). As an alternative, various list reduction techniques may be used. In brainstorming sessions, team members may be called on to identify which problems on the tally list are similar enough that they can be combined. Group multivoting techniques can then be used to further reduce the list so as to facilitate the selection of changes for implementation (6,20). Next, plans must be formulated to carry out the decisions that were made (8). During planning, the following questions must be answered: Who is in charge? What resources are available? Who can allocate additional resources if needed? What are the specific steps to be completed? Would an outline of steps (ie, a work breakdown struc- ture) be useful (21)? What is the time frame for project completion? Who should receive progress updates? Are there “stopping points” that might prevent the implementation of changes and doom the project to failure? When plans have been formulated, as many participants (eg, technologists, nurses) in the process as is reasonably possible should be in- vited to review them so as to assess the feasibil- ity of their implementation as well as to generate support for the project and allow learning about process change. How, then, should plans be implemented? We have found that small-scale pilot projects are useful initially to minimize risk (10,14,22). Lessons learned in these projects can be used to modify plans before scaling up, and plans that are clearly unsuccessful at the pilot project stage can be terminated quickly without a substantial waste of resources. For example, a new MR imaging protocol can be implemented initially on just one imaging system and the technologists authorized to switch to the old protocol if they encounter problems with the new one, with the stipulation that they provide information to the project team about the reason for the switch. This information can then be used to improve the protocol in a cyclical manner (through PDSA cycles) until it is sufficiently mature to be deployed more ...

Citations

... Currently, most dose optimization efforts place greater focus on technical issues [26,27]. One of the most used strategies in dose optimization is changing CT protocols [8,9,26,27]. ...
... Currently, most dose optimization efforts place greater focus on technical issues [26,27]. One of the most used strategies in dose optimization is changing CT protocols [8,9,26,27]. Harmonizing protocols across an organization can set standards for dose levels meeting the needs for diagnostic accuracy and safety. ...
Article
Background Advances in CT have facilitated widespread use of medical imaging while increasing patient lifetime exposure to ionizing radiation. Purpose To describe dose optimization strategies used by health care organizations to optimize radiation dose—and image quality. Materials and methods A qualitative study of semistructured interviews conducted with 26 leaders from 19 health care systems in the United States, Europe, and Japan. Interviews focused on strategies that were used to optimize radiation dose at the organizational level. A directed content analysis approach was used in data analysis. Results Analysis identified seven organizational strategies used by these leaders for optimizing CT dose: (1) engaging radiologists and technologists, (2) establishing a CT dose committee, (3) managing organizational change, (4) providing leadership and support, (5) monitoring and benchmarking, (6) modifying CT protocols, and (7) changes in equipment and work rules. Conclusions Leaders in these health systems engaged in specific strategies to optimize CT dose in within their organizations. The strategies address challenges health systems encounter in optimizing CT dose at the organizational level and offer an evolving framework for consideration in dose optimization efforts for enhancing safety and use of medical imaging.
... 32,33 These approaches have demonstrated process improvement and cost reduction at all organizational levels and in a variety of industries including health care and radiology. 24,[34][35][36][37] A principle tenant of CQI is to focus on the customer as a means of identifying value and to remove components that do not add value (ie, waste). 38 In the context of the Donabedian model and value-based payments, waste includes any structure or step in a process that does not contribute positively to outcomes or cost reduction. ...
Article
Medical imaging in the United States is evolving because of increased emphasis on documenting performance to quantify quality and value in the field. However, this fundamental shift might not be apparent at the technologist level with the American Registry of Radiologic Technologists (ARRT) discontinuing issuance of the quality management (QM) credential. Although the QM technologist’s scope of practice has undergone significant changes, evidence suggests that the focus on quality continues to expand. The remainder of the manuscript address factors pertaining to quality improvement and the need to develop technologists with skills to contribute in this area.
... Process and cause analysis. In accordance with the process improvement steps, we determined the frequency and probable causes of respiratory motion artifacts and expiratory phase scanning in the baseline chest CT examinations 19,20 . We created a Pareto chart with the QI Macros software (KnowWare International, Inc., Denver, CO). ...
Article
Full-text available
We hypothesized that clinical process improvement strategies can reduce frequency of motion artifacts and expiratory phase scanning in chest CT. We reviewed 826 chest CT to establish the baseline frequency. Per clinical process improvement guidelines, we brainstormed corrective measures and priority-pay-off matrix. The first intervention involved education of CT technologists, following which 795 chest CT were reviewed. For the second intervention, instructional videos on optimal breath-hold were shown to 245 adult patients just before their chest CT. Presence of motion artifacts and expiratory phase scanning was assessed. We also reviewed 311 chest CT scans belonging to a control group of patients who did not see the instructional videos. Pareto and percentage run charts were created for baseline and post-intervention data. Baseline incidence of motion artifacts and expiratory phase scanning in chest CT was 35% (292/826). There was no change in the corresponding incidence following the first intervention (36%; 283/795). Respiratory motion and expiratory phase chest CT with the second intervention decreased (8%, 20/245 patients). Instructional videos for patients (and not education and training of CT technologists) reduce the frequency of motion artifacts and expiratory phase scanning in chest CT.
... Prior studies have reported the prevalence of errors related to laterality or left and right discrepancies in radiology and non-radiology specialties (5)(6)(7)(8). While surgical and procedural errors related to wrong side treatment are rare, side discrepancies in radiology reports can contribute to these errors leading to catastrophic consequences for both physicians and patients (5,7,(9)(10)(11)(12). We defined laterality errors related to side discrepancies as lack of consistent side labeling of an abnormality between the "Findings" and "Impression" sections of the radiology reports. ...
... Clinical process improvement involves the creation of a series of illustrations to understand the clinical process, a source of limitation or errors in the process, and identify focused areas for improvement as targets (11). The baseline dataset on radiology reports with side discrepancies between the findings and impressions sections was reviewed to determine possible causes for these errors and plot a Pareto chart using QI Macros software (KnowWare International, Inc., Denver, CO, USA). ...
Article
Full-text available
Background Laterality errors in radiology reports can lead to serious errors in management. Purpose To reduce errors related to side discrepancies in radiology reports from thoracic imaging by 50% over a six-month period with education and voice recognition software tools. Material and Methods All radiology reports at the Thoracic Imaging Division from the fourth quarter of 2016 were reviewed manually for presence of side discrepancies (baseline data). Side discrepancies were defined as a lack of consistency in side labeling of any abnormality in the “Findings” to “Impression” sections of the reports. Process map and Ishikawa fishbone diagram (Microsoft Visio) were created. All thoracic radiologists were educated on side-related errors in radiology reports for plan–design–study–act cycle 1 (PDSA #1). Two weeks later, voice recognition software was configured to capitalize sides (RIGHT and LEFT) in the reports during dictated (PDSA# 2). Radiology reports were analyzed to determine side-discrepancy errors following each PDSA cycle (post-interventional data). Statistical run charts were created using QI Macros statistical software. Results Baseline data revealed 33 side-discrepancy errors in 47,876 reports with an average of 2.5 errors per week (range = 1–8 errors). Following PDSA #1, there were seven errors pertaining to side discrepancies over a two-week period. Errors declined following implementation of PDSA #2 to meet the target of 0.85 side-discrepancy error per week over seven weeks. Conclusion Automated processes (such as capitalization of sides) help reduce left/right errors substantially without affecting reporting turnaround time.
... The ABR states that each PQI project should incorporate a Plan-Do-Study-Act (PDSA) process [9,10]. First, an area within one's practice that could benefit from quality improvement is identified and a plan with a set of measureable goals and methods for data collection are established. ...
Article
The purpose of this report is to describe our experience with the implementation of a practice quality improvement (PQI) project in thoracic imaging as part of the American Board of Radiology Maintenance of Certification process. The goal of this PQI project was to reduce the effective radiation dose of routine chest CT imaging in a busy clinical practice by employing the iDose(4) (Philips Healthcare) iterative reconstruction technique. The dose reduction strategy was implemented in a stepwise process on a single 64-slice CT scanner with a volume of 1141 chest CT scans during the year. In the first annual quarter, a baseline effective dose was established using the standard filtered back projection (FBP) algorithm protocol and standard parameters such as kVp and mAs. The iDose(4) technique was then applied in the second and third annual quarters while keeping all other parameters unchanged. In the fourth quarter, a reduction in kVp was also implemented. Throughout the process, the images were continually evaluated to assure that the image quality was comparable to the standard protocol from multiple other scanners. Utilizing a stepwise approach, the effective radiation dose was reduced by 23.62 and 43.63 % in quarters two and four, respectively, compared to our initial standard protocol with no perceived difference in diagnostic quality. This practice quality improvement project demonstrated a significant reduction in the effective radiation dose of thoracic CT scans in a busy clinical practice.
... One solution is to create specialized supple-mentary data forms that can be distributed and completed either with every study, or frequently with a representative sample of patients. An example is a data form we utilized for a body MRI process improvement project that focused on throughput [11]. This data form, given to technologists in one location of scanners, allowed us to collect data on the time taken for individual steps undertaken during a scan. ...
... In this case, a gradual rollout to progressively more scanners may identify that some older scanners are not compatible, or that additional training of participants is needed. We have found that giving authority to ''fall back'' to established techniques (e.g., allowing technologists to switch back to an established older MRI technique if they encounter problems with a new technique) while reporting the details of such difficulties was valuable for maintaining reasonable workflow and to gain the knowledge needed to make appropriate adjustments [11]. ...
... One is to document the project's data, control charts, interventions (logs), etc., to guide future interventions. It can also be useful to calculate the financial benefits or costs of particular changes by calculating returns on investment (ROI), calculated by subtracting the cost of an investment in a particular change from the gain derived and then dividing the result by the cost from that investment [11]. This can make clear the financial benefits of various changes or conversely identify unsustainable costs. ...
Article
Full-text available
Major changes in the management and funding of healthcare are underway that will markedly change the way radiology studies will be reimbursed. The result will be the need to deliver radiology services in a highly efficient manner while maintaining quality. The science of process improvement provides a practical approach to improve the processes utilized in radiology. This article will address in a step-by-step manner how to implement process improvement techniques to improve workflow in abdominal imaging.
... Currently all manufacturers systematically provide this display. Awareness is also raised by the software's dose-recording system that allows radiologists to monitor the doses absorbed by the patients and to detect cumulated doses, sometimes substantial [38,39]. More generally, national and international dose registers are available. ...
Article
Computed tomography (CT) has become the reference technique in medical imaging for renal colic, to diagnose, plan treatment and explore differential diagnosis. Its main limitation is the radiation dose, especially as urinary stone disease tends to relapse and mainly affects young people. It is therefore essential to reduce the CT radiation dose when renal colic is suspected. The goal of this review was twofold. First, we wanted to show how to use low-dose CT in patients with suspected renal colic in current clinical practice. Second, we wished to discuss the different ways of reducing CT radiation dose by considering both behavioral and technological factors. Among the behavioral factors, limiting the scan coverage area is a straightforward and effective way to reduce the dose. Improvement of technological factors relies mainly on using automatic tube current modulation, lowering the tube voltage and current as well using iterative reconstruction.
... In designing the framework, our objective was to distill the basic elements of process improvement, including identifying and defining a problem, collecting and analyzing data, developing and implementing solutions, and assessing performance through auditing (7,8), into a practical self-contained module. ...
Article
As radiology departments continue to increase in size and complexity, the process of improving and maintaining excellent performance is becoming increasingly challenging. In response, a systematic process for efficiently implementing and sustaining measurable improvement in our radiology department has been developed, which targets focused aspects of individual performance that contribute to overall departmental quality. Projects designed to achieve such improvements have been called quality improvement and confirmation (QuIC) projects. The QuIC project process involves a project champion, medical expert, technical expert, quality improvement technologist specialist, and appropriate leaders, managers, and support personnel. The project champion conducts a preliminary investigation and organizes team members, who define the desired performance through consensus, establish data collection and analysis procedures, and prepare to launch the project. Once launched, the QuIC project process follows an execution period that is divided into four phases: (a) project launch phase, (b) support phase, (c) transition phase, and (d) maintenance phase. The first three phases focus on education, group-level feedback, and individual feedback, respectively. Weekly audits are performed to track performance improvement. Data collection, analysis, and dissemination processes are automated to the extent possible. To date, four such projects have been successfully conducted. The QuIC project concept is an attempt to apply the principles of process improvement to the process of process improvement by enabling any member of a radiology department to efficiently and reliably spearhead a quality improvement project. We consider this to be a work in progress and continue to refine the process with the goal of eventually being able to conduct many projects simultaneously.© RSNA, 2013.
Article
Objective To estimate the human resources required for a retrospective quality review of different percentages of all routine diagnostic procedures in the Department of Radiology at Bern University Hospital, Switzerland. Materials and Methods Three board-certified radiologists retrospectively evaluated the quality of the radiological reports of a total of 150 examinations (5 different examination types: abdominal CT, chest CT, mammography, conventional X-ray images and abdominal MRI). Each report was assigned a RADPEER score of 1 to 3 (score 1: concur with previous interpretation; score 2: discrepancy in interpretation/not ordinarily expected to be made; score 3: discrepancy in interpretation/should be made most of the time). The time (in seconds, s) required for each review was documented and compared. A sensitivity analysis was conducted to calculate the total workload for reviewing different percentages of the total annual reporting volume of the clinic. Results Among the total of 450 reviews analyzed, 91.1 % (410/450) were assigned a score of 1 and 8.9 % (40/450) were assigned scores of 2 or 3. The average time (in seconds) required for a peer review was 60.4 s (min. 5 s, max. 245 s). The reviewer with the greatest clinical experience needed significantly less time for reviewing the reports than the two reviewers with less clinical expertise (p < 0.05). Average review times were longer for discrepant ratings with a score of 2 or 3 (p < 0.05). The total time requirement calculated for reviewing all 5 types of examination for one year would be more than 1200 working hours. Conclusion A retrospective peer review of reports of radiological examinations using the RADPEER system requires considerable human resources. However, to improve quality, it seems feasible to peer review at least a portion of the total yearly reporting volume. Key Points: Citation Format