Weon Jung's research while affiliated with Samsung Medical Center and other places

A knowledgebase (KB) transition of a clinical decision support (CDS) system occurred at the study site. The transition was made from one commercial database to another, provided by a different vendor. The change was applied to all medications in the institute. The aim of this study was to analyze the effect of KB transition on medication-related orders and alert patterns in an emergency department (ED). Data of patients, medication-related orders and alerts, and physicians in the ED from January 2018 to December 2020 were analyzed in this study. A set of definitions was set to define orders, alerts, and alert overrides. Changes in order and alert patterns before and after the conversion, which took place in May 2019, were assessed. Overall, 101,450 patients visited the ED, and 1325 physicians made 829,474 prescription orders to patients during visit and at discharge. Alert rates (alert count divided by order count) for periods A and B were 12.6% and 14.1%, and override rates (alert override count divided by alert count) were 60.8% and 67.4%, respectively. Of the 296 drugs that were used more than 100 times during each period, 64.5% of the drugs had an increase in alert rate after the transition. Changes in alert rates were tested using chi-squared test and Fisher’s exact test. We found that the CDS system knowledgebase transition was associated with a significant change in alert patterns at the medication level in the ED. Careful consideration is advised when such a transition is performed.

To save time during transport, where resuscitation quality can degrade in a moving ambulance, it would be prudent to continue the resuscitation on scene if there is a high likelihood of ROSC occurring at the scene. We developed the pre-hospital real-time cardiac arrest outcome prediction (PReCAP) model to predict ROSC at the scene using prehospital input variables with time-adaptive cohort. The patient survival at discharge from the emergency department (ED), the 30-day survival rate, and the final Cerebral Performance Category (CPC) were secondary prediction outcomes in this study. The Pan-Asian Resuscitation Outcome Study (PAROS) database, which includes out-of-hospital cardiac arrest (OHCA) patients transferred by emergency medical service in Asia between 2009 and 2018, was utilized for this study. From the variables available in the PAROS database, we selected relevant variables to predict OHCA outcomes. Light gradient-boosting machine (LightGBM) was used to build the PReCAP model. Between 2009 and 2018, 157,654 patients in the PAROS database were enrolled in our study. In terms of prediction of ROSC on scene, the PReCAP had an AUROC score between 0.85 and 0.87. The PReCAP had an AUROC score between 0.91 and 0.93 for predicting survived to discharge from ED, and an AUROC score between 0.80 and 0.86 for predicting the 30-day survival. The PReCAP predicted CPC with an AUROC score ranging from 0.84 to 0.91. The feature importance differed with time in the PReCAP model prediction of ROSC on scene. Using the PAROS database, PReCAP predicted ROSC on scene, survival to discharge from ED, 30-day survival, and CPC for each minute with an AUROC score ranging from 0.8 to 0.93. As this model used a multi-national database, it might be applicable for a variety of environments and populations.

Objective/introduction: Sequential vital-sign information and trends in vital signs are useful for predicting changes in patient state. This study aims to predict latent shock by observing sequential changes in patient vital signs. Methods: The dataset for this retrospective study contained a total of 93,194 emergency department (ED) visits from January 1, 2016, and December 31, 2020, and Medical Information Mart for Intensive Care (MIMIC)-IV-ED data. We further divided the data into training and validation datasets by random sampling without replacement at a 7:3 ratio. We carried out external validation with MIMIC-IV-ED. Our prediction model included logistic regression (LR), random forest (RF) classifier, a multi-layer perceptron (MLP), and a recurrent neural network (RNN). To analyze the model performance, we used area under the receiver operating characteristic curve (AUROC). Results: Data of 89,250 visits of patients who met pre-specified criteria were used to develop a latent-shock prediction model. Data of 142,250 patient visits from MIMIC-IV-ED satisfying the same inclusion criteria were used for external validation of the prediction model. The AUROC values of prediction for latent shock were 0.822, 0.841, 0.852, and 0.830 with RNN, MLP, RF, and LR methods, respectively, at 3 h before latent shock. This is higher than the shock index or adjusted shock index. Conclusion: We developed a latent shock prediction model based on 24 hours of vital-sign sequence that changed with time and predicted the results by individual.

Introduction Post-donation renal outcomes are a crucial issue for living kidney donors considering young donors’ high life expectancy and elderly donors’ comorbidities that affect kidney function. We developed a prediction model for renal adaptation after living kidney donation using interpretable machine learning. Methods The study included 823 living kidney donors who underwent nephrectomy in 2009–2020. AutoScore, a machine learning-based score generator, was used to develop a prediction model. Fair and good renal adaptation were defined as post-donation estimated glomerular filtration rate (eGFR) of ≥ 60 mL/min/1.73 m ² and ≥ 65% of the pre-donation values, respectively. Results The mean age was 45.2 years; 51.6% were female. The model included pre-donation demographic and laboratory variables, GFR measured by diethylenetriamine pentaacetate scan, and computed tomography kidney volume/body weight of both kidneys and the remaining kidney. The areas under the receiver operating characteristic curve were 0.846 (95% confidence interval, 0.762–0.930) and 0.626 (0.541–0.712), while the areas under the precision-recall curve were 0.965 (0.944–0.978) and 0.709 (0.647–0.788) for fair and good renal adaptation, respectively. An interactive clinical decision support system was developed. ¹ Conclusion The prediction tool for post-donation renal adaptation showed good predictive capability and may help clinical decisions through an easy-to-use web-based application.

Background In South Korea, after the spread of the Middle East Respiratory Syndrome epidemic was aggravated by long stays in crowded emergency departments (EDs), a 24-hour target policy for EDs was introduced to prevent crowding and reduce patients' length of stay (LOS). The policy requires at least 95% of all patients to be admitted, discharged or transferred from an ED within 24 hours of arrival. This study analyzes the effects of the 24-hour target policy on ED LOS and compliance rates and describes the consequences of the policy. Methods A mixed-methods approach was applied to a retrospective observational study of ED visits combined with a survey of medical professionals. The primary measure was ED LOS, and the secondary measure was policy compliance rate which refers to the proportion of patient visits with a LOS shorter than 24 hours. Patient flow, quality of care, patient safety, staff workload, and staff satisfaction were also investigated through surveys. Mann–Whitney U and χ2 tests were used to compare variables before and after the introduction of the policy. Results The median ED LOS increased from 3.9 hours (interquartile range [IQR] = 2.1–7.6) to 4.5 hours (IQR = 2.5–8.5) after the policy was introduced. This was likely influenced by the average monthly number of patients, which greatly increased from 4819 (SD = 340) to 5870 (SD = 462) during the same period. The proportion of patients with ED LOS greater than 24 hours remained below5% only after 6 months of policy implementation, but the number of patients whose disposition was decided at 23 hours increased by 4.84 times. Survey results suggested that patient flow and quality of care improved slightly, while the workload of medical staff worsened. Conclusions After implementing the 24-hour target policy, the proportion of patients whose ED LOS exceeded 24 hours decreased, even though the median ED LOS increased. However, the unintended consequences of the policy were observed such as increased medical professional workload and abrupt expulsion of patients before 24 hours.

The study aims to measure the effectiveness of an AI-based traumatic intracranial hemorrhage prediction model in the decisions of emergency physicians regarding ordering head computed tomography (CT) scans. We developed a deep-learning model for predicting traumatic intracranial hemorrhages (DEEPTICH) using a national trauma registry with 1.8 million cases. For simulation, 24 cases were selected from previous emergency department cases. For each case, physicians made decisions on ordering a head CT twice: initially without the DEEPTICH assistance, and subsequently with the DEEPTICH assistance. Of the 528 responses from 22 participants, 201 initial decisions were different from the DEEPTICH recommendations. Of these 201 initial decisions, 94 were changed after DEEPTICH assistance (46.8%). For the cases in which CT was initially not ordered, 71.4% of the decisions were changed (p < 0.001), and for the cases in which CT was initially ordered, 37.2% (p < 0.001) of the decisions were changed after DEEPTICH assistance. When using DEEPTICH, 46 (11.6%) unnecessary CTs were avoided (p < 0.001) and 10 (11.4%) traumatic intracranial hemorrhages (ICHs) that would have been otherwise missed were found (p = 0.039). We found that emergency physicians were likely to accept AI based on how they perceived its safety.

Objective A knowledgebase (KB) transition of a clinical decision support (CDS) system occurred at the study site. The transition was made from one commercial database to another, provided by a different vendor. The change was applied to all medications in the institute. The aim of this study was to analyze the effect of KB transition on medication-related orders and alert patterns in an emergency department (ED). Methods Data of patients, medication-related orders and alerts, and physicians in the ED from January 2018 to December 2020 were analyzed in this study. A set of definitions was set to define orders, alerts, and alert overrides. Changes in order and alert patterns before and after the conversion, which took place in May 2019, were assessed. Results Overall, 101,450 patients visited the ED, and 1,325 physicians made 829,474 prescription orders. Alert rates (alert count divided by order count) for periods A and B were 12.6% and 14.1%, and override rates (alert override count divided by alert count) were 60.8% and 67.4%, respectively. Of the 296 drugs that were used more than 100 times during each period, 64.5% of the drugs had an increase in alert rate after the transition. Changes in alert rates were tested using chi-squared test and Fisher’s exact test. Conclusion We found that the CDS KB transition was associated with a significant change in alert patterns at the medication level in the ED. Careful consideration is advised when such a transition is performed.