Browsing by Author "Minty, Evan"

Now showing 1 - 2 of 2
  • Thumbnail Image
    ItemOpen Access
    Development and initial implementation of electronic clinical decision supports for recognition and management of hospital-acquired acute kidney injury
    (2020-11-04) Howarth, Megan; Bhatt, Meha; Benterud, Eleanor; Wolska, Anna; Minty, Evan; Choi, Kyoo-Yoon; Devrome, Andrea; Harrison, Tyrone G; Baylis, Barry; Dixon, Elijah; Datta, Indraneel; Pannu, Neesh; James, Matthew T
    Abstract Background Acute kidney injury (AKI) is common in hospitalized patients and is associated with poor patient outcomes and high costs of care. The implementation of clinical decision support tools within electronic medical record (EMR) could improve AKI care and outcomes. While clinical decision support tools have the potential to enhance recognition and management of AKI, there is limited description in the literature of how these tools were developed and whether they meet end-user expectations. Methods We developed and evaluated the content, acceptability, and usability of electronic clinical decision support tools for AKI care. Multi-component tools were developed within a hospital EMR (Sunrise Clinical Manager™, Allscripts Healthcare Solutions Inc.) currently deployed in Calgary, Alberta, and included: AKI stage alerts, AKI adverse medication warnings, AKI clinical summary dashboard, and an AKI order set. The clinical decision support was developed for use by multiple healthcare providers at the time and point of care on general medical and surgical units. Functional and usability testing for the alerts and clinical summary dashboard was conducted via in-person evaluation sessions, interviews, and surveys of care providers. Formal user acceptance testing with clinical end-users, including physicians and nursing staff, was conducted to evaluate the AKI order set. Results Considerations for appropriate deployment of both non-disruptive and interruptive functions was important to gain acceptability by clinicians. Functional testing and usability surveys for the alerts and clinical summary dashboard indicated that the tools were operating as desired and 74% (17/23) of surveyed healthcare providers reported that these tools were easy to use and could be learned quickly. Over three-quarters of providers (18/23) reported that they would utilize the tools in their practice. Three-quarters of the participants (13/17) in user acceptance testing agreed that recommendations within the order set were useful. Overall, 88% (15/17) believed that the order set would improve the care and management of AKI patients. Conclusions Development and testing of EMR-based decision support tools for AKI with clinicians led to high acceptance by clinical end-users. Subsequent implementation within clinical environments will require end-user education and engagement in system-level initiatives to use the tools to improve care.
  • Thumbnail Image
    ItemOpen Access
    Feasibility and evaluation of a large-scale external validation approach for patient-level prediction in an international data network: validation of models predicting stroke in female patients newly diagnosed with atrial fibrillation
    (2020-05-06) Reps, Jenna M; Williams, Ross D; You, Seng C; Falconer, Thomas; Minty, Evan; Callahan, Alison; Ryan, Patrick B; Park, Rae W; Lim, Hong-Seok; Rijnbeek, Peter
    Abstract Background To demonstrate how the Observational Healthcare Data Science and Informatics (OHDSI) collaborative network and standardization can be utilized to scale-up external validation of patient-level prediction models by enabling validation across a large number of heterogeneous observational healthcare datasets. Methods Five previously published prognostic models (ATRIA, CHADS2, CHADS2VASC, Q-Stroke and Framingham) that predict future risk of stroke in patients with atrial fibrillation were replicated using the OHDSI frameworks. A network study was run that enabled the five models to be externally validated across nine observational healthcare datasets spanning three countries and five independent sites. Results The five existing models were able to be integrated into the OHDSI framework for patient-level prediction and they obtained mean c-statistics ranging between 0.57–0.63 across the 6 databases with sufficient data to predict stroke within 1 year of initial atrial fibrillation diagnosis for females with atrial fibrillation. This was comparable with existing validation studies. The validation network study was run across nine datasets within 60 days once the models were replicated. An R package for the study was published at https://github.com/OHDSI/StudyProtocolSandbox/tree/master/ExistingStrokeRiskExternalValidation. Conclusion This study demonstrates the ability to scale up external validation of patient-level prediction models using a collaboration of researchers and a data standardization that enable models to be readily shared across data sites. External validation is necessary to understand the transportability or reproducibility of a prediction model, but without collaborative approaches it can take three or more years for a model to be validated by one independent researcher. In this paper we show it is possible to both scale-up and speed-up external validation by showing how validation can be done across multiple databases in less than 2 months. We recommend that researchers developing new prediction models use the OHDSI network to externally validate their models.