Improved evaluation frameworks are required to move application of LLMs from research into clinical practice.
Author(s): Bakken, Suzanne
DOI: 10.1093/jamia/ocag016
Author(s): Bakken, Suzanne
DOI: 10.1093/jamia/ocag016
Federal healthcare legislation has played a central role in shaping the digital transformation of U.S. healthcare. Key legislative milestones-including the Health Security Act of 1993, the Health Insurance Portability and Accountability Act (HIPAA), the Health Information Technology for Economic and Clinical Health (HITECH) Act, the Patient Protection and Affordable Care Act (ACA), and the 21st Century Cures Act-collectively accelerated the adoption of electronic health records (EHRs), promoted interoperability, and expanded [...]
Author(s): Mani, Kyle A, Nandal, Sanjna, Scharfenberger, Thomas, Veldhuis, Meghana, Tang, Kevin, Gad, Bishoy, Jariwala, Sunit P
DOI: 10.1055/a-2830-2591
People with physical disabilities are one of the largest subgroups of people with disabilities, and this group experiences significant health disparities. Given the risk of preventable multimorbidity among this group, there is an opportunity to improve primary care for this population.The goal of this study was to use a clinical decision support (CDS) tool to improve preventive screenings in primary care for people with physical disabilities.We used a convergent mixed [...]
Author(s): James, Tyler G, Kellampalli, Suhas, Palazzolo, Beatrice, Carbone, Lorrie, Heizelman, Robert, Mahmoudi, Elham, McKee, Michael M
DOI: 10.1055/a-2830-2528
In recent years, there has been an emerging wave of artificial intelligence (AI) and digital tools in healthcare, thereby revolutionizing clinical practice. As health systems are increasingly utilizing these tools as a means to improve clinical and operational performance outcomes, it becomes imperative to train and professionally develop key frontline stakeholders, such as clinicians, in digital health and clinical AI to ensure seamless and responsible adoption within healthcare settings.This paper [...]
Author(s): Patel, Milin, Scharfenberger, Thomas, Mashieh, Jonathan, Arora, Shitij, Jariwala, Sunit P
DOI: 10.1055/a-2828-0479
Clinical informatics (CI) fellowship training equips physicians to design, implement, and evaluate health information systems in support of patient care. While core curricula emphasize academic health system experiences, fellows may benefit from exposure to industry settings where much health technology innovation originates.This study aimed to characterize the structure, perceived value, and logistical challenges of industry electives among CI fellowship programs and to synthesize best practices for integrating these experiences into [...]
Author(s): Genes, Nicholas, Solanki, Priyanka, Kannry, Joseph, Khanna, Raman, Mize, Dara, Lingam, Veena, Turer, Robert W, Leu, Michael G
DOI: 10.1055/a-2820-3029
This study aimed to explore the performance of ChatGPT version 4.0 (GPT-4) and Gemini Advanced (Gemini) large language models (LLMs) in addressing common patient questions after gynecology surgery with regards to accuracy, relevance, helpfulness to the average patient, and readability.In this cross-sectional study, the two LLMs were prompted to generate answers to postoperative patient questions after gynecologic surgery. Postoperative patient questions were developed to simulate common patient questions after gynecologic [...]
Author(s): Voigt, Petra C, Sharma, Rhea S, Chaudhari, Angela, Tsai, Susan, Milad, Magdy P, Yang, Linda C
DOI: 10.1055/a-2818-1611
This scoping review aimed to (1) map current applications of transformers and large language models (LLMs) for extracting social drivers of health (SDOH) from clinical text, (2) benchmark model performance across SDOH domains, and (3) evaluate methodological rigor to identify research gaps and inform clinical deployment.
Author(s): Farrag, Ahmed, Soliman, Ahmed, Hatef, Elham, Goodin, Amie, Rouhizadeh, Masoud
DOI: 10.1093/jamia/ocaf201
Author(s): Cheng, Weihao
DOI: 10.1093/jamia/ocaf236
Accurate phenotyping is an essential task for researchers utilizing electronic health record (EHR)-linked biobank programs like the All of Us Research Program to study human genetics. However, little guidance is available on how to select an EHR-based phenotyping procedure that maximizes downstream statistical power. This study aims to estimate accuracy of three phenotype definitions of ovarian, female breast, and colorectal cancers in All of Us (v7 release) and determine which [...]
Author(s): Baierl, John, Hsiao, Yi-Wen, Jones, Michelle R, Peng, Pei-Chen, Pharoah, Paul D P
DOI: 10.1093/jamia/ocaf234
To characterize the nature and consequence(s) of interdependent physician electronic health record (EHR) work across inpatient shifts.
Author(s): Cross, Dori A, Weiner, Josh, Neprash, Hannah T, Melton, Genevieve B, Olson, Andrew
DOI: 10.1093/jamia/ocaf212