Advancing the application and evaluation of large language models in health and biomedicine.
Author(s): Bakken, Suzanne
DOI: 10.1093/jamia/ocaf043
Author(s): Bakken, Suzanne
DOI: 10.1093/jamia/ocaf043
The Safety Assurance Factors for Electronic Health Record (EHR) Resilience (SAFER) Guides provide recommendations to healthcare organizations for conducting proactive self-assessments of the safety and effectiveness of their EHR implementation and use. Originally released in 2014, they were last updated in 2016. In 2022, the Centers for Medicare and Medicaid Services required their annual attestation by US hospitals.
Author(s): Sittig, Dean F, Flanagan, Trisha, Sengstack, Patricia, Cholankeril, Rosann T, Ehsan, Sara, Heidemann, Amanda, Murphy, Daniel R, Salmasian, Hojjat, Adelman, Jason S, Singh, Hardeep
DOI: 10.1093/jamia/ocaf018
Large language models (LLMs) are increasingly utilized in healthcare, transforming medical practice through advanced language processing capabilities. However, the evaluation of LLMs predominantly relies on human qualitative assessment, which is time-consuming, resource-intensive, and may be subject to variability and bias. There is a pressing need for quantitative metrics to enable scalable, objective, and efficient evaluation.
Author(s): Hong, Chuan, Chowdhury, Anand, Sorrentino, Anthony D, Wang, Haoyuan, Agrawal, Monica, Bedoya, Armando, Bessias, Sophia, Economou-Zavlanos, Nicoleta J, Wong, Ian, Pean, Christian, Li, Fan, Pollak, Kathryn I, Poon, Eric G, Pencina, Michael J
DOI: 10.1093/jamia/ocaf023
We developed and validated a large language model (LLM)-assisted system for conducting systematic literature reviews in health technology assessment (HTA) submissions.
Author(s): Li, Ying, Datta, Surabhi, Rastegar-Mojarad, Majid, Lee, Kyeryoung, Paek, Hunki, Glasgow, Julie, Liston, Chris, He, Long, Wang, Xiaoyan, Xu, Yingxin
DOI: 10.1093/jamia/ocaf030
The vast and complex nature of human genomic sequencing data presents challenges for effective analysis. This review aims to investigate the application of natural language processing (NLP) techniques, particularly large language models (LLMs) and transformer architectures, in deciphering genomic codes, focusing on tokenization, transformer models, and regulatory annotation prediction. The goal of this review is to assess data and model accessibility in the most recent literature, gaining a better understanding [...]
Author(s): Cheng, Shuyan, Wei, Yishu, Zhou, Yiliang, Xu, Zihan, Wright, Drew N, Liu, Jinze, Peng, Yifan
DOI: 10.1093/jamia/ocaf029
Accurate, complete allergy histories are critical for decision-making and medication prescription. However, allergy information is often spread across the electronic health record (EHR); thus, allergy lists are often inaccurate or incomplete. Discrepant allergy information can lead to suboptimal or unsafe clinical care and contribute to alert fatigue. We developed an allergy reconciliation module within Mass General Brigham (MGB)'s EHR to support accurate and intuitive reconciliation of discrepancies in the allergy [...]
Author(s): Blackley, Suzanne V, Lo, Ying-Chih, Varghese, Sheril, Chang, Frank Y, James, Oliver D, Seger, Diane L, Blumenthal, Kimberly G, Goss, Foster R, Zhou, Li
DOI: 10.1093/jamia/ocaf022
Modernizing and strengthening the US public health data and information infrastructure requires a strong public health informatics (PHI) workforce. The study objectives were to characterize existing PHI specialists and assess informatics-related training needs.
Author(s): Rajamani, Sripriya, Leider, Jonathon P, Gunashekar, Divya Rupini, Dixon, Brian E
DOI: 10.1093/jamia/ocaf019
Digital health research involves collecting vast amounts of personal health data, making data management practices complex and challenging to convey during informed consent.
Author(s): McInnis, Brian J, Pindus, Ramona, Kareem, Daniah H, Cakici, Julie, Vital, Daniela G, Hekler, Eric, Nebeker, Camille
DOI: 10.1093/jamia/ocaf004
To assess the prevalence of recommended design elements in implemented electronic health record (EHR) interruptive alerts across pediatric care settings.
Author(s): Kandaswamy, Swaminathan, Yarahuan, Julia K W, Dobler, Elizabeth A, Molloy, Matthew J, Knake, Lindsey A, Hernandez, Sean M, Fallon, Anne A, Hess, Lauren M, McCoy, Allison B, Fortunov, Regine M, Kirkendall, Eric S, Muthu, Naveen, Orenstein, Evan W, Dziorny, Adam C, Chaparro, Juan D
DOI: 10.1093/jamia/ocaf013
With the global population aging and advancements in the medical system, long-term care in healthcare institutions and home settings has become essential for older adults with disabilities. However, the diverse and scattered care requirements of these individuals make developing effective long-term care plans heavily reliant on professional nursing staff, and even experienced caregivers may make mistakes or face confusion during the care plan development process. Consequently, there is a rigid [...]
Author(s): Miao, Chunlong, Luo, Jingjing, Liang, Yan, Liang, Hong, Cen, Yuhui, Guo, Shijie, Yu, Hongliu
DOI: 10.1093/jamia/ocae327