As large language models (LLMs) are integrated into electronic health record (EHR) workflows, validated instruments are essential to evaluate their performance before implementation and as models and documentation practices evolve. Existing instruments for provider documentation quality are often unsuitable for the complexities of LLM-generated text and lack validation on real-world data. The Provider Documentation Summarization Quality Instrument (PDSQI-9) was developed to evaluate LLM-generated clinical summaries. This study aimed to validate [...]
Author(s): Croxford, Emma, Gao, Yanjun, Pellegrino, Nicholas, Wong, Karen, Wills, Graham, First, Elliot, Schnier, Miranda, Burton, Kyle, Ebby, Cris, Gorski, Jillian, Kalscheur, Matthew, Khalil, Samy, Pisani, Marie, Rubeor, Tyler, Stetson, Peter, Liao, Frank, Goswami, Cherodeep, Patterson, Brian, Afshar, Majid
DOI: 10.1093/jamia/ocaf068