How DISCERNing is ChatGPT? An Evaluation of Models and Prompt Engineering in Assessing Patient Education Materials.
The objective of this study is to evaluate whether ChatGPT models can reliably apply the DISCERN instrument, a 16-question human-scored rubric developed in 1999 to evaluate consumer health information, and assess the impact of prompting strategies, model choice, and scoring repeatability on agreement with human-derived DISCERN scores.
Author(s): Blackman, Justin, Friesen, Danica, Sikkel, Markus Bernardus, Veerapen, Richard
DOI: 10.1055/a-2853-8892