Evaluating the impact of pre-annotation on annotation speed and potential bias: natural language processing gold standard development for clinical named entity recognition in clinical trial announcements.
To present a series of experiments: (1) to evaluate the impact of pre-annotation on the speed of manual annotation of clinical trial announcements; and (2) to test for potential bias, if pre-annotation is utilized.
Author(s): Lingren, Todd, Deleger, Louise, Molnar, Katalin, Zhai, Haijun, Meinzen-Derr, Jareen, Kaiser, Megan, Stoutenborough, Laura, Li, Qi, Solti, Imre
DOI: 10.1136/amiajnl-2013-001837