TREC-COVID: rationale and structure of an information retrieval shared task for COVID-19.
TREC-COVID is an information retrieval (IR) shared task initiated to support clinicians and clinical research during the COVID-19 pandemic. IR for pandemics breaks many normal assumptions, which can be seen by examining 9 important basic IR research questions related to pandemic situations. TREC-COVID differs from traditional IR shared task evaluations with special considerations for the expected users, IR modality considerations, topic development, participant requirements, assessment process, relevance criteria, evaluation metrics [...]
Author(s): Roberts, Kirk, Alam, Tasmeer, Bedrick, Steven, Demner-Fushman, Dina, Lo, Kyle, Soboroff, Ian, Voorhees, Ellen, Wang, Lucy Lu, Hersh, William R
DOI: 10.1093/jamia/ocaa091