Visualizing the operating range of a classification system.
The performance of a classification system depends on the context in which it will be used, including the prevalence of the classes and the relative costs of different types of errors. Metrics such as accuracy are limited to the context in which the experiment was originally carried out, and metrics such as sensitivity, specificity, and receiver operating characteristic area--while independent of prevalence--do not provide a clear picture of the performance [...]
Author(s): Hripcsak, George
DOI: 10.1136/amiajnl-2011-000633