Clinically relevant pretraining is all you need.
Clinical notes present a wealth of information for applications in the clinical domain, but heterogeneity across clinical institutions and settings presents challenges for their processing. The clinical natural language processing field has made strides in overcoming domain heterogeneity, while pretrained deep learning models present opportunities to transfer knowledge from one task to another. Pretrained models have performed well when transferred to new tasks; however, it is not well understood if [...]
Author(s): Bear Don't Walk Iv, Oliver J, Sun, Tony, Perotte, Adler, Elhadad, Noémie
DOI: 10.1093/jamia/ocab086