Image‐based multiplex immune profiling of cancer tissues: translational implications. A report of the International Immuno‐oncology Biomarker Working Group on Breast Cancer
Spatial analyses of immune cell infiltration in cancer: current methods and future directions: A report of the International Immuno‐Oncology Biomarker Working Group on Breast Cancer
Pitfalls in machine learning‐based assessment of tumor‐infiltrating lymphocytes in breast cancer: A report of the International Immuno‐Oncology Biomarker Working Group on Breast Cancer
An open natural language processing (NLP) framework for EHR-based clinical research: a case demonstration using the National COVID Cohort Collaborative (N3C)
Abstract Despite recent methodology advancements in clinical natural language processing (NLP), the adoption of clinical NLP models within the translational research community remains hindered by process heterogeneity and human factor variations. Concurrently, these factors also dramatically increase the difficulty in developing NLP models in multi-site settings, which is necessary for algorithm robustness and generalizability. Here, we reported on our experience developing an NLP solution for Coronavirus Disease 2019 (COVID-19) signs and symptom extraction in an open NLP framework from a subset of sites participating in the National COVID Cohort (N3C). We then empirically highlight the benefits of multi-site data for both symbolic and statistical methods, as well as highlight the need for federated annotation and evaluation to resolve several pitfalls encountered in the course of these efforts.