Context.— Title 45, section 164.524 of the Code of Federal Regulations states that health care systems must provide patient health records upon that patient’s request. For complex testing, such as next-generation sequencing (NGS), this raises questions related to what data should be released and the laboratory considerations regarding the release of this data. Objective.— To describe the laboratory implications of releasing different NGS data files and the limitations for the clinical use of different NGS data files. Design.— The College of American Pathologists workgroup, composed of laboratorians with expertise regarding NGS testing, reviewed pertinent literature, including title 45, section 164.524, and the Health and Human Services “Guidance on Individuals’ Right to Access Health Information.” Results.— From an accreditation standpoint, validation of NGS includes both the wet bench and data processing (bioinformatics) portions, and appropriately validated laboratory testing is required to ensure quality patient results. NGS testing generates intermediate data files that have not completed the fully validated process but are often kept by the laboratory. These files may be requested by patients, but most patients will not be aware of the test validation process and the limitations of data that have not gone through a fully validated process. Conclusions.— Laboratories should encourage patients to receive their health data and to help individuals understand the content, uses, and limitations of laboratory data they have requested or received. NGS data used in a nonvalidated manner should not be used for clinical purposes without confirmation by a clinically validated method.
RNA Sequencing for Solid Tumor Fusion Gene Detection: Proficiency Testing Practice and Performance Comparison
Context Next-generation sequencing–based approaches using RNA have increasingly been used by clinical laboratories for the detection of fusion genes, intragenic rearrangements, and exon-skipping events. Correspondingly, the College of American Pathologists (CAP) has advanced RNA sequencing proficiency testing (PT) to ensure optimal performance of these assays. Objective To report on laboratory performance and practices of RNA sequencing for the detection of fusion genes, intragenic rearrangements, and exon-skipping events using CAP PT data from 8 mailings (2018-A through 2021-B). Design CAP PT RNA sequencing program results from 153 laboratories across 24 proficiency test specimens, interrogating 22 distinct engineered fusion transcripts, were analyzed for correct identification of the fusion event, associated performance variables, and laboratory practices. Results Overall, the 4-year program detection rate (sensitivity) was 95.5% (1486 of 1556 results). False-negative rates were 3.6% (53 of 1463) and 18.3% (17 of 93) for fusion gene and intragenic rearrangement/exon-skipping events, respectively. Only 19 false-positive results were reported among the 8 PT mailings, and most were likely the result of preanalytical or postanalytical errors. There were no practice characteristics (eg, instrumentation, sequencing method) significantly associated with the fusion detection results. Conclusions These data reveal a high overall sensitivity and specificity for fusion gene detection by participating laboratories using clinical RNA sequencing. Performance was comparable across all laboratories, regardless of methodology. The fraction of false-negative results for intragenic rearrangement/exon-skipping events was greater than that for the chimeric fusion genes. False-negative results could not be attributed to any specific practice characteristics.
Clinical Testing for Tumor Cell-Free DNA: College of American Pathologists Proficiency Programs Reveal Practice Trends
Context.— Clinical testing for tumor cell-free DNA (cfDNA) has evolved rapidly, but no practice guidelines exist. Objective.— To summarize cfDNA laboratory practices based on self-reporting and assess preanalytical, analytical, and postanalytical trends that may influence the quality, accuracy, and consistency of cfDNA testing. Design.— Data were derived from the College of American Pathologists cfDNA proficiency testing program submitted by 101 participating laboratories from 2018 to 2019. Results.— Most laboratories performing clinical circulating tumor DNA testing are commercial/nonhospital (71.2%; 72 of 101) and international (77.2%; 78 of 101) laboratories. Commercial laboratories had higher monthly test volumes than hospital-based laboratories (median, 36 versus 7–8) and tended to have larger gene panels (median, 50 versus 11 genes) when panel-based testing was offered. The main clinical indications include therapy selection and treatment/disease monitoring. Plasma is the most commonly accepted specimen, which is predominantly collected in cell-stabilizing tubes. Equal proportions of laboratories use next-generation sequencing (NGS) and non-NGS methods to assess key genes, including EGFR, BRAF, KRAS, NRAS, and IDH1. Most laboratories reported a lower limit of detection (LLOD) of 0.5%, variant allele frequency or less, which did not differ by method, NGS or non-NGS, except for EGFR. Sixty-five percent (17 of 26) of laboratories using the US Food and Drug Administration (FDA)-approved non-NGS EGFR assay report analytical sensitivities higher than 0.5%, as compared to 15% (16 of 104) of laboratories using an alternative NGS or non-NGS method. There is also a wider range in LLODs obtained for the FDA-approved EGFR assay than nonapproved assays. Conclusions.— These results highlight emerging practice trends and serve as a foundation to initiate future practice recommendations.
Performance of cell-free tumor DNA testing for 101 clinical laboratories on College of American Pathologists proficiency tests.
e13681 Background: Cell-free tumor DNA or circulating tumor DNA tests are increasingly used in clinical care to detect somatic mutations from solid tumors. However, data on laboratory performance characteristics using standardized samples is limited. Methods: Well-characterized reference materials were used for the College of American Pathologists (CAP) cell-free tumor DNA proficiency testing surveys, which consisted of stabilized DNA fragmented to simulate cell-free DNA in a synthetic plasma matrix. For the 2018A, 2018B, 2019A and 2019B surveys, laboratories tested for hotspot mutations (single and dinucleotide sequence changes) in EGFR, BRAF, KRAS, NRAS, and IDH1 at variant allele fractions ranging from 0.1% - 1.0%. As per CAP proficiency testing standards, results were scored according to the known mutation(s) engineered at designated variant allele fractions in each PT sample. Nine laboratories were excluded from analysis because they provided incomplete results. Statistical significance was calculated using a multivariate logistic regression model. Results: In 2018 and 2019, 101 laboratories submitted survey results for at least one proficiency testing mailing. There were 5088 total proficiency testing responses for EGFR, BRAF, KRAS, NRAS, and IDH1 mutations across 12 different samples. For the 3585 responses submitted for BRAF, KRAS, NRAS, and IDH1, sensitivity ranged from 94.6 – 100%, while specificity exceeded 99%. There were no significant differences in performance between analytical methodologies for BRAF, KRAS, NRAS, and IDH1 mutations. Performance characteristics for EGFR mutations among the 1503 responses showed a combined sensitivity of 87.1% and specificity of 98.7%. For laboratories detecting mutations in EGFR, next-generation sequencing methods exhibited a sensitivity (true positivity) of 95.7% while the sensitivity of non-NGS methods was lower at 81.7% ( P= 0.02). Conclusions: These findings demonstrate high sensitivity and specificity for clinical laboratories performing cell-free tumor DNA tests. For EGFR mutations, NGS outperformed non-NGS methods. These data suggest excellent overall agreement among laboratories performing clinical cell-free tumor DNA tests. Further investigation across variant allele fractions and additional variant types is warranted.
Comparative Performance of Breast Cancer Human Epidermal Growth Factor Receptor 2 Fluorescence In Situ Hybridization and Brightfield In Situ Hybridization on College of American Pathologists Proficiency Tests
Context.— Fluorescence in situ hybridization (FISH) and brightfield in situ hybridization (ISH) are 2 clinically approved laboratory methods for detecting ERBB2 (HER2) amplification in breast cancer. Objective.— To compare the performance of FISH and brightfield ISH on proficiency testing administered by the College of American Pathologists Laboratory Accreditation Program. Design.— Retrospective review was performed on 70 tissue core samples in 7 separate proficiency testing surveys conducted between 2009 and 2013. Results.— The samples included 13 consensus-amplified tissue cores, 53 consensus-nonamplified cores, and 4 cores that did not reach consensus for FISH and/or brightfield ISH. There were 2552 individual responses for FISH and 1871 individual responses for brightfield ISH. Consensus response rates were comparable for FISH (2474 of 2524; 98.0%) and brightfield ISH (2135 of 2189; 97.5%). The FISH analysis yielded an average HER2 copy number per cell that was significantly higher (by 2.86; P = .02) compared with brightfield ISH for amplified cores. For nonamplified cores, FISH yielded slightly, but not significantly, higher (by 0.17; P = .10) HER2 copy numbers per cell. There was no significant difference in the average HER2 to control ratio for either consensus-amplified or consensus-nonamplified cores. Participants reported “unable to analyze” more frequently for brightfield ISH (244 of 2453; 9.9%) than they did for FISH (160 of 2684; 6.0%). Conclusions.— Our study indicates a high concordance rate in proficiency testing surveys, with some significant differences noted in the technical performance of these assays. In borderline cases, updated American Society of Clinical Oncology/College of American Pathologists cutoff thresholds that place greater emphasis on HER2 copy number per cell could accentuate those differences between FISH and brightfield ISH.