Citations

Abstract Immune checkpoint inhibitors (ICIs) can produce durable tumor control, yet many patients experience primary or acquired resistance, mixed lesion-level responses, or immune-related adverse events. Tissue and blood biomarkers provide biologically informative but spatially incomplete views of a heterogeneous and time-varying tumor–host system. Radiologic imaging complements these assays by repeatedly measuring whole-body tumor burden, organ-specific disease patterns, lesion-level heterogeneity, and treatment-related change. This critical narrative review evaluates imaging-centered artificial intelligence (AI) for precision cancer immunotherapy, including baseline and serial CT, MRI, and PET; radiomics and learned image representations; lesion-level and whole-body heterogeneity; toxicity assessment; and integration with pathology, genomics, circulating tumor DNA, laboratory measurements, and electronic health records. Representative cohorts range from early radiogenomic studies of approximately 100–200 patients to externally validated and longitudinal models involving hundreds or thousands of patients. Rather than treating all reported performance estimates as equally actionable, we appraise the clinical question, cohort design, endpoint, validation strategy, calibration, and intended clinical action. Current evidence supports noninvasive immune phenotyping, risk stratification, longitudinal monitoring, and multimodal biomarker integration. However, most models predict outcomes among patients already receiving ICIs and therefore remain prognostic under treatment rather than predictive of differential treatment benefit. Radiotherapy (RT) combined with ICI serves as a focused imaging use case because lesion identity, dose distribution, fractionation, sequence, and thoracic and normal-tissue exposure must be linked to defined actions. Existing patient-level AI studies estimate efficacy or toxicity after treatment selection; none has prospectively shown that an AI-selected RT strategy improves patient outcomes. Translation will require patient-level leakage control, calibration, geographic and temporal validation, robustness to missing modalities, and prospective evaluation of prespecified model-guided decisions.

Abstract Background Accurate and efficient dose calculation is essential for online adaptive planning in proton therapy. Deep learning (DL) has shown promising dose prediction results for pencil beam scanning proton therapy (PBSPT) in recent years, but existing DL‐based dose prediction methods still suffer from limited generalizability and an inability to effectively handle outlier clinical cases. This may lead to inaccurate dose delivery to targets or excessive irradiation to organs at risk (OARs), thereby compromising the safety and efficacy of online adaptive proton therapy. Purpose To design a physics‐aware and generalizable AI‐based PBSPT dose prediction method that incorporates underlying physics to enhance generalizability, particularly in handling outlier clinical cases. Methods This study analyzed PBSPT plans of 103 prostate (93 for training and 10 for testing) and 78 lung cancer patients (68 for training and 10 for testing) from our institution, with each case comprising CT images and structure sets. Using the doses generated by our Monte Carlo‐based dose engine as the reference standard, we compared three methods: the region of interest (ROI)‐based method, the beam mask and sliding window method, and the proposed noisy probing dose method, which rapidly generates a low‐statistics dose via uniformly weighted spots on an expanded spot‐placement target volume without optimization. To evaluate the generalizability of these methods to rare treatment planning scenarios, 12 cases with uncommon beam angles or prescription doses were used to assess their performance, which was evaluated using dose‐volume histogram (DVH) indices, 3D Gamma passing rates (3%/2 mm/10%), and Dice coefficients for dose agreement, while prediction times were measured to gauge model efficiency. Results The proposed noisy probing dose method consistently outperformed the ROI‐based and beam mask baselines across all evaluated metrics, with more accurate dose agreement and superior generalizability. For DVH indices, the noisy probing dose method achieved the smallest deviation in clinical target volume (CTV) dose coverage: in prostate cancer, CTV D98 deviation was reduced by 45% (from 0.53 ± 0.22 Gy [RBE] for ROI‐based) and 29% (from 0.41 ± 0.28 Gy [RBE] for beam mask) to 0.29 ± 0.06 Gy [RBE]; in lung cancer, similar improvements were observed, with CTV D98 deviations reduced to 0.34 ± 0.12 Gy [RBE]. The 3D Gamma passing rates improved to 99.65% ± 1.15% for prostate targets and 97.04% ± 1.17% for lung targets. The dice coefficients of the 90% iso‐dose lines were also the highest with the noisy probing dose method (prostate: 0.983 ± 0.005; lung: 0.967 ± 0.01). For the 12 outlier cases, the noisy probing dose method maintained superior generalizability, yielding higher 3D Gamma passing rates (prostate targets: 96.79% ± 0.83%, OARs: 94.29% ± 1.01%; lung targets: 93.38% ± 1.34%, OARs: 93.95% ± 1.32%), demonstrating robust generalizability to rare clinical scenarios. The dose predictions for all testing cases were completed within 0.3 seconds. Conclusions A novel noisy probing dose method was proposed for PBSPT dose prediction in prostate and lung cancer patients. By embedding more proton‐specific physics, this method demonstrated an improvement in the generalizability of dose prediction.

Abstract With the rapid advancements in large language model technology and the emergence of bioinformatics‐specific language models (BioLMs), there is a growing need for a comprehensive analysis of the current landscape, computational characteristics, and diverse applications. This survey aims to address this need by providing a thorough review of BioLMs, focusing on their evolution, classification, and distinguishing features, alongside a detailed examination of training methodologies, datasets, and evaluation frameworks. We explore the wide‐ranging applications of BioLMs in critical areas such as disease diagnosis, drug discovery, and vaccine development, highlighting their impact and transformative potential in bioinformatics. We identify key challenges and limitations inherent in BioLMs, including data privacy and security concerns, interpretability issues, biases in training data and model outputs, and domain adaptation complexities. Finally, we highlight emerging trends and future directions, offering valuable insights to guide researchers and clinicians toward advancing BioLMs for increasingly sophisticated biological and clinical applications.

Abstract Background The radiation oncology clinical practice involves many steps relying on the dynamic interplay of abundant text data. Large language models have displayed remarkable capabilities in processing complex text information. But their direct applications in specific fields like radiation oncology remain underexplored. Purpose This study aims to investigate whether fine‐tuning LLMs with domain knowledge can improve the performance on Task (1) treatment regimen generation, Task (2) treatment modality selection (photon, proton, electron, or brachytherapy), and Task (3) ICD‐10 code prediction in radiation oncology. Methods Data for 15 724 patient cases were extracted. Cases where patients had a single diagnostic record, and a clearly identifiable primary treatment plan were selected for preprocessing and manual annotation to have 7903 cases of the patient diagnosis, treatment plan, treatment modality, and ICD‐10 code. Each case was used to construct a pair consisting of patient diagnostics details and an answer (treatment regimen, treatment modality, or ICD‐10 code, respectively) for the supervised fine‐tuning of these three tasks. Open source LLaMA2‐7B and Mistral‐7B models were utilized for the fine‐tuning with the Low‐Rank Approximations method. Accuracy and ROUGE‐1 score were reported for the fine‐tuned models and original models. Clinical evaluation was performed on Task (1) by radiation oncologists, while precision, recall, and F‐1 score were evaluated for Task (2) and (3). One‐sided Wilcoxon signed‐rank tests were used to statistically analyze the results. Results Fine‐tuned LLMs outperformed original LLMs across all tasks with p value ≤ 0.001. Clinical evaluation demonstrated that over 60% of the fine‐tuned LLMs‐generated treatment regimens were clinically acceptable. Precision, recall, and F1‐score showed improved performance of fine‐tuned LLMs. Conclusion Fine‐tuned LLMs demonstrated statistically significant improvements over original LLMs upon three clinically important tasks in radiation oncology. This study explored the feasibility of applying fine‐tuned LLMs in radiation oncology, inspiring further development of utilizing LLMs to assist with radiation oncology tasks.

Purpose: This study compares the performance of small, fine-tuned LLMs with the large original models on two radiation oncology clinical tasks: treatment modality selection and ICD-10 code prediction. Methods: We used data of 403 treatment modality selection cases and 377 ICD-10 code prediction cases. The models used were fine-tuned LLaMA 2 7B and Mistral 7B, as well as the larger LLaMA 3.1 70B and 405B models for comparison. We evaluated the accuracy of all models on these two tasks. Results: Both fine-tuned LLaMA 2 7B and Mistral 7B outperformed LLaMA 3.1 70B and 405B in treatment modality selection task. The fine-tuned LLaMA 2 7B and Mistral 7B models achieved accuracy comparable to the larger models in ICD-10 code prediction. Conclusions: Small models, fine-tuned with radiation oncology data, can achieve performance comparable to-or even surpass-that of larger models.

Abstract Background Efficient and accurate delineation of organs at risk (OARs) is a critical procedure for treatment planning and dose evaluation. Deep learning‐based auto‐segmentation of OARs has shown promising results and is increasingly being used in radiation therapy. However, existing deep learning‐based auto‐segmentation approaches face two challenges in clinical practice: generalizability and human‐AI interaction. A generalizable and promptable auto‐segmentation model, which segments OARs of multiple disease sites simultaneously and supports on‐the‐fly human‐AI interaction, can significantly enhance the efficiency of radiation therapy treatment planning. Purpose Meta's segment anything model (SAM) was proposed as a generalizable and promptable model for next‐generation natural image segmentation. We further evaluated the performance of SAM in radiotherapy segmentation. Methods Computed tomography (CT) images of clinical cases from four disease sites at our institute were collected: prostate, lung, gastrointestinal, and head & neck. For each case, we selected the OARs important in radiotherapy treatment planning. We then compared both the Dice coefficients and Jaccard indices derived from three distinct methods: manual delineation (ground truth), automatic segmentation using SAM's ’segment anything’ mode, and automatic segmentation using SAM's ‘box prompt’ mode that implements manual interaction via live prompts during segmentation. Results Our results indicate that SAM's segment anything mode can achieve clinically acceptable segmentation results in most OARs with Dice scores higher than 0.7. SAM's box prompt mode further improves Dice scores by 0.1∼0.5. Similar results were observed for Jaccard indices. The results show that SAM performs better for prostate and lung, but worse for gastrointestinal and head & neck. When considering the size of organs and the distinctiveness of their boundaries, SAM shows better performance for large organs with distinct boundaries, such as lung and liver, and worse for smaller organs with less distinct boundaries, like parotid and cochlea. Conclusions Our results demonstrate SAM's robust generalizability with consistent accuracy in automatic segmentation for radiotherapy. Furthermore, the advanced box‐prompt method enables the users to augment auto‐segmentation interactively and dynamically, leading to patient‐specific auto‐segmentation in radiation therapy. SAM's generalizability across different disease sites and different modalities makes it feasible to develop a generic auto‐segmentation model in radiotherapy.