Multimodal Slice Interaction Network Enhanced by Transfer Learning for Precise Segmentation of Internal Gross Tumor Volume in Lung Cancer PET/CT Imaging
2026 IEEE 14th International Conference on Healthcare Informatics (ICHI) | August 12, 2026 | Volume: No volume available | Issue: No issue available | Pages: 525-534
To improve synthetic CT (sCT) generation from cone-beam CT (CBCT) in radiotherapy, we propose a multiscale segmentation-guided diffusion framework. The proposed model integrates anatomical priors across multiple spatial resolutions through a segmentation mask pyramid and introduces a scale-specific loss function to guide learning at each level. When evaluated on the SynthRAD2023 brain dataset, our model achieves a mean absolute error (MAE) of 61.82 HU, a peak signal-to-noise ratio (PSNR) of 32.05 dB, and a structural similarity index (SSIM) of 0.90, outperforming baseline models. These results suggest that multiscale anatomical guidance can improve the fidelity and anatomical consistency of sCT images, thus facilitating high-quality CBCT-to-CT translation in radiotherapy applications.
With the rapid development of artificial intelligence (AI), various deep learning (DL) methods have been introduced into radiation oncology. Among them, the generation of synthetic Computed Tomography (sCT) images has attracted increasing attention, as it supports different clinical scenarios, from image-guided adaptive radiotherapy (IGART) to the simulation-free workflow. This review provides a comprehensive overview of recent studies on DL-based sCT synthesis in radiotherapy from multiple imaging modalities, including Cone-Beam CT (CBCT), Magnetic Resonance Imaging (MRI), and diagnostic CT, and discusses their clinical applications in CBCT-based online adaptive radiotherapy, MRI-guided radiotherapy, and simulation-free workflows. We also examine the architectures of representative DL models such as convolutional neural networks (CNNs) and generative adversarial networks (GANs) and summarize emerging training strategies. Finally, we discuss current challenges of clinical translation of DL algorithms into clinical practice and suggest potential directions for future research. Overall, this paper highlights the potential of AI-driven sCT generation to advance treatment planning by reducing imaging burden, improving dose accuracy, and accelerating workflow efficiency, thus ultimately improving the treatment outcome of patient care.
A Language Vision Model Approach for Automated Tumor Contouring in Radiation Oncology
Background: Lung cancer ranks as the leading cause of cancer-related mortality worldwide. The complexity of tumor delineation, crucial for radiation therapy, requires expertise often unavailable in resource-limited settings. Artificial Intelligence (AI), particularly with advancements in deep learning (DL) and natural language processing (NLP), offers potential solutions yet is challenged by high false positive rates. Purpose: The Oncology Contouring Copilot (OCC) system is developed to leverage oncologist expertise for precise tumor contouring using textual descriptions, aiming to increase the efficiency of oncological workflows by combining the strengths of AI with human oversight. Methods: Our OCC system initially identifies nodule candidates from CT scans. Employing Language Vision Models (LVMs) like GPT-4V, OCC then effectively reduces false positives with clinical descriptive texts, merging textual and visual data to automate tumor delineation, designed to elevate the quality of oncology care by incorporating knowledge from experienced domain experts. Results: The deployment of the OCC system resulted in a 35.0% reduction in the false discovery rate, a 72.4% decrease in false positives per scan, and an F1-score of 0.652 across our dataset for unbiased evaluation. Conclusions: OCC represents a significant advance in oncology care, particularly through the use of the latest LVMs, improving contouring results by (1) streamlining oncology treatment workflows by optimizing tumor delineation and reducing manual processes; (2) offering a scalable and intuitive framework to reduce false positives in radiotherapy planning using LVMs; (3) introducing novel medical language vision prompt techniques to minimize LVM hallucinations with ablation study; and (4) conducting a comparative analysis of LVMs, highlighting their potential in addressing medical language vision challenges.
Development of a hybrid automated chart checking, data collection, and analysis system
Abstract Purpose To describe the creation and clinical deployment of an integrated stand‐alone hybrid automated chart review platform that is comprised of a database, oncology information system (OIS) interfaces, and a user interface (UI). Methods A consensus checklist was developed to homogenize the practices of clinical physics staff and physics residents for all plan types. Critical review of the single checklist's items led to the creation of a new concept, the “plan attribute,” which permits specialization of the final checklist based on the characteristics of a particular plan. Only relevant and applicable tests are automatically populated to form a plan checklist based on plan attributes. Each populated checklist in this hybrid automation platform includes elements of full automation, steps or functions that use automation to augment a human input or effort, as well as steps completed by humans. Logging and categorizing of deficiencies found during the chart check was also implemented. Results Chart check data was analyzed for an over 4‐year time span starting from the clinical deployment of the tool in October 2020. This analysis included a total of 427 073 tests spread among 7882 initial chart checks. The recorded deficiencies at three triage levels showed 7116 minor errors, 679 major errors, and 71 plan rejections. The plan rejection level is the highest chart deficiency, which required the plan to be rejected and sent back for serious remediation and/or new plan generation. Conclusion This report describes the successful development and implementation of a hybrid‐automated chart checking program. The software leverages modern database and software design to improve the per case performance and experience of a multi‐user group. Chart check database permits high‐level review and improvement in all aspects of plan check and user performance.
Simulation‐free workflow for lattice radiation therapy using deep learning predicted synthetic computed tomography: A feasibility study
Abstract Purpose Lattice radiation therapy (LRT) is a form of spatially fractionated radiation therapy that allows increased total dose delivery aiming for improved treatment response without an increase in toxicities, commonly utilized for palliation of bulky tumors. The LRT treatment planning process is complex, while eligible patients often have an urgent need for expedited treatment start. In this study, we aimed to develop a simulation‐free workflow for volumetric modulated arc therapy (VMAT)‐based LRT planning via deep learning‐predicted synthetic CT (sCT) to expedite treatment initiation. Methods Two deep learning models were initially trained using 3D U‐Net architecture to generate sCT from diagnostic CTs (dCT) of the thoracic and abdomen regions using a training dataset of 50 patients. The models were then tested on an independent dataset of 15 patients using image similarity analysis assessing mean absolute error (MAE) and structural similarity index measure (SSIM) as metrics. VMAT‐based LRT plans were generated based on sCT and recalculated on the planning CT (pCT) for dosimetric accuracy comparison. Differences in dose volume histogram (DVH) metrics between pCT and sCT plans were assessed using the Wilcoxon signed‐rank test. Results The final sCT prediction model demonstrated high image similarity to pCT, with a MAE and SSIM of 38.93 ± 14.79 Hounsfield Units (HU) and 0.92 ± 0.05 for the thoracic region, and 73.60 ± 22.90 HU and 0.90 ± 0.03 for the abdominal region, respectively. There were no statistically significant differences between sCT and pCT plans in terms of organ‐at‐risk and target volume DVH parameters, including maximum dose (Dmax), mean dose (Dmean), dose delivered to 90% (D90%) and 50% (D50%) of target volume, except for minimum dose (Dmin) and (D10%). Conclusion With demonstrated high image similarity and adequate dose agreement between sCT and pCT, our study is a proof‐of‐concept for using deep learning predicted sCT for a simulation‐free treatment planning workflow for VMAT‐based LRT.
Improving the Precision of Deep-Learning-Based Head and Neck Target Auto-Segmentation by Leveraging Radiology Reports Using a Large Language Model
Background/Objectives: The accurate delineation of primary tumors (GTVp) and metastatic lymph nodes (GTVn) in head and neck (HN) cancers is essential for effective radiation treatment planning, yet remains a challenging and laborious task. This study aims to develop a deep-learning-based auto-segmentation (DLAS) model trained on external datasets with false-positive elimination using clinical diagnosis reports. Methods: The DLAS model was trained on a multi-institutional public dataset with 882 cases. Forty-four institutional cases were randomly selected as the external testing dataset. DLAS-generated GTVp and GTVn were validated against clinical diagnosis reports to identify false-positive and false-negative segmentation errors using two large language models: ChatGPT-4 and Llama-3. False-positive ruling out was conducted by matching the centroids of AI-generated contours with the slice locations or anatomical regions described in the reports. Performance was evaluated using the Dice similarity coefficient (DSC), 95th percentile Hausdorff distance (HD95), and tumor detection precision. Results: ChatGPT-4 outperformed Llama-3 in accurately extracting tumor locations from the diagnostic reports. False-positive contours were identified in 15 out of 44 cases. The DSCmean of the DLAS contours for GTVp and GTVn increased from 0.68 to 0.75 and from 0.69 to 0.75, respectively, after the ruling-out process. Notably, the average HD95 value for GTVn decreased from 18.81 mm to 5.2 mm. Post ruling out, the model achieved 100% precision for GTVp and GTVn when compared with the results of physician-determined contours. Conclusions: The false-positive ruling-out approach based on diagnostic reports effectively enhances the precision of DLAS in the HN region. The model accurately identifies the tumor location and detects all false-negative errors.
Deep Learning-Based Synthetic CT for Personalized Treatment Modality Selection Between Proton and Photon Therapy in Thoracic Cancer
Objectives: Identifying patients’ advantageous radiotherapy modalities prior to CT simulation is challenging. This study aimed to develop a workflow using deep learning (DL)-predicted synthetic CT (sCT) for treatment modality comparison based solely on a diagnostic CT (dCT). Methods: A DL network, U-Net, was trained utilizing 46 thoracic cases from a public database to generate sCT images predicting planning CT (pCT) scans based on the latest dCT, and tested on 15 institutional patients. The sCT accuracy was evaluated against the corresponding pCT and a commercial algorithm deformed CT (MdCT) based on Mean Absolute Error (MAE) and Universal Quality Index (UQI). To determine advantageous treatment modality, clinical dose-volume histogram (DVH) metrics and Normal Tissue Complication Probability (NTCP) differences between proton and photon treatment plans were analyzed on the sCTs via concordance correlation coefficient (CCC). Results: The AI-generated sCTs closely resembled those of the commercial deformation algorithm in the tested cases. The differences in MAE and UQI values between the sCT-vs-pCT and MdCT-vs-pCT were 19.38 HU and 0.06, respectively. The mean absolute NTCP deviation between sCT and pCT was 1.54%, 0.21%, and 2.36% for esophagus perforation, lung pneumonitis, and heart pericarditis, respectively. The CCC between sCT and pCT was 0.90 for DVH metrics and 0.97 for NTCP, indicating moderate agreement for DVH metrics and substantial agreement. Conclusions: Radiation oncologists can potentially utilize this personalized sCT based approach as a clinical support tool to rapidly compare the treatment modality benefit during patient consultation and facilitate in-depth discussion on potential toxicities at a patient-specific level.
Subsequent kilovoltage imaging‐based fiducial triangulation for intra‐fractional prostate motion monitoring and correction
Abstract Background Inter‐fractional and intra‐fractional positioning and motion monitoring based on implanted fiducials through kilovoltage (kV) imaging is a cost‐effective approach to enhance intact prostate radiotherapy treatment accuracy. However, comprehensive studies for three‐dimensional (3D) position extraction and the corrective action threshold are lacking. Purpose To develop and verify a fiducial motion monitoring system with 3D position information based on triggered kV images taken during treatment delivery, and to comprehensively evaluate the recommended thresholds for corrective action during treatment. Methods An in‐house fiducial triangulation algorithm was developed to monitor fiducial positions using subsequent kV triggered images. The precision of fiducial triangulation and motion detection was validated on a pelvis phantom with four fiducial inserts. A retrospective study was conducted on prostate cancer patients who received either moderately hypofractionated radiotherapy (MHRT, n = 16) or stereotactic body radiotherapy (SBRT, n = 12), categorized by endo‐rectal balloon (ERB) use. Intra‐fractional positions relative to isocenter were computed, and these positions were analyzed in comparison to the original marker locations of the patient's treatment plan. A linear regression fit was used per fraction to determine correlation coefficients between motions in the left–right (LR), superior–inferior (SI), and anterior–posterior (AP) directions. Average fraction time (AFT) of treatment was reported based on the observed average time spent on steps in the workflow and the percentage of fiducials caught outside of the current two‐dimensional (2D) tolerance threshold of 5 mm. The observed 3D offsets were used to estimate AFT for various 3D tolerance thresholds. Results Overall, our triangulation method proved to be very precise for static cases, where phantom measurements revealed a fiducial position triangulation precision of mm for stationary targets, but had a spread of mm for targets with 1 mm of motion. Employing triangulation, true motion exceeding 5 mm was detected above 4.0 mm in magnitude 90.9% of the time, a noticeable improvement in comparison to the 28%–65% successful detection rate reported by 2D projection methods. Most detection errors were attributed to depth disparity. Similar to other reports, correlation coefficients for intra‐fractional motion generally indicated no LR/SI, no LR/AP, and weak positive SI/AP correlations for MHRT and SBRT patients. Offsets beyond a 3D tolerance threshold of 5 mm were observed at a rate of 4.25%–5.25%, while the 5 mm 2D out‐of‐tolerance catch‐rate was 1.6%. The AFT was 8.1–8.2 min using the 2D tolerance threshold of 5 mm. In comparison, the estimated AFT for the proposed 3D tolerance monitoring of offsets beyond 2–5 mm was slightly higher at 8.2–10.9 min due to the higher amount of out‐of‐tolerance instances for the higher precision intra‐fractional motion management. Conclusions Our study showcases a promising subsequent kV‐based triangulation method for intra‐fractional prostate motion monitoring. Acquiring 3D motion information results in higher out‐of‐tolerance catch‐rates particularly in the depth dimension of the kV images, which is perpendicular to the treatment beam. Failure to properly observe and catch these offsets would result in sub‐optimal conformality and accuracy of the dose delivery.
Development of an automated CBCT‐based simulation‐free platform for expedited palliative radiotherapy on a conventional linear accelerator
AbstractBackgroundConventional approaches for emergent or expedited palliative radiotherapy (RT) involve the application of cumbersome vendor‐provided solutions and/or multiple patient appointments to complete the RT workflow within a compressed timeframe.PurposeThis report delineates the clinical development of an in‐house, semi‐automated Cone‐beam computed tomography (CBCT)‐based simulation‐free platform for expedited palliative RT on conventional linacs, intended to supplant existing techniques employed at this institution.MethodsThe internal software, termed SimFree Wizard (SFW), was engineered utilizing a C#‐based application programming interface integrated within the treatment planning system (TPS). Generated scripts were compiled as stand‐alone executables, with a graphical user interface (GUI) customized via an integrated development environment. The platform was conceived as a framework for accelerated CBCT‐based RT, bypassing the requirement for standard simulation imaging. SFW employs full automation where feasible to minimize user intervention, supplemented by graphical instructions for tasks requiring manual execution. During development, relevant temporal metrics from 10 end‐to‐end tests for palliative spine RT were quantified. User feedback was solicited via a simple questionnaire assessing the overall platform usability. Automated in‐house secondary verification software was developed for validation of the TPS‐calculated monitor units (MUs).ResultsThe mean duration for workflow execution was 41:42 ± 3:18 [mm:ss] (range ∼37–46 min). SFW satisfactorily generated simple, multi‐field CBCT‐based 3D treatment plans within seconds following delineation of the desired treatment area. User feedback indicated enhanced usability compared to previously employed solutions. Validation of the secondary verification software demonstrated accurate results for palliative spine RT and other simple cases wherein the dose calculation point resides in a predominantly homogenous medium.ConclusionA novel in‐house solution for expedited CBCT‐based RT was successfully developed, facilitating completion of the entire workflow within approximately 1‐hour or less for simple palliative/emergent scenarios. Overall, this application is expected to improve the quality and safety of palliative RT while greatly reducing workflow duration, thereby improving access to palliative care.