Wang, Peilong

Abstract With the rapid advancements in large language model technology and the emergence of bioinformatics‐specific language models (BioLMs), there is a growing need for a comprehensive analysis of the current landscape, computational characteristics, and diverse applications. This survey aims to address this need by providing a thorough review of BioLMs, focusing on their evolution, classification, and distinguishing features, alongside a detailed examination of training methodologies, datasets, and evaluation frameworks. We explore the wide‐ranging applications of BioLMs in critical areas such as disease diagnosis, drug discovery, and vaccine development, highlighting their impact and transformative potential in bioinformatics. We identify key challenges and limitations inherent in BioLMs, including data privacy and security concerns, interpretability issues, biases in training data and model outputs, and domain adaptation complexities. Finally, we highlight emerging trends and future directions, offering valuable insights to guide researchers and clinicians toward advancing BioLMs for increasingly sophisticated biological and clinical applications.

Abstract Background The radiation oncology clinical practice involves many steps relying on the dynamic interplay of abundant text data. Large language models have displayed remarkable capabilities in processing complex text information. But their direct applications in specific fields like radiation oncology remain underexplored. Purpose This study aims to investigate whether fine‐tuning LLMs with domain knowledge can improve the performance on Task (1) treatment regimen generation, Task (2) treatment modality selection (photon, proton, electron, or brachytherapy), and Task (3) ICD‐10 code prediction in radiation oncology. Methods Data for 15 724 patient cases were extracted. Cases where patients had a single diagnostic record, and a clearly identifiable primary treatment plan were selected for preprocessing and manual annotation to have 7903 cases of the patient diagnosis, treatment plan, treatment modality, and ICD‐10 code. Each case was used to construct a pair consisting of patient diagnostics details and an answer (treatment regimen, treatment modality, or ICD‐10 code, respectively) for the supervised fine‐tuning of these three tasks. Open source LLaMA2‐7B and Mistral‐7B models were utilized for the fine‐tuning with the Low‐Rank Approximations method. Accuracy and ROUGE‐1 score were reported for the fine‐tuned models and original models. Clinical evaluation was performed on Task (1) by radiation oncologists, while precision, recall, and F‐1 score were evaluated for Task (2) and (3). One‐sided Wilcoxon signed‐rank tests were used to statistically analyze the results. Results Fine‐tuned LLMs outperformed original LLMs across all tasks with p value ≤ 0.001. Clinical evaluation demonstrated that over 60% of the fine‐tuned LLMs‐generated treatment regimens were clinically acceptable. Precision, recall, and F1‐score showed improved performance of fine‐tuned LLMs. Conclusion Fine‐tuned LLMs demonstrated statistically significant improvements over original LLMs upon three clinically important tasks in radiation oncology. This study explored the feasibility of applying fine‐tuned LLMs in radiation oncology, inspiring further development of utilizing LLMs to assist with radiation oncology tasks.

AbstractPurposeThe time structures of proton spot delivery in proton pencil beam scanning (PBS) radiation therapy are essential in many clinical applications. This study aims to characterize the time structures of proton PBS delivered by both synchrotron and synchrocyclotron accelerators using a non‐invasive technique based on scattered particle tracking.MethodsA pixelated semiconductor detector, AdvaPIX‐Timepix3, with a temporal resolution of 1.56 ns, was employed to measure time of arrival of secondary particles generated by a proton beam. The detector was placed laterally to the high‐flux area of the beam in order to allow for single particle detection and not interfere with the treatment. The detector recorded counts of radiation events, their deposited energy and the timestamp associated with the single events. Individual recorded events and their temporal characteristics were used to analyze beam time structures, including energy layer switch time, magnet switch time, spot switch time, and the scanning speeds in the x and y directions. All the measurements were repeated 30 times on three dates, reducing statistical uncertainty.ResultsThe uncertainty of the measured energy layer switch times, magnet switch time, and the spot switch time were all within 1% of average values. The scanning speeds uncertainties were within 1.5% and are more precise than previously reported results. The measurements also revealed continuous sub‐milliseconds proton spills at a low dose rate for the synchrotron accelerator and radiofrequency pulses at 7 µs and 1 ms repetition time for the synchrocyclotron accelerator.ConclusionThe AdvaPIX‐Timepix3 detector can be used to directly measure and monitor time structures on microseconds scale of the PBS proton beam delivery. This method yielded results with high precision and is completely independent of the machine log files.