Forte, Antonio Jorge

Current clinical care relies heavily on complex, rule-based systems for tasks like diagnosis and treatment. However, these systems can be cumbersome and require constant updates. This study explores the potential of the large language model (LLM), LLaMA 2, to address these limitations. We tested LLaMA 2′s performance in interpreting complex clinical process models, such as Mayo Clinic Care Pathway Models (CPMs), and providing accurate clinical recommendations. LLM was trained on encoded pathways versions using DOT language, embedding them with SentenceTransformer, and then presented with hypothetical patient cases. We compared the token-level accuracy between LLM output and the ground truth by measuring both node and edge accuracy. LLaMA 2 accurately retrieved the diagnosis, suggested further evaluation, and delivered appropriate management steps, all based on the pathways. The average node accuracy across the different pathways was 0.91 (SD ± 0.045), while the average edge accuracy was 0.92 (SD ± 0.122). This study highlights the potential of LLMs for healthcare information retrieval, especially when relevant data are provided. Future research should focus on improving these models’ interpretability and their integration into existing clinical workflows.

Background: Effective pain management is crucial for both comfort and outcomes, yet predicting and managing this pain is difficult. This study aimed to analyze postoperative pain in patients undergoing hand surgery at the Mayo Clinic Florida, examining how patient characteristics and anxiety affect pain outcomes. Methods: We conducted a single-arm clinical trial at Mayo Clinic Florida, recruiting patients undergoing hand surgery. Preoperative pain and anxiety were assessed using the Pain Catastrophizing Scale (PCS) and State-Trait Anxiety Inventory (STAI). Postoperatively, patients used an iPhone app to record pain levels and medication use every four hours. Devices were collected three days after surgery. We analyzed the relationship between demographics, PCS, STAI scores, and pain levels using linear and logistic regression models. All statistical tests were two-sided with significance set at p < 0.05, analyzed with R4.2.2. Results: Data were collected from 62 patients (62.9% women, 37.1% men) undergoing hand surgery. Participants were mainly White (90.3%), with 50% being in the middle-aged adult group. Most had low anxiety levels (80.6% STAI-S, 82.3% STAI-T) and low catastrophizing (61.3% PCS). Postoperative pain was low, with median scores between 1.0 and 2.0 over three days. Demographics, anxiety, and catastrophizing were not significant predictors of pain levels. Logistic regression showed time as a significant factor, with pain levels peaking on Day 3. Conclusions: Postoperative pain after hand surgery was generally low, with time being a significant predictor of increased pain. Demographic factors, anxiety, and catastrophizing did not significantly affect pain levels. Pain management should emphasize time-sensitive interventions and ongoing monitoring.

Introduction: Melanoma is a deadly type of skin cancer that develops from melanocytes and can manifest on the skin or other regions of the body. Its incidence is increasing rapidly, with approximately 100,000 diagnoses and 7000 deaths per year in the US alone. We conducted a cross-sectional study with the aim of determining an association between the cost of care for invasive melanoma and the specialty involved in the treatment to adequately guide future treatment. Methods: We analyzed data from 3817 patients (2013–2018) using the Florida inpatient/outpatient dataset, CMS cost reports, and the National Plan and Provider Enumeration System. Covariates included age, sex, race/ethnicity, insurance type, region, county rurality, the number of procedures, the comorbidity index, obesity, metastatic cancer presence, hospital size, and physician volume. Multivariable mixed linear regression was used to analyze the data, and the cost was adjusted to the 2019 USD. Results: Dermatology had the largest decrease in the overall and outpatient costs compared to general surgery, followed by plastic surgery. The inpatient costs for dermatology and plastic surgery were lower than those for general surgery, but not significantly so. Conclusions: The costs associated with surgical procedures may vary depending on the specialty of the physician treating the patient. Dermatology was associated with lower treatment costs for invasive melanoma compared to other specialties, indicating that physician specialty influences the cost of care.

Chronic pain affects over 50 million people in the United States, particularly older adults, making effective assessment and treatment essential in primary care. Actigraphy, which monitors and records limb movement to estimate wakefulness and sleep, has emerged as a valuable tool for assessing pain by providing insights into activity patterns. This review highlights the non-invasive, cost-effective nature of actigraphy in pain monitoring, along with its ability to offer continuous, detailed data on patient movement. However, actigraphy’s reliance on physical activity as a proxy for pain, and its inability to directly measure pain intensity, limit its applicability to certain pain types, such as neuropathic pain. Further research is needed to overcome these limitations and to improve the effectiveness of actigraphy in diverse clinical settings.

Medical researchers are increasingly utilizing advanced LLMs like ChatGPT-4 and Gemini to enhance diagnostic processes in the medical field. This research focuses on their ability to comprehend and apply complex medical classification systems for breast conditions, which can significantly aid plastic surgeons in making informed decisions for diagnosis and treatment, ultimately leading to improved patient outcomes. Fifty clinical scenarios were created to evaluate the classification accuracy of each LLM across five established breast-related classification systems. Scores from 0 to 2 were assigned to LLM responses to denote incorrect, partially correct, or completely correct classifications. Descriptive statistics were employed to compare the performances of ChatGPT-4 and Gemini. Gemini exhibited superior overall performance, achieving 98% accuracy compared to ChatGPT-4’s 71%. While both models performed well in the Baker classification for capsular contracture and UTSW classification for gynecomastia, Gemini consistently outperformed ChatGPT-4 in other systems, such as the Fischer Grade Classification for gender-affirming mastectomy, Kajava Classification for ectopic breast tissue, and Regnault Classification for breast ptosis. With further development, integrating LLMs into plastic surgery practice will likely enhance diagnostic support and decision making.

Background and Objectives: Large language models (LLMs) are emerging as valuable tools in plastic surgery, potentially reducing surgeons’ cognitive loads and improving patients’ outcomes. This study aimed to assess and compare the current state of the two most common and readily available LLMs, Open AI’s ChatGPT-4 and Google’s Gemini Pro (1.0 Pro), in providing intraoperative decision support in plastic and reconstructive surgery procedures. Materials and Methods: We presented each LLM with 32 independent intraoperative scenarios spanning 5 procedures. We utilized a 5-point and a 3-point Likert scale for medical accuracy and relevance, respectively. We determined the readability of the responses using the Flesch–Kincaid Grade Level (FKGL) and Flesch Reading Ease (FRE) score. Additionally, we measured the models’ response time. We compared the performance using the Mann–Whitney U test and Student’s t-test. Results: ChatGPT-4 significantly outperformed Gemini in providing accurate (3.59 ± 0.84 vs. 3.13 ± 0.83, p-value = 0.022) and relevant (2.28 ± 0.77 vs. 1.88 ± 0.83, p-value = 0.032) responses. Alternatively, Gemini provided more concise and readable responses, with an average FKGL (12.80 ± 1.56) significantly lower than ChatGPT-4′s (15.00 ± 1.89) (p < 0.0001). However, there was no difference in the FRE scores (p = 0.174). Moreover, Gemini’s average response time was significantly faster (8.15 ± 1.42 s) than ChatGPT’-4′s (13.70 ± 2.87 s) (p < 0.0001). Conclusions: Although ChatGPT-4 provided more accurate and relevant responses, both models demonstrated potential as intraoperative tools. Nevertheless, their performance inconsistency across the different procedures underscores the need for further training and optimization to ensure their reliability as intraoperative decision-support tools.

In the U.S., diagnostic errors are common across various healthcare settings due to factors like complex procedures and multiple healthcare providers, often exacerbated by inadequate initial evaluations. This study explores the role of Large Language Models (LLMs), specifically OpenAI’s ChatGPT-4 and Google Gemini, in improving emergency decision-making in plastic and reconstructive surgery by evaluating their effectiveness both with and without physical examination data. Thirty medical vignettes covering emergency conditions such as fractures and nerve injuries were used to assess the diagnostic and management responses of the models. These responses were evaluated by medical professionals against established clinical guidelines, using statistical analyses including the Wilcoxon rank-sum test. Results showed that ChatGPT-4 consistently outperformed Gemini in both diagnosis and management, irrespective of the presence of physical examination data, though no significant differences were noted within each model’s performance across different data scenarios. Conclusively, while ChatGPT-4 demonstrates superior accuracy and management capabilities, the addition of physical examination data, though enhancing response detail, did not significantly surpass traditional medical resources. This underscores the utility of AI in supporting clinical decision-making, particularly in scenarios with limited data, suggesting its role as a complement to, rather than a replacement for, comprehensive clinical evaluation and expertise.

Since their release, the medical community has been actively exploring large language models’ (LLMs) capabilities, which show promise in providing accurate medical knowledge. One potential application is as a patient resource. This study analyzes and compares the ability of the currently available LLMs, ChatGPT-3.5, GPT-4, and Gemini, to provide postoperative care recommendations to plastic surgery patients. We presented each model with 32 questions addressing common patient concerns after surgical cosmetic procedures and evaluated the medical accuracy, readability, understandability, and actionability of the models’ responses. The three LLMs provided equally accurate information, with GPT-3.5 averaging the highest on the Likert scale (LS) (4.18 ± 0.93) (p = 0.849), while Gemini provided significantly more readable (p = 0.001) and understandable responses (p = 0.014; p = 0.001). There was no difference in the actionability of the models’ responses (p = 0.830). Although LLMs have shown their potential as adjunctive tools in postoperative patient care, further refinement and research are imperative to enable their evolution into comprehensive standalone resources.

Background: Large language models (LLMs) represent a recent advancement in artificial intelligence with medical applications across various healthcare domains. The objective of this review is to highlight how LLMs can be utilized by clinicians and surgeons in their everyday practice. Methods: A systematic review was conducted following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. Six databases were searched to identify relevant articles. Eligibility criteria emphasized articles focused primarily on clinical and surgical applications of LLMs. Results: The literature search yielded 333 results, with 34 meeting eligibility criteria. All articles were from 2023. There were 14 original research articles, four letters, one interview, and 15 review articles. These articles covered a wide variety of medical specialties, including various surgical subspecialties. Conclusions: LLMs have the potential to enhance healthcare delivery. In clinical settings, LLMs can assist in diagnosis, treatment guidance, patient triage, physician knowledge augmentation, and administrative tasks. In surgical settings, LLMs can assist surgeons with documentation, surgical planning, and intraoperative guidance. However, addressing their limitations and concerns, particularly those related to accuracy and biases, is crucial. LLMs should be viewed as tools to complement, not replace, the expertise of healthcare professionals.