Panizza, Benedict James

Objective To examine the quality of information provided by artificial intelligence platforms ChatGPT-4 and Claude 2 surrounding the management of vestibular schwannomas. Study design Cross-sectional. Setting Skull base surgeons were involved from different centers and countries. Intervention Thirty-six questions regarding vestibular schwannoma management were tested. Artificial intelligence responses were subsequently evaluated by 19 lateral skull base surgeons using the Quality Assessment of Medical Artificial Intelligence (QAMAI) questionnaire, assessing “Accuracy,” “Clarity,” “Relevance,” “Completeness,” “Sources,” and “Usefulness.” Main Outcome Measure The scores of the answers from both chatbots were collected and analyzed using the Student t test. Analysis of responses grouped by stakeholders was performed with McNemar test. Stuart-Maxwell test was used to compare reading level among chatbots. Intraclass correlation coefficient was calculated. Results ChatGPT-4 demonstrated significantly improved quality over Claude 2 in 14 of 36 (38.9%) questions, whereas higher-quality scores for Claude 2 were only observed in 2 (5.6%) answers. Chatbots exhibited variation across the dimensions of “Accuracy,” “Clarity,” “Completeness,” “Relevance,” and “Usefulness,” with ChatGPT-4 demonstrating a statistically significant superior performance. However, no statistically significant difference was found in the assessment of “Sources.” Additionally, ChatGPT-4 provided information at a significant lower reading grade level. Conclusions Artificial intelligence platforms failed to consistently provide accurate information surrounding the management of vestibular schwannoma, although ChatGPT-4 achieved significantly higher scores in most analyzed parameters. These findings demonstrate the potential for significant misinformation for patients seeking information through these platforms.

Purpose of review The purpose of this review is to outline the temporal bone management of external and middle ear carcinoma. The review will outline the current evidence involved in deciding which surgical approach to take, as well as new advances in auditory rehabilitation and immunotherapy. Recent findings Traditional surgical approaches include lateral temporal bone resection, subtotal temporal bone resection and total temporal bone resection. They can also involve parotidectomy and neck dissection depending on extension of disease into these areas. Options for auditory rehabilitation include osseointegrated hearing aids, transcutaneous bone-conduction implants, and active middle ear implants. Recent advances in immunotherapy have included the use of anti-PD-1 monoclonal antibodies. Summary The mainstay of management of temporal bone disease involves surgical resection. Early-stage tumours classified according to the Pittsburgh staging tool can often be treated with lateral temporal bone resection, whereas late-stage tumours might need subtotal or total temporal bone resection. Parotidectomy and neck dissection might also be indicated if there is a risk of occult regional disease. Recent advances in immunotherapy have been promising, particularly around anti-PD-1 inhibitors. However, larger clinical trials will be required to test the extent of efficacy, particularly around combination use with surgery.