Objective: Generative artificial intelligence is rapidly evolving and is now being explored in health care to support patient and clinician education. This study evaluated the accuracy, completeness, and readability of four large language models (LLMs): ChatGPT 3.5, Gemini, ChatGPT 4.0, and OpenEvidence in answering questions about menopause and hormone therapy. Methods: A total of 35 questions (20 patient-level, 15 clinician-level) were entered into each LLM. OpenEvidence was only used for clinician-level questions. Four blinded expert reviewers rated responses as accurate and complete, accurate but incomplete, or inaccurate. Readability of patient-level responses was assessed using the Flesch Reading Ease Score (FRES) and word count. Analysis used ANOVA for readability, odds ratios for accuracy comparisons. Results: For patient-level questions, ChatGPT 3.5 achieved the highest accuracy (70%), followed by ChatGPT 4.0 (60%) and Gemini (30%); Gemini had significantly lower odds of accuracy compared with ChatGPT 3.5 (OR=0.18, 95% CI=0.05-0.71; P =0.014). FRES scores differed significantly ( P <0.001): Gemini scored 38.9±7.3 (“difficult”), ChatGPT 3.5 scored 31.0±11.2, and ChatGPT 4.0 scored 26.5±8.6 (both “very difficult”). For clinician-level questions, ChatGPT 4.0 achieved the highest accuracy (67%), followed by ChatGPT 3.5 and OpenEvidence (60% each) and Gemini (47%); no significant differences were observed among models (all P >0.05). Conclusion: LLMs demonstrated limited accuracy and frequent incorrect or incomplete responses to menopause-related queries, highlighting the need to improve model performance to ensure accurate and reliable information for both patients and clinicians.
Documentation of menopause-related international classification of diseases codes in the electronic health record in midlife women with menopause symptoms
Objective: To evaluate the documentation of menopause-related International Classification of Diseases-10 (ICD-10) codes in the electronic health record (EHR) among midlife women with moderate or greater menopause symptoms receiving primary care. Methods: This cross-sectional study from the Hormones and Experiences of Aging (HERA) cohort included women aged 45-60 years receiving primary care at one of 4 Mayo Clinic sites who completed a one-time survey between March 1, 2021 and June 30, 2021. The survey captured demographic data, menopause symptoms using the Menopause Rating Scale (MRS), health care utilization, and treatment. Women with an MRS score ≥12 were included. The primary outcome was documentation of a menopause-related ICD-10 code in the EHR in the 12 months before survey completion. Results: Of 5,254 women with completed surveys, 2,414 (49%) had an MRS score ≥12 and were included. Among these, 1,519 (63%) reported seeking care for their menopause symptoms in the past 12 months, but only 345 (23%) had a menopause-related ICD-10 code. Women with an ICD-10 code had higher MRS scores (18 [IQR: 14-22] vs 17 [IQR: 14-20]; P = 0.002) and were more likely to use systemic hormone therapy (HT; 26% vs 9%; P < 0.001), and vaginal HT (20% vs 6%; P < 0.001). Conclusions: Menopause-related ICD-10 diagnosis codes were under-documented in women with significant menopause symptom burden. Those with a code were more likely to report menopause treatment. These findings highlight a critical gap between symptom burden and diagnosis coding in the EHR, underscoring the need to improve identification and management of menopause symptoms.
Understanding the sexual concerns of older women presenting for care to women’s health clinics: a cross-sectional study
Objective: To compare the prevalence of female sexual dysfunction (FSD) and distress between sexually active midlife women (50-64 y) and older women (65+ y) presenting for care at women’s health clinics at a tertiary care center. Methods: This cross-sectional study included women aged 50 and above who received care at Mayo Clinic women’s health clinics in Rochester, MN; Scottsdale, AZ; and Jacksonville, FL, between May 1, 2015, and August 31, 2022. Sexual function and distress were compared between midlife and older women using the Female Sexual Function Index (FSFI), Female Sexual Distress Scale-Revised (FSDS-R), and self-reported sexual health concerns. Results: Among 3,465 sexually active women, older women were less likely to report loss of sexual desire (33.4% vs. 47.6%; P <0.001) and reduced genital sensation (13.0% vs. 16.9%; P =0.024) compared with midlife women. There were no significant differences for vaginal dryness, painful intercourse, or arousal/orgasm difficulties. FSFI scores were higher in older women for desire (3.0 vs. 2.4; P <0.001) and lubrication (3.9 vs. 3.6; P <0.001). While total FSFI scores were similar between older and midlife women (21.2 vs. 22.2; P =0.11), sexually related distress was lower in older women compared with midlife women (13.0 vs. 15.0; P =0.015). The prevalence of FSD (defined as FSFI score ≤26.55 and FSDS-R score ≥11) was similar between groups (51.8% vs. 56.2%; P =0.056). Conclusions: Older women experienced FSD at similar rates as midlife women but reported less sexual distress, potentially reflecting lower expectations regarding sexual function. Addressing sexual health concerns in older women may enhance quality of life.
(136) SEXUAL HEALTH CONCERNS OF OLDER WOMEN: A CROSS-SECTIONAL STUDY
Abstract Introduction Female sexual dysfunctions (FSDs) are prevalent yet underrecognized concerns among menopausal women, particularly those aged 65 and older. Age- and menopause-related sexual health issues often go unaddressed due to societal stigma and misconceptions, leading many women to attribute their symptoms to a normal part of aging. This perception limits diagnosis and treatment of conditions like hypoactive sexual desire disorder and genitourinary syndrome of menopause. Objective This study aims to compare sexual function and distress between women aged 50-64 and those aged 65 and older, with a focus on addressing critical knowledge gaps in sexual function among older women. Methods This cross-sectional study included women aged 50 and above who visited Mayo Clinic Women’s Health Clinics in Rochester, MN; Scottsdale, AZ; and Jacksonville, FL between, May 1, 2015, and August 31, 2022. Participants completed the Female Sexual Function Index (FSFI) and Female Sexual Distress Scale (FSDS-R), along with assessments of chief sexual health complaints, mood (PHQ-9), and anxiety (GAD-7) included in the Data Registry on Experiences of Aging, Menopause, and Sexuality (DREAMS). Results Among 4900 women included in the analysis, the median number of sexual health complaints was 2.0 in midlife (50-64 yrs) and 1.0 in older (65+ yrs) age groups (p = 0.004). Chief complaints of loss of sexual desire (47.6% vs. 33.4%; p < 0.001) and reduced genital sensation (16.9% vs. 13.0%; p = 0.024) were more common in the midlife age group. No significant differences were found in rates of complaints of vaginal dryness (51.2% vs. 52.5%; p = 0.57), painful intercourse (32.6% vs 30.7%; p = 0.38), or of difficulties with arousal or orgasm (24.0% vs 20.8%; p = 0.09). Midlife age women were also more likely to report pelvic pain (6.7% vs. 4.5%; p = 0.050), while older women reported more genital pain (8.1% vs. 5.8%; p = 0.038). FSFI scores indicated age-related differences in desire (2.4 vs. 3.0; p < 0.001), lubrication (3.9 vs. 3.6; p < 0.001), and pain (4.8 vs. 4.0; p < 0.001), aligning with the chief complaints, while arousal (3.6, p = 0.890), orgasm (4.0, p = 0.926), and satisfaction (4.4, p = 0.346) scores were similar between groups. Total FSFI scores showed no significant difference between the age groups (total = 22.2 vs 21.2, p = 0.109). Median FSDS-R scores indicated higher distress in the midlife group (15.0 vs. 13.0; p = 0.015), while overall FSD prevalence (FSFI ≤26.55 and FSDS ≥11) was similar between groups (56.2% vs 51.8%; p = 0.056). Conclusions Midlife and older women were equally likely to experience FSD in women presenting to women’s health clinics, but older women reported less distress. These results are strikingly similar to previous research indicating that while older women have FSD, there is less distress associated with it. Raising awareness and promoting open dialogue can help older women recognize that their sexual health concerns are both valid and treatable, ultimately improving quality of life. Disclosure No.