Abstract With global aging, assessing functional status is vital for precision medicine. Electronic Health Records (EHRs), particularly unstructured data, hold abundant information on patient mobility. This study explores using Large Language Models (LLMs) to extract and standardize mobility status from unstructured EHR data (i.e., clinical notes). We annotated 600 clinical notes from three health care institutions located in southeastern Minnesota and west-central Wisconsin, focusing on expressions of mobility and associated impairment. Leveraging the open-source Llama 3 model, we tested various prompting strategies—including zero-shot, few-shot, and task decomposition—and evaluated their performance. Error analysis showed that while the model sometimes inferred impairments without explicit evidence, most errors were clinically reasonable, often reflecting borderline or ambiguous cases. While considering reasonable inference as correct, at the patient-level, Mobility Extraction achieves a micro-average accuracy of 0.952 with an F1-score of 0.962, and Impairment Classification produces a micro-average accuracy of 0.912 and an F1-score of 0.948. A local, deterministic setup improved trustworthiness by ensuring consistent outputs, safeguarding privacy, and demonstrating cross-institution generalizability. These findings highlight the feasibility of LLM-based solutions for extracting mobility functional status from unstructured EHR data, supporting both clinical applications and research.
LoST: A Mental Health Dataset of Low Self-Esteem in Reddit Posts
2023 IEEE International Conference on Systems, Man, and Cybernetics (SMC) | January 29, 2024 | Volume: No volume available | Issue: No issue available | Pages: 3854-3859
The surge in internet use for expression of personal thoughts and beliefs has made it increasingly feasible for the social Natural Language Processing (NLP) research community to find and validate associations between social media posts and mental health status . Cross-sectional and longitudinal studies of low-resourced social media data bring to fore the importance of real-time responsible Artificial Intelligence (AI) models for mental health analysis in native languages. Aiming at classifying research for social computing and tracking advances in the development of learning-based models, we propose a comprehensive survey on mental health analysis for social media and posit the need of analyzing low-resourced social media data for mental health . We first classify three components for computing on social media as: SM - data mining/natural language processing on social media , IA - integrated applications with social media data and user-network modeling, and NM - user and network modeling on social networks. To this end, we posit the need of mental health analysis in different languages of East Asia (e.g., Chinese, Japanese, Korean), South Asia (Hindi, Bengali, Tamil), Southeast Asia (Malay, Thai, Vietnamese), European languages (Spanish, French) and the Middle East (Arabic). Our comprehensive study examines available resources and recent advances in low-resourced languages for different aspects of SM, IA, and NM to discover new frontiers as potential field of research.
Advances in Systems Analysis, Software Engineering, and High Performance Computing | September 12, 2023 | Volume: No volume available | Issue: No issue available | Pages: 1-13
Amid the pandemic, people express the cause and consequences of their mental disturbance on social media platforms with ease. The causal analysis through cause detection, cause inference, and cause classification, and identifying consequences such as loneliness and low self-esteem expedite the interpersonal risk factors. The interpersonal risk factors of thwarted belongingness and perceived burdensomeness trigger clinical depression, which if left untreated advances to suicidal ideation and self-harm. The mental health practitioners are reliable on mental health triaging and motivational interviewing. To this end, this chapter models the evolution of mental disturbance through self-reported texts generated by users suffering with mental disturbance. The clinical psychology theories on interpersonal needs questionnaire (INQ) supporting a theory on thwarted belongingness and perceived burdensomeness is followed by extracting causes and consequences in a given text.
MULTIWD: Multiple Wellness Dimensions in Social Media Posts
The concept of wellness, as proposed by Halbert L. Dunn, recognizes the importance of multiple dimensions, such as social and mental well-being, in maintaining overall health. Neglecting these dimensions can have long-term negative consequences on an individual's mental well-being. In the context of traditional in-person therapy sessions, efforts are made to manually identify underlying factors that contribute to mental disturbances, as these factors, if triggered, can potentially lead to severe mental health disorders. Our research focuses on introducing a meticulous task aimed at identifying indicators of wellness dimensions and detecting their presence in self-narrated human writings on the Reddit social media platform. We have mentioned Ethics and Broader Impact.