Bartz, Alicia

PURPOSE Emoji are digital images or icons used to express an idea or emotion in electronic communication. The purpose of this study was to develop and evaluate the psychometric properties of two patient-reported scales that incorporate emoji. METHODS The Emoji Response Scale developed for this study has two parts: the Emoji-Ordinal and Emoji-Mood scales. A pilot study was designed to validate the ordinal nature of the Emoji-Ordinal Scale. Twenty patients were shown all possible pairs of five emoji and asked to select the most positive from each pair. The psychometric ordering was assessed using Coombs unfolding and Thurstone scaling. A separate pilot study was designed to determine which emoji to include in the Emoji-Mood Scale. Ten common feelings experienced by patients with cancer were chosen by the study team. Patients and providers were asked to select the one emoji that best represented each feeling from the selection. The most commonly selected emotions and representative emoji were chosen for the Emoji-Mood Scale. In a randomized study of 294 patients, Spearman correlations, Wilcoxon tests, and Bland-Altman analyses determined the construct validity of the scales compared with Linear Analog Scale Assessments (LASA) and Patient-Reported Outcomes Measurement Information System (PROMIS) scores. RESULTS Ninety-five percent of patients selected the same ordering among the ordinal emoji, and Thurstone scaling confirmed the ordinal nature of the response scale. The construct validity of the scales was high with correlations between the Emoji-Ordinal Scale and the LASA scale of 0.70 for emotional well-being, 0.72 for physical well-being, 0.74 for overall quality of life, and –0.81 for fatigue. Emoji-Mood Scale ratings were strongly related to PROMIS global mental, global physical, fatigue, anxiety, sleep disturbance, and social activity scales ( P < .0001). CONCLUSION This study provides evidence that scales incorporating emoji are valid for collecting patient-reported outcomes.

174 Background: Patient-reported outcomes (PROs), including physical function and quality of life (QOL), are important outcomes in cancer patients. Emoji are a near-universal, popular form of communication, understandable by diverse populations, including those with low health literacy. We aimed to explore whether emoji could be a valid, reliable scale for assessing PROs in cancer patients. Methods: To develop the emoji scale, 5 emoji faces were selected from the Apple emoji dictionary by study authors. 20 cancer patients participated in a card-sorting exercise to rank the emoji from negative to positive; 19 out of 20 selected the same order, which exceeded Coomb’s criteria for being a valid ordinal scale. Patients were recruited from Mayo Clinic practices. Eligibility included: adult patients with a diagnosis of lymphoma, multiple myeloma, brain, pancreatic, breast, and ovarian cancer within the past 5 years; life expectancy of > 6 months; and own an iPhone version ≥ 5.0. All patients were provided with an Apple Watch and downloaded the study app. Baseline PRO data was collected on the iPhone, including single-item linear analog self-assessments (LASA) and emoji scales for fatigue, physical function, emotional well-being, and overall QOL. Results: From 2/2017-8/2017, 294 eligible patients were recruited. 25% were male, and median age was 53 years (range 20-79). The median time since diagnosis was 8.4 months (range 0-60); 63% were on active therapy, 27% were in observation post-treatment, and 10% had not been treated. All patients were “extremely” confident filling out forms, 99% had used a computer in the past 12 months, and 27% had ever used a smart watch. Emoji responses were significantly associated with validated measures of PROs; the Spearman correlations between the ordinal emoji scales and LASAs were -0.83 for fatigue, 0.72 for physical well-being, 0.72 for emotional well-being, and 0.77 for overall QOL (all p < 0.0001). Of the 75 patients who have completed the study thus far, 92% reported they would use emoji scales again and 89% would recommend that others use emoji scales. Conclusions: A novel ordinal emoji scale is strongly associated with accepted measures of PROs in cancer patients and should be studied further.