Back to Authors

Starren, Justin

https://orcid.org/0000-0002-5403-1115

Mayo Clinic

University of Arizona

Citations 8

PhenoFit: a framework for determining computable phenotyping algorithm fitness for purpose and reuse
Wiley, Laura K. , Rasmussen, Luke V. , Levinson, Rebecca T. , Malinowski, Jennifer , Manemann, Sheila M., Wilson, Melissa P. , Chapman, Martin , Pacheco, Jennifer A. , Walunas, Theresa L. , Starren, Justin , Richesson, Rachel , Malinowski, Jennnifer , Starren, Justin B , Bielinski, Suzette , Richesson, Rachel L , Rasmussen, Luke V , Pacheco, Jennifer A , Wiley, Laura K , Walunas, Theresa L , Bielinski, Suzette J.

Journal of the American Medical Informatics Association | November 12, 2025 | Volume: 33 | Issue: 2 | Pages: 536-542

10.1093/jamia/ocaf195 Get It

Abstract Background Computational phenotyping from electronic health records (EHRs) is essential for clinical research, decision support, and quality/population health assessment, but the proliferation of algorithms for the same conditions makes it difficult to identify which algorithm is most appropriate for reuse. Objective To develop a framework for assessing phenotyping algorithm fitness for purpose and reuse. Fitness for Purpose Phenotyping algorithms are fit for purpose when they identify the intended population with performance characteristics appropriate for the intended application. Fitness for Reuse Phenotyping algorithms are fit for reuse when the algorithm is implementable and generalizable—that is, it identifies the same intended population with similar performance characteristics when applied to a new setting. Conclusions The PhenoFit framework provides a structured approach to evaluate and adapt phenotyping algorithms for new contexts increasing efficiency and consistency of identifying patient populations from EHRs.
Paging the Clinical Informatics Community: Respond STAT to Dobbs v. Jackson's Women's Health Organization
Ravi, Akshay , Weia, Benjamin , Aarts, Jos , Ahmad, Hasan B., Araj, Ellen, Bauml, Julie A., Boyd, Andrew D. , Brecht-Doscher, Aimee, Butler‐Henderson, Kerryn , Butte, Atul J. , Cardilo, Anthony B., Chilukuri, Nymisha , Cho, Mildred K. , Cohen, Jenny K., Craven, Catherine K. , Crusco, Salvatore, Dadabhoy, Farah Z. , Dash, Dev , DeBolt, Claire , Fayanju, Oluseyi A, Fochtmann, Laura J. , Graham, Justin V., Hanna, John , Hofford, Mackenzie , Hron, Jonathan D. , Huang, Sean S, Jackson, Brian R. , Kaplan, Bonnie , Kelly, William R. , Ko, Kyungmin, Kurapati, Nikhil , Labbad, Gabriel , Lee, Julie , Leitner, Stefano, Liao, Zachary C , Melnick, Edward R. , Muniyappa, Anoop , Murray, Sara G. , Nichols-Johnson, Victoria, Novak, Laurie L. , Ogan, William Scott , Ozeran, Larry, Pageler, Natalie M. , Pandita, Deepti , Perumbeti, Ajay, Petersen, Carolyn , Pierce, Logan , Puttagunta, Raghuveer, Ramaswamy, Priya , Rogers, Kendall, Ryan, Angela M., Sarabu, Chethan , Shaw, Kate A. , Spector, Jacob D. , Starren, Justin , Stoffel, Michelle , Swanson, Karl , Tomes, Adrian, Unertl, Kim M. , Weon, Jenny L. , Wiley, Kevin , Winkelstein, Peter , Wong, Jenson, Xie, James , Yarahuan, Julia , Yung, Nathan , Zera, Chloe , Sadasivaiah, Shobha , Boyd, Andrew D , Melnick, Edward R , Petersen, Carolyn , Arvisais‐Anhalt, Simone , Benham‐Hutchins, Marge , Brecht-Doscher, Aimee, Elkin, Peter L. , Hersh, William , Kelly, William, Koppel, Ross , Lehmann, Christoph U. , Medford, Richard J , Neinstein, Aaron Barak , Rosenbloom, S. Trent , Ryan, Angela, Saleh, Sameh Nagui , Schreiber, Richard , Sim, Ida , Sirintrapun, Sahussapont Joseph , Solomonides, Anthony , Subbian, Vignesh , Trang, Karen , Whooley, Mary A. , Williamson, Drew F. K. , Ratanawongsa, Neda

Applied Clinical Informatics | December 19, 2022 | Volume: 14 | Issue: 01 | Pages: 164-171

10.1055/a-2000-7590 Get It

Characterizing variability of electronic health record-driven phenotype definitions
Brandt, Pascal , Luo, Yuan , Pacheco, Jennifer A. , Walunas, Theresa L. , Håkonarson, Håkon , Liu, Cong , Walton, Nephi , Carrell, David , Crane, Paul K. , Chute, Christopher G. , Carroll, Robert J. , Denny, Joshua C. , Ramirez, Andrea H. , Wei, Wei‐Qi, Pathak, Jyoti , Wiley, Laura K. , Richesson, Rachel , Starren, Justin , Rasmussen, Luke V. , Brandt, Pascal S , Luo, Yuan , Pacheco, Jennifer A , Hakonarson, Hakon , Liu, Cong , Carrell, David S , Chute, Christopher G , Wiley, Laura K , Starren, Justin B , Rasmussen, Luke V , Denny, Joshua C , Richesson, Rachel L , Wei, Wei-Qi , Walunas, Theresa L , Kho, Abel , Hripcsak, George , Shang, Ning , Weng, Chunhua , Larson, Eric B. , Kullo, Iftikhar J. , Pathak, Jyoti

Journal of the American Medical Informatics Association | December 7, 2022 | Volume: 30 | Issue: 3 | Pages: 427-437

10.1093/jamia/ocac235 Get It

AbstractObjectiveThe aim of this study was to analyze a publicly available sample of rule-based phenotype definitions to characterize and evaluate the variability of logical constructs used.Materials and MethodsA sample of 33 preexisting phenotype definitions used in research that are represented using Fast Healthcare Interoperability Resources and Clinical Quality Language (CQL) was analyzed using automated analysis of the computable representation of the CQL libraries.ResultsMost of the phenotype definitions include narrative descriptions and flowcharts, while few provide pseudocode or executable artifacts. Most use 4 or fewer medical terminologies. The number of codes used ranges from 5 to 6865, and value sets from 1 to 19. We found that the most common expressions used were literal, data, and logical expressions. Aggregate and arithmetic expressions are the least common. Expression depth ranges from 4 to 27.DiscussionDespite the range of conditions, we found that all of the phenotype definitions consisted of logical criteria, representing both clinical and operational logic, and tabular data, consisting of codes from standard terminologies and keywords for natural language processing. The total number and variety of expressions are low, which may be to simplify implementation, or authors may limit complexity due to data availability constraints.ConclusionsThe phenotype definitions analyzed show significant variation in specific logical, arithmetic, and other operators but are all composed of the same high-level components, namely tabular data and logical expressions. A standard representation for phenotype definitions should support these formats and be modular to support localization and shared logic.
Infobuttons for Genomic Medicine: Requirements and Barriers
Connolly, John J. , Pet, Douglas , Peterson, Josh F. , Shirts, Brian H. , Starren, Justin , Walton, Nephi , Connolly, John J , Peterson, Josh F , Rasmussen, Luke V. , Fiol, Guilherme Del , Freimuth, Robert R. , Williams, Marc S , Taylor, Casey Overby

Applied Clinical Informatics | May 12, 2021 | Volume: 12 | Issue: 02 | Pages: 383-390

10.1055/s-0041-1729164 Get It

Abstract Objectives The study aimed to understand potential barriers to the adoption of health information technology projects that are released as free and open source software (FOSS). Methods We conducted a survey of research consortia participants engaged in genomic medicine implementation to assess perceived institutional barriers to the adoption of three systems: ClinGen electronic health record (EHR) Toolkit, DocUBuild, and MyResults.org. The survey included eight barriers from the Consolidated Framework for Implementation Research (CFIR), with additional barriers identified from a qualitative analysis of open-ended responses. Results We analyzed responses from 24 research consortia participants from 18 institutions. In total, 14 categories of perceived barriers were evaluated, which were consistent with other observed barriers to FOSS adoption. The most frequent perceived barriers included lack of adaptability of the system, lack of institutional priority to implement, lack of trialability, lack of advantage of alternative systems, and complexity. Conclusion In addition to understanding potential barriers, we recommend some strategies to address them (where possible), including considerations for genomic medicine. Overall, FOSS developers need to ensure systems are easy to trial and implement and need to clearly articulate benefits of their systems, especially when alternatives exist. Institutional champions will remain a critical component to prioritizing genomic medicine projects.
Pharmacogenomic clinical decision support design and multi-site process outcomes analysis in the eMERGE Network
Herr, Timothy M., Peterson, Josh F. , Rasmussen, Luke V. , Peissig, Peggy , Starren, Justin , Caraballo, Pedro J. , Rasmussen, Luke V , Peterson, Josh F

Journal of the American Medical Informatics Association | November 5, 2018 | Volume: 26 | Issue: 2 | Pages: 143-148

10.1093/jamia/ocy156 Get It

Abstract To better understand the real-world effects of pharmacogenomic (PGx) alerts, this study aimed to characterize alert design within the eMERGE Network, and to establish a method for sharing PGx alert response data for aggregate analysis. Seven eMERGE sites submitted design details and established an alert logging data dictionary. Six sites participated in a pilot study, sharing alert response data from their electronic health record systems. PGx alert design varied, with some consensus around the use of active, post-test alerts to convey Clinical Pharmacogenetics Implementation Consortium recommendations. Sites successfully shared response data, with wide variation in acceptance and follow rates. Results reflect the lack of standardization in PGx alert design. Standards and/or larger studies will be necessary to fully understand PGx impact. This study demonstrated a method for sharing PGx alert response data and established that variation in system design is a significant barrier for multi-site analyses.
CSER and eMERGE: current and potential state of the display of genetic information in the electronic health record
Shirts, Brian H. , Salama, Joseph S , Aronson, Samuel , Gray, Stacy W. , Hindorff, Lucia A. , Jarvik, Gail P. , Tarczy‐Hornoch, Peter , Freimuth, Robert R. , Grundmeier, Robert W. , Hartzler, Andrea L. , Li, Rongling, Peissig, Peggy , Peterson, Josh F. , Rasmussen, Luke V. , Starren, Justin , Overby, Casey Lynnette, Taylor, Casey Overby , Chute, Christopher G. , Chung, Wendy K. , Plon, Sharon E. , Stoffel, Elena M. , Van Allen, Eliezer M , Weck, Karen E. , Williams, Marc S , Jarvik, Gail P , Rasmussen, Luke V , Freimuth, Robert R , Peterson, Josh F , Gray, Stacy W

Journal of the American Medical Informatics Association | July 4, 2015 | Volume: 22 | Issue: 6 | Pages: 1231-1242

10.1093/jamia/ocv065 Get It

Abstract Objective Clinicians’ ability to use and interpret genetic information depends upon how those data are displayed in electronic health records (EHRs). There is a critical need to develop systems to effectively display genetic information in EHRs and augment clinical decision support (CDS). Materials and Methods The National Institutes of Health (NIH)-sponsored Clinical Sequencing Exploratory Research and Electronic Medical Records & Genomics EHR Working Groups conducted a multiphase, iterative process involving working group discussions and 2 surveys in order to determine how genetic and genomic information are currently displayed in EHRs, envision optimal uses for different types of genetic or genomic information, and prioritize areas for EHR improvement. Results There is substantial heterogeneity in how genetic information enters and is documented in EHR systems. Most institutions indicated that genetic information was displayed in multiple locations in their EHRs. Among surveyed institutions, genetic information enters the EHR through multiple laboratory sources and through clinician notes. For laboratory-based data, the source laboratory was the main determinant of the location of genetic information in the EHR. The highest priority recommendation was to address the need to implement CDS mechanisms and content for decision support for medically actionable genetic information. Conclusion Heterogeneity of genetic information flow and importance of source laboratory, rather than clinical content, as a determinant of information representation are major barriers to using genetic information optimally in patient care. Greater effort to develop interoperable systems to receive and consistently display genetic and/or genomic information and alert clinicians to genomic-dependent improvements to clinical care is recommended.
NEAT-o-games
Fujiki, Yuichi, Kazakos, Konstantinos, Puri, Colin, Pavlidis, Ioannis , Starren, Justin , Levine, James A.

CHI '07 Extended Abstracts on Human Factors in Computing Systems | June 6, 2007 | Volume: No volume available | Issue: No issue available | Pages: 2369-2374

10.1145/1240866.1241009 Get It

StressCam
Puri, Colin, Olson, Leslie, Pavlidis, Ioannis , Levine, James A. , Starren, Justin

CHI '05 Extended Abstracts on Human Factors in Computing Systems | August 3, 2005 | Volume: No volume available | Issue: No issue available | Pages: 1725-1728

10.1145/1056808.1057007 Get It