Introduction: Manual measurement of leg length (LL) and offset can be tedious. This study developed an automated algorithm for measuring LL and offset from pre- and postoperative AP pelvis radiographs in a large cohort of THA patients. Methods: Using a deep learning model trained on 1100 total AP pelvis radiographs, an algorithm was developed to calculate LL and offset. Algorithm measurements were compared with manual measurements by 4 raters on a sample of 100 pre- and postoperative image pairs. Inter- and intra-rater consistency was calculated using the intraclass correlation coefficient (ICC). The algorithm was applied to calculate the pre- and postoperative LL and offset discrepancies and the change in LL and offset bilaterally in a cohort of 15,951 image pairs. Results: ICC values between the algorithm and human raters ranged from 0.83 to 0.88 for offset measurements and 0.92 to 0.97 for LL measurements. Human raters demonstrated good-to-excellent inter-rater ICC and uniformly excellent intra-rater ICC. Entire database measurements demonstrated shorter LLs for arthritic joints versus the contralateral leg preoperatively and reduced LL discrepancy post-arthroplasty. Conclusions: We present a deep learning algorithm for calculating LL and offset using AP pelvis radiographs. This tool can support population-level studies and may assist operative management.
AKIRA: Deep learning tool for image standardization, implant detection and arthritis grading to establish a radiographic registry in patients with anterior cruciate ligament injuries
Abstract Purpose Developing large‐scale, standardized radiographic registries for anterior cruciate ligament (ACL) injuries with artificial intelligence (AI) tools can enhance personalized orthopaedics. We propose deploying Artificial Intelligence for Knee Imaging Registration and Analysis (AKIRA), a trio of deep learning (DL) algorithms, to automatically classify and annotate radiographs. We hypothesize that algorithms can efficiently organize radiographs based on laterality, projection, identify implants and classify osteoarthritis (OA) grade. Methods A collection of 20,836 knee radiographs from all time points of treatment (mean orthopaedic follow‐up 70.7 months; interquartile range [IQR]: 6.8–172 months) were aggregated from 1628 ACL‐injured patients (median age 26 years [IQR: 19–42], 57% male). Three DL algorithms (EfficientNet, YOLO [You Only Look Once] and Residual Network) were employed. Radiograph laterality and projection (anterior‐posterior [AP], lateral, sunrise, posterior‐anterior, hip–knee–ankle and Camp‐Coventry intercondylar [notch]) were labelled by a DL model. Manually provided labels of metal fixation implants were used to develop a DL object detection algorithm. The degree of OA, both as measured by specific Kellgren–Lawrence (KL) grades, as well as based on a binarized label of OA (defined as KL Grade ≥2), on standing AP radiographs were classified using a DL algorithm. Individual model performances were evaluated on a subset of images prior to the deployment of AKIRA to registry construction using all ACL radiographs. Results The classification algorithms showed excellent performance in classifying radiographic laterality (F1 score: 0.962–0.975) and projection (F1 score: 0.941–1.0). The object detection algorithm achieved high precision–recall (area under the precision‐recall curve: 0.695–0.992) for identifying various metal fixations. The KL classifier reached concordances of 0.39–0.40, improving to 0.81–0.82 for binary OA labels. Sequential deployment of AKIRA following internal validation processed and labelled all 20,836 images with the appropriate views, implants, and the presence of OA within 88 min. Conclusion AKIRA effectively automated the classification and object detection in a large radiograph cohort of ACL injuries, creating an AI‐enabled radiographic registry with comprehensive details on laterality, projection, implants and OA. Study Design Cross‐sectional study. Level of Evidence Level IV.
A Stepwise Approach to Analyzing Musculoskeletal Imaging Data With Artificial Intelligence
The digitization of medical records and expanding electronic health records has created an era of “Big Data” with an abundance of available information ranging from clinical notes to imaging studies. In the field of rheumatology, medical imaging is used to guide both diagnosis and treatment of a wide variety of rheumatic conditions. Although there is an abundance of data to analyze, traditional methods of image analysis are human resource intensive. Fortunately, the growth of artificial intelligence (AI) may be a solution to handle large datasets. In particular, computer vision is a field within AI that analyzes images and extracts information. Computer vision has impressive capabilities and can be applied to rheumatologic conditions, necessitating a need to understand how computer vision works. In this article, we provide an overview of AI in rheumatology and conclude with a five step process to plan and conduct research in the field of computer vision. The five steps include (1) project definition, (2) data handling, (3) model development, (4) performance evaluation, and (5) deployment into clinical care.