Ross, Joseph S.

This cross-sectional study assesses published research articles about medical items and services approved by the Coverage With Evidence Development program to characterize their scientific impact.

Objectives To evaluate the feasibility for use of electronic health record (EHR) data in conducting adverse event surveillance among women who received mid-urethral slings (MUS) to treat stress urinary incontinence (SUI) in five health systems. Design Retrospective observational study using EHR data from 2010 through 2021. Women with a history of MUS were identified using common data models; a common analytic code was executed at each site. A manual chart review was conducted in a per-site random patient subset to establish a reference standard. Automated text processing (Text Processed Integrated (TPI)) was developed and evaluated at each site to determine the surgical approach and synthetic mesh implantation. Patients were characterized and surgical outcomes were ascertained over 730 subsequent days. Setting Five large tertiary care academic medical centers. Participants Across five health systems, 9,906 eligible patients (mean age 57–60 per site) were identified. Main outcome measures Determination of surgical approach, synthetic mesh implantation, and assessment of the duration of surveillance for mortality and reoperation rates following MUS implantation. Results In the TPI cohort analysis, 3,331 patients were identified. Surgical approach per site was retropubic (42% to 77%), transobturator (6% to 44%), single incision (0% to 24%), and adjustable sling (0% to <4%). Concordance rates for TPI using chart review were 71%–90% at each site for the surgical approach and 28%–85% for synthetic mesh implantation. Patient follow-up observation rates for mortality and reoperation ranged from 22% to 36% at 90 days, 15% to 30% at 365 days, and 8% to 19% at 730 days. Conclusion Using EHR data alone, identification of medical devices and surgical approaches was feasible among women with MUS surgery for SUI, but long-term follow-up ascertainment rates were low. Medical device surveillance using EHR data should be evaluated in the context of the clinical use case, as applicability may vary.

Introduction In 2005, the Centers for Medicare and Medicaid Services introduced the Coverage with Evidence Development program for items and services with limited evidence of benefit and harm for Medicare beneficiaries, aiming to generate evidence to determine whether they meet the statutory “reasonable and necessary” criteria for coverage. Coverage with Evidence Development requires participation in clinical studies approved by the Centers for Medicare and Medicaid Services (i.e. Coverage with Evidence Development-approved studies) as a condition of coverage. We examined the quality of evidence generated by Coverage with Evidence Development-approved studies compared with those that informed Centers for Medicare and Medicaid Services’ initial Coverage with Evidence Development decisions (i.e. National Coverage Determination studies). Methods Using Centers for Medicare and Medicaid Services’ webpage, we identified all items and services covered under Coverage with Evidence Development and their Coverage with Evidence Development-approved studies. Through searching PubMed and Google Scholar, we identified original research articles that reported results for primary endpoints of Coverage with Evidence Development-approved studies. We then reviewed the initial Coverage with Evidence Development decision memos and identified National Coverage Determination studies that were original research.We characterized and compared Coverage with Evidence Development-approved studies and National Coverage Determination studies. Results From 2005 to 2023, 26 items and services were covered under the Coverage with Evidence Development program, associated with 196 National Coverage Determination studies (170 (86.7%) clinical trials and 26 (13.3%) registries) and 116 unique Coverage with Evidence Development-approved studies (86 (74.1%) clinical trials, 23 (19.8%) registries, 4 (3.4%) claims-based studies, and 3 (2.6%) expanded access studies). Among clinical trial studies, National Coverage Determination studies and Coverage with Evidence Development-approved studies did not differ with respect to multi-arm design (59.4% vs 68.6%; p = 0.15). However, among multi-arm clinical trial studies, National Coverage Determination studies were less likely than Coverage with Evidence Development-approved studies to be randomized (52.5% vs 93.2%; p < 0.001). Overall, National Coverage Determination studies less frequently had ≥ 1 primary endpoint focused on a clinical outcome measure (65.8% vs 87.9%; p = 0.006) and less frequently exclusively enrolled Medicare beneficiaries (3.1% vs 25.9%; p < 0.001). In addition, National Coverage Determination studies had smaller population sizes than Coverage with Evidence Development-approved studies (median 100 (interquartile range, 45–414) vs 302 (interquartile range, 93–1000) patients; p = 0.002). Among Coverage with Evidence Development-approved studies, 59 (50.9%) had not yet publicly reported results for the primary endpoint. Discussion Studies required under Medicare’s Coverage with Evidence Development program more often used randomized study designs, had larger patient populations, enrolled US patients, and focused on clinical outcomes as primary endpoints than studies used to inform initial National Coverage Determinations. However, not all Coverage with Evidence Development-approved studies have thus far reported results, which could create uncertainty for patients, physicians, and payers regarding the clinical benefits of covered items and services. Conclusion The Centers for Medicare and Medicaid Services’ Coverage with Evidence Development program has successfully prompted generation of more robustly designed clinical studies to better inform clinical, regulatory, and coverage decisions compared to studies informing initial coverage decisions. Yet, opportunities exist to further strengthen the design and dissemination of studies required under this program.

Background: Physical function (PF) is an important outcome that can inform cancer treatment tolerability from a clinical and regulatory perspective. PF can be assessed through different modalities: patient-reported (PRO), clinician-reported (ClinRo), performance tests (PerfO), and digital sensors (wearables). No standard approach for PF measurement has been defined, and each modality bears unique implementation challenges. The Integrating 4 Measures to Assess Physical Function study (In4M, NCT05214144) characterized the performance of these PF modalities in patients receiving cytotoxic chemotherapy, with a goal of guiding an assessment strategy in future cancer trials. Here we present feasibility results of the In4M study in patients with lymphoma. Methods: In4M is a prospective observational study with longitudinal PF assessment of PROs, ClinRo, PerfO, and wearable sensor data for over 9 months in patients initiating chemotherapy for lymphoma or breast cancer at Mayo Clinic and Yale University. Patient-reported PF was assessed using several validated ePRO instruments, ClinRo utilized clinician-reported Eastern Cooperative Oncology Group (ECOG) performance status, PerfO was measured via 6-minute walk test (6MWT), and digital sensor data was obtained from a wearable (Fitbit) provided to all participants. We evaluated the feasibility of implementing these PF modalities through compliance outcomes and a study-specific exit survey. Descriptive statistics included medians and interquartile ranges (IQR) for continuous variables and frequencies for categorical variables. We used a mixed model to estimate mean number of Fitbit compliant days per week. Results: Among 66 patients with lymphoma in the study (median age was 57 years; 52% were male), 90% self-reported as White, 4.9% as Black, 1.6% as Asian, 1.6% as American Indian or Alaska Native, and 1.6% as multiple races. Ethnicity was reported as non-Hispanic/Latino by 93% of patients. Education status was reported as more than high school by 92% of patients, and 49% reported full-time employment at time of enrollment. The overall ePROs completion rate was 80.7% for the entire study period. Baseline ePRO completion rate was 93.9%. Completion rate while undergoing chemotherapy was 91.3% and 75.4% in the post-treatment follow-up. The median time to complete ePROs was 4.1 minutes (IQR 2.8-5.9), ranging from 3.1 minutes for surveys with 37 questions to 5.6 minutes for surveys with 55 questions (survey length varied by timepoint). The baseline 6MWT was completed by 91% of patients. The most common reasons for not completing the baseline 6MWT were: patient refusal (50%, 3/6), patient not physically present (33%, 2/6), and unable to complete due to fatigue (17%, 1/6). The 3-month 6MWT was completed by 66% (40/61) of patients, with the most common reasons for missingness being: patient not physically present (38%, 8/21) and unable to complete due to fatigue (14%, 3/21). When considering the days when Fitbit was used, the median wear time was 21.3 hours (IQR 18.9-22.5) per day. The proportion of compliant days (&gt;10 hours of wear time during waking hours) was 53% (IQR 20-84). The median of participants' average compliant days per week was 5.4 (IQR 4.3-6.1) days/week after enrollment, with a slight downward trend over time (-0.017 compliant days per week [95% CI: -0.021, -0.012, p &lt;0.001] over each consecutive week in the study). The exit survey was completed by 39 (59%) patients. Most participants (85%) indicated they did not find the ePRO surveys burdensome to complete. Using the Fitbit (charging and syncing) was found to be manageable by most patients (87% and 84%, respectively). 60.8% of patients did not find the wearable bothersome to use, while the main themes reported by the remaining patients were related to the operation of the wearable itself (functions, small text size, forgetting login information) or discomfort (band material, wearing at night). Conclusion: Multi-modal assessment of PF with PRO, ClinRo, PerfO and wearable sensor data in patients with lymphoma undergoing treatment is feasible. Designing lymphoma therapeutic trials that incorporate at least one PF assessment modality, or assessment with a parsimonious combination of modalities, is achievable and may yield valuable insights into treatment tolerability for clinical and regulatory purposes.

Key Points Sodium-glucose cotransporter 2 inhibitors and glucagon-like peptide-1 receptor agonists were superior to dipeptidyl peptidase-4 inhibitor and sulfonylurea for preventing kidney complications in patients with type 2 diabetes at moderate cardiovascular disease risk. Sodium-glucose cotransporter 2 inhibitor therapy compared favorably with glucagon-like peptide-1 receptor agonists for kidney disease outcomes. Background CKD is a serious diabetes-related complication. While guidelines recommend use of sodium-glucose cotransporter 2 inhibitor (SGLT2i) and glucagon-like peptide-1 receptor agonist (GLP-1RA) therapies to mitigate cardiorenal risk in high-risk patients, the benefit of early initiation of these agents relative to other commonly prescribed glucose-lowering agents in patients at lower baseline cardiovascular disease (CVD) risk remains less clear. Methods This retrospective observational study emulated an idealized target trial using claims data from OptumLabs data warehouse to test the comparative association of treatment with a dipeptidyl peptidase-4 inhibitor (DPP-4i), SGLT2i, GLP-1RA, or sulfonylurea (SU) on a primary kidney composite outcome of incident CKD stages 3–5, kidney failure, or need for KRT in patients with type 2 diabetes and moderate CVD risk. A secondary composite outcome included all components of the primary composite outcome plus death. Results A total of 364,714 adults aged 21 years or older initiating treatment with a DPP-4i ( N =78,843), GLP-1RA ( N =42,049), SGLT2i ( N =45,466), or SU ( N =198,356) were identified. Relative to DPP-4i, SGLT2i (hazard ratio [HR], 0.71; 95% confidence interval [CI], 0.67 to 0.74; P < 0.001) and GLP-1RA (HR, 0.87; 95% CI, 0.83 to 0.92; P < 0.001) treatment was superior for the primary composite outcome. Similarly, SGLT2i (HR, 0.69; 95% CI, 0.66 to 0.73) and GLP-1RA (HR, 0.86; 95% CI, 0.82 to 0.91) treatment was associated with risk reductions for the primary outcome relative to SU treatment. When comparing SGLT2i with GLP-1RA therapy, SGLT2is were superior for the primary composite outcome (HR, 0.81; 95% CI, 0.75 to 0.86; P < 0.001). Similar findings were observed for the secondary composite outcome across all comparisons. Conclusions SGLT2is and GLP-1RAs were superior to DPP-4is and SUs for preventing kidney complications in a type 2 diabetes population with moderate baseline CVD risk. Clinical Trial registry name and registration number: NCT05214573.

1564 Background: Physical function (PF) is a core outcome in cancer trials that can inform treatment tolerability. PF can be assessed across modalities including by patient (pt) report, clinician (clin) report, performance tests and digital sensors. The optimal approach for PF measurement has not been defined. Methods: In4M is a prospective observational study evaluating PF in pts initiating chemotherapy for breast cancer or lymphoma followed over 9 months. We used an electronic platform (Hugo) to aggregate serially assessed pt-reported PF, clin- and pt-reported ECOG performance status (PS), 6-minute walk test (6MWT) and wearable (Fitbit) data. We evaluated feasibility in all pts; associations among PF measures and the ability of PF measures to detect change were evaluated in pts with both baseline (BL) and 3-month (3M) data. We used Pearson correlations to assess the relationship of average daily steps with measures of PF. To assess change, we compared each PF measure from BL to 3M using a 2-sided α=.05 paired t-test. Results: Of the208 pts enrolled, 193 (93%) and 159 (76%) completed surveys, and 121 (58%) and 124 (60%) provided wearable data (evaluable: ≥1 day data) at BL and 3M, respectively. When requiring a stringent BL with 4+ days of data with ≥1 weekend day to be evaluable, 88 (42%) and 120 (58%) provided wearable data at BL and 3M. At both BL and 3M, pt-reported PF was generally more highly correlated with wearable-derived daily steps than clin-reported PF and 6MWT were (Table). Significant declines in PF were observed for pt- and clin-reported PF (all p<0.05), but not other modalities. Conclusions: Longitudinalassessment of multi-modal PF data including pragmatic wearable data collection was feasible in pts receiving chemotherapy. Pt-reported PF was the only modality that was both correlated with step count and able to detect change. Additional wearable metrics, correlations among PF measurements and outcomes, and clinically meaningful change scores will be reported. Optimal PF measurement may improve future reporting of treatment tolerability. Clinical trial information: NCT05214144 . [Table: see text]

Abstract The Centers for Medicare & Medicaid Services (CMS) relies on public comments submitted in response to proposed national coverage determinations to assist the agency in determining the coverage of items and services for Medicare beneficiaries. In a cross-sectional study, we characterized the cited evidence and what funding supported the cited evidence submitted in public comments to CMS for all therapeutic medical device national coverage determinations finalized between June 2019 and June 2022. Of 681 public comments, 159 (23%) cited at least 1 identifiable published scientific journal article. Within these 159 public comments, 198 unique articles were cited, 170 (86%) of which included funding statements or author disclosures. Among these, 96 (56%) disclosed funding from manufacturers that would benefit from Medicare coverage and/or were written by author(s) who received funding from these manufacturers. In summary, most public commenters for national coverage determinations did not cite published scientific journal articles to support their positions. Among those who did, more than half of articles were directly funded by manufacturers that would benefit from coverage. Greater funding of independent, non–industry-supported research may help provide unbiased evaluations of benefits and harms to support Medicare coverage decisions.

BACKGROUND: Following regulatory approval, medical devices may be used “off-label.” Patent foramen ovale (PFO) closure is indicated to reduce recurrent stroke but has been proposed for other indications, including migraine, transient ischemic attack, and diving decompression illness. We sought to evaluate PFO closure rates and indications relative to the timing of regulatory approval and publication of key randomized trials. METHODS: We performed a retrospective cohort study using the OptumLabs Data Warehouse of US commercial insurance enrollees from 2006 to 2019. We quantified PFO closure among individuals with ≥2 years of preprocedure coverage to establish indications, classified hierarchically as stroke/systemic embolism, migraine, transient ischemia attack, or other. RESULTS: We identified 5315 patients undergoing PFO closure (51.8% female, 29.2%≥60 years old), which increased from 4.75 per 100 000 person-years in 2006 to 6.60 per 100 000 person-years in 2019. Patients aged ≥60 years accounted for 29.2% of closures. Procedure volumes corresponded weakly with supportive clinical publications and device approval. Among patients with PFO closure, 58.6% underwent closure for stroke/systemic embolism, 10.2% for transient ischemia attack, 8.8% for migraine, and 22.4% for other indications; 17.6% of patients had atrial fibrillation at baseline; and 11.9% developed atrial fibrillation postprocedure. Those aged ≥60 years and male were less likely to undergo closure for migraine than stroke/systemic embolism. CONCLUSIONS: From 2006 to 2019, PFO closure use was consistently low and corresponded weakly with clinical trial publications and regulatory status. Nearly half of patients underwent PFO closure for indications unapproved by the Food and Drug Administration. Regulators and payers should coordinate mechanisms to promote utilization for approved indications to ensure patient safety and should facilitate clinical trials for other possible indications.

Objective To build on the recently completed GRADE (Glycemia Reduction Approaches in Diabetes: A Comparative Effectiveness Study) randomised trial examining the comparative effectiveness of second line glucose lowering drugs in achieving and maintaining glycaemic control in adults with type 2 diabetes. Design Emulation of a target trial. Setting Medical and pharmacy claims data from the OptumLabs Data Warehouse, a de-identified US national dataset of beneficiaries of commercially insured and Medicare Advantage plans, 29 March 2013 to 30 June 2021. Participants Adults (≥18 years) with type 2 diabetes who first started taking glimepiride, sitagliptin, liraglutide, insulin glargine, or canagliflozin between 29 March 2013 and 30 June 2021. Participants were treatment naive or were receiving metformin monotherapy at the time of starting the study drug. Main outcome measures The main outcomes were time to primary and secondary metabolic failure of the assigned treatment, calculated as days to haemoglobin A1c levels of ≥7.0% and >7.5%, respectively. Secondary metabolic, cardiovascular, and microvascular outcomes were analysed as specified in the GRADE statistical analysis plan. Propensity scores were estimated with the gradient boosting method, and inverse propensity score weighting was used to emulate randomisation to the treatment groups, which were then compared with Cox proportional hazards regression. (Results The study cohort included participants starting treatment with glimepiride (n=20 511), liraglutide (n=5569), sitagliptin (n=13 039), insulin glargine (n=7262), and canagliflozin (n=5290). The insulin glargine arm was excluded because of insufficient control of confounding. Median times to primary metabolic failure were 439 (95% confidence interval 400 to 489) days in the canagliflozin arm, 439 (426 to 453) days in the glimepiride arm, 624 (567 to 731) days in the liraglutide arm, and 461 (442 to 482) days in the sitagliptin arm. Median time to secondary metabolic failure was also longest in the liraglutide arm. Adults receiving liraglutide had the lowest one year cumulative incidence rate of primary metabolic failure (0.37, 95% confidence interval 0.35 to 0.40) followed by sitagliptin (0.44, 0.43 to 0.45), glimepiride (0.45, 0.44 to 0.45), and canagliflozin (0.46, 0.44 to 0.48). Similarly, the one year cumulative incidence rate of secondary metabolic failure was 0.27 (0.25 to 0.29) in the canagliflozin arm, 0.28 (0.27 to 0.29) in the glimepiride arm, 0.23 (0.21 to 0.26) in the liraglutide arm, and 0.28 (0.27 to 0.29) in the sitagliptin arm. No differences were observed between the study arms in the rates of microvascular and macrovascular complications. Conclusions In this target trial emulation of an expanded GRADE study framework, liraglutide was more effective in achieving and maintaining glycaemic control as a second line glucose lowering drug than canagliflozin, sitagliptin, or glimepiride.