Comparing clinical trial population representativeness to real-world populations: an external validity analysis encompassing 43 895 trials and 5 685 738 individuals across 989 unique drugs and 286 conditions in England

Randomised controlled trials (RCTs) inform prescription guidelines, but stringent eligibility criteria exclude individuals with vulnerable characteristics, which we define as comorbidities, concomitant medication use, and vulnerabilities due to age. Poor external validity can result in inadequate treatment decision information. Our first aim was to quantify the extent of exclusion of individuals with vulnerable characteristics from RCTs for all prescription drugs. Our second aim was to quantify the prevalence of individuals with vulnerable characteristics from population electronic health records who are actively prescribed such drugs. In tandem, these two aims will allow us to assess the representativeness between RCT and real-world populations and identify vulnerable populations potentially at risk of inadequate treatment decision information. When a vulnerable population is highly excluded from RCTs but has a high prevalence of individuals actively being prescribed the same medication, there is likely to be a gap in treatment decision information. Our third aim was to investigate the use of real-world evidence in contributing towards quantifying missing treatment risk or benefit through an observational study.

We extracted RCTs from ClinicalTrials.gov from its inception to April 28, 2021, and primary care records from the Clinical Practice Research Datalink Gold database from Jan 1, 1998, to Dec 31, 2020. We referred to the British National Formulary to classify prescription drugs into drug categories. We conducted descriptive analyses and quantified RCT exclusion and prevalence of individuals with vulnerable characteristics for comparison to identify populations without treatment decision information. Exclusion and prevalence were assessed separately for different age groups, individual clinical specialities, and for quantities of concomitant conditions by clinical specialities, where multimorbidity was defined as having two or more clinical specialties, and medications prescribed, where polypharmacy was defined as having five or more medications prescribed. Population trends of individuals with multimorbidity or polypharmacy were assessed separately by age group. We conducted an observational cohort study to validate the use of real-world evidence in contributing towards quantifying treatment risk or benefit for patients with dementia on anti-dementia drugs with and without a contraindicated clinical speciality. To do so, we identified the clinical specialities that anti-dementia drug RCTs highly excluded yet had corresponding high prevalence in the real-world population, forming the groups with highest risk of having scarce treatment decision information. Cox regression was used to assess if the risk of mortality outcomes differs between both groups.