Assessment of the Inclusion of Racial/Ethnic Minority, Female, and Older Individuals in Vaccine Clinical Trials

This cross-sectional study examines whether racial and/or ethnic minority, female, and older adults are underrepresented in vaccine clinical trials compared with the US population.


Introduction
Vaccines are one of the most important public health developments over the past century, leading to global reductions in morbidity and mortality from major infectious diseases. 1,2Worldwide production and availability of vaccines have helped to eliminate smallpox and nearly eradicate poliovirus. 3ccines have been a major focus to address the global severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) (ie, coronavirus disease 2019 [COVID-19]) pandemic, which is a danger to health care systems and global economies as well as to human life.The US government, in collaboration with industry, has accelerated multiple vaccine candidates through clinical trials with the hope of alleviating the COVID-19 pandemic. 4ccines are usually only approved for public use after rigorous randomized clinical trials that establish safety and efficacy. 57][8] In vaccine trials, enrollment should target populations at greatest risk for infection, serious morbidity, or mortality.In the case of SARS-CoV-2, data demonstrate disproportionate rates of infection and COVID-19-attributable mortality among older adults and in communities with longstanding social and structural inequities, specifically, Black or African American, American Indian and Alaska Native, Native Hawaiian and Pacific Islander, and Hispanic or Latino individuals. 9,10Some minority groups, including but not limited to Black, Latino, Pacific Islander, and Indigenous individuals, have been reported to have more than twice the mortality rate of White people. 10,11storically, clinical trials have lacked equitable inclusion of people identifying as members of racial/ethnic minority groups and female and older individuals. 12When people with diverse backgrounds are not adequately represented, treatments shown to be effective in trials may not be generalizable to or effective for all populations. 13Furthermore, because of previous experience with exclusion and maltreatment, vaccine hesitancy and lack of trust in the medical establishment may be more prevalent across minority groups, making inclusion even more important. 14 enhance enrollment of underrepresented groups, the National Institutes of Health (NIH) Revitalization Act of 1993 mandated appropriate inclusion of women and racial/ethnic minority groups in clinical trials. 15,16However, decades later, inclusion has remained persistently low. 17More recently, the US Food and Drug Administration (FDA) developed plans to enhance inclusion of underrepresented groups and to improve reporting of demographic data; the impact of this plan is unclear. 18spite policies aimed at addressing enrollment diversity in clinical trials, to our knowledge, data regarding the inclusion of these groups have not been assessed in vaccine trials.This study assessed whether racial/ethnic minority groups and female and older adults are underrepresented in vaccine clinical trials.We hypothesized that these 3 groups would be underrepresented.

Methods
This cross-sectional study used data from completed interventional vaccine trials from July 1, 2011, to June 30, 2020, that were registered and reported on ClinicalTrials.gov.On July 17, 2020, the terms vaccine, vaccination, immunization, and inoculation were used to identify trials that were registered in the NIH's ClinicalTrials.govonline repository within the past decade (July 1, 2011, to June 30, 2020) of all human vaccine trials including children only, adults only, or both children and adults and targeting an infection.Trials addressing vaccine immunogenicity or efficacy of preventative vaccines were included; therapeutic vaccines (eg, targeting cancer) were excluded.To be included, trials had to be categorized as completed and have available results.Trials that were completed but without results reported were excluded.Also excluded were studies with unknown status and those that were not yet recruiting, still recruiting, enrolling by invitation, active but not recruiting, suspended, terminated, or withdrawn.Studies based outside the US were excluded, as were studies testing other components of vaccine production, delivery, and participant behavior.Since this cross-sectional study did not involve human participants and used publicly available data, it did not require review and approval by an institutional review board or ethics committee, according to the Fred Hutchinson Cancer Research Center Institutional Review Board.No informed consent was obtained, given that the data used did not contain any identifiable information and participants could not be contacted.
This study followed the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) reporting guideline.

Data Collection
We collected demographic data, including race/ethnicity, sex, and age.For race/ethnicity, we used the categories used on ClinicalTrials.govby the Office of Management and Budget Standards for the Classification of Federal Data on Race and Ethnicity. 17,19We included the following categories for race: White, Black or African American, Asian, Hawaiian or Pacific Islander, American Indian or Alaska Native, more than 1 race, and other, missing, or unknown.Ethnicity was classified as Hispanic or Latino.Trials were categorized by primary pathogen (eg, viral, bacterial, or other), age (eg, adult, child, or adult and child), and trial phase (eg, phase 1, 2, 3, or 4).For consistency, studies that were characterized as combined phases (eg, phases 1 and 2) were categorized to the higher phase except those that enrolled fewer than 50 participants, which were considered as phase 1 for the purposes of this study; all postlicensure studies were considered phase 4. Month and calendar year for trial start and conclusion were collected to assess reporting changes over the study period.In addition, we collected primary and secondary funding sources for each trial (eg, industry, government).For comparison of these demographic data, we used US population data from the 2011 and 2018 American Community Surveys (ie, US censuses). 20,21

Statistical Analysis
For trials reporting demographic information as percentages only, we computed integer counts of participants by multiplying the percentage in each group by the total number of participants analyzed and rounding to the nearest integer.In the event that counts of mutually exclusive minority groups did not add to the total number analyzed in the trial, we adjusted counts among the other, unknown, or missing category so the sum of participants in all minority groups matched the total number of participants analyzed in the trial.To make inference from our sample of vaccine trials to a larger population, we computed 95% CIs for estimates of the percentage in each demographic group using the Wilson method for binomial proportions. 22For racial group estimates, we computed simultaneous 95% CIs by applying a Bonferroni correction using a 2-sided α level of .05divided by 7 to reflect multinomial distribution of race proportions.We compared our estimates with 95% CIs with US population estimates from the 2011 and 2018 censuses, which generally reported a sampling error of ±0.1% for demographic estimates of interest in this study.Analyses were completed using SPSS, version 25.0 (IBM) or SAS, version 9.4 (SAS Institute Inc).

Race/Ethnicity
Table 2 presents the number and percentage of participants in each demographic group for the subset of 153 adult trials and 52 pediatric trials compared with US census data from 2011 and 2018.
Of all 134 trials reporting race, 65 (48.5%) did not include American Indian or Alaska Native participants and 81 (60.4%) did not include Hawaiian or Pacific Islander participants.In contrast, White participants were represented in 133 trials [99.3%] reporting race.There was significant variability in trials reporting race/ethnicity over time.Figure 2 shows the percentage of registered trials reporting race/ethnicity between 2011 and 2018.In 2017 and 2018, 100% of trials reported race, and in 2017, reporting of ethnicity reached its highest percentage (12 of 17 [70.6%]).In most years, fewer than half of the trials reported ethnicity.
When analyzed by phase, enrollment of members of racial/ethnic minority groups varied widely (Figure 3).In adult phase 3 trials, 25 684 participants (79.8%) were White and 2187 participants (6.8%) were Black or African American compared with 12.6% to 13.9% reported in the general US population during this period.Similarly, Native Hawaiian and Pacific Islander, American Indian and Alaska Native, and Hispanic or Latino participants were underrepresented in phase 3 trials compared with their representation in the US population.Pediatric trials were more representative of the population when analyzed by phase; however, in pediatric phase 3 trials, 2147 (8.8%) of participants were Black or African American, compared with 14% among the US pediatric population (Figure 3).

Sex
Overall, female adult participants were overrepresented in vaccine clinical trials.They accounted for 56.0%(95% CI, 55.7%-56.2%) of participants compared with 50.8% to 51.5% of the US population according to census data.When analyzed by phase, female adults remained overrepresented in all trials regardless of phase (Figure 3).In pediatric trials, female participants had nearly equal representation (48.0%; 95% CI, 47.6%-48.4%)compared with the US population (48.8%) (Table 2).

Age
Of the total sample of 230 trials, 178 recruited adults and 52 recruited only children (Table 1).Of the trials including adults, 80 (45%) had age greater than or equal to 65 years as an inclusion criterion and 71 (39.9%) enrolled trial participants 65 years or older; 5 trials (2.8%) recruited only older adults.
Among the 170 studies reporting age as a percentage, 12.1% (95% CI, 12.0%-12.3%) of participants were 65 years or older, in contrast with 16.0% of the 2018 US population representing this age group.
When analyzed by phase, older adults were underrepresented across all trial phases, but their greatest participation was in phase 3 trials (Figure 3).

Discussion
In this cross-sectional study, we hypothesized that individuals who identify as members of minority groups, female adults, and people 65 years or older would be underrepresented in vaccine clinical trials.One of the most important findings was that despite FDA recommendations, many studies were not complying with reporting guidance regarding demographic characteristics of the study population.Black or African American and American Indian or Alaska Native adults were underrepresented, as were Hispanic or Latino adults and older adults.Female adults were overrepresented.Asian and Native Hawaiian or Pacific Islander participants were equally represented in vaccine trials compared with the US population.
The initial NIH Revitalization Act provided the impetus for policies related to the inclusion of women and minority groups in clinical trials for more than a quarter of a century. 16,17In 2000, this policy was updated to require inclusion of women and members of minority groups in all "biomedical and behavioral research projects involving human subjects" 8 unless there was a clear justification for their exclusion.Reporting guidance for trial results were clarified regarding sex, gender, and/or race/ethnicity differences. 16In 2001, the NIH updated the policy to align with the Office of Management and Budget guidelines regarding race/ethnicity. 19This update provided revised minimum standards of inclusion of sex, gender, and racial/ethnic minority groups in phase 3 clinical trials.The updated policy with diversity amendments stated that investigators needed to collect this information to meet the following definition for clinical research: "Research conducted on human subjects (or material of human origin such as tissues, specimens, and cognitive phenomena) for which an investigator (or colleague) directly interacts with human subjects." 8arly 2 decades later, in 2017, the NIH announced an amendment requiring investigators to not only include the specified groups in NIH-defined phase 3 clinical trials but also submit their results to ClinicalTrials.govafter conducting valid analyses based on sex, gender, and race/ethnicity.These analyses entailed an unbiased evaluation of the different groups with appropriate randomization, documentation of different outcomes or measures, and comparison of the intervention effects based on sex, gender, and race/ethnicity.The new rules and regulations were required and applied to all new competing grants awarded from December 2017 onward. 8The same year, the NIH updated its existing 1998 policy on the inclusion of children in research to include older individuals, focusing on participants across the life span; exclusion of these age groups requires an explanation. 7spite advancements, equity in clinical trial enrollment remains an issue.In a report examining the frequency in which minorities were the primary focus of National Cancer Institute-sponsored clinical trials, the researchers found, in a search done in 2013 over the previous 2 decades, that less than 2% of these clinical trials had minorities as the primary focus and that the percentage of manuscripts reporting race/ethnicity data ranged from 1.5% to 58%. 17 Our study contributes additional data to the reported gaps in participant representation; although of importance, the gaps were not large in general. 23,24Our study showed that diversity and inclusion challenges remained among vaccine trials because many trials enrolled participants while these updated regulations were  12,25,26 We confirmed our first hypothesis that adult participants from minority groups would be underrepresented; however, a large percentage of trials had no data available on minority groups, particularly Hispanic and Latino populations.8][29][30][31][32][33] For example, neighborhood poverty level has been associated with significant disparities in pneumococcal disease incidence among patients with vaccine and nonvaccine serotypes. 31[36] Our findings suggest that NIH policies on reporting of identified groups has increased over time, but a need to focus such policies beyond reporting to representative enrollment remains.Such differences were most apparent in large phase 3 trials in which Black or African American and other underrepresented minority research participants in both adult and pediatric vaccine trials were often underrepresented.Costs and rapid enrollment goals in phase 3 trials, which are primarily funded by industry (eFigure 2 in the Supplement), may be associated with this difference.Our data suggest that investments by federal agencies and industry are needed to ensure that enrollment is fair and equitable.Programs aimed at improving vaccine access for members of minority groups have been shown to be effective in increasing vaccination rates, suggesting that similar support could be used to bolster enrollment numbers. 33proving racial/ethnic diversity in clinical trials is important because enrollment may be associated with vaccination rates in minority groups.8][39] Enhancing enrollment may also address these issues by ensuring early community engagement.In addition, improving the diversity of the health care and clinical trial workforces may further engender trust, ensure culturally appropriate education, and limit language barriers to enhance trial participation and vaccination rates within minority communities. 40Future studies are needed to assess whether access to and a Wilson 95% CIs are given.For race, simultaneous 95% CIs were calculated using a Bonferroni correction for the 7 racial categories.Ethnicity was reported for 19 995 adult participants and 8626 pediatric participants.
d Excluding 13 trials that targeted exclusively women from the adult trials.For adult trials, n = 134 570; for pediatric trials, n = 60 767.
enrollment in clinical trials will lead to improved vaccination rates in these populations because not all policy changes help improve rates. 41r second hypothesis that female participants would be underrepresented in vaccine clinical trials was disproved.3][44] Our data revealed that female adults were overrepresented in trials of all phases.
Even when we excluded trials targeting exclusively female individuals, they remained overrepresented.The reasons for this are not clear, and further investigation may be enlightening,   Our third hypothesis, that people 65 years or older would be underrepresented, was challenging to assess because of data-reporting issues related to ClinicalTrials.gov.Variance in age reporting allowed us to assess enrollment of older adults in less than one-half of all trials.Considering trials that allowed assessment of this population and excluding those targeting only older adults, adults 65 years or older were less frequently enrolled in trials than expected according to their representation in the US population based on census data. 45This finding is not unexpected because many clinical vaccine trials target primary end points of seroconversion, immunogenicity, and/or efficacy and older adults have altered immunity with aging and less robust responses to conventional vaccines. 46,479][50][51] Although we focused on the representation of older adults, of note, the data challenges mentioned previously also apply to pediatric trials.The incomplete and varied reporting among specific age groups of children limited our ability to assess inclusion across the life span. 19

Limitations
This study has limitations.We examined 230 US-based trials with 219 555 participants; however, a lack of compliance with reporting data on the ClinicalTrials.govwebsite is both an important finding and a limitation.Despite clear grouping labels, data from ClinicalTrials.gov are heterogeneous.For example, although 100% of trials reported some age information, the registry lacks age-reporting standards.Age was reported variably by category, mean, range, and/or percentage older than 65 years, resulting in difficulty addressing age disparities.Most trials reported race/ethnicity using standardized categories, but some used customized race reporting, and we had to deduce racial makeup or eliminate trials entirely because of insufficient data.Furthermore, we relied on 2 US census estimates for population norms for demographic categories because the years when these data were reported spanned the study period.Evaluation of phase 3 trial enrollment may have been biased toward less reporting on race/ethnicity because most completed trials were begun before FDA regulations for reporting were established.ClinicalTrials.govreports sex data only, which restricted our ability to analyze representation of gender identity minority groups in trials.Similarly, we were unable to analyze representation with regard to sexual orientation because of lack of data reporting.We were unable to account for database inaccuracies in ClinicalTrials.gov.

Figure 1 .1
Figure 1.Flowchart of Clinical Trials Included in This Study 629 Records identified through database search in ClinicalTrials.gov(January 1, 2011, to June 30, 2020)

Figure 2 .
Figure 2. Registered Vaccine Clinical Trials Reporting Race/Ethnicity By Year 100

Figure 3 .
Figure 3. Demographic Representation by Trial Phase

Table 2 .
Race/Ethnicity and Sex Representation in Registered Vaccine Clinical Trials in ClinicalTrials.gov