Missing or incomplete reporting of clinical trial results and its scientific and ethical consequences are well documented.1,2 One concrete example of this problem occurs when a sponsor conducts several studies of a particular drug for a particular condition but only some (or none) of the studies make their way into the public domain, leaving a distorted body of public evidence.3 Policies that require reporting to ClinicalTrials.gov are designed to ameliorate that problem. ClinicalTrials.gov currently has more than 255 000 registered studies, with summary results information for more than 28 000 studies, of which an estimated half lack corresponding publications.2,4,5 To evaluate the influence of this resource on the evidence base, we examined the extent to which sets of trials registered in ClinicalTrials.gov by individual sponsors for the same drug and condition had results available publicly in ClinicalTrials.gov and/or PubMed.
We identified ClinicalTrials.gov-registered records for industry-sponsored, phase 2 to 4 trials of drugs or biologics, with at least 1 US study location, completed or terminated from January 1, 2007, through December 31, 2009 (allowing at least 7 years from trial completion for results reporting). We manually grouped trials into a sponsor-drug-condition trial set when the listed sponsor, drug, and condition appeared to be identical; we limited the analysis to a convenience sample of the first 96 sponsor-drug-condition trial sets identified. On July 25, 2017, we assessed the availability of results in PubMed-cited publications and/or results posted in ClinicalTrials.gov based on methods used in prior research.4 We also evaluated whether the drug was approved by the US Food and Drug Administration (FDA) for any use.
Our sample consisted of 329 trials studying 86 drugs and representing 96 unique sponsor-drug-condition trial sets (eg, Amgen-sponsored trials of alendronate for osteoporosis). The median number of trials per set was 3 (range, 2-11). The median proportion of trials in each set with results publicly available (in PubMed and/or ClinicalTrials.gov) was 100% (interquartile range, 62.5%-100%). Most trials used parallel assignment, double-blinding, randomization, and multiple sites and had more than 100 participants enrolled (Table 1). As of July 25, 2017, results were publicly available for 255 of 329 trials (77.5%): 79 (24.0%) from ClinicalTrials.gov only, 63 (19.1%) from PubMed only, and 113 (34.3%) from both sources. Overall, 58 (60.4%) of 96 sponsor-drug-condition trial sets had results available for all trials, and 13 (13.5%) had no results available from either source (Table 2). There were 15 (15.6%) trial sets with results from ClinicalTrials.gov only (10 sets with results posted for all trials and 5 sets with results posted for some trials) (Table 2).
Of 214 trials studying 55 FDA-approved drugs, 184 (86.0%) had results available, including 64 (29.9%) in ClinicalTrials.gov only. Of 115 trials studying 31 unapproved drugs, 70 (60.9%) had results publicly available, including 15 (13.0%) with results in ClinicalTrials.gov only.
ClinicalTrials.gov was a unique source of results for nearly one-quarter of sampled drug trials and more than one-tenth of sampled sponsor-drug-condition trial sets. However, results remain unavailable in ClinicalTrials.gov or PubMed 7 or more years after study completion for nearly one-quarter of sampled drug trials and more than one-tenth of sampled sponsor-drug-condition trial sets. This study is limited by the convenience sampling approach, omission of unregistered trials, and lack of assessment of reporting content. Availability of results in ClinicalTrials.gov, particularly before or in lieu of any publication, adds critical information to the evidence base. However, this advance in access to trial results only accrues if ClinicalTrials.gov is used; for example, systematic reviewers who rely entirely on literature searches are at risk of missing relevant evidence.6 Despite advances in making trial results publicly available, it is critical to continue identifying and ameliorating gaps in results reporting.
Accepted for Publication: January 13, 2018.
Corresponding Author: Kevin M. Fain, JD, MPH, DrPH, National Library of Medicine, National Institutes of Health, US Department of Health and Human Services, 8600 Rockville Pike, Bldg 38A, Bethesda, MD 20894 (kevin.fain@nih.gov).
Published Online: March 12, 2018. doi:10.1001/jamainternmed.2018.0263
Author Contributions: Drs Fain and Rajakannan had full access to all the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis.
Study concept and design: Tse, Zarin.
Acquisition, analysis, or interpretation of data: Fain, Rajakannan, Williams.
Drafting of the manuscript: Fain, Rajakannan, Tse, Zarin.
Critical revision of the manuscript for important intellectual content: Fain, Tse, Williams, Zarin.
Statistical analysis: Rajakannan.
Administrative, technical, or material support: Tse, Zarin.
Study supervision: Fain, Williams, Zarin.
Conflict of Interest Disclosures: None reported.
Funding/Support: This research was supported by the Intramural Research Program of the National Institutes of Health, National Library of Medicine.
Role of the Funder/Sponsor: The funding source had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.
1.Anderson
ML, Chiswell
K, Peterson
ED, Tasneem
A, Topping
J, Califf
RM. Compliance with results reporting at ClinicalTrials.gov.
N Engl J Med. 2015;372(11):1031-1039.
PubMedGoogle ScholarCrossref 2.Zarin
DA, Tse
T, Williams
RJ, Califf
RM, Ide
NC. The ClinicalTrials.gov results database: update and key issues.
N Engl J Med. 2011;364(9):852-860.
PubMedGoogle ScholarCrossref 3.Turner
EH, Matthews
AM, Linardatos
E, Tell
RA, Rosenthal
R. Selective publication of antidepressant trials and its influence on apparent efficacy.
N Engl J Med. 2008;358(3):252-260.
PubMedGoogle ScholarCrossref 4.Ross
JS, Tse
T, Zarin
DA, Xu
H, Zhou
L, Krumholz
HM. Publication of NIH funded trials registered in ClinicalTrials.gov: cross sectional analysis.
BMJ. 2012;344:d7292.
PubMedGoogle ScholarCrossref 5.Riveros
C, Dechartres
A, Perrodeau
E, Haneef
R, Boutron
I, Ravaud
P. Timing and completeness of trial results posted at ClinicalTrials.gov and published in journals.
PLoS Med. 2013;10(12):e1001566.
PubMedGoogle ScholarCrossref 6.Baudard
M, Yavchitz
A, Ravaud
P, Perrodeau
E, Boutron
I. Impact of searching clinical trial registries in systematic reviews of pharmaceutical treatments: methodological systematic review and reanalysis of meta-analyses.
BMJ. 2017;356:j448.
PubMedGoogle ScholarCrossref