[Skip to Content]
Sign In
Individual Sign In
Create an Account
Institutional Sign In
OpenAthens Shibboleth
Purchase Options:
[Skip to Content Landing]
Table 1.  
Number of Subgroup Analyses in Trial Reports
Number of Subgroup Analyses in Trial Reports
Table 2.  
Reporting of Subgroup Analyses in Trial Reports
Reporting of Subgroup Analyses in Trial Reports
1.
Assmann  SF, Pocock  SJ, Enos  LE, Kasten  LE.  Subgroup analysis and other (mis)uses of baseline data in clinical trials.  Lancet. 2000;355(9209):1064-1069.PubMedGoogle ScholarCrossref
2.
Sun  X, Briel  M, Busse  JW,  et al.  Credibility of claims of subgroup effects in randomised controlled trials: systematic review.  BMJ. 2012;344:e1553.PubMedGoogle ScholarCrossref
3.
Wang  R, Lagakos  SW, Ware  JH, Hunter  DJ, Drazen  JM.  Statistics in medicine—reporting of subgroup analyses in clinical trials.  N Engl J Med. 2007;357(21):2189-2194.PubMedGoogle ScholarCrossref
4.
Kolh  P, Wijns  W, Danchin  N,  et al; Task Force on Myocardial Revascularization of the European Society of Cardiology (ESC) and the European Association for Cardio-Thoracic Surgery (EACTS); European Association for Percutaneous Cardiovascular Interventions (EAPCI).  Guidelines on myocardial revascularization.  Eur J Cardiothorac Surg. 2010;38(suppl):S1-S52.PubMedGoogle ScholarCrossref
5.
Pocock  S, Calvo  G, Marrugat  J,  et al.  International differences in treatment effect: do they really exist and why?  Eur Heart J. 2013;34(24):1846-1852.PubMedGoogle ScholarCrossref
6.
Schulz  KF, Altman  DG, Moher  D; CONSORT Group.  CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials.  BMJ. 2010;340:c332.PubMedGoogle ScholarCrossref
Research Letter
November 20, 2013

Subgroup Analyses in Trial Reports Comparing Percutaneous Coronary Intervention With Coronary Artery Bypass Surgery

Author Affiliations
  • 1Department of Cardio-Thoracic Surgery, Erasmus University Medical Center, Rotterdam, the Netherlands
  • 2Division of Cardiology, Cedars-Sinai Medical Center, Los Angeles, California
  • 3Department of Cardiology, Academic Medical Center of the University of Amsterdam, Amsterdam, the Netherlands
  • 4Department of Cardiology, Erasmus University Medical Center, Rotterdam, the Netherlands
JAMA. 2013;310(19):2097-2098. doi:10.1001/jama.2013.281630

Subgroup analyses within randomized clinical trials (RCTs) may not be valid,1,2 although they may identify important treatment heterogeneity. Reviews of subgroup analyses in primary reports of RCTs have found low credibility due to methodological or reporting issues.2 Subgroup analyses may also be presented in separate reports of extended follow-up beyond the primary end point or specific subgroups of patients.

No data are available on the quality of subgroup analyses in these subsequent reports. We evaluated subgroup analyses in reports from RCTs comparing percutaneous coronary intervention (PCI) with coronary artery bypass grafting (CABG).

Methods

PubMed was searched up to January 1, 2011, to identify primary end point reports of RCTs comparing PCI with CABG for complex coronary artery disease using the following search: “(PCI OR PTCA OR percutaneous coronary intervention) AND (CABG OR coronary bypass) AND (random*).” A second search through January 1, 2012, identified subsequent reports of extended follow-up beyond the primary end point or subgroups of patients (eg, patients with diabetes).

Two researchers collected data on characteristics of subgroup analyses from the reports: (1) subgroups prespecified in the trial protocol; (2) reported groups complementary to the investigated subgroup (eg, patients with diabetes but also those without diabetes); (3) number of subgroup analyses; (4) primary or secondary end points analyzed; (5) interaction tests used; (6) subgroup differences claimed; (7) subgroup results emphasized in the text or abstract; and (8) caution advised about interpretation of subgroup results. These characteristics were chosen based on expert consensus and quality measures of subgroup analyses used in other reports.13

Results

Seventeen trials reporting primary end points were published, along with 19 follow-up and 28 subgroup reports. Subgroup analyses appeared in 5 primary reports (29%), 13 follow-up reports (68%), and 28 subgroup reports (100%). Thirteen trials reported subgroup analyses: 5 in the primary reports (29%), 8 in follow-up reports (47%), and 9 in subgroup reports (53%).

Prespecification of subgroups was mentioned in 4 trials and 12 reported exploratory post hoc subgroup analyses on groups not prespecified. All primary and follow-up reports included the complementary subgroups, whereas 10 subgroup reports (36%) only reported results of the subgroup of interest.

There were differences between primary, follow-up, and subgroup reports in the total number of subgroup analyses performed (70 vs 372 vs 952, respectively) and the median number of analyses per report (0 vs 12 vs 26, respectively) (Table 1). Subgroup analyses were performed on secondary end points in 25% vs 52% vs 84%, respectively.

An interaction test was not reported in 40% of primary reports, 54% of follow-up reports, and 71% of subgroup reports (Table 2). Nevertheless, subgroup differences were claimed in 70% of reports, with an emphasis on these results in 87%. Caution in interpretation was mentioned in only 22%.

Discussion

We identified many shortcomings in subgroup analyses in reports of RCTs of PCI vs CABG. We found an increase in the number of subgroup analyses from primary to follow-up to subgroup reports, which were also more often performed on secondary end points. Moreover, subgroup analyses appeared to be of poorer methodological quality from primary to follow-up to subgroup reports.

Subgroup analyses, particularly those that are published separately from the main trial result, must be interpreted cautiously. Some prespecified analyses are of clinical importance, but conclusions from exploratory analyses may not be sufficiently robust to justify changes in treatment for specific subgroups. Still, these analyses are considered for drug and device approval and are used to establish guidelines.4,5

The Consolidated Standards of Reporting Trials (CONSORT) statement provides little guidance on how subgroup analyses should be reported and lacks any specific guidance on drafting follow-up or subgroup reports.6 To prevent spurious observations and minimize treatment errors, improving analysis and interpretation of subgroup data should receive more attention.

The limitations of this study include the sample size and potential lack of generalizability because of its focus on PCI vs CABG trials.

Section Editor: Jody W. Zylke, MD, Senior Editor.
Back to top
Article Information

Corresponding Author: A. Pieter Kappetein, MD, PhD, Erasmus University Medical Center, PO Box 2040, 3000 CA Rotterdam, the Netherlands (a.kappetein@erasmusmc.nl).

Author Contributions: Drs Head and Kappetein had full access to all of the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis.

Study concept and design: Kaul, Tijssen, Kappetein.

Acquisition of data: Head.

Analysis and interpretation of data: Head, Kaul, Tijssen, Serruys, Kappetein.

Drafting of the manuscript: Head, Kaul, Kappetein.

Critical revision of the manuscript for important intellectual content: Kaul, Tijssen, Serruys, Kappetein.

Statistical analysis: Head, Kaul, Tijssen, Kappetein.

Study supervision: Serruys, Kappetein.

Conflict of Interest Disclosures: The authors have completed and submitted the ICMJE Form for Disclosure of Potential Conflicts of Interest. Dr Kaul reported serving as a consultant to Novo Nordisk, sanofi, and Boehringer Ingelheim; and owning stock in Johnson & Johnson. No other disclosures were reported.

Additional Contributions: We thank the following colleagues for carefully reading the manuscript and providing valuable comments: David R. Holmes Jr, MD (Mayo Clinic, Rochester, Minnesota); Michael J. Mack, MD, and David L. Brown, MD (Baylor Health Care System, Dallas, Texas); and Ad J. Bogers, MD, PhD (Erasmus University Medical Center, Rotterdam, the Netherlands). We further thank Esther M. Stoop, MD (Erasmus University Medical Center, Rotterdam, the Netherlands), for help with the literature searches and study identification. None of these persons received compensation for their work.

References
1.
Assmann  SF, Pocock  SJ, Enos  LE, Kasten  LE.  Subgroup analysis and other (mis)uses of baseline data in clinical trials.  Lancet. 2000;355(9209):1064-1069.PubMedGoogle ScholarCrossref
2.
Sun  X, Briel  M, Busse  JW,  et al.  Credibility of claims of subgroup effects in randomised controlled trials: systematic review.  BMJ. 2012;344:e1553.PubMedGoogle ScholarCrossref
3.
Wang  R, Lagakos  SW, Ware  JH, Hunter  DJ, Drazen  JM.  Statistics in medicine—reporting of subgroup analyses in clinical trials.  N Engl J Med. 2007;357(21):2189-2194.PubMedGoogle ScholarCrossref
4.
Kolh  P, Wijns  W, Danchin  N,  et al; Task Force on Myocardial Revascularization of the European Society of Cardiology (ESC) and the European Association for Cardio-Thoracic Surgery (EACTS); European Association for Percutaneous Cardiovascular Interventions (EAPCI).  Guidelines on myocardial revascularization.  Eur J Cardiothorac Surg. 2010;38(suppl):S1-S52.PubMedGoogle ScholarCrossref
5.
Pocock  S, Calvo  G, Marrugat  J,  et al.  International differences in treatment effect: do they really exist and why?  Eur Heart J. 2013;34(24):1846-1852.PubMedGoogle ScholarCrossref
6.
Schulz  KF, Altman  DG, Moher  D; CONSORT Group.  CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials.  BMJ. 2010;340:c332.PubMedGoogle ScholarCrossref
×