[Skip to Navigation]
Sign In
Figure 1.  Flow Diagram of Progress Through Phases of the Randomized Trial Comparing a Non–Tumor-Necrosis Factor (TNF)-Targeted Biologic or a Second Anti-TNF Agent Among Patients With Rheumatoid Arthritis and an Insufficient Response to a First Anti-TNF Agent
Flow Diagram of Progress Through Phases of the Randomized Trial Comparing a Non–Tumor-Necrosis Factor (TNF)-Targeted Biologic or a Second Anti-TNF Agent Among Patients With Rheumatoid Arthritis and an Insufficient Response to a First Anti-TNF Agent

The number of patients screened for eligibility, number excluded, and reasons for exclusion are not available. Patients who during follow-up received any biologic agent different from the treatment initially assigned for any reason continued to be followed up and were considered nonresponders. TNF indicates tumor necrosis factor.

aOne patient at 3 months and 1 patient at 12 months who discontinued the study discontinued the intervention (new biologic).

bTwo patients who discontinued the study discontinued the intervention (new biologic).

Figure 2.  Evolution of Disease Activity Score in 28 Joints-Erythrocyte Sedimentation Rate (DAS28-ESR) and Health Assessment Questionnaire Score in Non–Tumor-Necrosis Factor (TNF) and Second Anti-TNF Groups
Evolution of Disease Activity Score in 28 Joints-Erythrocyte Sedimentation Rate (DAS28-ESR) and Health Assessment Questionnaire Score in Non–Tumor-Necrosis Factor (TNF) and Second Anti-TNF Groups

The analytic sample sizes shown at baseline in Figure 2 differ from the total number randomized because of missing data. They also differ for DAS28-ESR from the numbers included in the primary analysis (European League Against Rheumatism response) because in the primary analysis, some of the patients with missing data were considered nonresponders because they received during the follow-up a biologic agent different from the treatment initially assigned, as specified in the statistical analysis section. Constrained longitudinal data analyses were used for between-group comparisons for DAS28-ESR and HAQ. For DAS-28-ESR, the 12-week P value was .008; 24- week, P = .004; and 52-week, P = .01; for HAQ, the 12-week P value was.09; 24-week, P = .44; and 52-week, P = .75. Data markers represent the mean and error bars 95% CIs. See the Methods section for a definition of disease activity score in 28 joints-erythrocyte sedimentation rate (DAS28-ESR) and range and the Health Assessment Questionnaire (HAQ) definition and score range.

Table 1.  Baseline Characteristics of Patients Randomized to Receive a Non-TNF Biologic or a Second Anti-TNF Drug
Baseline Characteristics of Patients Randomized to Receive a Non-TNF Biologic or a Second Anti-TNF Drug
Table 2.  Response Criteria in the Non-TNF Biologic and Second Anti-TNF Groups
Response Criteria in the Non-TNF Biologic and Second Anti-TNF Groups
Table 3.  Serious Adverse Events by Treatment Groups
Serious Adverse Events by Treatment Groups
1.
Scott  DL, Wolfe  F, Huizinga  TW.  Rheumatoid arthritis.  Lancet. 2010;376(9746):1094-1108.PubMedGoogle ScholarCrossref
2.
Hyrich  KL, Lunt  M, Watson  KD, Symmons  DP, Silman  AJ; British Society for Rheumatology Biologics Register.  Outcomes after switching from one antitumor necrosis factor alpha agent to a second anti-tumor necrosis factor alpha agent in patients with rheumatoid arthritis: results from a large UK national cohort study.  Arthritis Rheum. 2007;56(1):13-20.PubMedGoogle ScholarCrossref
3.
Hetland  ML, Christensen  IJ, Tarp  U,  et al; All Departments of Rheumatology in Denmark.  Direct comparison of treatment responses, remission rates, and drug adherence in patients with rheumatoid arthritis treated with adalimumab, etanercept, or infliximab: results from eight years of surveillance of clinical practice in the nationwide Danish DANBIO registry.  Arthritis Rheum. 2010;62(1):22-32.PubMedGoogle ScholarCrossref
4.
Smolen  JS, Landewé  R, Breedveld  FC,  et al.  EULAR recommendations for the management of rheumatoid arthritis with synthetic and biological disease-modifying antirheumatic drugs.  Ann Rheum Dis. 2010;69(6):964-975. doi:10.1136/ard.2009.126532PubMedGoogle ScholarCrossref
5.
Cohen  SB, Emery  P, Greenwald  MW,  et al; REFLEX Trial Group.  Rituximab for rheumatoid arthritis refractory to anti-tumor necrosis factor therapy: Results of a multicenter, randomized, double-blind, placebo-controlled, phase 3 trial evaluating primary efficacy and safety at twenty-four weeks.  Arthritis Rheum. 2006;54(9):2793-2806.PubMedGoogle ScholarCrossref
6.
Emery  P, Keystone  E, Tony  HP,  et al.  IL-6 receptor inhibition with tocilizumab improves treatment outcomes in patients with rheumatoid arthritis refractory to anti-tumour necrosis factor biologicals: results from a 24-week multicentre randomised placebo-controlled trial.  Ann Rheum Dis. 2008;67(11):1516-1523.PubMedGoogle ScholarCrossref
7.
Genovese  MC, Becker  JC, Schiff  M,  et al.  Abatacept for rheumatoid arthritis refractory to tumor necrosis factor alpha inhibition.  N Engl J Med. 2005;353(11):1114-1123.PubMedGoogle ScholarCrossref
8.
Burmester  GR, Blanco  R, Charles-Schoeman  C,  et al; ORAL Step investigators.  Tofacitinib (CP-690,550) in combination with methotrexate in patients with active rheumatoid arthritis with an inadequate response to tumour necrosis factor inhibitors: a randomised phase 3 trial.  Lancet. 2013;381(9865):451-460.PubMedGoogle ScholarCrossref
9.
Bartelds  GM, Krieckaert  CL, Nurmohamed  MT,  et al.  Development of antidrug antibodies against adalimumab and association with disease activity and treatment failure during long-term follow-up.  JAMA. 2011;305(14):1460-1468.PubMedGoogle ScholarCrossref
10.
Smolen  JS, Kay  J, Doyle  MK,  et al; GO-AFTER study investigators.  Golimumab in patients with active rheumatoid arthritis after treatment with tumour necrosis factor alpha inhibitors (GO-AFTER study): a multicentre, randomised, double-blind, placebo-controlled, phase III trial.  Lancet. 2009;374(9685):210-221.PubMedGoogle ScholarCrossref
11.
Schiff  MH, von Kempis  J, Goldblum  R, Tesser  JR, Mueller  RB.  Rheumatoid arthritis secondary non-responders to TNF can attain an efficacious and safe response by switching to certolizumab pegol: a phase IV, randomised, multicentre, double-blind, 12-week study, followed by a 12-week open-label phase.  Ann Rheum Dis. 2014;73(12):2174-2177.PubMedGoogle ScholarCrossref
12.
Chatzidionysiou  K, van Vollenhoven  RF.  Rituximab vs anti-TNF in patients who previously failed one TNF inhibitor in an observational cohort.  Scand J Rheumatol. 2013;42(3):190-195.PubMedGoogle ScholarCrossref
13.
Emery  P, Gottenberg  JE, Rubbert-Roth  A,  et al.  Rituximab vs an alternative TNF inhibitor in patients with rheumatoid arthritis who failed to respond to a single previous TNF inhibitor: SWITCH-RA, a global, observational, comparative effectiveness study.  Ann Rheum Dis. 2015;74(6):979-984.PubMedGoogle ScholarCrossref
14.
Finckh  A, Ciurea  A, Brulhart  L,  et al; Physicians of the Swiss Clinical Quality Management Program for Rheumatoid Arthritis.  B cell depletion may be more effective than switching to an alternative anti-tumor necrosis factor agent in rheumatoid arthritis patients with inadequate response to anti-tumor necrosis factor agents.  Arthritis Rheum. 2007;56(5):1417-1423.PubMedGoogle ScholarCrossref
15.
Harrold  LR, Reed  GW, Kremer  JM,  et al.  The comparative effectiveness of abatacept vs anti-tumour necrosis factor switching for rheumatoid arthritis patients previously treated with an anti-tumour necrosis factor.  Ann Rheum Dis. 2015;74(2):430-436.PubMedGoogle ScholarCrossref
16.
van Gestel  AM, Haagsma  CJ, van Riel  PLCM.  Validation of rheumatoid arthritis improvement criteria that include simplified joint counts.  Arthritis Rheum. 1998;41(10):1845-1850.PubMedGoogle ScholarCrossref
17.
Fries  JF, Spitz  P, Kraines  RG, Holman  HR.  Measurement of patient outcome in arthritis.  Arthritis Rheum. 1980;23(2):137-145.PubMedGoogle ScholarCrossref
18.
Baron  G, Ravaud  P, Samson  A, Giraudeau  B.  Missing data in randomized controlled trials of rheumatoid arthritis with radiographic outcomes: a simulation study.  Arthritis Rheum. 2008;59(1):25-31.PubMedGoogle ScholarCrossref
19.
Twisk  J, de Boer  M, de Vente  W, Heymans  M.  Multiple imputation of missing values was not necessary before performing a longitudinal mixed-model analysis.  J Clin Epidemiol. 2013;66(9):1022-1028.PubMedGoogle ScholarCrossref
Original Investigation
September 20, 2016

Non–TNF-Targeted Biologic vs a Second Anti-TNF Drug to Treat Rheumatoid Arthritis in Patients With Insufficient Response to a First Anti-TNF Drug: A Randomized Clinical Trial

Author Affiliations
  • 1Department of Rheumatology, National Reference Center for Systemic Autoimmune Diseases, Strasbourg University Hospital, Université de Strasbourg, Strasbourg, France
  • 2Department of Rheumatology, Centre Hospitalier Princesse Grâce, Monaco
  • 3Department of Rheumatology, Rennes University Hospital, Rennes, France
  • 4Department of Rheumatology, Centre Hospitalier de Cahors, Cahors, France
  • 5Department of Rheumatology, Nantes University Hospital, Nantes, France
  • 6Department of Rheumatology, Besançon University Hospital, Besançon, France
  • 7Department of Rheumatology, Nice University Hospital, Nice, France
  • 8Department of Rheumatology, Clermont-Ferrand University Hospital, Clermont-Ferrand, France
  • 9Department of Rheumatology, Bordeaux University Hospital, Bordeaux, France
  • 10Department of Rheumatology, Hôpital La Pitié Salpétrière, Paris, France
  • 11Department of Rheumatology, Toulouse University Hospital, Toulouse, France
  • 12Department of Rheumatology, Hôpital Kremlin Bicêtre, Kremlin Bicêtre, France
  • 13Department of Rheumatology, Montpellier University Hospital, Montpellier, France
  • 14Department of Rheumatology, Grenoble University Hospital, Grenoble, France
  • 15Department of Rheumatology, Centre Hospitalier de La Roche Sur Yon, La Roche Sur Yon, France
  • 16Department of Rheumatology, Reims University Hospital, Reims, France
  • 17Department of Rheumatology, Centre Hospitalier d’Orléans, Orléans, France
  • 18Department of Rheumatology, Hôpital Lariboisière, Paris, France
  • 19Department of Rheumatology, Saint-Etienne University Hospital, Saint-Etienne, France
  • 20Department of Rheumatology, Limoges University Hospital, Limoges, France
  • 21Department of Rheumatology, Caen University Hospital, Caen France
  • 22Department of Rheumatology, Hôpital Saint-Antoine, Paris, France
  • 23Department of Rheumatology, Hôpital Bichat, Paris, France
  • 24Department of Rheumatology, Poitiers University Hospital, Poitiers, France
  • 25Department of Rheumatology, Marseille University Hospital, Marseille, France
  • 26Department of Rheumatology, Hôpital La Croix Saint Simon, Paris, France
  • 27Department of Rheumatology, Centre Hospitalier du Havre, Le Havre, France
  • 28Department of Rheumatology, Nancy University Hospital, Nancy, France
  • 29Department of Rheumatology, Rouen University Hospital, Rouen, France
  • 30Department of Rheumatology, Brest University Hospital, Brest, France
  • 31Department of Internal Medicine, Institut Montsouris, Paris, France
  • 32Department of Rheumatology, Centre Hospitalier de Cannes, Cannes, France
  • 33Department of Rheumatology, Hôpital Mondor, Créteil, France
  • 34Department of Rheumatology, Centre Hospitalier de Mulhouse, Mulhouse, France
  • 35Department of Rheumatology, Centre Hospitalier du Mans, Le Mans, France
  • 36Department of Rheumatology, Hôpital Ambroise Paré, Paris, France
  • 37Department of Internal Medicine, Hôpital Saint-Antoine, Paris, France
  • 38Department of Rheumatology, Centre Hospitalier de Belfort, Belfort, France
  • 39Department of Direction de la recherche clinique et de l’innovation, Strasbourg University Hospital, Strasbourg, France
  • 40Department of Immunology, Hôpital Necker, Paris, France
  • 41Department of Epidemiology and Biostatistics, Hotel Dieu, Paris, France
JAMA. 2016;316(11):1172-1180. doi:10.1001/jama.2016.13512
Abstract

Importance  One-third of patients with rheumatoid arthritis show inadequate response to tumor necrosis factor α (TNF-α) inhibitors; little guidance on choosing the next treatment exists.

Objective  To compare the efficacy of a non–TNF-targeted biologic (non-TNF) vs a second anti-TNF drug for patients with insufficient response to a TNF inhibitor.

Design, Setting, and Participants  A total of 300 patients (conducted between 2009-2012) with rheumatoid arthritis, with persistent disease activity (disease activity score in 28 joints–erythrocyte sedimentation rate [DAS28-ESR]  ≥ 3.2 [range, 0-9.3]) and an insufficient response to anti-TNF therapy were included in a 52-week multicenter, pragmatic, open-label randomized clinical trial. The final follow-up date was in August 2013.

Interventions  Patients were randomly assigned (1:1) to receive a non–TNF-targeted biologic agent or an anti-TNF that differed from their previous treatment. The choice of the biologic prescribed within each randomized group was left to the treating clinician.

Main Outcomes and Measures  The primary outcome was the proportion of patients with good or moderate response according to the European League Against Rheumatism (EULAR) scale at week 24. Secondary outcomes included the EULAR response at weeks 12 and 52; at weeks 12, 24, and 52; DAS28ESR, low disease activity (DAS28 ≤3.2), remission (DAS28 ≤2.6); serious adverse events; and serious infections.

Results  Of the 300 randomized patients (243 [83.2%] women; mean [SD] age, 57.1 [12.2] years; baseline DAS28-ESR, 5.1 [1.1]), 269 (89.7%) completed the study. At week 24, 101 of 146 patients (69%) in the non-TNF group and 76 (52%) in the second anti-TNF group achieved a good or moderate EULAR response (OR, 2.06; 95% CI, 1.27-3.37; P = .004, with imputation of missing data; absolute difference, 17.2%; 95% CI, 6.2% to 28.2%). The DAS28-ESR was lower in the non-TNF group than in the second anti-TNF group (mean difference adjusted for baseline differences, −0.43; 95% CI, −0.72 to −0.14; P = .004). At weeks 24 and 52, more patients in the non-TNF group vs the second anti-TNF group showed low disease activity (45% vs 28% at week 24; OR, 2.09; 95% CI, 1.27 to 3.43; P = .004 and 41% vs 23% at week 52; OR, 2.26; 95% CI, 1.33 to 3.86; P = .003).

Conclusions and Relevance  Among patients with rheumatoid arthritis previously treated with anti-TNF drugs but with inadequate primary response, a non-TNF biologic agent was more effective in achieving a good or moderate disease activity response at 24 weeks than was the second anti-TNF medication.

Trial Registration  clinicaltrials.gov Identifier: NCT01000441

Introduction

Tumor necrosis factor α (TNF-α) inhibitors have improved the quality of life for patients with rheumatoid arthritis who show insufficient response to methotrexate.1 However, as many as one-third of patients2,3 have persistent disease activity and insufficient (inadequate) response to anti-TNF agents according to international recommendations.4 Therefore, alternatives are needed.

Switching to a non–TNF-targeted therapy can be an acceptable strategy, as was reported in 3 placebo-controlled trials.5-7 The most frequently used non-TNF biologics are abatacept, an inhibitor of T-cell costimulation; rituximab, a β-cell–depleting agent; and tocilizumab, an inhibitor of interleukin 6 (IL-6) receptor. Tofacitinib could also be an option8 but has not been approved in most European countries, including France. Cycling to a second anti-TNF agent after failure of a first anti-TNF agent is a reasonable alternative. The molecular structure of TNF inhibitors (adalimumab, certolizumab, etanercept, golimumab, and infliximab) and their affinity for membrane and soluble TNF-α differ. Etanercept targets TNF as well as lymphotoxin-α. In addition, loss of efficacy to monoclonal antibodies might result from the secretion of antidrug antibodies.9 Therefore, the lack of efficacy of one anti-TNF drug does not preclude the potential efficacy of another. Two randomized placebo-controlled trials reported that approximately half of patients with rheumatoid arthritis with insufficient response to a TNF-α inhibitor responded to a second anti-TNF drug.10,11

Four observational studies compared a non-TNF biologic vs a second anti-TNF agent in patients with rheumatoid arthritis with insufficient response to a TNF-α inhibitor.12-15 However, no randomized controlled trial has compared the 2 strategies in such patients.

Therefore, the Rotation or Change (ROC) trial was designed to compare the efficacy of 2 therapeutic strategies in patients with rheumatoid arthritis after an initial anti-TNF agent failed to reduce their symptoms: a non–TNF-targeted biologic or a second anti-TNF agent.

Box Section Ref ID

Key Points

  • Question For patients with rheumatoid arthritis and an inadequate response to an anti–tumor necrosis factor (TNF) drug, is a non–TNF-targeted biologic drug more effective than a second anti-TNF drug?

  • Findings In this randomized clinical trial involving 300 adults, 69% of patients achieved an effective clinical response with a non-TNF biologic vs 52% of patients who took a second anti-TNF drug.

  • Meaning For patients with rheumatoid arthritis and an insufficient response to anti-TNF therapy, a non-TNF biologic agent may be more effective than a second anti-TNF drug.

Methods
Design

The ROC trial was a 52-week pragmatic, multicenter, open, parallel-group, randomized clinical trial with a superiority design. Patients with insufficient response to an anti-TNF drug were randomly assigned in a 1:1 ratio to receive a non–TNF-targeted biologic or a second anti-TNF agent. Patients were recruited from December 2009 to August 2012 (Trial Protocol Supplement 1).

Ethics

The trial was approved by the institutional review board of the Comité de Protection des Personnes-Est 1, Strasbourg, France. The study was conducted according to the current regulations of the International Conference on Harmonization guidelines and the principles of the Declaration of Helsinki. All patients gave written informed consent after receiving oral and written information about the trial.

Randomization

A computer-generated list (random permuted block design using block sizes of 2, 4, or 6, randomly selected with equal probability) was generated by an independent statistician. Concealed allocation of treatments involved a web-based system that confirmed eligibility criteria before issuing a treatment assignment.

Patients

From December 2009 to August 2012, patients who were at least 18 years old were recruited from 47 French clinical centers belonging to the Club des Rhumatismes et Inflammation (a section of the French Society of Rheumatology)–IMIDIATE Clinical Research Network. To meet the inclusion criteria patients needed to have (1) a diagnosis of rheumatoid arthritis according to the 1987 American College of Rheumatology criteria; (2) presence of erosions; (3) a disease activity score in 28 joints–erythrocyte sedimentation rate (DAS28-ESR) of 3.2 or more (DAS28-ESR is a composite score that ranges from 0-9.3 by taking into account the number of tender joints [range, 0-28], number of swollen joints [range, 0-28], patient global assessment of disease activity [numeric analog scale range, 0-10, with 0 representing the best and 10 the worst], and the ESR); (4) insufficient response to anti-TNF according to the physician, who usually considers the response to be insufficient (inadequate) with one or several of the following conditions: persistent tender and swollen joints, persistent disease activity according to patient global assessment, elevated levels of acute-phase reactants, and dependence on analgesics, nonsteroidal anti-inflammatory drugs or corticosteroids. International recommendations state that a DAS28-ESR score greater than 3.2 indicates insufficient control of disease activity and justifies changing the rheumatoid arthritis treatment4; (5) stable dose of oral corticosteroids of 15 mg/d or less of equivalent prednisone within 4 weeks before enrollment; (6) stable dose of synthetic disease-modifying antirheumatic drugs (DMARDs) within 4 weeks of enrollment; and (7) informed written consent.

The exclusion criteria were discontinuation of the first anti-TNF agent due to an adverse event only; previous treatment with 2 or more anti-TNF agents; previous treatment with abatacept, rituximab, or tocilizumab; contraindication to all anti-TNF agents and other biologics (ongoing infection; history of recent cancer <5 years before enrollment, except for cured nonmelanoma skin cancer); pregnancy; and breastfeeding.

Interventions

Patients were randomly assigned to receive either a non-TNF biologic (ie, abatacept, rituximab, or tocilizumab) or a second anti-TNF agent (adalimumab, certolizumab, etanercept, infliximab, or golimumab). The choice of the biologic prescribed within each randomized group was left to the treating clinician. The initial dose and frequency of treatment were defined for each drug as follows. In the non-TNF group, the biologic could be abatacept (500 to 1000 mg intravenously, dosed according to the patient’s weight, every 14 days until week 4 and once monthly thereafter), rituximab (1-g infusion intravenously followed by another 2 weeks later), or tocilizumab (8 mg/kg monthly, intravenously).

Patients receiving an anti-TNF that differed from their initial treatment could receive adalimumab (40 mg subcutaneously every 14 days), certolizumab (400 mg subcutaneously every 14 days until week 4, then 200 mg every 14 days), etanercept (50 mg subcutaneously every 7 days), or infliximab (3 mg/kg intravenously initially, with the possibility of ascending doses at weeks 2 and 6 and every 8 weeks thereafter). A fifth anti-TNF agent, golimumab, was not available at the time of the study. According to the marketing authorization, the choice of subsequent dose and frequency adjustment of the treatment was left to the treating physician in both groups. The assigned treatment had to be continued for 12 months within the study protocol but could be discontinued for inefficacy, for adverse events, or by patient choice. Dose adjustments of oral corticosteroids and glucocorticoid intra-articular injections were allowed for both groups.

End Points

The primary end point was the proportion at week 24 of patients with a good or moderate European League Against Rheumatism (EULAR) response.16 A good EULAR response is defined as a decrease in DAS28-ESR of more than 1.2 points, resulting in a score of 3.2 or less. A moderate EULAR response is defined as a decrease of more than 0.6 and resulting in a score of 5.1 points or lower.16 Twenty-four weeks was chosen for the primary end point to ensure that changes in disease activity were due to the initially assigned biologic treatment. Because clinicians evaluate therapeutic response and safety within 24 weeks of drug initiation and change treatments in case of insufficient response or serious adverse event, the study duration was 52 weeks to allow the evaluation of longer-term end points, such as therapeutic maintenance.

Prespecified secondary end points included the EULAR response at weeks 12 and 52; DAS28-ESR at weeks 12, 24, and 52; low disease activity (DAS28-ESR<3.2) and remission (DAS28-ESR<2.6) at weeks 12, 24, and 52; mean oral corticosteroid use at weeks 24 and 52; therapeutic maintenance (defined as the proportion of patients who did not discontinue the assigned biologic treatment) at weeks 24 and 52; and health assessment questionnaire17 (HAQ) score (range, 0-3, with 0 representing the best and 3 the worst outcomes) at weeks 12, 24, and 52. Structural radiographic progression, initially listed in the protocol, was not available for half of the recruited patients and was not analyzed or reported herein.

Safety was evaluated throughout the study. Serious adverse events were defined as life-threatening or resulting in death, hospitalization, or persistent disability. Serious infections were defined as requiring intravenous antibiotics, or resulting in hospitalization, or in death.

Statistical Analysis

Among patients with insufficient response to a TNF-α inhibitor, the EULAR response was approximately 50% in one placebo-controlled study of a second anti-TNF (golimumab)10 and 66% in 2 placebo-controlled studies of rituximab5 and tocilizumab.6 Therefore, we assumed that 50% of patients with insufficient response to anti-TNF therapy would respond to a second anti-TNF agent and that 66% would respond to a non–TNF-targeted biologic. We hypothesized an absolute increase of 16% in EULAR response (ie, odds ratio [OR], 1.94) in the non–TNF-targeted group, with an α risk of .05 and a β risk of .20. This hypothesis required randomizing 300 patients (150 patients per group).

Data were analyzed on an intention-to-treat basis. In case of missing data for the primary end point, we decided, before the study data were made available to the statistical team, to use multiple imputation by chained equation with m = 50 imputations instead of a last-observation-carried-forward approach, as specified in the initial protocol. Since the protocol was written, multiple imputation has become widely accepted as a vastly superior method to the last-observation-carried-forward approach.18 Given the low number of missing data and the fact that they were well balanced, secondary end points were not imputed. For mixed models of longitudinal data, multiple imputation has been shown to not improve the results and a mixed model for imputed data could sometimes lead to unstable results.19 During follow-up, patients who received any biologic agent different from the treatment initially assigned, for any reason, were continued in the study and were considered nonresponders.

Categorical variables are described with frequencies and percentages and quantitative variables with mean (SD) or, for data that did not have normal distribution, median (interquartile range [IQR] percentile). Mixed logistic regression models were used to assess differences between the 2 groups for categorical variables at weeks 12, 24, and 52 with a random effect on each center to account for the potential correlation between centers. To assess mean differences between groups at weeks 12, 24, and 52, we used a constrained longitudinal analysis with random effects on patient and center. In this model, both the baseline and postbaseline values were modeled as dependent variables and the true baseline means were constrained to be the same for the 2 treatment groups. Hence, this analysis provides an adjustment for the observed baseline difference in estimating the treatment. If the hypotheses for the mixed model were not satisfied, nonparametric analysis was used; differences between week 0 and the week of interest between the 2 groups were compared by Wilcoxon test.

A comparison of the primary end point between the 3 biologics in the non–TNF-targeted group was also performed. To handle the fact that the choice of the biologic prescribed was left to the clinician (and not randomized), inverse probability weighting was used; each observation was weighted by the inverse of the predicted probability of receiving the biologic prescribed (abatacept, rituximab, or tocilizumab) for each patient. Therapeutic maintenance was analyzed by Kaplan-Meier curves and compared with a marginal Cox model to take into account the center effect. All statistical tests were 2-sided with P values <.05 considered statistically significant. Statistical analysis involved use of R 3.0.1 (http://www.R-project.org, the R Foundation for Statistical Computing).

Results
Baseline Characteristics of Patients

From December 2009 to August 2012, 300 patients (150 in each group) were randomized; 7 patients withdrew their consent for use of data and 1 patient did not meet inclusion criteria and was wrongly included. The final follow-up testing was in August 2013. On-site monitoring of all patients in all 47 centers was completed in February 2015. Overall, data for 146 patients in each group could be analyzed; 144 and 141 patients received the allocated intervention in the non–TNF-targeted and second anti-TNF groups, respectively (Figure 1). The 2 groups were not different in demographic and disease characteristics, such as sex, age, disease duration, rheumatoid factor, and anticyclic citrullinated peptide positivity, number of previous synthetic DMARDs taken, baseline DAS28-ESR, and HAQ score (Table 1).

Treatments Received

In the non-TNF group, 33 of 146 patients (23%) received abatacept; 41 (28%) rituximab, and 70 (48%), tocilizumab. Two patients (1%) did not receive the intervention as allocated; 1 patient received adalimumab and 1 patient received no treatment. In the second anti-TNF group, 57 of 146 patients (39%) received adalimumab; 23 (16%), certolizumab, 53 (36%), etanercept; and 8 (5%), infliximab. Five patients (3%) did not receive the intervention as allocated; 2 patients received rituximab, 1 patient received tocilizumab, and 2 patients received no treatment. At enrollment, 112 patients (77%) in each group received a concomitant synthetic DMARD: 95 patients (65%) in the non-TNF group and 88 (60%) in the second anti-TNF group concomitantly received methotrexate; and 80 (55%) in the non-TNF group received a mean (SD) dose of 7.3 (2.9) mg/d and 75 (51%) in the second anti-TNF group received 7.2 (3.1) mg/d of oral corticosteroids.

At week 24, 104 of 140 patients (74%) in the non-TNF group and 112 of 141 patients (79%) in the second anti-TNF group concomitantly received a synthetic DMARD, including 89 (63.6%) in the non-TNF group and 88 (62.4%) in the second anti-TNF group who received methotrexate. At week 24, 79 of 142 patients (56%) in the non-TNF group concomitantly received a mean (SD) dose of 6.81 (4.26) mg/d of prednisone and 79 of 141 patients (56%) in the second anti-TNF group 6.69 (2.93) mg/d.

At week 52, 98 of 132 patients (74%) in the non-TNF group concomitantly received a synthetic DMARD, including 84 (64%) who received methotrexate, and 106 of 130 patients (82%) in the second anti-TNF group, concomitantly received a synthetic DMARD, including 84 (65%) who received methotrexate. At week 52, 67 of 127 patients (53%) in the non-TNF group concomitantly received prednisone at a mean (SD) dosage of 7.83 (6.99) mg/d and 73 of 131 patients (56%) in the second anti-TNF group concomitantly received 7.23 (4.45) mg/d.

All changes in conventional DMARDs and oral corticosteroids throughout the study are summarized in eTable in Supplement 2.

Efficacy

At week 24, 101 of 146 patients (69%) in the non-TNF group and 76 (52%) in the second anti-TNF group achieved a good or moderate EULAR response, the primary end point of the trial, with 39% with a good response and 30% with a moderate response in the non-TNF group and 21% with a good response and 31% with a moderate response in the second anti-TNF group (OR, 2.12; 95% CI, 1.31-3.46; P = .003; absolute difference, 17.6%; 95% CI, 6.4-28.8, without imputation of missing data; OR, 2.06; 95% CI, 1.27-3.37; P = .004; absolute difference, 17.2%; 95% CI, 6.2%-28.2%, with imputation of missing data (4 in each group). At week 12, 64% of patients in the non-TNF vs 48% of patients in the second anti-TNF group showed good or moderate EULAR response (good response, 28% vs 13%; moderate response, 37% vs 35%, respectively; OR, 2.01; 95% CI, 1.23-3.32; P = .005; absolute difference, 16.4; 95% CI, 4.8-28.1) (Table 2). At week 52, 60% of patients in the non-TNF group vs 43% in the second anti-TNF group showed good or moderate EULAR response (good response, 38% vs 21%; moderate response, 22% vs 22%, respectively; OR, 1.99; 95% CI, 1.22-3.25; P = .006; absolute difference, 17.0; 95% CI, 5.1-28.9) (Table 2).

Overall the mean DAS28-ESR change from baseline was greater for patients in the non-TNF group than for patients in the second anti-TNF group with a week-12 mean difference of −0.40 (95% CI, −0.70 to −0.10; P = .008); 24-week mean difference of −0.43 (95% CI, −0.72 to −0.14; P = .004), and week-52 mean difference of −0.38 (95% CI, −0.69 to −0.08; P = .01) (Figure 2).

At week 24, 62 of 139 patients (45%) in the non-TNF group vs 39 of 140 patients (28%) in the second anti-TNF group showed low disease activity with a DAS28-ESR of less than 3.2 (OR, 2.09; 95% CI, 1.27-3.43; P = .004). At week 52, 53 of 130 patients (41%) in the non-TNF group vs 31 of 133 patients (23%) in the anti-TNF group showed low disease activity (OR, 2.26; 95% CI, 1.33-3.86; P = .003).

At week 12, 28 of 137 patients (20%) in the non-TNF group vs 13 patients of 135 (10%) in the second anti-TNF group showed DAS28-ESR remission with a score of 2.6 or less (OR, 2.41; 95% CI, 1.19; 4.89; P = .02). At week 52, 35 of 130 patients (27%) in the non-TNF group vs 18 of 133 (14%) in the second anti-TNF group had a DAS28-ESR remission (OR, 2.36; 95% CI, 1.25-4.43; P = .008) (Table 2).

The health assessment questionnaire scores did not differ between the 2 groups: the mean difference adjusted for baseline difference at week 12 was −0.09 (95% CI, −0.20 to 0.01; P = .09); week 24, −0.04 (95% CI, −0.15 to 0.07; P = .44), and week 52, −0.02 (95% CI, −0.13 to 0.09; P = .75).

At week 24, the median change from baseline in erythrocyte sediment rate was −10 (interquartile range [IQR], −28 to −1) in the non-TNF group vs −2 (IQR, −13 to 3) in the second anti-TNF group (P < .001). The median change in C-reactive protein (CRP) level was −3 (IQR, −18 to 0) in the non-TNF group vs −2 (IQR, −10 to −1) in the second anti-TNF group (P = .06).

The proportion of EULAR good and moderate responders at week 24 did not significantly differ with abatacept, rituximab, and tocilizumab treatment: 67% (22 of 33) of patients, 61% (25 of 41) of patients, and 80% (56 of 70) of patients, respectively (OR tocilizumab vs abatacept, 1.78; 95% CI, 0.59-5.37; P = .30; OR tocilizumab vs rituximab, 2.47; 95% CI, 0.92 to 6.62; P = .07).

Twenty-seven patients (18%) in the non-TNF group and 48 (33%) in the anti-TNF group (OR, 0.46; 95% CI, 0.27 to 0.79) started a new biologic. In the non-TNF group 14 patients did so because of inefficacy; 12, adverse events, and 1, unknown reasons. In the second anti-TNF group, 40 patients did so because of inefficacy; 6, adverse events; 1, desire to become pregnant; and 1, unknown reasons. At the time of discontinuation, the mean (SD) DAS28-ESR was 4.54 (1.90) in the non-TNF group and 5.25 (1.17) in second anti-TNF, 2 in each group had missing data. The therapeutic maintenance rate, defined as the proportion of patients who continued the biologic treatment as initially assigned, was significantly higher at weeks 24 and 52 in the non-TNF group than in the second anti-TNF group (eFigure in Supplement 2). The mean change from baseline to weeks 24 and 52 in the level of prednisone doses were not significantly different between patients between treatment groups. The mean difference in the level of prednisone doses at week 24 was −0.16 (95% CI, −1.11 to 0.79; P = .74) and was −0.02 (95%, CI −1.01 to 0.97; P = .97) at week 52.

Safety

Sixteen patients (11%) in the non-TNF experienced 18 serious adverse events, and 8 patients (5%) in the second anti-TNF group experienced 13 events (P = .10). Seven patients (5%) in each group developed serious infections (Table 3). One case of tuberculosis occurred in the second anti-TNF group. Six cardiovascular events occurred in the non-TNF group: tachycardia occurred in 1 patient receiving abatacept and 1 receiving tocilizumab; stroke, in 1 patient receiving rituximab and 1 receiving tocilizumab; and 2 episodes of limb ischemia, in 1 patient receiving rituximab. One cardiovascular event occurred in the second anti-TNF group, hypertensive crisis in a patient receiving certolizumab. One patient in the non-TNF group receiving abatacept died of complications stemming from a dissection of an aortic aneurysm.

Discussion

This pragmatic, multicenter, open-label, parallel-group, randomized clinical trial addressed the optimal therapeutic strategy for patients with rheumatoid arthritis and insufficient response to a first anti-TNF drug. The proportion of EULAR response at week 24, the primary end point of the study, was greater among those treated with a non–TNF-targeted biologic than those treated with a second anti-TNF biologic.

The results of the ROC study demonstrate in a pragmatic clinical trial that approximately 50% of patients with insufficient response to a TNF-α inhibitor might respond to a second anti-TNF agent. However, a therapeutic response was more frequent with non–TNF-targeted biologics. In addition to the superiority of the non-TNF treatment for the primary outcome at week 24, the non-TNF treatment was associated with a better EULAR response than a second anti-TNF drug at weeks 12 and 52. Consistent with these findings, the DAS28-ESR and proportion of patients achieving low disease activity status were greater at months 6 and 12 than in the non-TNF group in the second anti-TNF group.

Tocilizumab is the only drug with a direct effect on CRP levels due to inhibition of IL-6, independent of clinical response. Of note, the 2 groups did not differ in changes in their CRP levels. Thus, the differences in the primary and most of the secondary outcomes were not likely to be due to the biological effect of tocilizumab.

The main strength of the study is its pragmatic design. Physicians commonly choose one drug rather than another for multiple reasons (habits, characteristics of patients). We chose to compare strategies instead of individual drug prescriptions because this issue corresponds to the therapeutic question clinicians face in daily practice. Therefore, the choice of the biologic within each randomized group and the concomitant synthetic DMARDs was left to the clinicians.

The study also has several limitations. First, a primary limitation is the lack of blinding of participants. However, in this trial including multiple biologics, a blinded design could not be easily performed given the number of different placebos that would have been needed. Second, some biologic agents were not allowed (eg, golimumab because this drug was not marketed in France at the time of enrollment in the study or anakinra because this drug is less frequently used than other biologics to treat rheumatoid arthritis). Third, the study was not powered to compare the safety profile of non–TNF-targeted drugs and anti-TNF agents or to detect differences between individual drugs. Therefore, no conclusions can be made regarding individual drug efficacy. Fourth, approximately 40% of patients in each group did not receive concomitant treatment with methotrexate. Methotrexate improves the clinical efficacy of most biologics, with tocilizumab perhaps the least likely to benefit from its concomitant use. Fifth, treatment adherence might have differed between the 2 groups because all non-TNF drugs were given as infusions under observation, whereas most of the anti-TNF drugs (except infliximab) were self-injected by patients.

Conclusions

Among patients with rheumatoid arthritis previously treated with anti-TNF drugs but considered for a second medication due to inadequate primary response, a non-TNF biologic agent was more effective in achieving a good or moderate disease activity response at 24 weeks. However, a second anti-TNF drug to treat these patients was often effective in producing a clinical improvement.

Back to top
Article Information

Corresponding Author: Jacques-Eric Gottenberg, MD, PhD, Department of Rheumatology, National Reference Center for Rare Systemic Autoimmune Diseases, Strasbourg University Hospital, CNRS, Institut de Biologie Moléculaire et Cellulaire, Immunopathologie et Chimie Thérapeutique/Laboratory of excellence MEDALIS, Université de Strasbourg, Hôpital Hautepierre, 1 Ave Molière, 67000 Strasbourg, Strasbourg, France (jacques-eric.gottenberg@chru-strasbourg.fr).

Correction: This article was corrected September 20, 2016, to delete incorrect language in a footnote of Table 1.

Author Contributions: Drs Gottenberg and Ravaud had full access to all of the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis.

Study Concept and design: Gottenberg, Brocq, Lassoued, Euller-Ziegler, Mariette, Morel, Gilson, Sellam, Meyer, Saraux, Bolla, Back, Sibilia, Ravaud.

Acquisition, analysis, or interpretation of data: Gottenberg, Perdriger, Berthelot, Wendling, Euller-Ziegler, Soubrier, Richez, Fautrel, Constantin, Mariette, Gilson, Cormier, Salmon, Rist, Lioté, Marotte, Bonnet, Marcelli, Sellam, Meyer, Solau-Gervais, Guis, Ziza, Zarnitsky, Chary-Valckenaere, Vittecoq, Saraux, Pers, Gayraud, Claudepierre, Ardizzone, Dernis, Breban, Fain, Balblanc, Aberkane, Vasel, Back, Candon, Chatenoud, Perrodeau, Sibilia, Ravaud.

Drafting of the manuscript: Gottenberg, Ravaud.

Critical revision of the manuscript for important intellectual content: Gottenberg, Perdriger, Lassoued, Wendling, Euller-Ziegler, Soubrier, Richez, Fautrel, Constantin, Mariette, Morel, Gilson, Salmon, Rist, Lioté, Marotte, Marcelli, Sellam, Solau-Gervais, Ziza, Zarnitsky, Chary-Valckenaere, Vittecoq, Saraux, Pers, Gayraud, Claudepierre, Ardizzone, Dernis, Breban, Fain, Balblanc, Aberkane, Candon, Chatenoud, Perrodeau, Sibilia, Ravaud.

Statistical analysis: Perrodeau, Ravaud.

Obtained Funding: Gottenberg, Sibilia, Ravaud.

Administrative, technical, or material support: Gottenberg, Euller-Ziegler, Soubrier, Constantin, Gilson, Marotte, Sellam, Chary-Valckenaere, Saraux, Pers, Claudepierre, Ardizzone, Dernis, Aberkane, Vasel, Back, Candon, Chatenoud, Sibilia.

Study supervision: Gottenberg, Back, Ravaud.

Conflict of Interest Disclosures: All authors have completed and submitted the ICMJE Form for Disclosure of Potential Conflicts of Interest. Dr Gottenberg reported receiving grant support from Abbvie, Pfizer, and Roche and personal fees from Bristol-Myers Squibb, Merck, Sharp, and Dohme, UCB, GlaxoSmithKline, and Novartis. Dr Berthelot reported receiving personal fees from Pfizer, Abbvie, Bristol-Myers Squibb, Roche, and UCB. Dr Wendling reported receiving personal fees from Abbvie, Bristol-Myers Squibb, Merck, Sharp, and Dohme, Pfizer, Roche Chugai, Amgen, Nordic Pharma, UCB, and Novartis and nonfinancial support from Merck, Sharp, and Dohme, Roche Chugai, and UCB. Dr Richez reported receiving personal fees from Roche, Bristol-Myers Squibb, Pfizer, UCB, Abbvie, and Merck, Sharp, and Dohme. Dr Mariette reported receiving personal fees from Pfizer, UCB, Bristol-Myers Squibb, and GlaxoSmithKline and grant support from Roche, Pfizer, Bristol-Myers Squibb, GlaxoSmithKline, and Biogen. Dr Morel reported serving on the board of Roche Chugai, Bristol Myer Squib, Abbvie and Merck, Sharp, and Dohme and receiving grant support from Pfizer. Dr Liote reported grant support from Pfizer, serving as a principal investigator for Roche, and nonfinancial support from Abbvie, Bristol-Myers Squibb, Nordic and Pfizer. Dr Marotte reported receiving grant support from Bristol-Myers Squibb, Pfizer, UCB, and Abbvie and nonfinancial support from Bristol-Myers Squibb, Pfizer, Merck, Sharp, and Dohme, Roche Chugai, and Hospira. Dr Salmon reported receiving grant support from Roche France Pfizer; personal fees from Roche France, Bristol-Myers Squibb, Pfizer, Merck, Sharp, and Dohme, and Menarini; and nonfinancial support from Roche France, Bristol-Myers Squibb, Pfizer, UCB, Abbvie, and Merck, Sharp, and Dohme. Dr Solau-Gervais reported receiving personal from Pfizer, Abbvie, Roche, Bristol-Myers Squibb, Merck, Sharp, and Dohme, UCB, Novartis, and SOBI. Dr Vittecoq reported receiving grant support and personal fees from Bristol-Myers Squibb, Pfizer, Roche, Merck, Sharp, and Dohme, and Abbvie, and personal fees from UCB. Dr Saraux reported receiving personal fees and grant support from Abbvie, Bristol-Myers Squibb, Merck, Sharp, and Dohme, UCB, Pfizer, and Roche. Dr Claudepierre reported receiving personal fees from Abbvie, UCB, Pfizer, Merck, Sharp, and Dohme, Janssen, Roche, Novartis, and Celgene. Dr Balblanc reported serving as a symposium presenter for Bristol-Myers Squibb, Roche Chugai, and Merck, Sharp, and Dohme and as a board member for Roche Chugai. Dr Sibilia reported receiving personal fees from Abbvie, Bristol-Myers Squibb, Merck, Sharp, and Dohme, UCB, Pfizer, Roche, Novartis, GlaxoSmithKline, Actelion, Amgen, and Hospira. No other disclosures were reported.

Funding/Support: The study was sponsored by the French Ministry of Health (Programme Hospitalier de Recherche Clinique National 2009/4507 EUDRACT No: 2009-013482-26) and promoted by The Direction de la Recherche Clinique et de l’Innovation, Strasbourg University Hospital.

Role of the Funder/Sponsor: The funding agency had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; the decision to submit for publication or preparation, review, or approval of the manuscript for publication.

Additional Contributions: The authors thank all patients for participating in this study; all staff (physicians, nurses, assistants) at all participating sites for their cooperation; and CRI-Imidiate and Direction de la Recherche Clinique et Innovation du CHU Strasbourg for their contribution to the study. We thank Hélène Kuissu, formerly at the Direction de la Recherche Clinique et de l’Innovation, Strasbourg University Hospital, for her contribution to obtain the funding for the clinical trial.

References
1.
Scott  DL, Wolfe  F, Huizinga  TW.  Rheumatoid arthritis.  Lancet. 2010;376(9746):1094-1108.PubMedGoogle ScholarCrossref
2.
Hyrich  KL, Lunt  M, Watson  KD, Symmons  DP, Silman  AJ; British Society for Rheumatology Biologics Register.  Outcomes after switching from one antitumor necrosis factor alpha agent to a second anti-tumor necrosis factor alpha agent in patients with rheumatoid arthritis: results from a large UK national cohort study.  Arthritis Rheum. 2007;56(1):13-20.PubMedGoogle ScholarCrossref
3.
Hetland  ML, Christensen  IJ, Tarp  U,  et al; All Departments of Rheumatology in Denmark.  Direct comparison of treatment responses, remission rates, and drug adherence in patients with rheumatoid arthritis treated with adalimumab, etanercept, or infliximab: results from eight years of surveillance of clinical practice in the nationwide Danish DANBIO registry.  Arthritis Rheum. 2010;62(1):22-32.PubMedGoogle ScholarCrossref
4.
Smolen  JS, Landewé  R, Breedveld  FC,  et al.  EULAR recommendations for the management of rheumatoid arthritis with synthetic and biological disease-modifying antirheumatic drugs.  Ann Rheum Dis. 2010;69(6):964-975. doi:10.1136/ard.2009.126532PubMedGoogle ScholarCrossref
5.
Cohen  SB, Emery  P, Greenwald  MW,  et al; REFLEX Trial Group.  Rituximab for rheumatoid arthritis refractory to anti-tumor necrosis factor therapy: Results of a multicenter, randomized, double-blind, placebo-controlled, phase 3 trial evaluating primary efficacy and safety at twenty-four weeks.  Arthritis Rheum. 2006;54(9):2793-2806.PubMedGoogle ScholarCrossref
6.
Emery  P, Keystone  E, Tony  HP,  et al.  IL-6 receptor inhibition with tocilizumab improves treatment outcomes in patients with rheumatoid arthritis refractory to anti-tumour necrosis factor biologicals: results from a 24-week multicentre randomised placebo-controlled trial.  Ann Rheum Dis. 2008;67(11):1516-1523.PubMedGoogle ScholarCrossref
7.
Genovese  MC, Becker  JC, Schiff  M,  et al.  Abatacept for rheumatoid arthritis refractory to tumor necrosis factor alpha inhibition.  N Engl J Med. 2005;353(11):1114-1123.PubMedGoogle ScholarCrossref
8.
Burmester  GR, Blanco  R, Charles-Schoeman  C,  et al; ORAL Step investigators.  Tofacitinib (CP-690,550) in combination with methotrexate in patients with active rheumatoid arthritis with an inadequate response to tumour necrosis factor inhibitors: a randomised phase 3 trial.  Lancet. 2013;381(9865):451-460.PubMedGoogle ScholarCrossref
9.
Bartelds  GM, Krieckaert  CL, Nurmohamed  MT,  et al.  Development of antidrug antibodies against adalimumab and association with disease activity and treatment failure during long-term follow-up.  JAMA. 2011;305(14):1460-1468.PubMedGoogle ScholarCrossref
10.
Smolen  JS, Kay  J, Doyle  MK,  et al; GO-AFTER study investigators.  Golimumab in patients with active rheumatoid arthritis after treatment with tumour necrosis factor alpha inhibitors (GO-AFTER study): a multicentre, randomised, double-blind, placebo-controlled, phase III trial.  Lancet. 2009;374(9685):210-221.PubMedGoogle ScholarCrossref
11.
Schiff  MH, von Kempis  J, Goldblum  R, Tesser  JR, Mueller  RB.  Rheumatoid arthritis secondary non-responders to TNF can attain an efficacious and safe response by switching to certolizumab pegol: a phase IV, randomised, multicentre, double-blind, 12-week study, followed by a 12-week open-label phase.  Ann Rheum Dis. 2014;73(12):2174-2177.PubMedGoogle ScholarCrossref
12.
Chatzidionysiou  K, van Vollenhoven  RF.  Rituximab vs anti-TNF in patients who previously failed one TNF inhibitor in an observational cohort.  Scand J Rheumatol. 2013;42(3):190-195.PubMedGoogle ScholarCrossref
13.
Emery  P, Gottenberg  JE, Rubbert-Roth  A,  et al.  Rituximab vs an alternative TNF inhibitor in patients with rheumatoid arthritis who failed to respond to a single previous TNF inhibitor: SWITCH-RA, a global, observational, comparative effectiveness study.  Ann Rheum Dis. 2015;74(6):979-984.PubMedGoogle ScholarCrossref
14.
Finckh  A, Ciurea  A, Brulhart  L,  et al; Physicians of the Swiss Clinical Quality Management Program for Rheumatoid Arthritis.  B cell depletion may be more effective than switching to an alternative anti-tumor necrosis factor agent in rheumatoid arthritis patients with inadequate response to anti-tumor necrosis factor agents.  Arthritis Rheum. 2007;56(5):1417-1423.PubMedGoogle ScholarCrossref
15.
Harrold  LR, Reed  GW, Kremer  JM,  et al.  The comparative effectiveness of abatacept vs anti-tumour necrosis factor switching for rheumatoid arthritis patients previously treated with an anti-tumour necrosis factor.  Ann Rheum Dis. 2015;74(2):430-436.PubMedGoogle ScholarCrossref
16.
van Gestel  AM, Haagsma  CJ, van Riel  PLCM.  Validation of rheumatoid arthritis improvement criteria that include simplified joint counts.  Arthritis Rheum. 1998;41(10):1845-1850.PubMedGoogle ScholarCrossref
17.
Fries  JF, Spitz  P, Kraines  RG, Holman  HR.  Measurement of patient outcome in arthritis.  Arthritis Rheum. 1980;23(2):137-145.PubMedGoogle ScholarCrossref
18.
Baron  G, Ravaud  P, Samson  A, Giraudeau  B.  Missing data in randomized controlled trials of rheumatoid arthritis with radiographic outcomes: a simulation study.  Arthritis Rheum. 2008;59(1):25-31.PubMedGoogle ScholarCrossref
19.
Twisk  J, de Boer  M, de Vente  W, Heymans  M.  Multiple imputation of missing values was not necessary before performing a longitudinal mixed-model analysis.  J Clin Epidemiol. 2013;66(9):1022-1028.PubMedGoogle ScholarCrossref
×