[Skip to Navigation]
Sign In
Figure.  CONSORT Flowchart
CONSORT Flowchart

Abbreviations: CBT, cognitive behavior therapy; ICBT, internet-delivered CBT.

Table 1.  Overview of the Internet-Delivered CBT Treatment Modules
Overview of the Internet-Delivered CBT Treatment Modules
Table 2.  List of Measures and Assessment Points
List of Measures and Assessment Points
1.
National Institute for Health and Care Excellence. Obsessive-compulsive disorder and body dysmorphic disorder: treatment. https://www.nice.org.uk/guidance/cg31. Accessed April 29, 2019.
2.
Geller  DA, March  J.  Practice parameter for the assessment and treatment of children and adolescents with obsessive-compulsive disorder.  J Am Acad Child Adolesc Psychiatry. 2012;51(1):98-113. doi:10.1016/j.jaac.2011.09.019PubMedGoogle ScholarCrossref
3.
Öst  L-G, Riise  EN, Wergeland  GJ, Hansen  B, Kvale  G.  Cognitive behavioral and pharmacological treatments of OCD in children: a systematic review and meta-analysis.  J Anxiety Disord. 2016;43:58-69. doi:10.1016/j.janxdis.2016.08.003PubMedGoogle ScholarCrossref
4.
Melin  K, Skarphedinsson  G, Thomsen  PH,  et al.  Treatment gains are sustainable in pediatric obsessive-compulsive disorder: three-year follow-up from the NordLOTS [published online February 14, 2019].  J Am Acad Child Adolesc Psychiatry.PubMedGoogle Scholar
5.
Franklin  ME, Sapyta  J, Freeman  JB,  et al.  Cognitive behavior therapy augmentation of pharmacotherapy in pediatric obsessive-compulsive disorder: the Pediatric OCD Treatment Study II (POTS II) randomized controlled trial.  JAMA. 2011;306(11):1224-1232. doi:10.1001/jama.2011.1344PubMedGoogle ScholarCrossref
6.
Skarphedinsson  G, Weidle  B, Thomsen  PH,  et al.  Continued cognitive-behavior therapy versus sertraline for children and adolescents with obsessive-compulsive disorder that were non-responders to cognitive-behavior therapy: a randomized controlled trial.  Eur Child Adolesc Psychiatry. 2015;24(5):591-602. doi:10.1007/s00787-014-0613-0PubMedGoogle ScholarCrossref
7.
Schwartz  C, Schlegl  S, Kuelz  AK, Voderholzer  U.  Treatment-seeking in OCD community cases and psychological treatment actually provided to treatment-seeking patients: a systematic review.  J Obsessive Compuls Relat Disord. 2013;2(4):448-456. doi:10.1016/j.jocrd.2013.10.006Google ScholarCrossref
8.
Krebs  G, Isomura  K, Lang  K,  et al.  How resistant is ‘treatment-resistant’ obsessive-compulsive disorder in youth?  Br J Clin Psychol. 2015;54(1):63-75. doi:10.1111/bjc.12061PubMedGoogle ScholarCrossref
9.
Shapiro  DA, Cavanagh  K, Lomas  H.  Geographic inequity in the availability of cognitive behavioural therapy in England and Wales.  Behav Cogn Psychother. 2003;31(02):185-192. doi:10.1017/S1352465803002066Google ScholarCrossref
10.
Marques  L, LeBlanc  NJ, Weingarden  HM, Timpano  KR, Jenike  M, Wilhelm  S.  Barriers to treatment and service utilization in an internet sample of individuals with obsessive-compulsive symptoms.  Depress Anxiety. 2010;27(5):470-475. doi:10.1002/da.20694PubMedGoogle ScholarCrossref
11.
Griffiths  F, Lindenmeyer  A, Powell  J, Lowe  P, Thorogood  M.  Why are health care interventions delivered over the internet? a systematic review of the published literature.  J Med Internet Res. 2006;8(2):e10. doi:10.2196/jmir.8.2.e10PubMedGoogle ScholarCrossref
12.
Aspvall  K, Andrén  P, Lenhard  F, Andersson  E, Mataix-Cols  D, Serlachius  E.  Internet-delivered cognitive behavioural therapy for young children with obsessive-compulsive disorder: development and initial evaluation of the BIP OCD Junior programme.  BJPsych Open. 2018;4(3):106-112. doi:10.1192/bjo.2018.10PubMedGoogle ScholarCrossref
13.
Lenhard  F, Vigerland  S, Andersson  E,  et al.  Internet-delivered cognitive behavior therapy for adolescents with obsessive-compulsive disorder: an open trial.  PLoS One. 2014;9(6):e100773. doi:10.1371/journal.pone.0100773PubMedGoogle ScholarCrossref
14.
Lenhard  F, Andersson  E, Mataix-Cols  D,  et al.  Therapist-guided, internet-delivered cognitive-behavioral therapy for adolescents with obsessive-compulsive disorder: a randomized controlled trial.  J Am Acad Child Adolesc Psychiatry. 2017;56(1):10-19.e2. doi:10.1016/j.jaac.2016.09.515PubMedGoogle ScholarCrossref
15.
Lenhard  F, Ssegonja  R, Andersson  E,  et al.  Cost-effectiveness of therapist-guided internet-delivered cognitive behaviour therapy for paediatric obsessive-compulsive disorder: results from a randomised controlled trial.  BMJ Open. 2017;7(5):e015246. doi:10.1136/bmjopen-2016-015246PubMedGoogle ScholarCrossref
16.
Jolstedt  M, Wahlund  T, Lenhard  F,  et al.  Efficacy and cost-effectiveness of therapist-guided internet cognitive behavioural therapy for paediatric anxiety disorders: a single-centre, single-blind, randomised controlled trial.  Lancet Child Adolesc Health. 2018;2(11):792-801. doi:10.1016/S2352-4642(18)30275-XPubMedGoogle ScholarCrossref
17.
Vigerland  S, Ljótsson  B, Thulin  U, Öst  LG, Andersson  G, Serlachius  E.  Internet-delivered cognitive behavioural therapy for children with anxiety disorders: a randomised controlled trial.  Behav Res Ther. 2016;76:47-56. doi:10.1016/j.brat.2015.11.006PubMedGoogle ScholarCrossref
18.
Mataix-Cols  D, Marks  IM.  Self-help with minimal therapist contact for obsessive-compulsive disorder: a review.  Eur Psychiatry. 2006;21(2):75-80. doi:10.1016/j.eurpsy.2005.07.003PubMedGoogle ScholarCrossref
19.
Chan  A-W, Tetzlaff  JM, Altman  DG,  et al.  SPIRIT 2013 statement: defining standard protocol items for clinical trials.  Ann Intern Med. 2013;158(3):200-207. doi:10.7326/0003-4819-158-3-201302050-00583PubMedGoogle ScholarCrossref
20.
Statistics Sweden. Kommuner i siffror. https://www.scb.se/hitta-statistik/sverige-i-siffror/kommuner-i-siffror/. Accessed August 23rd, 2019.
21.
Sheehan  DV, Sheehan  KH, Shytle  RD,  et al.  Reliability and validity of the Mini International Neuropsychiatric Interview for Children and Adolescents (MINI-KID).  J Clin Psychiatry. 2010;71(3):313-326. doi:10.4088/JCP.09m05305whiPubMedGoogle ScholarCrossref
22.
Scahill  L, Riddle  MA, McSwiggin-Hardin  M,  et al.  Children’s Yale-Brown Obsessive Compulsive Scale: reliability and validity.  J Am Acad Child Adolesc Psychiatry. 1997;36(6):844-852. doi:10.1097/00004583-199706000-00023PubMedGoogle ScholarCrossref
23.
Guy  W.  ECDEU Assessment Manual for Psychopharmacology. Vol 76. Rockville, MD: US Department of Health, Education and Welfare; 1976.
24.
Shaffer  D, Gould  MS, Brasic  J,  et al.  A Children’s Global Assessment Scale (CGAS).  Arch Gen Psychiatry. 1983;40(11):1228-1231. doi:10.1001/archpsyc.1983.01790100074010PubMedGoogle ScholarCrossref
25.
American Psychiatric Association.  Diagnostic and Statistical Manual of Mental Disorders. 5th ed. Washington, DC: American Psychiatric Association; 2013.
26.
Başoğlu  M, Marks  I, Livanou  M, Swinson  R.  Double-blindness procedures, rater blindness, and ratings of outcome: observations from a controlled trial.  Arch Gen Psychiatry. 1997;54(8):744-748. doi:10.1001/archpsyc.1997.01830200078011PubMedGoogle ScholarCrossref
27.
Karolinska Institutet. BIP OCD. https://vimeo.com/355965105/b3d5d1c439. Accessed September 15, 2019.
28.
Turner  CM, Mataix-Cols  D, Lovell  K,  et al.  Telephone cognitive-behavioral therapy for adolescents with obsessive-compulsive disorder: a randomized controlled non-inferiority trial.  J Am Acad Child Adolesc Psychiatry. 2014;53(12):1298-1307.e2. doi:10.1016/j.jaac.2014.09.012PubMedGoogle ScholarCrossref
29.
March  JS, Mulle  K.  OCD in Children and Adolescents: A Cognitive-Behavioral Treatment Manual. New York, NY: Guilford Press; 1998.
30.
Mataix-Cols  D, Fernández de la Cruz  L, Nordsletten  AE, Lenhard  F, Isomura  K, Simpson  HB.  Towards an international expert consensus for defining treatment response, remission, recovery and relapse in obsessive-compulsive disorder.  World Psychiatry. 2016;15(1):80-81. doi:10.1002/wps.20299PubMedGoogle ScholarCrossref
31.
Foa  EB, Coles  M, Huppert  JD, Pasupuleti  RV, Franklin  ME, March  J.  Development and validation of a child version of the obsessive compulsive inventory.  Behav Ther. 2010;41(1):121-132. doi:10.1016/j.beth.2009.02.001PubMedGoogle ScholarCrossref
32.
Shafran  R, Frampton  I, Heyman  I, Reynolds  M, Teachman  B, Rachman  S.  The preliminary development of a new self-report measure for OCD in young people.  J Adolesc. 2003;26(1):137-142. doi:10.1016/S0140-1971(02)00083-0PubMedGoogle ScholarCrossref
33.
Pinto  A, Van Noppen  B, Calvocoressi  L.  Development and preliminary psychometric evaluation of a self-rated version of the Family Accommodation Scale for Obsessive-Compulsive Disorder.  J Obsessive Compuls Relat Disord. 2013;2(4):457-465. doi:10.1016/j.jocrd.2012.06.001PubMedGoogle ScholarCrossref
34.
Jassi  A, Lenhard  F, Krebs  G,  et al. The work and social adjustment scale, youth and parent versions: psychometric evaluation of a brief measure of functional impairment in young people [published online July 3, 2019].
35.
Angold  A, Costello  EJ, Messer  SC, Pickles  A.  Development of a short questionnaire for use in epidemiological studies of depression in children and adolescents.  Int J Methods Psychiatr Res. 1995;5(4):237-249.Google Scholar
36.
Bastien  CH, Vallières  A, Morin  CM.  Validation of the Insomnia Severity Index as an outcome measure for insomnia research.  Sleep Med. 2001;2(4):297-307. doi:10.1016/S1389-9457(00)00065-4PubMedGoogle ScholarCrossref
37.
Stevens  K.  Assessing the performance of a new generic measure of health-related quality of life for children and refining it for use in health state valuation.  Appl Health Econ Health Policy. 2011;9(3):157-169. doi:10.2165/11587350-000000000-00000PubMedGoogle ScholarCrossref
38.
Bouwmans  C, De Jong  K, Timman  R,  et al.  Feasibility, reliability and validity of a questionnaire on healthcare consumption and productivity loss in patients with a psychiatric disorder (TiC-P).  BMC Health Serv Res. 2013;13(1):217. doi:10.1186/1472-6963-13-217PubMedGoogle ScholarCrossref
39.
Allison  C, Auyeung  B, Baron-Cohen  S.  Toward brief “red flags” for autism screening: the Short Autism Spectrum Quotient and the Short Quantitative Checklist for Autism in toddlers in 1,000 cases and 3,000 controls [corrected].  J Am Acad Child Adolesc Psychiatry. 2012;51(2):202-212.e7. doi:10.1016/j.jaac.2011.11.003PubMedGoogle ScholarCrossref
40.
Borkovec  TD, Nau  SD.  Credibility of analogue therapy rationales.  J Behav Ther Exp Psychiatry. 1972;3(4):257-260. doi:10.1016/0005-7916(72)90045-6Google ScholarCrossref
41.
Andrusyna  TP, Tang  TZ, DeRubeis  RJ, Luborsky  L.  The factor structure of the working alliance inventory in cognitive-behavioral therapy.  J Psychother Pract Res. 2001;10(3):173-178.PubMedGoogle Scholar
42.
Attkisson  CC, Zwick  R.  The client satisfaction questionnaire. Psychometric properties and correlations with service utilization and psychotherapy outcome.  Eval Program Plann. 1982;5(3):233-237. doi:10.1016/0149-7189(82)90074-XPubMedGoogle ScholarCrossref
43.
Simpson  HB, Maher  M, Page  JR, Gibbons  CJ, Franklin  ME, Foa  EB.  Development of a patient adherence scale for exposure and response prevention therapy.  Behav Ther. 2010;41(1):30-37. doi:10.1016/j.beth.2008.12.002PubMedGoogle ScholarCrossref
44.
Lenhard  F, Mitsell  K, Jolstedt  M,  et al.  The Internet Intervention Patient Adherence Scale for Guided Internet-Delivered Behavioral Interventions: Development and Psychometric Evaluation.  J Med Internet Res. 2019;21(10):e13602. doi:10.2196/13602PubMedGoogle ScholarCrossref
45.
Moher  D, Hopewell  S, Schulz  KF,  et al.  CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials.  BMJ. 2010;340:c869. doi:10.1136/bmj.c869PubMedGoogle ScholarCrossref
46.
Rubin  DB.  Multiple Imputation for Nonresponse in Surveys. New York, NY: John Wiley & Sons; 1987. doi:10.1002/9780470316696
47.
Bridges  JFP, Hauber  AB, Marshall  D,  et al.  Conjoint analysis applications in health—a checklist: a report of the ISPOR Good Research Practices for Conjoint Analysis Task Force.  Value Health. 2011;14(4):403-413. doi:10.1016/j.jval.2010.11.013PubMedGoogle ScholarCrossref
48.
Statens beredning för medicinsk och social utvärdering (SBU). Hälsoekonomiska utvärderingar. https://www.sbu.se/globalassets/ebm/metodbok/sbushandbok_kapitel11.pdf. Accessed April 29, 2019.
49.
Matthews  JNS, Altman  DG, Campbell  MJ, Royston  P.  Analysis of serial measurements in medical research.  BMJ. 1990;300(6719):230-235. doi:10.1136/bmj.300.6719.230PubMedGoogle ScholarCrossref
50.
Manning  WG, Mullahy  J.  Estimating log models: to transform or not to transform?  J Health Econ. 2001;20(4):461-494. doi:10.1016/S0167-6296(01)00086-8PubMedGoogle ScholarCrossref
51.
Drummond  MF, Sculpher  MJ, Claxton  K, Stoddart  GL, Torrance  GW. Methods for the Economic Evaluation of Health Care Programmes. 4th ed. Oxford, England: Oxford University Press; 2015.
52.
World Medical Association.  World Medical Association Declaration of Helsinki: ethical principles for medical research involving human subjects.  JAMA. 2013;310(20):2191-2194. doi:10.1001/jama.2013.281053PubMedGoogle ScholarCrossref
53.
Piaggio  G, Elbourne  DR, Pocock  SJ, Evans  SJ, Altman  DG; CONSORT Group.  Reporting of noninferiority and equivalence randomized trials: extension of the CONSORT 2010 statement.  JAMA. 2012;308(24):2594-2604. doi:10.1001/jama.2012.87802PubMedGoogle ScholarCrossref
54.
Husereau  D, Drummond  M, Petrou  S,  et al; CHEERS Task Force.  Consolidated Health Economic Evaluation Reporting Standards (CHEERS) statement.  BJOG. 2013;120(6):765-770. doi:10.1111/1471-0528.12241PubMedGoogle ScholarCrossref
Original Investigation
Psychiatry
October 23, 2019

Stepped Care Internet-Delivered vs Face-to-Face Cognitive-Behavior Therapy for Pediatric Obsessive-Compulsive Disorder: A Trial Protocol for a Randomized Noninferiority Trial

Author Affiliations
  • 1Centre for Psychiatry Research, Department of Clinical Neuroscience, Karolinska Institutet
  • 2Stockholm Health Care Services, Stockholm County Council, Stockholm, Sweden
  • 3Division of Psychology, Department of Clinical Neuroscience, Karolinska Institutet, Stockholm, Sweden
  • 4Institute of Neuroscience and Physiology, the Sahlgrenska Academy, University of Gothenburg, Gothenburg, Sweden
  • 5Department of Child and Adolescent Psychiatry, Child and Adolescent Psychiatry Specialized Unit, Sahlgrenska University Hospital, Gothenburg, Sweden
  • 6Department of Women's and Children's Health, Uppsala Universitet, Uppsala, Sweden
  • 7Institute of Environmental Medicine, Biostatistics, Karolinska Institutet, Stockholm, Sweden
JAMA Netw Open. 2019;2(10):e1913810. doi:10.1001/jamanetworkopen.2019.13810
Key Points español 中文 (chinese)

Question  Is internet-delivered cognitive behavior therapy implemented within a stepped care model noninferior to, and cost-effective compared with, face-to-face cognitive behavior therapy for pediatric obsessive-compulsive disorder?

Findings  This protocol describes a multicenter randomized clinical noninferiority trial conducted in a health care setting. Participants are 152 children and adolescents aged 7 to 17 years.

Meaning  This trial will add to the current knowledge base by specifically evaluating a stepped care approach to the treatment of pediatric obsessive-compulsive disorder in which patients are first offered internet-delivered cognitive behavior therapy as a low-intensity intervention, reserving higher-intensity treatments such as face-to-face therapy for those who do not benefit from the first step.

Abstract

Importance  Internet-delivered cognitive behavior therapy is an effective treatment for children and adolescents with obsessive-compulsive disorder and has the potential to markedly increase access to treatment for patients while being cost-effective for health care organizations.

Objective  To investigate whether internet-delivered cognitive behavior therapy implemented within a stepped care model is noninferior to, and cost-effective compared with, the gold standard of face-to-face cognitive behavior therapy for pediatric obsessive-compulsive disorder.

Design, Setting, and Participants  Multicenter, single-blind, randomized clinical noninferiority trial implemented at 2 specialist pediatric obsessive-compulsive disorder clinics in Stockholm and Gothenburg, Sweden. Participants are 152 children and adolescents aged 7 to 17 years with obsessive compulsive disorder, recruited through the 2 clinics and online self-referral. Patients will be randomized 1:1 to the stepped care intervention or face-to-face therapy. Blind evaluations will be conducted after treatment and at 3-month and 6-month follow-ups. At the 6-month follow-up (primary end point), noninferiority will be tested and resource use will be compared between the 2 treatment groups. Data will be analyzed according to intention-to-treat principles.

Intervention  Patients randomized to stepped care will first receive internet-delivered cognitive behavior therapy for 16 weeks; patients who are classified as nonresponders 3 months after treatment completion will receive additional face-to-face therapy. The control group will receive 16 weeks of face-to-face cognitive behavior therapy immediately following randomization and nonresponders at the 3-month follow-up will, as in the stepped care group, receive additional face-to-face therapy.

Main Outcomes and Measures  Noninferiority is defined as a 4-point difference on the primary outcome measure (Children’s Yale-Brown Obsessive Compulsive Scale).

Discussion  Recruitment started October 6, 2017, and was completed May 24, 2019. Results from the primary end point will be available by May 2020. The naturalistic follow-ups (1, 2, and 5 years after the end of treatment) will continue to 2025. There are no interim analyses planned or stopping rules for the trial.

Trial Registration  ClinicalTrials.gov identifier: NCT03263546

Introduction

Cognitive behavior therapy (CBT) is regarded as the gold-standard treatment for pediatric obsessive-compulsive disorder (OCD)1,2 and has consistently shown large effect sizes compared with both wait-list (g = 1.53) and various active comparators (g = 0.93)3 as well as sustained long-term effects.4 Furthermore, CBT is an effective augmentation treatment for patients showing suboptimal response to initial courses of both serotonin reuptake inhibitors5 and CBT.6 Unfortunately, suitably trained CBT therapists specializing in OCD are scarce and typically concentrated in large urban areas, and it is estimated that many patients do not have access to CBT.7-10 One way to increase the availability of CBT is to remotely deliver it online without the need to attend in-clinic sessions with a therapist.11 Our research group has developed a therapist-guided internet-delivered CBT (ICBT) program for youth with OCD called BIP OCD. The treatment is primarily self-guided, with assistance from parents or legal guardians, and supported by a designated therapist who communicates with both the child and the parent through the entire treatment. The BIP OCD program has to date been evaluated in 2 open pilot studies in both children12 and adolescents13 that showed high acceptability and safety and promising results. A subsequent randomized clinical trial including 67 patients demonstrated superiority and cost-effectiveness of BIP OCD against a wait-list control.14,15 Interestingly, the effects of ICBT were slightly weaker than expected but continued beyond the primary end point, with patients experiencing additional symptom improvement at the 3-month follow-up. This delayed improvement phenomenon has also been observed in other ICBT trials.16,17 As participants in these trials were primarily self-referred12-14 and may therefore constitute a selected group of individuals (eg, highly educated, more motivated), the generalizability of these findings to regular clinic-referred patients is currently unclear.

Before ICBT for pediatric OCD can be recommended for implementation in routine clinical care, it is essential to evaluate whether this approach is comparable or noninferior and cost-effective compared with the gold standard of face-to-face CBT. Even if ICBT were less efficacious than face-to-face CBT, it might still have a meaningful place in the health system, as its potential cost-effectiveness could outweigh its loss of efficacy. In that scenario, ICBT might be used in a stepped care model in which patients are first offered ICBT as a low-intensity intervention, reserving higher-intensity treatments that require specialist input (eg, face-to-face CBT) for more complex patients or those who do not benefit sufficiently from ICBT.18 Stepped care approaches are heralded as the ideal model of psychiatric service delivery1 but have rarely been evaluated.

We describe the trial protocol of a multicenter, single-blind, randomized clinical noninferiority trial aimed to investigate whether therapist-guided ICBT implemented within a stepped care model is noninferior to, and cost-effective compared with, the gold standard of face-to-face CBT for pediatric OCD. The main hypothesis is that the stepped care ICBT approach will be noninferior to gold-standard treatment (face-to-face CBT) in reducing clinician-rated OCD symptoms and will also be associated with lower resource use. As a secondary aim, the trial will explore whether the outcomes of ICBT differ between clinic-referred and self-referred patients.

Methods
Study Design

The study is a 2-site randomized clinical noninferiority trial for children and adolescents with OCD. Participants randomized to stepped care ICBT first receive ICBT for 16 weeks; patients classed as nonresponders at the 3-month follow-up are offered a course of face-to-face CBT for up to 12 weeks. Participants randomized to the gold standard treatment receive face-to-face CBT for 16 weeks; as in the stepped care group, patients classed as nonresponders at the 3-month follow-up are offered additional sessions of face-to-face CBT for up to 12 weeks. The full trial protocol is available in the Supplement.

The primary end point is 6 months after the end of the first course of treatment (6-month follow-up). Long-term effects will be investigated 1, 2, and 5 years after treatment completion. The trial design is graphically summarized in the Figure.

The study was approved by the Regional Ethical Review Board in Stockholm, Sweden, and preregistered at ClinicalTrials.gov. The participants and their parents received verbal and written information about the study, including an informed consent form and an age-adapted information brochure specifically designed for the children and adolescents. The written consent procedure was witnessed by the clinician who provided the verbal information about the study. This trial protocol follows the Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) reporting guideline for clinical trials.19

Study Sites

Study participants are assessed and treated at 1 of 2 specialist pediatric OCD clinics, located in Stockholm (Child and Adolescent Psychiatry Research Center) and Gothenburg (Sahlgrenska University Hospital), Sweden. Stockholm and Gothenburg are Sweden’s largest cities and have similar socioeconomic landscapes.20 The 2 clinics receive referrals from Child and Adolescent Mental Health Services within their respective regions but also accept referrals from other parts of Sweden.

Participants

Consecutive patients referred to the 2 specialist clinics are assessed for eligibility. Participants can also find information about the study online and self-refer via a dedicated website. Eligible participants are offered a face-to-face appointment with a clinician for a full psychiatric assessment, including the administration of the Mini International Neuropsychiatric Interview for Children and Adolescents (MINI-KID),21 the Children’s Yale-Brown Obsessive Compulsive Scale (CY-BOCS),22 the Clinical Global Impression–Severity scale (CGI-S),23 and the Children’s Global Assessment Scale (CGAS).24 If suitable for the study, both the children or adolescents and their parents sign informed consent to participate during this visit. Participants receiving psychotropic medication are requested to continue using stable doses until the primary end point (6-month follow-up).

Inclusion criteria are as follows: primary diagnosis of OCD according to the Diagnostic and Statistical Manual of Mental Disorders (Fifth Edition)25; total score of 16 or greater on the CY-BOCS22; age between 7 and 17 years; ability to read and write Swedish; and daily access to a computer with an internet connection. Exclusion criteria are changes in psychotropic medication within the last 6 weeks prior to baseline assessment; comorbid diagnosis of organic brain disorders, global learning disabilities, autism spectrum disorder, bipolar disorder, or severe eating disorder; suicidal ideation; being housebound or in need of intensive or inpatient treatment; having completed a course of cognitive behavior therapy for OCD within the last 12 months (defined as ≥5 sessions including exposure and response prevention); and ongoing psychological treatment for OCD or an anxiety disorder.

Randomization and Allocation Concealment

The allocation sequence is generated by an independent external party, the Karolinska Trial Alliance (KTA). The research team and the therapists who enroll the participants are not involved in the randomization or allocation process. Participants are randomized to either stepped care ICBT or gold-standard CBT through an online automated system for clinical trials. The allocation ratio is 1:1. Randomization is stratified by source of referral (clinician-referred or self-referred) and participant’s age (children [7-12 years] or adolescents [13-17 years]).

Quality Control

This trial follows Good Clinical Practice (GCP) standards. All quality and safety aspects are regularly monitored by KTA (ie, case-by-case monitoring of informed consent, inclusion and exclusion criteria, source data quality, and adverse events).

Blinding

Assessments of OCD symptom severity are conducted by a team of independent evaluators blind to treatment allocation at 3 different points: posttreatment, 3-month follow-up, and 6-month follow-up. To ensure blinding integrity, participants receive explicit instructions not to disclose which treatment they have received. After completing the assessment, the blind raters guess the participant’s group allocation and record whether the family has inadvertently revealed their group allocation.26 If participants inadvertently disclose the treatment allocation during the assessment, another blind assessor will rerate the participant’s CY-BOCS score based on the recording from the interview. We expect that the blind raters’ guesses on allocation will not be better than chance. The participants, therapists, and the project manager are not blind to treatment allocation. The 1-year, 2-year, and 5-year follow-ups are naturalistic (unblinded).

Assessment Points

The assessments occur at predetermined points after randomization and are independent of the treatment progress. The primary end point is at 6-month follow-up. All clinician measures and self- and parent-reported questionnaires are administered at baseline, after treatment, and at 3-month, 6-month, and 1-year follow-ups. Self- and parent-administered measures of OCD symptom severity are also administered weekly during the first 16 weeks of treatment. Additional clinician follow-up assessments are conducted after 2 and 5 years via telephone. Changes in psychotropic medication and additional psychological treatment are monitored and documented throughout the study period.

Planned Intervention
Internet-Delivered CBT

The BIP OCD intervention is a 16-week therapist-guided online self-help program consisting of 14 modules provided through a secure online site with double authentication.12-14 There are 2 age-adapted versions of the intervention, one for children aged 7 to 12 years and one for adolescents aged 13 to 17 years. The content of the intervention is presented in a varied and engaging manner, with reading material, films, animations, illustrations, and exercises adapted for the 2 age groups. The main treatment components are education, exposure with response prevention (ERP), and relapse prevention. An overview of the treatment content is presented in Table 1. Parents have separate accounts and receive parallel online guidance, including in-depth knowledge about OCD, the rationale for CBT and ERP, strategies to reduce family accommodation, and ways to incorporate positive reinforcement. During the treatment, families have regular contact with a dedicated therapist with expertise in treating patients with OCD. The therapist contact is provided through written messages in the online platform or, when necessary, telephone calls. The therapist responds to all activity on the platform and sends reminders to families in case of inactivity. After treatment completion, families continue to have access to all online material for a year (without therapist support). For an overview of BIP OCD, see https://vimeo.com/355965105/b3d5d1c439.27

Face-to-Face CBT

Participants in the gold-standard group receive face-to-face CBT based on validated protocols,28,29 including up to 14 sessions with a dedicated therapist delivered over 16 weeks (allowing for missed appointments due to illness or holidays). Parents are encouraged to participate in all the therapy sessions, but their attendance varies according to participant’s age and individual needs.

The treatment begins with 2 sessions of education about OCD and the treatment rationale. The main focus of sessions 3 to 12 is ERP and includes therapist-led exposure exercises. Between these sessions, participants are encouraged to practice ERP tasks on a daily basis. Sessions 13 to 14 include relapse prevention strategies and planning to reduce remaining OCD symptoms. Sessions are typically 1 hour long and conducted at the clinic, but can be longer or conducted outside the clinic or in the participant’s home, according to individual needs. All sessions are audiotaped and a random 20% of the sessions will be selected to ensure therapists’ adherence to the treatment protocol.

Nonresponders

Participants in either group not meeting strict criteria for clinical response30 at the 3-month follow-up are offered up to 12 sessions of face-to-face CBT for OCD.6 This additional treatment is delivered between the 3-month and 6-month follow-ups. The content of the treatment is identical to the face-to-face CBT treatment, with the main focus on therapist-guided ERP.28,29 Individual adaptations are made to ensure optimal treatment dosage, including longer sessions or home visits as appropriate.

Therapists

The same therapists treat patients in both groups, and the families have a dedicated therapist throughout the entire treatment. Typically, the assigned therapist is the same clinician who did the baseline clinician assessment. Therapists are clinical psychologists or social workers who specialize in CBT, either experienced in delivery of CBT for pediatric OCD or recently qualified but with training and supervision in the use of the therapy manuals. All therapists have a training session on the treatment manuals and study procedures with the project coordinator prior to starting to support patients. They are closely supervised and monitored by the project coordinator, with weekly meetings throughout the trial, and can also receive on-demand supervision with 12 hours’ notice.

Outcome Measures
Primary Outcome Measure

The primary outcome measure is the participant’s total score on the CY-BOCS,22 a semistructured clinician-administered interview for assessment of OCD symptom severity in pediatric OCD. The total score is the sum of 10 items; total scores range from 0 to 40, with higher scores indicating greater severity. The CY-BOCS has a high internal consistency and excellent interrater reliability.22 The CY-BOCS is administered at all assessment points. All assessors in the trial receive extensive training in using the CY-BOCS and also practice and rate cases together during the trial on a continuous basis.

Secondary Outcome Measures

An overview of the measurements, points for completion, and informant is shown in Table 2. The clinician-rated measures are administered during scheduled assessments at the clinic, and the child- and parent-reported measures are administered online.

Secondary clinician-rated outcome measures are the CGI Severity and Improvement scales (CGI-S and CGI-I)23 and CGAS.24 Severity of OCD symptoms is measured using the child-rated Obsessive-Compulsive Inventory–Child Version (OCI-CV)31 and the Children's Obsessional Compulsive Inventory Revised–Parent version (ChOCI-R-P).32 Family accommodation behaviors are measured using the Family Accommodation Scale–Self Rated (FAS-SR).33 Impairment of functioning due to OCD is assessed using the Work and Social Adjustment Scale–Youth version and Parent version (WSAS-Y and WSAS-P), which are adaptations of the Work and Social Adjustment Scale.34 Depressive symptoms are assessed using the short version of the Mood and Feelings Questionnaire (MFQ).35 The Insomnia Severity Index (ISI)36 is used to quantify the severity of insomnia. The Child Health Utility 9D (CHU9D)37 is used as a measure of quality of life and for the estimation of quality-adjusted life years. The Trimbos/iMTA Questionnaire for Costs Associated With Psychiatric Illness (TiC-P),38 which measures resource use of health care, social support and assistance, medication use, informal care by parents, and school and work absenteeism over the last 3-month period, is administered to the parents. The Autism Spectrum Quotient (AQ-10)39 is used as a baseline measure of autistic symptoms rated by the parent. Other measures are the Treatment Credibility and Expectancy Scale (TCES)40 to measure how credible participants perceive the treatment to be, the Working Alliance Inventory (WAI)41 to measure working alliance, and the Client Satisfaction Questionnaire (CSQ-8)42 to assess participants’ satisfaction with treatment. To measure treatment adherence, the Patient EX/RP Adherence Scale (PEAS)43 is used to investigate the amount of exposure and response prevention exercises performed weekly (administered as both a clinician-rated and self-reported measure during face-to-face CBT and as a self-rated version during ICBT), and the clinician-rated Internet Intervention Patient Adherence Scale (iiPAS)44 is used only in the ICBT group. To investigate the role of parental behaviors in relation to treatment outcome, questions about parental strategies are administered every week during treatment.

Safety Procedures

Both children and parents report occurrence of adverse events or undesirable treatment effects in the middle of the course of treatment, after the course of treatment, and at the 6-month follow-up. Adverse events are assessed in the online platform where both the child and the parent report and describe the event and its impact on the child. Reported incidents are categorized depending on severity and frequency in line with GCP. All adverse event assessments will be cross-checked by KTA.

All participants are monitored by the study personnel throughout the study period to ensure participant safety. Therapists and assessors have routines for situations of potential risk. Serious adverse events (ie, events that result in death, suicide attempt, serious violent incident, or admission to the hospital) are documented and monitored by KTA. In case a participant’s condition deteriorates during treatment, the therapist does an immediate in-depth assessment of the symptoms and discusses this with the principal investigator to determine necessary actions. For patient safety reasons, an item to assess suicide risk is added to the child-rated MFQ, which is administered before and after treatment and at 3-month, 6-month, and 1-year follow-ups. If the participant indicates suicidal ideation or has a total score greater than 13 on the child- or parent-rated MFQ (total score ranging from 0-26), the therapist will initiate an assessment of suicide risk.

Statistical Analysis
Baseline Data

Statistical analyses will be conducted under the guidance of the Karolinska Institutet Biostatistics Core Facility. Descriptive statistics with sample characteristics will be presented for each group at baseline. There will not be any formal testing for between-group differences on any baseline variable.45 However, we will test for possible site differences at baseline.

Outcome Data

The only previous pediatric OCD trial using a noninferiority design used −5 points on the primary outcome measure (CY-BOCS) as a noninferiority margin with an SD of 8.28 In the present study, we set the noninferiority margin to −4 points to gain greater precision. The noninferiority analysis will be based on the CY-BOCS score at the primary end point (6-month follow-up) and determined by the confidence interval around the mean difference between the 2 groups. The estimated enrollment is 152 participants, which gives an estimated power greater than 95%, allowing for possible data attrition (10% based on experience from our previous trials). The power is estimated based on each participant being observed at 4 points (baseline, after treatment, 3-month follow-up, and 6-month follow-up). We used a linear random intercept model with 1000 bootstrap samples using the following values, which were based on individual-level data from a previous study of therapist-guided ICBT for adolescents with OCD that used 3 repeated observations14: intercept (22.45), slope (−0.37 per week), SD of the random effect (4.03), and SD of the residual error (3.94). In other words, if the stepped care ICBT approach is truly noninferior to the gold-standard treatment, 152 patients will give an estimated probability greater than 95% that the upper limit of a 1-sided 95% confidence interval (or, equivalently, a 90% 2-sided confidence interval) will be below the noninferiority limit of 4 points on the CY-BOCS. No specific noninferiority margin is defined for the secondary outcome measures, but we expect no statistically significant difference between the groups on these measures.

Data will be analyzed according to the participants’ original treatment allocation in line with intention-to-treat principles. Data analysis on the continuous outcome measures will be performed with mixed-effect regression analyses for repeated measures with maximum likelihood estimation. The model will include fixed effects of time, treatment group, and site and an interaction effect of treatment group by time, as well as random intercept and random slope to account for individual differences. In line with our secondary aim, a model with an interaction effect of treatment group, time, and source of referral will be implemented to explore whether source of referral is a moderator of treatment effect. Ordinal data will be analyzed with ordinal regression, binary data will be analyzed with logistic regression, and paired binary data will be analyzed with McNemar tests. Logistic regression will be used to test whether the blinded assessor’s guesses on treatment allocation are better than chance. Within- and between-group effect sizes will be reported as Cohen d. If the proportion of missing data is greater than 10%, we will perform multiple imputation with 10 extra data sets.46 In a first sensitivity analysis, we will compare the results of the complete-case analysis with those of the multiple-imputed data sets. If the results are inconsistent, we will investigate the reasons of the nonresponse and discuss their possible impact on the study findings. In a second sensitivity analysis, we will exclude the participants who violate protocol (eg, start medication in the middle of the trial) and investigate any inconsistencies with the results from the main analysis. Additional analysis of the 1-year, 2-year, and 5-year follow-up data will evaluate whether the treatment gains are maintained long term.

Cost-effectiveness Analysis

In our cost-effectiveness analysis, we will compare costs and health outcomes between stepped care ICBT and gold-standard CBT. Costs will be collected from 2 different perspectives: a health care organization perspective and a societal perspective. Costs within the health care organization perspective include recorded therapist time in the ICBT treatment and on face-to-face CBT sessions (including time for preparation and traveling), telephone calls, and administration. In the analysis from a societal perspective, other health care costs (other health care utilization and medication use) as well as indirect costs (eg, informal care, productivity loss associated with school and work absenteeism) captured by the TiC-P will be included.38 Our hypothesis is that there will be a difference between the 2 groups in treatment costs from the health care organization perspective, but we expect no difference in other costs.

Two types of analyses will be conducted on each of the 2 perspectives: a cost-effectiveness analysis and a cost-utility analysis. In the cost-effectiveness analysis, both number of responders and remitters at primary end point (6-month follow-up) will be used as the health outcome. We will use expert consensus criteria to define treatment response and remission.30 A responder is defined as at least 35% reduction on the CY-BOCS and a CGI-I score of 1 (very much improved) or 2 (much improved). Remission is defined as a score of less than or equal to 12 on the CY-BOCS and a CGI-S rating of 1 (normal, not at all ill) or 2 (borderline mentally ill). In the cost-utility analysis, the outcome will be quality-adjusted life years, according to international standards for cost-effectiveness analyses.47,48 Quality-adjusted life-years will be calculated using the area under the curve method.49 Costs will be estimated by appropriate regression analyses testing alternative link functions and distributions.50 Nonparametric bootstrapping with 5000 iterations will be carried out, pairing up differences in costs with differences in outcomes. As a global cost-effectiveness estimate, we will present the incremental cost-effectiveness ratio (difference in costs between the 2 groups divided by the difference in effect),51 as well as a visual presentation of cost-effectiveness planes. The time frames for the cost-effectiveness analyses will be from baseline to the 6-month follow-up, and from baseline to the 1-year follow-up.

Ethics and Dissemination

The study is conducted according to the Declaration of Helsinki52 and GCP standards. All investigators and therapists involved in the study will attend a course in GCP that KTA arranges. The study results will be reported following the Consolidated Standards of Reporting Trials Extension (CONSORT Extension) reporting guideline 2010 statement for noninferiority trials,53 and the Consolidated Health Economic Evaluation Reporting Standards (CHEERS) reporting guideline.54 The results will be published in peer-reviewed academic journals, presented at scientific conferences, and communicated to the participants and patient organizations.

Trial Status

Recruitment started October 6, 2017, and was completed in May 24, 2019. Results from the primary end point will be available by May 2020. The naturalistic follow-up will continue to 2025. No interim analyses are planned, and there are no prespecified stopping rules.

Conclusions

If, as expected, the stepped care ICBT approach is noninferior to the gold standard of CBT but uses fewer resources, it will provide an opportunity to increase the availability of evidence-based treatment for children and adolescents with OCD. The next challenge would be to implement the proposed stepped care model in routine clinical services.

Back to top
Article Information

Accepted for Publication: September 4, 2019.

Published: October 23, 2019. doi:10.1001/jamanetworkopen.2019.13810

Open Access: This is an open access article distributed under the terms of the CC-BY License. © 2019 Aspvall K et al. JAMA Network Open.

Corresponding Author: Kristina Aspvall, MSc, Child and Adolescent Psychiatry Research Centre, Gävlegatan 22, SE-113 30 Stockholm, Sweden (kristina.aspvall@ki.se).

Author Contributions: Ms Aspvall and Dr Serlachius had full access to all of the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis.

Concept and design: Aspvall, Andersson, Lenhard, Silverberg-Mörse, Feldman, Mataix-Cols, Serlachius.

Acquisition, analysis, or interpretation of data: Aspvall, Andersson, Lenhard, Melin, Norlin, Wallin, Bottai, Mataix-Cols, Serlachius.

Drafting of the manuscript: Aspvall, Andersson, Lenhard, Feldman.

Critical revision of the manuscript for important intellectual content: All authors.

Statistical analysis: Aspvall, Andersson, Bottai.

Obtained funding: Aspvall, Andersson, Mataix-Cols, Serlachius.

Administrative, technical, or material support: Aspvall, Andersson, Lenhard, Silverberg-Mörse, Serlachius.

Supervision: Andersson, Lenhard, Silverberg-Mörse, Feldman, Mataix-Cols, Serlachius.

Conflict of Interest Disclosures: Dr Andersson reported receiving book royalties from Natur & Kultur outside the submitted work. Dr Mataix-Cols reported receiving personal fees from UpToDate, Wolters Kluwer Health, and Elsevier outside the submitted work. No other disclosures were reported.

Funding/Support: This study was funded by the Swedish Research Council for Heath, Working Life and Welfare (grant 2014-4052), ALF Medicin Project Grant by Stockholm County Council (grant 20160247), and Jane and Dan Olssons Foundation (grant 2016-64). Dr Serlachius was supported by a clinical research appointment from the Stockholm County Council (grant 20170605).

Role of the Funder/Sponsor: The funders had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.

References
1.
National Institute for Health and Care Excellence. Obsessive-compulsive disorder and body dysmorphic disorder: treatment. https://www.nice.org.uk/guidance/cg31. Accessed April 29, 2019.
2.
Geller  DA, March  J.  Practice parameter for the assessment and treatment of children and adolescents with obsessive-compulsive disorder.  J Am Acad Child Adolesc Psychiatry. 2012;51(1):98-113. doi:10.1016/j.jaac.2011.09.019PubMedGoogle ScholarCrossref
3.
Öst  L-G, Riise  EN, Wergeland  GJ, Hansen  B, Kvale  G.  Cognitive behavioral and pharmacological treatments of OCD in children: a systematic review and meta-analysis.  J Anxiety Disord. 2016;43:58-69. doi:10.1016/j.janxdis.2016.08.003PubMedGoogle ScholarCrossref
4.
Melin  K, Skarphedinsson  G, Thomsen  PH,  et al.  Treatment gains are sustainable in pediatric obsessive-compulsive disorder: three-year follow-up from the NordLOTS [published online February 14, 2019].  J Am Acad Child Adolesc Psychiatry.PubMedGoogle Scholar
5.
Franklin  ME, Sapyta  J, Freeman  JB,  et al.  Cognitive behavior therapy augmentation of pharmacotherapy in pediatric obsessive-compulsive disorder: the Pediatric OCD Treatment Study II (POTS II) randomized controlled trial.  JAMA. 2011;306(11):1224-1232. doi:10.1001/jama.2011.1344PubMedGoogle ScholarCrossref
6.
Skarphedinsson  G, Weidle  B, Thomsen  PH,  et al.  Continued cognitive-behavior therapy versus sertraline for children and adolescents with obsessive-compulsive disorder that were non-responders to cognitive-behavior therapy: a randomized controlled trial.  Eur Child Adolesc Psychiatry. 2015;24(5):591-602. doi:10.1007/s00787-014-0613-0PubMedGoogle ScholarCrossref
7.
Schwartz  C, Schlegl  S, Kuelz  AK, Voderholzer  U.  Treatment-seeking in OCD community cases and psychological treatment actually provided to treatment-seeking patients: a systematic review.  J Obsessive Compuls Relat Disord. 2013;2(4):448-456. doi:10.1016/j.jocrd.2013.10.006Google ScholarCrossref
8.
Krebs  G, Isomura  K, Lang  K,  et al.  How resistant is ‘treatment-resistant’ obsessive-compulsive disorder in youth?  Br J Clin Psychol. 2015;54(1):63-75. doi:10.1111/bjc.12061PubMedGoogle ScholarCrossref
9.
Shapiro  DA, Cavanagh  K, Lomas  H.  Geographic inequity in the availability of cognitive behavioural therapy in England and Wales.  Behav Cogn Psychother. 2003;31(02):185-192. doi:10.1017/S1352465803002066Google ScholarCrossref
10.
Marques  L, LeBlanc  NJ, Weingarden  HM, Timpano  KR, Jenike  M, Wilhelm  S.  Barriers to treatment and service utilization in an internet sample of individuals with obsessive-compulsive symptoms.  Depress Anxiety. 2010;27(5):470-475. doi:10.1002/da.20694PubMedGoogle ScholarCrossref
11.
Griffiths  F, Lindenmeyer  A, Powell  J, Lowe  P, Thorogood  M.  Why are health care interventions delivered over the internet? a systematic review of the published literature.  J Med Internet Res. 2006;8(2):e10. doi:10.2196/jmir.8.2.e10PubMedGoogle ScholarCrossref
12.
Aspvall  K, Andrén  P, Lenhard  F, Andersson  E, Mataix-Cols  D, Serlachius  E.  Internet-delivered cognitive behavioural therapy for young children with obsessive-compulsive disorder: development and initial evaluation of the BIP OCD Junior programme.  BJPsych Open. 2018;4(3):106-112. doi:10.1192/bjo.2018.10PubMedGoogle ScholarCrossref
13.
Lenhard  F, Vigerland  S, Andersson  E,  et al.  Internet-delivered cognitive behavior therapy for adolescents with obsessive-compulsive disorder: an open trial.  PLoS One. 2014;9(6):e100773. doi:10.1371/journal.pone.0100773PubMedGoogle ScholarCrossref
14.
Lenhard  F, Andersson  E, Mataix-Cols  D,  et al.  Therapist-guided, internet-delivered cognitive-behavioral therapy for adolescents with obsessive-compulsive disorder: a randomized controlled trial.  J Am Acad Child Adolesc Psychiatry. 2017;56(1):10-19.e2. doi:10.1016/j.jaac.2016.09.515PubMedGoogle ScholarCrossref
15.
Lenhard  F, Ssegonja  R, Andersson  E,  et al.  Cost-effectiveness of therapist-guided internet-delivered cognitive behaviour therapy for paediatric obsessive-compulsive disorder: results from a randomised controlled trial.  BMJ Open. 2017;7(5):e015246. doi:10.1136/bmjopen-2016-015246PubMedGoogle ScholarCrossref
16.
Jolstedt  M, Wahlund  T, Lenhard  F,  et al.  Efficacy and cost-effectiveness of therapist-guided internet cognitive behavioural therapy for paediatric anxiety disorders: a single-centre, single-blind, randomised controlled trial.  Lancet Child Adolesc Health. 2018;2(11):792-801. doi:10.1016/S2352-4642(18)30275-XPubMedGoogle ScholarCrossref
17.
Vigerland  S, Ljótsson  B, Thulin  U, Öst  LG, Andersson  G, Serlachius  E.  Internet-delivered cognitive behavioural therapy for children with anxiety disorders: a randomised controlled trial.  Behav Res Ther. 2016;76:47-56. doi:10.1016/j.brat.2015.11.006PubMedGoogle ScholarCrossref
18.
Mataix-Cols  D, Marks  IM.  Self-help with minimal therapist contact for obsessive-compulsive disorder: a review.  Eur Psychiatry. 2006;21(2):75-80. doi:10.1016/j.eurpsy.2005.07.003PubMedGoogle ScholarCrossref
19.
Chan  A-W, Tetzlaff  JM, Altman  DG,  et al.  SPIRIT 2013 statement: defining standard protocol items for clinical trials.  Ann Intern Med. 2013;158(3):200-207. doi:10.7326/0003-4819-158-3-201302050-00583PubMedGoogle ScholarCrossref
20.
Statistics Sweden. Kommuner i siffror. https://www.scb.se/hitta-statistik/sverige-i-siffror/kommuner-i-siffror/. Accessed August 23rd, 2019.
21.
Sheehan  DV, Sheehan  KH, Shytle  RD,  et al.  Reliability and validity of the Mini International Neuropsychiatric Interview for Children and Adolescents (MINI-KID).  J Clin Psychiatry. 2010;71(3):313-326. doi:10.4088/JCP.09m05305whiPubMedGoogle ScholarCrossref
22.
Scahill  L, Riddle  MA, McSwiggin-Hardin  M,  et al.  Children’s Yale-Brown Obsessive Compulsive Scale: reliability and validity.  J Am Acad Child Adolesc Psychiatry. 1997;36(6):844-852. doi:10.1097/00004583-199706000-00023PubMedGoogle ScholarCrossref
23.
Guy  W.  ECDEU Assessment Manual for Psychopharmacology. Vol 76. Rockville, MD: US Department of Health, Education and Welfare; 1976.
24.
Shaffer  D, Gould  MS, Brasic  J,  et al.  A Children’s Global Assessment Scale (CGAS).  Arch Gen Psychiatry. 1983;40(11):1228-1231. doi:10.1001/archpsyc.1983.01790100074010PubMedGoogle ScholarCrossref
25.
American Psychiatric Association.  Diagnostic and Statistical Manual of Mental Disorders. 5th ed. Washington, DC: American Psychiatric Association; 2013.
26.
Başoğlu  M, Marks  I, Livanou  M, Swinson  R.  Double-blindness procedures, rater blindness, and ratings of outcome: observations from a controlled trial.  Arch Gen Psychiatry. 1997;54(8):744-748. doi:10.1001/archpsyc.1997.01830200078011PubMedGoogle ScholarCrossref
27.
Karolinska Institutet. BIP OCD. https://vimeo.com/355965105/b3d5d1c439. Accessed September 15, 2019.
28.
Turner  CM, Mataix-Cols  D, Lovell  K,  et al.  Telephone cognitive-behavioral therapy for adolescents with obsessive-compulsive disorder: a randomized controlled non-inferiority trial.  J Am Acad Child Adolesc Psychiatry. 2014;53(12):1298-1307.e2. doi:10.1016/j.jaac.2014.09.012PubMedGoogle ScholarCrossref
29.
March  JS, Mulle  K.  OCD in Children and Adolescents: A Cognitive-Behavioral Treatment Manual. New York, NY: Guilford Press; 1998.
30.
Mataix-Cols  D, Fernández de la Cruz  L, Nordsletten  AE, Lenhard  F, Isomura  K, Simpson  HB.  Towards an international expert consensus for defining treatment response, remission, recovery and relapse in obsessive-compulsive disorder.  World Psychiatry. 2016;15(1):80-81. doi:10.1002/wps.20299PubMedGoogle ScholarCrossref
31.
Foa  EB, Coles  M, Huppert  JD, Pasupuleti  RV, Franklin  ME, March  J.  Development and validation of a child version of the obsessive compulsive inventory.  Behav Ther. 2010;41(1):121-132. doi:10.1016/j.beth.2009.02.001PubMedGoogle ScholarCrossref
32.
Shafran  R, Frampton  I, Heyman  I, Reynolds  M, Teachman  B, Rachman  S.  The preliminary development of a new self-report measure for OCD in young people.  J Adolesc. 2003;26(1):137-142. doi:10.1016/S0140-1971(02)00083-0PubMedGoogle ScholarCrossref
33.
Pinto  A, Van Noppen  B, Calvocoressi  L.  Development and preliminary psychometric evaluation of a self-rated version of the Family Accommodation Scale for Obsessive-Compulsive Disorder.  J Obsessive Compuls Relat Disord. 2013;2(4):457-465. doi:10.1016/j.jocrd.2012.06.001PubMedGoogle ScholarCrossref
34.
Jassi  A, Lenhard  F, Krebs  G,  et al. The work and social adjustment scale, youth and parent versions: psychometric evaluation of a brief measure of functional impairment in young people [published online July 3, 2019].
35.
Angold  A, Costello  EJ, Messer  SC, Pickles  A.  Development of a short questionnaire for use in epidemiological studies of depression in children and adolescents.  Int J Methods Psychiatr Res. 1995;5(4):237-249.Google Scholar
36.
Bastien  CH, Vallières  A, Morin  CM.  Validation of the Insomnia Severity Index as an outcome measure for insomnia research.  Sleep Med. 2001;2(4):297-307. doi:10.1016/S1389-9457(00)00065-4PubMedGoogle ScholarCrossref
37.
Stevens  K.  Assessing the performance of a new generic measure of health-related quality of life for children and refining it for use in health state valuation.  Appl Health Econ Health Policy. 2011;9(3):157-169. doi:10.2165/11587350-000000000-00000PubMedGoogle ScholarCrossref
38.
Bouwmans  C, De Jong  K, Timman  R,  et al.  Feasibility, reliability and validity of a questionnaire on healthcare consumption and productivity loss in patients with a psychiatric disorder (TiC-P).  BMC Health Serv Res. 2013;13(1):217. doi:10.1186/1472-6963-13-217PubMedGoogle ScholarCrossref
39.
Allison  C, Auyeung  B, Baron-Cohen  S.  Toward brief “red flags” for autism screening: the Short Autism Spectrum Quotient and the Short Quantitative Checklist for Autism in toddlers in 1,000 cases and 3,000 controls [corrected].  J Am Acad Child Adolesc Psychiatry. 2012;51(2):202-212.e7. doi:10.1016/j.jaac.2011.11.003PubMedGoogle ScholarCrossref
40.
Borkovec  TD, Nau  SD.  Credibility of analogue therapy rationales.  J Behav Ther Exp Psychiatry. 1972;3(4):257-260. doi:10.1016/0005-7916(72)90045-6Google ScholarCrossref
41.
Andrusyna  TP, Tang  TZ, DeRubeis  RJ, Luborsky  L.  The factor structure of the working alliance inventory in cognitive-behavioral therapy.  J Psychother Pract Res. 2001;10(3):173-178.PubMedGoogle Scholar
42.
Attkisson  CC, Zwick  R.  The client satisfaction questionnaire. Psychometric properties and correlations with service utilization and psychotherapy outcome.  Eval Program Plann. 1982;5(3):233-237. doi:10.1016/0149-7189(82)90074-XPubMedGoogle ScholarCrossref
43.
Simpson  HB, Maher  M, Page  JR, Gibbons  CJ, Franklin  ME, Foa  EB.  Development of a patient adherence scale for exposure and response prevention therapy.  Behav Ther. 2010;41(1):30-37. doi:10.1016/j.beth.2008.12.002PubMedGoogle ScholarCrossref
44.
Lenhard  F, Mitsell  K, Jolstedt  M,  et al.  The Internet Intervention Patient Adherence Scale for Guided Internet-Delivered Behavioral Interventions: Development and Psychometric Evaluation.  J Med Internet Res. 2019;21(10):e13602. doi:10.2196/13602PubMedGoogle ScholarCrossref
45.
Moher  D, Hopewell  S, Schulz  KF,  et al.  CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials.  BMJ. 2010;340:c869. doi:10.1136/bmj.c869PubMedGoogle ScholarCrossref
46.
Rubin  DB.  Multiple Imputation for Nonresponse in Surveys. New York, NY: John Wiley & Sons; 1987. doi:10.1002/9780470316696
47.
Bridges  JFP, Hauber  AB, Marshall  D,  et al.  Conjoint analysis applications in health—a checklist: a report of the ISPOR Good Research Practices for Conjoint Analysis Task Force.  Value Health. 2011;14(4):403-413. doi:10.1016/j.jval.2010.11.013PubMedGoogle ScholarCrossref
48.
Statens beredning för medicinsk och social utvärdering (SBU). Hälsoekonomiska utvärderingar. https://www.sbu.se/globalassets/ebm/metodbok/sbushandbok_kapitel11.pdf. Accessed April 29, 2019.
49.
Matthews  JNS, Altman  DG, Campbell  MJ, Royston  P.  Analysis of serial measurements in medical research.  BMJ. 1990;300(6719):230-235. doi:10.1136/bmj.300.6719.230PubMedGoogle ScholarCrossref
50.
Manning  WG, Mullahy  J.  Estimating log models: to transform or not to transform?  J Health Econ. 2001;20(4):461-494. doi:10.1016/S0167-6296(01)00086-8PubMedGoogle ScholarCrossref
51.
Drummond  MF, Sculpher  MJ, Claxton  K, Stoddart  GL, Torrance  GW. Methods for the Economic Evaluation of Health Care Programmes. 4th ed. Oxford, England: Oxford University Press; 2015.
52.
World Medical Association.  World Medical Association Declaration of Helsinki: ethical principles for medical research involving human subjects.  JAMA. 2013;310(20):2191-2194. doi:10.1001/jama.2013.281053PubMedGoogle ScholarCrossref
53.
Piaggio  G, Elbourne  DR, Pocock  SJ, Evans  SJ, Altman  DG; CONSORT Group.  Reporting of noninferiority and equivalence randomized trials: extension of the CONSORT 2010 statement.  JAMA. 2012;308(24):2594-2604. doi:10.1001/jama.2012.87802PubMedGoogle ScholarCrossref
54.
Husereau  D, Drummond  M, Petrou  S,  et al; CHEERS Task Force.  Consolidated Health Economic Evaluation Reporting Standards (CHEERS) statement.  BJOG. 2013;120(6):765-770. doi:10.1111/1471-0528.12241PubMedGoogle ScholarCrossref
×