[Skip to Navigation]
Sign In
Figure 1 
Randomized trial flow diagram.

Randomized trial flow diagram.

Figure 2 
Psychiatric Status Rating (PSR) scale mean scores for manic symptoms for patients assigned to the intervention (n = 199) or usual care (n = 215) groups. Scale ranges from 1 (no symptoms of mania) to 6 (severe manic episode).

Psychiatric Status Rating (PSR) scale mean scores for manic symptoms for patients assigned to the intervention (n = 199) or usual care (n = 215) groups. Scale ranges from 1 (no symptoms of mania) to 6 (severe manic episode).

Figure 3 
Psychiatric Status Rating (PSR) scale mean scores for depressive symptoms for patients assigned to the intervention (n = 199) or usual care (n = 215) groups. Scale ranges from 1 (no symptoms of depression) to 6 (severe depressive episode).

Psychiatric Status Rating (PSR) scale mean scores for depressive symptoms for patients assigned to the intervention (n = 199) or usual care (n = 215) groups. Scale ranges from 1 (no symptoms of depression) to 6 (severe depressive episode).

Figure 4 
Distribution of weekly mood ratings during 2 years of follow-up according to treatment assignment.

Distribution of weekly mood ratings during 2 years of follow-up according to treatment assignment.

Figure 5 
Psychiatric Status Rating (PSR) scale mean scores for mania and depression averaged across the follow-up period and stratified by baseline symptom level.

Psychiatric Status Rating (PSR) scale mean scores for mania and depression averaged across the follow-up period and stratified by baseline symptom level.

Table 1 
Baseline Characteristics Among 441 Patients in the Cohort*
Baseline Characteristics Among 441 Patients in the Cohort*
Table 2 
Treatment During 24 Months Among 331 Patients Who Remained Enrolled in the Group Health Cooperative*
Treatment During 24 Months Among 331 Patients Who Remained Enrolled in the Group Health Cooperative*
1.
American Psychiatric Association, Practice guideline for the treatment of patients with bipolar disorder (revision).  Am J Psychiatry 2002;159 ((suppl 4)) 1- 50Google ScholarCrossref
2.
Suppes  TDennehy  EBSwann  ACBowden  CLCalabrese  JRHirschfeld  RMKeck  PE  JrSachs  GSCrismon  MLToprac  MGShon  SPTexas Consensus Conference Panel on Medication Treatment of Bipolar Disorder, Report of the Texas Consensus Conference Panel on Medication Treatment of Bipolar Disorder 2000.  J Clin Psychiatry 2002;63288- 299PubMedGoogle ScholarCrossref
3.
Goodwin  GMConsensus Group of the British Association for Psychopharmacology, Evidence-based guidelines for treating bipolar disorder: recommendations from the British Association for Psychopharmacology.  J Psychopharmacol 2003;17149- 173PubMedGoogle ScholarCrossref
4.
Post  RMDenicoff  KDLeverich  GSAltshuler  LLFrye  MASuppes  TMRush  AJKeck  PE  JrMcElroy  SLLuckenbaugh  DAPollio  CKupka  RNolen  WA Morbidity in 258 bipolar outpatients followed for 1 year with daily prospective ratings on the NIMH life chart method.  J Clin Psychiatry 2003;64680- 690PubMedGoogle ScholarCrossref
5.
Judd  LLAkiskal  HSSchettler  PJJudd  LLAkiskal  HSSchettler  PJEndicott  JMaser  JSolomon  DALeon  ACRice  JAKeller  MB The long-term natural history of the weekly symptomatic status of bipolar I disorder.  Arch Gen Psychiatry 2002;59530- 537PubMedGoogle ScholarCrossref
6.
Judd  LLAkiskal  HS The prevalence and disability of bipolar spectrum disorders in the US population: re-analysis of the ECA database taking into account subthreshold cases.  J Affect Disord 2003;73123- 131PubMedGoogle ScholarCrossref
7.
Calabrese  JRHirschfeld  RMReed  MDavies  MAFrye  MAKeck  PELewis  LMcElroy  SLMcNulty  JPWagner  KD Impact of bipolar disorder on a US community sample.  J Clin Psychiatry 2003;64425- 432Google ScholarCrossref
8.
Scott  JGutierrez  MJ The current status of psychological treatments in bipolar disorders: a systematic review of relapse prevention.  Bipolar Disord 2004;6498- 503PubMedGoogle ScholarCrossref
9.
Colom  FVieta  E A perspective on the use of psychoeducation, cognitive-behavioral therapy and interpersonal therapy for bipolar patients.  Bipolar Disord 2004;6480- 486PubMedGoogle ScholarCrossref
10.
Goldberg  JFHarrow  MGrossman  LS Course and outcome in bipolar affective disorder: a longitudinal follow-up study.  Am J Psychiatry 1995;152379- 384PubMedGoogle Scholar
11.
Gitlin  MJSwendsen  JHeller  TLHammen  C Relapse and impairment in bipolar disorder.  Am J Psychiatry 1995;1521635- 1640PubMedGoogle Scholar
12.
Lingam  RScott  J Treatment non-adherence in affective disorder.  Acta Psychiatr Scand 2002;105164- 172PubMedGoogle ScholarCrossref
13.
Institute of Medicine, Crossing the Quality Chasm: A New Health System for the 21st Century.  Washington, DC National Academies Press2001;
14.
Scott  JPope  M Nonadherence with mood stabilizers: prevalence and predictors.  J Clin Psychiatry 2002;63384- 390PubMedGoogle ScholarCrossref
15.
Unutzer  JSimon  GPabiniak  CBond  KKaton  W The use of administrative data to assess quality of care for bipolar disorder in a large staff model HMO.  Gen Hosp Psychiatry 2000;221- 10PubMedGoogle ScholarCrossref
16.
Johnson  REMcFarland  BH Lithium use and discontinuation in a health maintenance organization.  Am J Psychiatry 1996;153993- 1000PubMedGoogle Scholar
17.
Suppes  TBaldessarini  RJFaedda  GLTohen  M Risk of recurrence following discontinuation of lithium treatment in bipolar disorder.  Arch Gen Psychiatry 1991;481082- 1088PubMedGoogle ScholarCrossref
18.
Gilbody  SWhitty  PGrimshaw  JThomas  R Educational and organizational interventions to improve the management of depression in primary care: a systematic review.  JAMA 2003;2893145- 3151PubMedGoogle ScholarCrossref
19.
Neumeyer-Gromen  ALampert  TStark  KKallischnigg  G Disease management programs for depression: a systematic review and meta-analysis of randomized controlled trials.  Med Care 2004;421211- 1221PubMedGoogle ScholarCrossref
20.
Wagner  EHAustin  BTVon Korff  M Organizing care for patients with chronic illness.  Milbank Q 1996;74511- 544PubMedGoogle ScholarCrossref
21.
Von Korff  MGruman  JSchaefer  JCurry  SJWagner  EH Collaborative management of chronic illness.  Ann Intern Med 1997;1271097- 1102PubMedGoogle ScholarCrossref
22.
Simon  GELudman  EJUnutzer  JBauer  MSOperskalski  BRutter  C Randomized trial of a population-based care program for people with bipolar disorder.  Psychol Med 2005;3513- 24PubMedGoogle ScholarCrossref
23.
Simon  GELudman  EUnutzer  JBauer  MS Design and implementation of a randomized trial evaluating systematic care for bipolar disorder.  Bipolar Disord 2002;4226- 236PubMedGoogle ScholarCrossref
24.
Dial  THBergsten  CHaviland  MGPincus  HJ Psychiatrist and nonphysician mental health provider staffing levels in health maintenance organizations.  Am J Psychiatry 1998;155405- 408PubMedGoogle Scholar
25.
Unützer  JSimon  GPabiniak  CBond  KKaton  W The treated prevalence of bipolar disorder in a large staff-model HMO.  Psychiatr Serv 1998;491072- 1078PubMedGoogle Scholar
26.
First  MSpitzer  RGibbon  MWilliams  J Structured Clinical Interview for DSM-IV Axis I Disorders (SCID-I), Clinician Version.  Washington, DC American Psychiatric Press1997;
27.
Katon  WVon Korff  MLin  EWalker  ESimon  GEBush  TRobinson  PRusso  J Collaborative management to achieve treatment guidelines: impact on depression in primary care.  JAMA 1995;2731026- 1031PubMedGoogle ScholarCrossref
28.
Simon  GEVon Korff  MRutter  CWagner  E A randomized trial of monitoring, feedback, and management of care by telephone to improve depression treatment in primary care.  BMJ 2000;320550- 554PubMedGoogle ScholarCrossref
29.
Wells  KBSherbourne  CSchoenbaum  MDuan  NMeredith  LUnutzer  JMiranda  JCarney  MFRubenstein  LV Impact of disseminating quality improvement programs for depression in managed primary care: a randomized controlled trial.  JAMA 2000;283212- 230PubMedGoogle ScholarCrossref
30.
Hunkeler  EMMeresman  JFHargreaves  WAFireman  BBerman  WHKirsch  AJGroebe  JHurt  SWBraden  PGetzell  MFeigenbaum  PAPeng  TSalzer  M Efficacy of nurse telehealth care and peer support in augmenting treatment of depression in primary care.  Arch Fam Med 2000;9700- 708PubMedGoogle ScholarCrossref
31.
Katzelnick  DJSimon  GEPearson  SDManning  WGHelstad  CPHenk  HJCole  SMLin  EHTaylor  LHKobak  KA Randomized trial of a depression management program in high utilizers of medical care.  Arch Fam Med 2000;9345- 351PubMedGoogle ScholarCrossref
32.
Bauer  MS The collaborative practice model in bipolar disorder: design and implementation in a multi-site randomized controlled trial.  Bipolar Disord 2001;3233- 244PubMedGoogle ScholarCrossref
33.
Bauer  MMcBride  L Structured Group Psychotherapy for Bipolar Disorder: The Life Goals Program. 2nd New York, NY Springer Publishing Co Inc2003;
34.
Bauer  MSCrits-Christoph  PBall  WADewees  EMcAllister  TAlahi  PCacciola  JWhybrow  PC Independent assessment of manic and depressive symptoms by self-rating: scale characteristics and implications for the study of mania.  Arch Gen Psychiatry 1991;48807- 812PubMedGoogle ScholarCrossref
35.
Bauer  MSVojta  CKinosian  BAltshuler  LGlick  H The Internal State Scale: replication of its discriminating abilities in a multi-site, public sector sample.  Bipolar Disord 2000;2340- 346PubMedGoogle ScholarCrossref
36.
Rollnick  SMiller  WR What is motivational interviewing?  Behav Cognit Psychother 1995;23325- 335Google ScholarCrossref
37.
Keller  MBLavori  PWFriedman  BEndicott  JMcDonald-Scott  PAndreasen  NC The Longitudinal Interval Follow-up Evaluation: a comprehensive method for assessing outcome in prospective longitudinal studies.  Arch Gen Psychiatry 1987;44540- 548PubMedGoogle ScholarCrossref
38.
Rutter  CMSimon  G A Bayesian method for estimating the accuracy of recalled depression.  J R Stat Soc Series C 2004;53341- 353Google ScholarCrossref
39.
Diggle  PLiang  KZeger  S Analysis of Longitudinal Data.  New York, NY Oxford University Press1995;
40.
Kraemer  HCWilson  GTFairburn  CGAgras  WS Mediators and moderators of treatment effects in randomized clinical trials.  Arch Gen Psychiatry 2002;59877- 883PubMedGoogle ScholarCrossref
41.
Bauer  MSKirk  GFGavin  CWilliford  WO Determinants of functional outcome and healthcare costs in bipolar disorder: a high-intensity follow-up study.  J Affect Disord 2001;65231- 241PubMedGoogle ScholarCrossref
42.
Bauer  MSMitchner  L What is a “mood stabilizer”? an evidence-based response.  Am J Psychiatry 2004;1613- 18Google ScholarCrossref
43.
Perry  ATarrier  NMorriss  RMcCarthy  ELimb  K Randomised controlled trial of efficacy of teaching patients with bipolar disorder to identify early symptoms of relapse and obtain treatment.  BMJ 1999;318149- 153PubMedGoogle ScholarCrossref
44.
Colom  FVieta  EMartinez-Aran  AReinares  MGoikolea  JMBenebarre  ATorrent  CComes  MCorbella  BParramon  GCorominas  J A randomized trial on the efficacy of group psychoeducation in the prophylaxis of recurrences in bipolar patients whose disease is in remission.  Arch Gen Psychiatry 2003;60402- 407PubMedGoogle ScholarCrossref
45.
Lam  DHWatkins  ERHayward  PBright  JWright  KKerr  NParr-Davis  GSham  P A randomized controlled trial of cognitive therapy for relapse prevention for bipolar affective disorder.  Arch Gen Psychiatry 2003;60145- 152PubMedGoogle ScholarCrossref
46.
Miklowitz  DJGeorge  ELRichards  JASimoneau  TLSuddath  RL A randomized study of the family-focused psychoeducation and pharmacotherapy in the outpatient management of bipolar disorder.  Arch Gen Psychiatry 2003;60904- 912PubMedGoogle ScholarCrossref
47.
Simon  GEUnützer  J Health care utilization and costs among patients treated for bipolar disorder in an insured population.  Psychiatr Serv 1999;501303- 1308PubMedGoogle Scholar
48.
Lin  EHKaton  WJSimon  GEVon Korff  MBush  TMRutter  CMSaunders  KWWalker  EA Achieving guidelines for treatment of depression in primary care: is physician education enough?  Med Care 1997;35831- 842PubMedGoogle ScholarCrossref
49.
Lin  EHSimon  GEKatzelnick  DJPearson  SD Does physician education on depression management improve treatment in primary care?  J Gen Intern Med 2001;16614- 619PubMedGoogle ScholarCrossref
50.
Bauer  MSWilliford  WODawson  EEAkiskal  HSAltshuler  LFye  CGelenberg  AGlick  HKinosian  BSajatovic  M Principles of effectiveness trials and their implementation in VA Cooperative Study #430: ‘Reducing the Efficacy-Effectiveness Gap in Bipolar Disorder.’  J Affect Disord 2001;6761- 78PubMedGoogle ScholarCrossref
51.
Suppes  TRush  AJDennehy  EBCrismon  MLKashner  TMToprac  MGCarmody  TJBrown  ESBiggs  MMShores-Wilson  KWitte  BPTrivedi  MHMiller  ALAltshuler  KZShon  SPTexas Medication Algorithm Project, Texas Medication Algorithm Project, phase 3 (TMAP-3): clinical results for patients with a history of mania.  J Clin Psychiatry 2003;64370- 382PubMedGoogle ScholarCrossref
Original Article
May 2006

Long-term Effectiveness and Cost of a Systematic Care Program for Bipolar Disorder

Author Affiliations

Author Affiliations: Center for Health Studies, Group Health Cooperative (Drs Simon and Ludman and Ms Operskalski), and Department of Psychiatry and Behavioral Sciences, University of Washington (Drs Simon, Ludman, and Unützer), Seattle; and Providence Veterans Affairs Medical Center and Brown University, Providence, RI (Dr Bauer).

Arch Gen Psychiatry. 2006;63(5):500-508. doi:10.1001/archpsyc.63.5.500
Abstract

Context  Despite the availability of efficacious treatments, the long-term course of bipolar disorder is often unfavorable.

Objective  To test the effectiveness of a multicomponent intervention program to improve the quality of care and long-term outcomes for persons with bipolar disorder.

Design  Randomized controlled trial with allocation concealment and blinded outcome assessment.

Setting  Mental health clinics of a group-model prepaid health plan.

Patients  Of 785 patients in treatment for bipolar disorder who were invited to participate, 509 attended an evaluation appointment, 450 were found eligible to participate, and 441 enrolled in the trial.

Interventions  Participants were randomly assigned to a multicomponent intervention program or to continued care as usual. Three nurse care managers provided a 2-year systematic intervention program, including the following: a structured group psychoeducational program, monthly telephone monitoring of mood symptoms and medication adherence, feedback to treating mental health providers, facilitation of appropriate follow-up care, and as-needed outreach and crisis intervention.

Main Outcome Measures  In-person blinded research interviews every 3 months assessed mood symptoms using the Longitudinal Interval Follow-up Examination. Health plan administrative records were used to assess the use and cost of mental health services.

Results  Intent-to-treat analyses demonstrated that the intervention significantly reduced the mean level of mania symptoms (z = 2.09, P = .04) and the time with significant mania symptoms (19.2 vs 24.7 weeks; F1 = 6.0, P = .01). There was no significant intervention effect on mean level of depressive symptoms (z = 0.19, P = .85) or time with significant depressive symptoms (47.6 vs 50.7 weeks; F1 = 0.56, P = .45). Benefits of the intervention were found only in a subgroup of 343 persons with clinically significant mood symptoms at the baseline assessment. The incremental cost (adjusted) of the intervention was $1251 (95% confidence interval, $55-$2446), including approximately $800 for the intervention program services and an approximate $500 increase in the costs of other mental health services.

Conclusions  Population-based systematic care programs can significantly reduce the frequency and severity of mania in bipolar disorder, and cost increases are modest considering the clinical gains. The incorporation of more specific cognitive and behavioral content or more effective medication regimens may be necessary to significantly reduce the symptoms of depression.

Effective long-term treatment of bipolar disorder remains a difficult challenge for patients and clinicians. Despite the availability of effective pharmacotherapies,1-3 most persons with bipolar disorder experience frequent mood episodes,4 significant residual symptoms,5 and substantial disability.6,7 Accumulating evidence supports the efficacy of structured psychotherapy for bipolar disorder,8,9 but such treatments are rarely available outside of academic settings. Outcomes in everyday practice fall short of those seen in controlled clinical trials.10-12

Gaps in the treatment of bipolar disorder are similar to those in the treatment of other chronic medical conditions.13 Adherence to mood stabilizer treatment is often poor,12,14-16 and interruptions in treatment are the norm.15,17 Follow-up care is typically inconsistent.15

Systematic disease management programs have proved effective in the care of unipolar depression18,19 and other chronic conditions. Founded on the models for chronic illness care described by Wagner and Von Korff and their colleagues,20,21 these programs attempt to close the gaps between treatment efficacy and actual effectiveness. These population-based care programs typically include information systems to support population-based care, reorganization of practice to promote active follow-up, use of expert systems to apply evidence to practice, and support for patients' self-management.

We report herein the results of a 2-year effectiveness trial evaluating a multicomponent care program for bipolar disorder. The interim results at 12 months, reported previously,22 indicated a significant effect on the severity of mania and suggested an increasing effect on the depressive symptoms over time. Data from the full 24-month study period are used herein to evaluate the effectiveness among a population-based sample of patients with bipolar disorder, including acceptability and uptake, effects on mood symptoms, effects on the use of conventional mental health services, and incremental cost compared with care as usual.

Methods

The study methods are described in detail in earlier publications.22,23 They are summarized briefly herein.

Study sample and recruitment

Participants were identified in 1999-2000 using computerized visit and hospital discharge records at 4 group-model behavioral health clinics of a managed care organization in Washington State (Group Health Cooperative [GHC]). General medical and specialty mental health care is provided on a prepaid (capitated) basis. Specialty mental health staffing levels are similar to those at other group-model managed care organizations.24 The treated prevalence of bipolar disorder among the GHC population is approximately 0.4%.25 We systematically sampled health plan members 18 years and older having any diagnosis of bipolar spectrum disorder (bipolar disorder type I or type II, schizoaffective disorder, or cyclothymia) during the prior 12 months.

Initial baseline assessment

Potentially eligible members were invited (by letter, followed up with a telephone call) to an in-person baseline assessment. Relevant modules of the Structured Clinical Interview for DSM-IV (SCID)26 (current and lifetime depression, current and lifetime mania or hypomania, alcohol abuse or dependence, drug abuse or dependence, and psychosis screening) were used to confirm a diagnosis of bipolar disorder type I or II. If the diagnosis could not be confirmed using the SCID, one of us (G.S.) consulted with the treating psychiatrist and reviewed the medical records to identify mood episodes undetected by the structured interview. All patients with confirmed diagnoses were invited to participate. The only exclusion criterion was cognitive impairment severe enough to preclude informed consent (as assessed by the treating physician). Medical or psychiatric comorbidity was not a reason for exclusion.

Treatment assignment

During the informed consent process, each participant was advised that he or she might be offered additional treatment services but that willingness to accept any specific treatment was not a condition for enrollment. Using a concealed table of computer-generated random numbers (without blocking or stratification), eligible and consenting participants were randomly assigned to continued usual care or to usual care plus a multicomponent intervention program.

Usual care comparison group

Participants assigned to usual care received no additional services, but no services that are normally available (inside or outside of the GHC) were withheld. Usual care participants were advised to continue treatment with their current GHC mental health providers, but there was no additional study monitoring of follow-up visits or medication adherence. Treatment could include medication management visits, individual psychotherapy, or group psychotherapy, but no group program specifically for persons with bipolar disorder was available in usual care. No formal case management program was available. Although all participants had made at least 1 visit within the past 12 months (a requirement for eligibility), the level of engagement in or adherence to treatment varied widely.

Intervention group
Intervention Components

A multicomponent intervention was provided by 3 nurse care managers working in collaboration with the participants' usual mental health providers. The 24-month program included the following 5 elements that were adapted from systematic care programs for unipolar depression27-31 or for bipolar disorder32,33:

Assessment and Care Planning

First, the nurse care manager reviewed each patient's treatment history and developed a collaborative treatment plan, including current medications, expected frequency of follow-up visits, early warning signs of mood episodes, coping strategies for responding to warning signs, and identification of a care partner (family member or significant other).

Structured Monthly Telephone Calls

Second, the nurse care managers called each patient monthly to complete structured clinician ratings of current symptoms (depression, mania, and psychosis), current medication use, and medication adverse effects. Nurse care managers also used the Internal State Scale by Bauer and colleagues34 to support patients' ongoing self-monitoring.35

Feedback to the Mental Health Treatment Team

Third, following each telephone contact, nurse care managers sent structured feedback to the treating mental health providers regarding mood symptoms, current medication use, adverse effects, and algorithm-based suggestions about medication adjustments, laboratory testing, and follow-up visits. Communication with the treating psychiatrists and psychotherapists was by printed reports, voice messages, electronic messages, live telephone calls, or in-person conversations, determined by the clinical urgency. Participants' usual psychiatrists and psychotherapists received no special training other than general information about the intervention program and the role of the nurse care manager. An individual physician could have patients in both treatment condition groups.

Structured Group Psychoeducational Program

Fourth, implementation of the Life Goals Program by Bauer and McBride33 included 5 weekly group sessions (phase 1), followed by twice-monthly sessions for the duration of the intervention (phase 2), for a total of up to 48 sessions. Phase 1 included education on the nature of bipolar illness, triggers, early symptoms, and self-management strategies. Phase 2 used a structured problem-solving format to focus on accomplishment of specific life goals. Participants created and updated personalized self-management plans describing triggers, warning signs, and coping strategies.

As-Needed Support, Education, and Care Coordination

Fifth, as clinically necessary, nurse care managers made additional telephone contacts to provide general support, encourage group participation, and facilitate in-person follow-up care. As appropriate, nurse care managers also provided education regarding medication adverse effects, crisis intervention, coordination with family members or significant others, and assistance with barriers to treatment.

Intervention Delivery

Care managers were registered nurses with at least 5 years of clinical psychiatric experience. Caseloads averaged 95 patients per full-time equivalent. The training for the telephone monitoring program and group program is described elsewhere22,23 and included didactic instruction, demonstration or role playing, training in the techniques of motivational interviewing,36 observation of group sessions, and leadership of group sessions under supervision. Nurse care managers received 60 minutes of weekly supervision from one of us (G.E.S. or E.J.L.).

Telephone monitoring and care management were supported by a Web-based computer application integrating contact tracking, structured assessment, and standardized feedback reports to providers. Provider reports included graphic displays of mood symptoms over time, patient-reported medication use, ratings of medication adverse effects, and algorithm-based recommendations for medication adjustment. For example, a scenario of manic symptoms in a patient taking lithium with a current blood level of 0.3 mEq/L and no significant adverse effects would lead to a computer-generated recommendation to consider increasing the dosage of lithium. A similar scenario with no recorded lithium level in the past 6 months would lead to a recommendation for blood level testing. A combination of persistent manic symptoms, low lithium level, and moderate or severe adverse effects would lead to a recommendation to consider switching to or augmentation with a different mood stabilizer. The complete algorithm considered approximately 7000 clinical scenarios defined by symptom pattern, current medication dosage, blood levels (where applicable), and adverse effects. Additional details are available from the author. Each provider report included advice to consider algorithm-generated recommendations in light of each patient's individual treatment history.

Blinded outcome assessments

In-person follow-up assessments were conducted every 3 months during the 2-year study period. Assessments included relevant modules of the SCID (current depression, current mania or hypomania, alcohol abuse or dependence, and drug abuse or dependence) and a weekly timeline follow-back rating of depressive and manic or hypomanic symptoms using the Longitudinal Interval Follow-up Evaluation.37 This assessment yielded separate ratings of mania and depression severity for each week of follow-up using the 6-point Psychiatric Status Rating (PSR) scale. Ratings of 1 or 2 on this scale represent remission or minimal symptoms, ratings of 3 or 4 represent clinically significant subthreshold symptoms, a rating of 5 represents a current episode of hypomania or moderate major depression, and a rating of 6 represents a current episode of mania or severe depression. Interviewers were mental health clinicians with at least 1 year of clinical experience in the assessment of mood disorders. Details of the interviewer training have been described previously.22,23 To maintain interviewer blinding, participants were repeatedly advised not to reveal their group assignment or details of treatment. A substudy38 using random telephone reappraisals at varying times during the recall period supported the validity of 3-month mood recall using the Longitudinal Interval Follow-up Evaluation method.

Protection of human subjects

All study procedures were approved by institutional review boards at the GHC and at the University of California, Los Angeles. Participants provided written informed consent at the following 3 stages: before the baseline assessment, before enrollment in the randomized controlled trial, and (for those in the intervention group) before the initial intervention visit.

Pharmacy, resource use, and cost data

Computerized pharmacy and visit registration data were used to examine the mental health visits and psychotropic drug prescription fills and refills throughout the follow-up period. Refill data were used to calculate the total days' supply of individual drugs and drug classes used. Health plan cost accounting data were used to calculate the cost of mental health and general medical services. The costs of intervention services (telephone monitoring, group sessions, and supervision meetings) were calculated based on actual personnel time (including fringe benefits and overhead costs) for nurse care managers and for clinical supervisors.

Data analysis

The primary analyses of clinical outcomes compared the intervention and usual care participants' mean PSR scores across the 104-week follow-up period using a repeated-measures linear model with relevant baseline characteristics (age, sex, psychotic symptoms, substance abuse, and recent psychiatric hospitalization) included as the covariates. Each follow-up measure was included as the independent variable, while baseline mania and depression ratings were included as covariates. All analyses were based on original treatment assignment regardless of the treatment actually received. Each participant could contribute up to 104 weeks of follow-up data, but the analyses included all participants contributing any follow-up data. Test statistics were calculated using generalized estimating equations as implemented by the SAS version 8 software package (SAS Institute, Cary, NC). The use of generalized estimating equations is a semiparametric estimation approach based on the specification of the mean and covariance, but not the full distribution, of modeled outcomes.39 All models were estimated using an independence working correlation structure, with variance based on the empiric covariance matrix. Our primary hypothesis was that the intervention participants would have lower mean mania and depression scores across the full follow-up period (ie, the main effect of treatment assignment) after accounting for baseline severity. Secondary analyses compared the number of weeks in the follow-up period during which participants had mania and depression PSR scores of 3 or higher (ie, weeks with clinically significant mood symptoms). A priori power calculations indicated that a sample of 250 participants per group would provide 80% power to detect a 15% difference in the risk of moderate or severe mood episodes.

The resource use and cost analyses included only the 331 participants who remained enrolled in the GHC health plan throughout the follow-up period. Because of skewed distributions, the comparison of the resource use and cost measures relied primarily on the results of Mann-Whitney nonparametric tests.

Results
Study sample

Of 785 patients initially contacted, 509 (64.8%) attended a baseline assessment. Nonparticipants did not differ significantly in age, sex, or likelihood of psychiatric hospitalization or psychiatric emergency department use in the past year. Of 450 patients found eligible, 441 (98.0%) enrolled in the trial. The baseline characteristics of the participants assigned to the intervention and usual care groups are compared in Table 1. At baseline, 98 participants (22.2%) were in remission (mania and depression PSR scores, 1-2), 183 participants (41.5%) were in a threshold mood episode (current major depression, hypomania, or mania), and the remaining 160 participants (36.3%) had subthreshold mood symptoms.

Of 441 patients randomized, 414 (93.9%) completed at least 1 blinded outcome assessment and were included in the analyses of clinical outcomes. Three hundred eighty-one patients (86.4%) contributed at least 12 months of follow-up data, and 335 patients (76.0%) contributed the full 24 months of follow-up data. Compared with the patients contributing 24 months of follow-up data, the patients with fewer than 24 months of data were significantly younger (41 vs 45 years, P = .01) but did not differ significantly in baseline mania PSR scores (2.9 vs 2.7, P = .27) or in baseline depression PSR scores (3.6 vs 3.5, P = .48). Of 441 patients randomized, 331 (75.1%) remained enrolled in the GHC health plan for the full 24 months and were included in the resource use and cost analyses. Compared with the patients who remained enrolled in the study, the patients disenrolling were younger (39 vs 46 years, P<.001), had higher baseline mania PSR scores (3.4 vs 2.6, P<.001), and had higher baseline depression PSR scores (3.8 vs 3.4, P = .02). Figure 1 shows the progress of participants through the trial.

Participation in the intervention program

Of 212 participants assigned to the intervention group, 203 (95.8%) completed at least 1 telephone monitoring contact, and 180 (84.9%) completed 12 or more telephone contacts. One hundred thirty-seven (64.6%) attended at least 1 group session, 125 (59.0%) completed the first phase (5 weekly sessions) of the group program, and 108 (50.9%) continued group participation for 12 months or longer. Neither participation in telephone monitoring nor participation in the group program was significantly associated with the severity of mood symptoms at baseline.

Effects on clinical outcomes

As shown in Figure 2, the mean mania severity ratings were lower in the intervention group throughout the 24-month follow-up period. In a repeated-measures linear model adjusting for baseline mood symptoms, baseline psychotic symptoms, and baseline substance use comorbidity, the mean mania PSR scores were significantly lower in the intervention group (z = 2.09, P = .04).

As shown in Figure 3, the mean depression severity ratings seemed to be higher in the intervention group in the first quarter and slightly lower from the third quarter onward. Averaged across the full follow-up period, there was no significant difference in the depression ratings between the 2 treatment groups (z = 0.19, P = .85). Post hoc analyses limited to the second year of follow-up also demonstrated no difference in the mean depression ratings (z = 0.64, P = .52).

Figure 4 shows the distribution of weekly mood ratings classified as remissions (PSR score, 1-2), clinically significant subthreshold symptoms (PSR score, 3-4), and full mood episodes (PSR score, 5-6). Across both treatment groups, the mania ratings were in the remission range for approximately 75% of the follow-up period. A secondary analysis (defined a priori) examined the number of weeks during which patients had mania PSR scores of 3 or higher. The mean ± SD number of weeks during which patients had clinically significant mania symptoms was 19.2 ± 20.2 in the intervention group, compared with 24.7 ± 24.3 in the usual care group. In a linear model adjusting for the covariates of age, sex, and likelihood of psychiatric hospitalization or psychiatric emergency department use in the past year, the number of weeks during which patients had significant mania symptoms was significantly lower in the intervention group (F1 = 6.0, P = .01). Across both groups, the depression ratings were in the remission range for approximately 45% of the follow-up period. The mean ± SD number of weeks during which patients had depression PSR scores of 3 or higher was 47.6 ± 29.7 in the intervention group, compared with 50.7 ± 31.9 in usual care group (F1 = 0.56, P = .45). Data from the SCID interviews at each follow-up assessment showed a similar pattern. The overall probability of manic episodes across the 8 quarterly assessments was lower in the intervention group (χ22 = 6.4, P = .04), but the probability of depressive episodes did not differ significantly between the 2 groups (χ22 = 2.6, P = .26).

An additional secondary analysis (defined a priori) stratified the participants into a group of 98 patients with mania and depression PSR scores lower than 3 (in remission) at baseline and a group of 343 patients with mania and depression PSR scores of 3 or higher (not in remission) at baseline. The results are shown in Figure 5, with the mean PSR scores collapsed across all time points. For the group in remission at baseline, repeated-measures models adjusting for the covariates of age, sex, and likelihood of psychiatric hospitalization or psychiatric emergency department use in the past year found no effect of the intervention program on the follow-up mania scores (z = 0.23, P = .81) or depression scores (z = 1.26, P = .21). For patients with substantial symptoms at baseline, the intervention program had a significant effect on the mean mania scores (z = 2.27, P = .02) but not on the mean depression scores (z = 0.64, P = .52).

Additional post hoc analyses examined the intervention effects according to the specific bipolar diagnosis (type I vs type II) and the presence or absence of substance use disorder at baseline. We found no indication of different intervention effects between these subgroups (details are available from the author).

Effects on resource use and cost

The effects of the intervention on the resource use and cost of health services are given in Table 2. The patients in the intervention group had more medication management visits and consumed more atypical antipsychotic medications than the usual care group, but neither of these differences was statistically significant at the 5% level. The direct costs of the intervention program were approximately $500 during the first year and $300 during the second year. The total costs (unadjusted) of mental health treatment (including the intervention program costs) were $1302 higher in the intervention group. After adjustment for the baseline covariates of age, sex, and likelihood of psychiatric hospitalization or psychiatric emergency department use in the past year, the 2-year mental health treatment costs in the intervention group were $1251 (95% confidence interval, $55-$2446) higher than those in the usual care group.

Potential mediators of the intervention effect

Because the number of medication management visits and the use of atypical antipsychotic medications were greater in the intervention group, these were examined as potential mediators of the effect of the intervention on the mania scores. Neither the number of medication management visits nor the use of atypical antipsychotic medications was significantly associated with lower mania ratings during the follow-up period.

Comment

A systematic management program proved to be feasible and generally acceptable among a population-based sample of outpatients treated for bipolar disorder. Almost all participants assigned to the intervention group engaged in the telephone care management program, and almost 60% completed the initial phase of the group program. These participation rates are notable given the nature of our sample. We attempted to enroll all patients with any treatment contact in the past year and did not require that participants agree to accept any particular treatment. Almost two thirds of the GHC members with bipolar disorder enrolled in the trial, and nonparticipants did not differ significantly from the patients who enrolled. These high rates of participation in the intervention program were achieved through vigorous and persistent outreach.

The complete follow-up data confirm the preliminary finding that this systematic care management program reduced the frequency and severity of manic symptoms. The mean mania ratings decreased in both treatment groups over time, but the mania ratings were lower in the intervention group throughout the 2-year follow-up period. The number of weeks during which patients had significant manic symptoms was approximately 25% lower in patients assigned to the intervention program.

Although we cannot determine the specific mechanism by which the intervention program reduced the symptoms of mania, we can observe how the program affected the use of conventional mental health services. During 12 months, the intervention group patients had more medication management visits and more frequently used atypical antipsychotic drugs,22 but these differences were not statistically significant in the 24-month analysis. Neither the number of medication management visits nor the use of atypical antipsychotic drugs was significantly associated with improved clinical outcomes, so neither can be considered an important mediator of the intervention effect.40 The treatment groups did not differ in the use of mood stabilizer medications or other outpatient services.

We did not observe significant effects of the intervention program on the frequency or severity of depression. Preliminary analyses22 suggested a trend toward increasing intervention effects on depression during the first 12 months. The complete data seemed to demonstrate lower depression ratings in the intervention group beginning with the third quarter of follow-up. However, this difference did not approach statistical significance, even in a post hoc analysis limited to the second year of follow-up. This finding is disappointing given that depression accounts for most of the long-term morbidity among persons with bipolar disorder.41

There are 2 possible explanations for the discrepancy between the intervention effects on mania and the intervention effects on depression. First, the group psychoeducational program emphasized early recognition and early intervention for mood episodes. Such an approach might have a greater effect on preventing or shortening episodic mania than on relieving more chronic depression. Second, available pharmacotherapies are generally more successful for acute treatment of manic episodes than for acute treatment of depression.42 Consequently, our attempts to improve the quality of pharmacotherapy might be expected to have stronger effects on the symptoms of mania.

Several previous efficacy trials have evaluated psychoeducational and structured psychotherapy programs for bipolar disorder. Perry and colleagues43 found that a 7- to 12-session psychoeducational program that focused on early symptom recognition significantly reduced the risk of manic relapse. Colom et al44 found that a 21-session group psychoeducational program emphasizing early recognition and building self-management skills significantly reduced the risk of subsequent mania or depression. Lam and colleagues45 reported that a 14- to 20-session individual cognitive behavior therapy program significantly reduced the frequency of manic and depressive episodes. Miklowitz and coworkers46 found that a 21-session family-focused psychoeducational program significantly reduced the patients' mood disorder symptoms and reduced the risk of relapse. In all cases, psychoeducation or structured psychotherapy interventions were added to ongoing pharmacotherapy. Interventions that are focused on self-monitoring and on early recognition of mood episodes43 may be sufficient to reduce the risk of manic episodes. Reducing the frequency and severity of depression may require more intensive interventions, including development of specific depression management skills.44,45

The incremental costs of the intervention program were modest compared with the overall costs of treatment for bipolar disorder. The direct costs of the intervention services were approximately $800 during 2 years, and the costs of other mental health treatments were approximately $500 higher for the intervention patients. The added cost (adjusted) of $1251 per year accounted for approximately one sixth of the mental health treatment costs for the intervention patients. Although there is no generally accepted metric to assess the cost-effectiveness of interventions for bipolar disorder, the incremental cost of $1251 can be balanced against a benefit of 5.5 additional weeks that are free of significant manic symptoms.

The costs of psychotropic medications accounted for approximately half of all mental health treatment costs. Among a 1995 sample from the Group Health Cooperative,47 prescriptions accounted for approximately 20% of mental health treatment expenditures. This change probably reflects the increasing use of anticonvulsant agents and atypical antipsychotic medications and a shift toward more expensive antidepressant drugs.

The benefits of the intervention program were limited to patients with significant mood symptoms at baseline. The subgroup in remission at the baseline assessment had overall mean mania and depression scores in the remission range throughout the follow-up period. This subgroup may include patients with less severe disorder and those whose illness is well controlled by usual care. Our results do not support the benefit of more intensive management programs among patients who fare well with usual care.

Both treatment groups showed significant improvement in mood symptoms over time. Although we did not select participants who were at treatment stages during which they manifested particularly severe symptoms (eg, after hospitalization), we required some treatment contact in the past year. The general trend to improvement may reflect the benefits of treatment and the tendency to seek treatment when symptoms are more severe. In addition, the therapeutic effects of 9 in-person interviews with research staff during 2 years may have influenced patient improvement.

The rates of treatment in the usual care group were higher than would be predicted from earlier research among patients in the Group Health Cooperative.15 The participants who were assigned to usual care made a mean of 15 individual visits to mental health providers during 2 years, and almost 60% made 12 or more visits. The usual care participants averaged at least 15 months of mood stabilizer use during the 24-month study period, and approximately 50% filled prescriptions for at least 18 months. These high rates of usual care treatment may reflect the process of selection into a randomized trial or the effects of increased attention associated with repeated contacts with the research staff. Even in a population-based study such as this one, the patients who are least likely to continue in treatment may also be those who are least likely to enroll in research.

There are some important limitations in the interpretation of our results. First, approximately 35% of patients invited to participate could not be reached or declined to attend the baseline assessment. How the acceptability or effectiveness of the intervention would generalize to nonparticipants is unknown. Second, the intervention program, especially the group component, was designed for delivery in mental health group practices, including community mental health centers and Veterans Affairs clinics. Implementation would be difficult in rural areas or in solo practices serving small numbers of patients. Third, a significant proportion of patients contributed only partial outcome data (24.0% with <24 months and 13.6% with <12 months of data). However, follow-up participation was not related to the severity of illness or to the treatment assignment. Fourth, despite the large sample size, the confidence limits for the cost estimates were wide, ranging from almost equal costs to an incremental cost for the intervention program as high as $2446. Fifth, participating physicians treated patients in both treatment groups, and experience with the intervention could have affected the treatment of the usual care patients. Although this crossover effect could obscure the results of the intervention (ie, conservative bias), previous studies48,49 of similar interventions for depression demonstrate no evidence of such an effect.

These findings build on a series of trials demonstrating the effectiveness of systematic care programs for unipolar depression.18,19 The essential elements of those depression care programs included aggressive outreach to ensure appropriate follow-up care, systematic application of evidence-based guidelines, and psychoeducational or structured psychotherapy programs to support patient self-management. The present study extends earlier efforts50,51 to apply those principles to the management of bipolar disorder. The specific program tested herein proved to be acceptable to patients and significantly reduced the frequency and the severity of manic symptoms. Achieving similar improvements in the control of depressive symptoms may require a greater focus on the structured behavioral and cognitive interventions that have been shown to be effective in treating unipolar depression.

Correspondence: Gregory E. Simon, MD, MPH, Center for Health Studies, Group Health Cooperative, 1730 Minor Ave, Suite 1600, Seattle, WA 98101 (simon.g@ghc.org).

Submitted for Publication: March 4, 2005; final revision received July 26, 2005; accepted September 13, 2005.

Financial Disclosure: Dr Simon has received research grant support from Wyeth Research (Massachusetts), Eli Lilly and Co, and Solvay Pharmaceuticals, Inc.

Funding/Support: This study was funded by grant R01 MH59125 from the National Institute of Mental Health.

References
1.
American Psychiatric Association, Practice guideline for the treatment of patients with bipolar disorder (revision).  Am J Psychiatry 2002;159 ((suppl 4)) 1- 50Google ScholarCrossref
2.
Suppes  TDennehy  EBSwann  ACBowden  CLCalabrese  JRHirschfeld  RMKeck  PE  JrSachs  GSCrismon  MLToprac  MGShon  SPTexas Consensus Conference Panel on Medication Treatment of Bipolar Disorder, Report of the Texas Consensus Conference Panel on Medication Treatment of Bipolar Disorder 2000.  J Clin Psychiatry 2002;63288- 299PubMedGoogle ScholarCrossref
3.
Goodwin  GMConsensus Group of the British Association for Psychopharmacology, Evidence-based guidelines for treating bipolar disorder: recommendations from the British Association for Psychopharmacology.  J Psychopharmacol 2003;17149- 173PubMedGoogle ScholarCrossref
4.
Post  RMDenicoff  KDLeverich  GSAltshuler  LLFrye  MASuppes  TMRush  AJKeck  PE  JrMcElroy  SLLuckenbaugh  DAPollio  CKupka  RNolen  WA Morbidity in 258 bipolar outpatients followed for 1 year with daily prospective ratings on the NIMH life chart method.  J Clin Psychiatry 2003;64680- 690PubMedGoogle ScholarCrossref
5.
Judd  LLAkiskal  HSSchettler  PJJudd  LLAkiskal  HSSchettler  PJEndicott  JMaser  JSolomon  DALeon  ACRice  JAKeller  MB The long-term natural history of the weekly symptomatic status of bipolar I disorder.  Arch Gen Psychiatry 2002;59530- 537PubMedGoogle ScholarCrossref
6.
Judd  LLAkiskal  HS The prevalence and disability of bipolar spectrum disorders in the US population: re-analysis of the ECA database taking into account subthreshold cases.  J Affect Disord 2003;73123- 131PubMedGoogle ScholarCrossref
7.
Calabrese  JRHirschfeld  RMReed  MDavies  MAFrye  MAKeck  PELewis  LMcElroy  SLMcNulty  JPWagner  KD Impact of bipolar disorder on a US community sample.  J Clin Psychiatry 2003;64425- 432Google ScholarCrossref
8.
Scott  JGutierrez  MJ The current status of psychological treatments in bipolar disorders: a systematic review of relapse prevention.  Bipolar Disord 2004;6498- 503PubMedGoogle ScholarCrossref
9.
Colom  FVieta  E A perspective on the use of psychoeducation, cognitive-behavioral therapy and interpersonal therapy for bipolar patients.  Bipolar Disord 2004;6480- 486PubMedGoogle ScholarCrossref
10.
Goldberg  JFHarrow  MGrossman  LS Course and outcome in bipolar affective disorder: a longitudinal follow-up study.  Am J Psychiatry 1995;152379- 384PubMedGoogle Scholar
11.
Gitlin  MJSwendsen  JHeller  TLHammen  C Relapse and impairment in bipolar disorder.  Am J Psychiatry 1995;1521635- 1640PubMedGoogle Scholar
12.
Lingam  RScott  J Treatment non-adherence in affective disorder.  Acta Psychiatr Scand 2002;105164- 172PubMedGoogle ScholarCrossref
13.
Institute of Medicine, Crossing the Quality Chasm: A New Health System for the 21st Century.  Washington, DC National Academies Press2001;
14.
Scott  JPope  M Nonadherence with mood stabilizers: prevalence and predictors.  J Clin Psychiatry 2002;63384- 390PubMedGoogle ScholarCrossref
15.
Unutzer  JSimon  GPabiniak  CBond  KKaton  W The use of administrative data to assess quality of care for bipolar disorder in a large staff model HMO.  Gen Hosp Psychiatry 2000;221- 10PubMedGoogle ScholarCrossref
16.
Johnson  REMcFarland  BH Lithium use and discontinuation in a health maintenance organization.  Am J Psychiatry 1996;153993- 1000PubMedGoogle Scholar
17.
Suppes  TBaldessarini  RJFaedda  GLTohen  M Risk of recurrence following discontinuation of lithium treatment in bipolar disorder.  Arch Gen Psychiatry 1991;481082- 1088PubMedGoogle ScholarCrossref
18.
Gilbody  SWhitty  PGrimshaw  JThomas  R Educational and organizational interventions to improve the management of depression in primary care: a systematic review.  JAMA 2003;2893145- 3151PubMedGoogle ScholarCrossref
19.
Neumeyer-Gromen  ALampert  TStark  KKallischnigg  G Disease management programs for depression: a systematic review and meta-analysis of randomized controlled trials.  Med Care 2004;421211- 1221PubMedGoogle ScholarCrossref
20.
Wagner  EHAustin  BTVon Korff  M Organizing care for patients with chronic illness.  Milbank Q 1996;74511- 544PubMedGoogle ScholarCrossref
21.
Von Korff  MGruman  JSchaefer  JCurry  SJWagner  EH Collaborative management of chronic illness.  Ann Intern Med 1997;1271097- 1102PubMedGoogle ScholarCrossref
22.
Simon  GELudman  EJUnutzer  JBauer  MSOperskalski  BRutter  C Randomized trial of a population-based care program for people with bipolar disorder.  Psychol Med 2005;3513- 24PubMedGoogle ScholarCrossref
23.
Simon  GELudman  EUnutzer  JBauer  MS Design and implementation of a randomized trial evaluating systematic care for bipolar disorder.  Bipolar Disord 2002;4226- 236PubMedGoogle ScholarCrossref
24.
Dial  THBergsten  CHaviland  MGPincus  HJ Psychiatrist and nonphysician mental health provider staffing levels in health maintenance organizations.  Am J Psychiatry 1998;155405- 408PubMedGoogle Scholar
25.
Unützer  JSimon  GPabiniak  CBond  KKaton  W The treated prevalence of bipolar disorder in a large staff-model HMO.  Psychiatr Serv 1998;491072- 1078PubMedGoogle Scholar
26.
First  MSpitzer  RGibbon  MWilliams  J Structured Clinical Interview for DSM-IV Axis I Disorders (SCID-I), Clinician Version.  Washington, DC American Psychiatric Press1997;
27.
Katon  WVon Korff  MLin  EWalker  ESimon  GEBush  TRobinson  PRusso  J Collaborative management to achieve treatment guidelines: impact on depression in primary care.  JAMA 1995;2731026- 1031PubMedGoogle ScholarCrossref
28.
Simon  GEVon Korff  MRutter  CWagner  E A randomized trial of monitoring, feedback, and management of care by telephone to improve depression treatment in primary care.  BMJ 2000;320550- 554PubMedGoogle ScholarCrossref
29.
Wells  KBSherbourne  CSchoenbaum  MDuan  NMeredith  LUnutzer  JMiranda  JCarney  MFRubenstein  LV Impact of disseminating quality improvement programs for depression in managed primary care: a randomized controlled trial.  JAMA 2000;283212- 230PubMedGoogle ScholarCrossref
30.
Hunkeler  EMMeresman  JFHargreaves  WAFireman  BBerman  WHKirsch  AJGroebe  JHurt  SWBraden  PGetzell  MFeigenbaum  PAPeng  TSalzer  M Efficacy of nurse telehealth care and peer support in augmenting treatment of depression in primary care.  Arch Fam Med 2000;9700- 708PubMedGoogle ScholarCrossref
31.
Katzelnick  DJSimon  GEPearson  SDManning  WGHelstad  CPHenk  HJCole  SMLin  EHTaylor  LHKobak  KA Randomized trial of a depression management program in high utilizers of medical care.  Arch Fam Med 2000;9345- 351PubMedGoogle ScholarCrossref
32.
Bauer  MS The collaborative practice model in bipolar disorder: design and implementation in a multi-site randomized controlled trial.  Bipolar Disord 2001;3233- 244PubMedGoogle ScholarCrossref
33.
Bauer  MMcBride  L Structured Group Psychotherapy for Bipolar Disorder: The Life Goals Program. 2nd New York, NY Springer Publishing Co Inc2003;
34.
Bauer  MSCrits-Christoph  PBall  WADewees  EMcAllister  TAlahi  PCacciola  JWhybrow  PC Independent assessment of manic and depressive symptoms by self-rating: scale characteristics and implications for the study of mania.  Arch Gen Psychiatry 1991;48807- 812PubMedGoogle ScholarCrossref
35.
Bauer  MSVojta  CKinosian  BAltshuler  LGlick  H The Internal State Scale: replication of its discriminating abilities in a multi-site, public sector sample.  Bipolar Disord 2000;2340- 346PubMedGoogle ScholarCrossref
36.
Rollnick  SMiller  WR What is motivational interviewing?  Behav Cognit Psychother 1995;23325- 335Google ScholarCrossref
37.
Keller  MBLavori  PWFriedman  BEndicott  JMcDonald-Scott  PAndreasen  NC The Longitudinal Interval Follow-up Evaluation: a comprehensive method for assessing outcome in prospective longitudinal studies.  Arch Gen Psychiatry 1987;44540- 548PubMedGoogle ScholarCrossref
38.
Rutter  CMSimon  G A Bayesian method for estimating the accuracy of recalled depression.  J R Stat Soc Series C 2004;53341- 353Google ScholarCrossref
39.
Diggle  PLiang  KZeger  S Analysis of Longitudinal Data.  New York, NY Oxford University Press1995;
40.
Kraemer  HCWilson  GTFairburn  CGAgras  WS Mediators and moderators of treatment effects in randomized clinical trials.  Arch Gen Psychiatry 2002;59877- 883PubMedGoogle ScholarCrossref
41.
Bauer  MSKirk  GFGavin  CWilliford  WO Determinants of functional outcome and healthcare costs in bipolar disorder: a high-intensity follow-up study.  J Affect Disord 2001;65231- 241PubMedGoogle ScholarCrossref
42.
Bauer  MSMitchner  L What is a “mood stabilizer”? an evidence-based response.  Am J Psychiatry 2004;1613- 18Google ScholarCrossref
43.
Perry  ATarrier  NMorriss  RMcCarthy  ELimb  K Randomised controlled trial of efficacy of teaching patients with bipolar disorder to identify early symptoms of relapse and obtain treatment.  BMJ 1999;318149- 153PubMedGoogle ScholarCrossref
44.
Colom  FVieta  EMartinez-Aran  AReinares  MGoikolea  JMBenebarre  ATorrent  CComes  MCorbella  BParramon  GCorominas  J A randomized trial on the efficacy of group psychoeducation in the prophylaxis of recurrences in bipolar patients whose disease is in remission.  Arch Gen Psychiatry 2003;60402- 407PubMedGoogle ScholarCrossref
45.
Lam  DHWatkins  ERHayward  PBright  JWright  KKerr  NParr-Davis  GSham  P A randomized controlled trial of cognitive therapy for relapse prevention for bipolar affective disorder.  Arch Gen Psychiatry 2003;60145- 152PubMedGoogle ScholarCrossref
46.
Miklowitz  DJGeorge  ELRichards  JASimoneau  TLSuddath  RL A randomized study of the family-focused psychoeducation and pharmacotherapy in the outpatient management of bipolar disorder.  Arch Gen Psychiatry 2003;60904- 912PubMedGoogle ScholarCrossref
47.
Simon  GEUnützer  J Health care utilization and costs among patients treated for bipolar disorder in an insured population.  Psychiatr Serv 1999;501303- 1308PubMedGoogle Scholar
48.
Lin  EHKaton  WJSimon  GEVon Korff  MBush  TMRutter  CMSaunders  KWWalker  EA Achieving guidelines for treatment of depression in primary care: is physician education enough?  Med Care 1997;35831- 842PubMedGoogle ScholarCrossref
49.
Lin  EHSimon  GEKatzelnick  DJPearson  SD Does physician education on depression management improve treatment in primary care?  J Gen Intern Med 2001;16614- 619PubMedGoogle ScholarCrossref
50.
Bauer  MSWilliford  WODawson  EEAkiskal  HSAltshuler  LFye  CGelenberg  AGlick  HKinosian  BSajatovic  M Principles of effectiveness trials and their implementation in VA Cooperative Study #430: ‘Reducing the Efficacy-Effectiveness Gap in Bipolar Disorder.’  J Affect Disord 2001;6761- 78PubMedGoogle ScholarCrossref
51.
Suppes  TRush  AJDennehy  EBCrismon  MLKashner  TMToprac  MGCarmody  TJBrown  ESBiggs  MMShores-Wilson  KWitte  BPTrivedi  MHMiller  ALAltshuler  KZShon  SPTexas Medication Algorithm Project, Texas Medication Algorithm Project, phase 3 (TMAP-3): clinical results for patients with a history of mania.  J Clin Psychiatry 2003;64370- 382PubMedGoogle ScholarCrossref
×