aPatients who had at least 1 postbaseline assessment. BDI-II indicates Beck Depression Inventory II; CBT, cognitive behavioral therapy; IVR, interactive voice response; MINI, Mini International Neuropsychiatric Interview Version 6.0.0; SLUMS, Saint Louis University Mental Status examination.
CBT indicates cognitive behavioral therapy; IVR, interactive voice response.
Error bars represent 2-sided 95% CIs. A CI that lies entirely to the left of zero indicates the new treatment (CBT, cognitive behavioral therapy; IVR, interactive voice response [IVR-CBT]) is superior. A CI that lies to the left of the noninferiority margin of 1 indicates that the new treatment is noninferior. A CI that includes the noninferiority margin indicates that the result regarding noninferiority is inconclusive. A CI that is entirely above the noninferiority margin indicates the new treatment is inferior. Figure and explanation adapted from Piaggio et al.34
eTable 1. Change from baseline in LAW-NRS and between-group differences (estimates from mixed model and multiple imputation estimates)
eTable 2. Baseline characteristics of participants included in the primary analysis by treatment group
eTable 3. Primary outcome change from baseline and between-group differences: per protocol analysis results
eTable 4. Primary and secondary outcomes change from baseline and between-group differences: multiple imputation results
Customize your JAMA Network experience by selecting one or more topics from the list below.
Heapy AA, Higgins DM, Goulet JL, et al. Interactive Voice Response–Based Self-management for Chronic Back Pain: The COPES Noninferiority Randomized Trial. JAMA Intern Med. 2017;177(6):765–773. doi:10.1001/jamainternmed.2017.0223
What is the efficacy of interactive voice response–based cognitive behavioral therapy (IVR-CBT) relative to in-person CBT for chronic back pain?
In this noninferiority randomized clinical trial of 125 patients with chronic back pain, the average pain reduction was similar for both conditions with the difference between groups falling below the noninferiority margin of 1, indicating that IVR-CBT is noninferior to in-person CBT for chronic back pain.
IVR-CBT is a low-burden alternative that can increase access to CBT for chronic pain and shows promise as a nonpharmacologic treatment option, with outcomes that are not inferior to in-person CBT.
Recommendations for chronic pain treatment emphasize multimodal approaches, including nonpharmacologic interventions to enhance self-management. Cognitive behavioral therapy (CBT) is an evidence-based treatment that facilitates management of chronic pain and improves outcomes, but access barriers persist. Cognitive behavioral therapy delivery assisted by health technology can obviate the need for in-person visits, but the effectiveness of this alternative to standard therapy is unknown. The Cooperative Pain Education and Self-management (COPES) trial was a randomized, noninferiority trial comparing IVR-CBT to in-person CBT for patients with chronic back pain.
To assess the efficacy of interactive voice response–based CBT (IVR-CBT) relative to in-person CBT for chronic back pain.
Design, Setting, and Participants
We conducted a noninferiority randomized trial in 1 Department of Veterans Affairs (VA) health care system. A total of 125 patients with chronic back pain were equally allocated to IVR-CBT (n = 62) or in-person CBT (n = 63).
Patients treated with IVR-CBT received a self-help manual and weekly prerecorded therapist feedback based on their IVR-reported activity, coping skill practice, and pain outcomes. In-person CBT included weekly, individual CBT sessions with a therapist. Participants in both conditions received IVR monitoring of pain, sleep, activity levels, and pain coping skill practice during treatment.
Main Outcomes and Measures
The primary outcome was change from baseline to 3 months in unblinded patient report of average pain intensity measured by the Numeric Rating Scale (NRS). Secondary outcomes included changes in pain-related interference, physical and emotional functioning, sleep quality, and quality of life at 3, 6, and 9 months. We also examined treatment retention.
Of the 125 patients (97 men, 28 women; mean [SD] age, 57.9 [11.6] years), the adjusted average reduction in NRS with IVR-CBT (−0.77) was similar to in-person CBT (−0.84), with the 95% CI for the difference between groups (−0.67 to 0.80) falling below the prespecified noninferiority margin of 1 indicating IVR-CBT is noninferior. Fifty-four patients randomized to IVR-CBT and 50 randomized to in-person CBT were included in the analysis of the primary outcome. Statistically significant improvements in physical functioning, sleep quality, and physical quality of life at 3 months relative to baseline occurred in both treatments, with no advantage for either treatment. Treatment dropout was lower in IVR-CBT with patients completing on average 2.3 (95% CI, 1.0-3.6) more sessions.
Conclusions and Relevance
IVR-CBT is a low-burden alternative that can increase access to CBT for chronic pain and shows promise as a nonpharmacologic treatment option for chronic pain, with outcomes that are not inferior to in-person CBT.
clinicaltrials.gov Identifier: NCT01025752
Chronic pain affects more adults in the United States than diabetes, heart disease, and cancer combined and is associated with limitations in physical and emotional functioning, and quality of life.1 The dramatic increase in the use of opioid medications to treat chronic pain has led to concern about the harms associated with long-term opioid therapy (eg, addiction, overdose, and death) and lack of evidence for long-term benefits.2-4 As a result, the Institute of Medicine,1 US Department of Health and Human Services,5 and Centers for Disease Control and Prevention6 all advise against opioid medications as a first-line treatment or monotherapy for chronic pain and instead emphasize multimodal care that includes evidence-based nonpharmacologic approaches. Cognitive behavioral therapy (CBT) is a low-risk psychological intervention that is effective in reducing pain and improving function for numerous pain complaints, including back pain,7 osteoarthritis,8 and fibromyalgia.9 Cognitive behavioral therapy assists patients with reconceptualizing pain as influenced by not only biological, but psychological, behavioral, and social factors. Patients learn cognitive (eg, reframing catastrophic thoughts) and behavioral (eg, relaxation techniques) pain coping skills over 6 to 12 treatment sessions.
Although CBT is efficacious, many patients experience travel and scheduling barriers to attending in-person sessions. Cherkin et al10 found that both CBT and mindfulness-based stress reduction produced clinically significant improvements in pain and functioning relative to usual care; however, only half of participants attended 6 of the 8 sessions. In addition, trained therapists are scarce and concentrated in urban areas or near academic medical centers,11 further hindering access. Using mobile health technology, such as interactive voice response (IVR), may improve access to CBT for chronic pain.
Interactive voice response is an automated telephonic technology that allows patients to report symptoms, functioning, and pain coping skill use and receive prerecorded information and feedback via their telephone. Interactive voice response–based interventions have been used successfully to provide education, peer support, and tailored messages to enhance treatment adherence and maintenance of gains.12-16 Naylor and colleagues14,15,17 found maintenance or improvements in CBT treatment effects and reduction in prescription opioid use when IVR monitoring was used to reinforce in-person CBT. Despite these promising results, to our knowledge there have been no trials of a solely IVR-delivered treatment for chronic pain.
We hypothesized that IVR-based CBT (IVR-CBT) would not be significantly less efficacious than in-person treatment and would provide greater access to care with less patient burden. Specifically, IVR-CBT would produce reductions in pain intensity that were not meaningfully inferior to in-person CBT. We also compared pain-related physical and emotional functioning and health-related quality of life for participants in both conditions. Finally, we examined IVR-CBT relative to in-person CBT in terms of treatment retention.
The Cooperative Pain Education and Self-management (COPES) trial was a randomized, noninferiority trial comparing IVR-CBT to in-person CBT for patients with chronic back pain. A description of the COPES trial has been published elsewhere18 (see Supplement 1). Participants were veterans from 1 VA health care system. Eligibility screening was conducted using an electronic health record search for back pain–related diagnoses and at least moderate pain intensity (≥4 on the 0-10 numeric rating scale or NRS) reported during the most recent primary care visit. Potentially eligible patients were mailed an opt-out recruitment letter. In addition, recruitment flyers were posted in the medical center. Eligibility criteria included having an electronic health record–verified back condition, average pain score of at least 4 on the NRS for at least 3 months, self-reported ability to walk 1 block, absence of planned surgical intervention for pain, access to a touchtone telephone, and absence of medical or psychiatric conditions that could impair participation (eg, terminal cancer, severe depression [Beck Depression Inventory-II, BDI-II, score >28],19 dementia based on the St Louis University Mental Status [SLUMS]) score,20 or active psychosis or substance use disorder based on the Mini-International Neuropsychiatric Interview21).
After providing written informed consent, eligible patients were enrolled by the study research assistant (RA) (K.M.L.), completed baseline survey measures, and were given an Omron GoSmart HJ-112N pedometer. Patients were compensated for completing the assessments: $20 for baseline, $30 for the 3-month assessment, $40 for the 6-month assessment, and $50 for the 9-month assessment, total of $140 if all assessments were completed. The study was approved by the VA Connecticut Healthcare System and Yale School of Medicine institutional review boards. Recruitment occurred from June 2012 to July 2015. All follow-up assessments were completed by April 1, 2016.
Following the baseline assessment, participants were assigned in equal proportions, in block sizes of 4, and stratified by distance from the medical center, and back pain type (nonspecific, radicular, associated with other spinal causes).22 The randomization schedule was created by an independent biostatistician using SAS statistical software (version 8.2; SAS Institute Inc) and concealed in the study database until assignment to an intervention. After randomization, participants were assigned to a therapist by the RA based on therapist availability. Therapists were doctoral-level clinical psychologists or advanced-practice psychiatric nurse practitioners and followed treatment manuals to deliver both interventions.
All participants received a treatment manual specific to their intervention that had been adapted from prior trials and that was designed to be delivered over 10 weeks.23 Each manual included an introductory module that presented the rationale for CBT, 8 pain coping skill modules, and a relapse prevention module. All participants received 11 weeks of daily IVR assessment of pain, sleep, step count, and pain coping skill practice, engaged in a progressive walking program, and continued to receive care from their primary care clinician.
In-person CBT participants attended weekly in-person 30- to 40-minute treatment sessions. Therapists reviewed the IVR reports and provided feedback during sessions.
The IVR-CBT therapists reviewed the IVR-reported information and recorded 2- to 5-minute personalized feedback patterned after prior studies using IVR.14,17 Feedback was delivered weekly during participants’ regular IVR assessments. Details of the intervention are published elsewhere.18
We followed recommendations from the Initiative on Methods, Measurement, and Pain Assessment in Clinical Trials, for domains to assess and selection of measures.24 Unblinded participants independently completed measures in person, via mail, or online at baseline, 3, 6, and 9 months after baseline, with 3 months being the primary end point. Completion method was selected by the participant. Therapists did not participate in outcome data collection. Prior to treatment, participants in both groups underwent daily IVR assessment of pain intensity, sleep duration, and pedometer-measured step counts for 7 days to establish a baseline of function.25
Average pain intensity over the past week was assessed using an 11-point NRS (0, no pain; 10, worst pain imaginable).26 Originally, we planned to use the mean of NRS least, average, and worst pain intensity over the past week. Instead, we elected to use average NRS alone because it is more commonly used and therefore promotes cross-study comparisons. The correlation between the 2 measures is 0.95 and noninferiority results using the original outcome did not differ from current findings (eTable 1 in Supplement 2).
The Interference subscale of the West Haven-Yale Multidimensional Pain Inventory27 and the Roland and Morris Disability Questionnaire (RMDQ)28 were used to assess pain-related interference and physical functioning, respectively. Higher scores represent greater interference and poorer function. Depressive symptom severity was assessed using the BDI-II.29 Higher scores indicate more depressive symptomatology. Sleep quality was assessed with the Pittsburgh Sleep Quality Index.30 Scores of 5 or greater indicate poor sleep quality. The Veterans 36-item short-form (SF-36) questionnaire was used to assess physical and mental health–related quality of life.31 Lower scores represent poorer quality of life. All measures have strong psychometric properties.19,27-29,31,32
Treatment weeks completed (maximum, 10 weeks) was defined as in-person CBT attendance or completion of at least 1 IVR call during the treatment week.
Treatment fidelity was assessed using a revised version of the Yale Adherence and Competence Scale.33 A clinician experienced in chronic pain CBT rated a convenience sample of 30% of the audiotaped in-person CBT sessions for adherence and competence. Average scores of 4 or greater out of 7, indicating adequate adherence (99% of sessions) and competence (96% of sessions), were achieved. In IVR-CBT, therapists used templated scripts to enhance treatment fidelity when developing prerecorded IVR feedback.
Walking-related adverse events were collected weekly during IVR assessment calls. Additional adverse events were identified by medical record review at follow-up.
The sample size was based on a noninferiority test comparing IVR-CBT with in-person CBT for NRS pain intensity, with 80% power, type I error (1-sided) of .025, and assuming the true difference between means is 0. In preliminary data from similar participants,23 the baseline mean (SD) NRS was 7.0 (2.4). Since a 20% (1.4%) reduction in NRS from baseline was considered minimally clinically important,26 the noninferiority margin was set at 1 NRS unit. If the true mean NRS for IVR-CBT was less than 1 unit higher than in-person CBT, IVR-CBT would be deemed noninferior. This hypothesis can be tested by comparing the limit of the 95% CI for the mean difference between IVR-CBT and in-person CBT with the noninferiority margin 1; if this upper limit falls below 1, IVR-CBT is noninferior. Including a 15% inflation for losses, the required sample size was 230.
Because enrollment was slower than expected and the SD in the primary outcome was less than the initial power calculation (1.6 vs 2.4), we conducted a sample size recalculation based on observed data to determine if enrollment could be stopped prior to meeting the initial target of 230. Using the baseline SD (1.6), we determined that we would need 42 completers per group for 80% power. Enrollment was stopped at the end of the no-cost extension period with 125 randomized participants.
Randomization adequacy was assessed by comparing baseline demographic and clinical characteristics between groups. Between-group comparisons of changes from baseline in primary and secondary outcomes used mixed-effects models for repeated measurements. The original primary analysis proposed a 1-sided t test and mixed models for secondary analyses; before analyzing the data, we changed all analyses to mixed models because these models better accommodate missing data and allow adjustment for stratification variables. The models included treatment, time (3, 6, and 9 months), treatment-by-time interaction terms, baseline value of the outcome, and stratification variables (distance from VA facility and back pain cause). An unstructured variance-covariance matrix was used to model the within-subject correlations. Results were summarized as least-squares (LS) means (95% CI) within and between groups at each time point. Following CONSORT recommendations,34 noninferiority analyses were conducted on an intent-to-treat (ITT) and a per-protocol (completed ≥3 treatment weeks) basis at α = .025. All other analyses were ITT at α = .05.
We conducted a responder analysis of the 2 most commonly examined outcomes in pain treatment trials, pain intensity and physical functioning. A response was defined as having a clinically meaningful improvement of at least 30%35 at 3 months in NRS and RMDQ.
Sensitivity analyses were conducted that included baseline variables associated with primary outcome absence as covariates in models evaluating intervention effect. Additional sensitivity analyses used multiple imputation for missing variables.36 The imputation model included the primary and secondary outcomes measured at all time points, treatment, stratification, and baseline variables identified as predictive of absence. Results were based on 100 imputations. Analyses were conducted using SAS software (version 9.4) and R software (version 3.2.3; R Foundation).
Among 508 individuals assessed for eligibility, 134 were consented, 9 failed a baseline screening measure, and 125 were randomized (IVR-CBT, 62; in-person CBT, 63) (Figure 1). Eighteen randomized participants withdrew prior to attending any treatment sessions (IVR-CBT, 4; in-person CBT, 14; P = .02).
The groups were similar at baseline with 80 (64.5%) white patients and 28 (22.4%) women. The mean age of the sample was 57.9 years, and the average NRS pain rating indicated moderate pain (mean, 5.58) (Table 1).
Of those randomized, 102 (82%) completed at least 3 sessions, which constituted receiving a per-protocol “dose” of treatment (IVR-CBT, 56; in-person CBT, 46; P = .02). The IVR-CBT participants attended more sessions than those in in-person CBT (mean of 8.9 vs 6.6; difference, 2.3; 95% CI, 1.0- 3.6; P < .001) (Figure 2). Follow-up response rate was 76% at 3 months (IVR-CBT 84% vs in-person CBT 68%), 76% at 6 months (79% vs 73%), and 75% at 9 months (79% vs 71%). The primary analysis included 104 participants (87% IVR-CBT participants; 79% in-person CBT participants) who had at least 1 postbaseline assessment of past-week NRS pain intensity rating (see eTable 2 in Supplement 2 for baseline characteristics of these participants).
Immediately posttreatment (3-month postbaseline), the adjusted change from baseline in NRS was −0.77 (95% CI, −1.39 to −0.29) for IVR-CBT and −0.84 (95% CI, −1.29 to −0.26) for in-person CBT (Table 2). IVR-CBT was noninferior to in-person CBT in posttreatment NRS: mean difference between groups: 0.07; 95% CI, −0.67 to 0.80, with an upper limit (0.80) below the noninferiority margin of 1 (Figure 3). Noninferiority was sustained at subsequent time points. Noninferiority was also demonstrated in the per-protocol population (eTable 3 in Supplement 2).
There were no significant differences between IVR-CBT and in-person CBT in any secondary outcomes at any of the follow-up assessments (Table 2). Participants in both conditions had significant and similar improvements relative to baseline in physical functioning, sleep quality, and SF-36 Physical Component score (PCS) at posttreatment.
Posttreatment, 33% of participants (14 of 42) receiving in-person CBT reported clinically meaningful improvement in pain intensity of at least 30%, compared with 19% (10 of 52) receiving IVR-CBT (P = .19). For RMDQ, 35% of participants (15 of 43) in in-person CBT and 45% (23 of 51) in IVR-CBT reported a reduction of at least 30% (P = .43).
Participants with missing data on the primary outcome posttreatment were more likely to be black (45% [14 of 32] vs 19% [18 of 93]; P = .01), had lower average SLUMS dementia screen score (26.9 vs 25.9; P = .04), and shorter pain duration (11.3 vs 17.6 years; P = .01) than their counterparts. Conclusions remained substantively the same after including these variables as covariates in the models and after multiply imputing missing data (eTable 4 in Supplement 2).
Forty-six participants experienced 92 related and unrelated adverse events (AEs) (IVR-CBT, 40; in-person CBT, 52). Most related AEs were increased pain from exercise. The number of AEs was not significantly different by treatment group (P = .44). Two serious AEs were reported, but judged by the institutional review board to be unrelated to study participation.
In this noninferiority randomized trial, IVR-CBT was noninferior to in-person CBT for reduction in pain intensity at all assessment points. Participants in both groups demonstrated statistically significant reductions in average pain intensity at 3 and 6 months postbaseline, but not after 9 months. Examination of secondary outcomes revealed no evidence of a statistically significant difference between groups. Participants in both groups demonstrated significant improvements from pretreatment to posttreatment in physical functioning, physical quality of life, and sleep quality. A greater proportion of in-person CBT participants obtained a clinically meaningful improvement in pain intensity, whereas a larger proportion of participants in IVR-CBT obtained a clinically meaningful improvement in physical functioning, although neither comparison reached statistical significance. While neither treatment was associated with significant improvements in mood or mental health–related quality of life, mean baseline scores on these measures were near the normal range. Overall, both treatments were associated with a statistically and clinically meaningful change for participants with no meaningful differences between treatments.
Although we found significant improvements in pain intensity and other pain-relevant variables, the effects were modest. Our findings are similar to those of prior studies with veterans, which found significant but modest improvements in response to psychological23 and collaborative care interventions.37 Like these prior trials, participants in our study had multiple pain sites, low employment rates, and one-quarter had a history of substance abuse. Both treatments were associated with improved outcomes despite participants’ burden of medical and psychiatric illness.
Consistent with our hypothesis that IVR-CBT would be less burdensome than in-person CBT, participants receiving IVR-CBT completed more treatment weeks than those receiving in-person CBT, were significantly less likely to withdraw prior to treatment, and were more likely to obtain a minimal treatment dose. Our findings speak to the appeal, feasibility, and acceptability of IVR-CBT as an alternative to face-to-face therapy and confirm a primary justification for providing treatment using technology; it promotes convenient, patient-centered treatment.
The benefit-to-burden ratio for evaluating any treatment modality depends on each patient’s circumstances and preferences. Particularly, among those for whom in-person treatment is not practical, IVR-CBT represents a viable, efficacious, and well-tolerated option. In the presence of barriers to nonpharmacologic options, prescription medications including opioids become the default for many patients. Treatment impact may be captured most accurately by evaluating efficacy and reach.38,39 Given that IVR-CBT can be offered more widely and at lower burden to patients, it shows promise as a scalable and population-based treatment.
We acknowledge several limitations to the study. Because a third placebo arm was not included, we cannot definitively show that either treatment is noninferior to placebo. The trial also did not meet initial enrollment targets; however, we still had adequate power to reject the null hypothesis that the difference in pain intensity between the treatments was less than 1 point. We changed the original eligibility criteria, removing the medical clearance requirement for walking because primary care physicians believed it was unnecessary given the safety of walking. In addition, we did not conduct urine toxicology screens to identify substance misuse because this was perceived as a burden to participants. We do not believe these changes increased the risk of the trial or biased the results and likely increased the real-world applicability of the trial. The participants were all US military veterans, most were male, and all were diagnosed as having painful back conditions. Similar findings in patients with different demographic characteristics and conditions should not be assumed. Participants were slightly older and had longer pain duration than participants enrolled in trials used to establish the efficacy of CBT.7 We specified an a priori noninferiority margin for the primary outcome only and could not determine if IVR-CBT is noninferior in other trial outcomes. Future larger trials across multiple VA sites or including non-VA sites are needed to validate and generalize the results from this trial. Finally, there was a relatively large amount of missing data. However, the sensitivity analyses conducted to assess the influence of missing data supported the main analysis conclusions.
Despite these limitations, this trial suggests that IVR-CBT may address national recommendations to promote pain self-management and reduce barriers to care by providing a scalable, low-burden alternative to standard CBT. Given the large number of Americans living with chronic pain, IVR-CBT and similar approaches are promising strategies for improving the availability of nonpharmacologic care and health outcomes, despite constraints on health system resources.
Corresponding Author: Alicia A. Heapy, PhD, VA Connecticut Healthcare System (11ACLGS), 950 Campbell Ave, West Haven, CT 06516 (email@example.com).
Accepted for Publication: January 1, 2017.
Published Online: April 3, 2017. doi:10.1001/jamainternmed.2017.0223
Author Contributions: Drs Heapy and Buta had full access to all of the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis.
Study concept and design: Heapy, Higgins, Czlapinski, Piette, Krein, Kerns.
Acquisition, analysis, or interpretation of data: Heapy, Higgins, Goulet, LaChappelle, Driscoll, Buta, Piette, Kerns.
Drafting of the manuscript: Heapy, Higgins, Buta.
Critical revision of the manuscript for important intellectual content: All authors.
Statistical analysis: Goulet, LaChappelle, Buta.
Obtained funding: Heapy, Goulet, Piette.
Administrative, technical, or material support: Heapy, LaChappelle, Czlapinski, Piette.
Supervision: Heapy, Driscoll, Piette.
Conflict of Interest Disclosures: Drs Heapy and Higgins reported receiving consulting fees from Magellan Health for the development of a web-based CBT program for chronic pain. No other disclosures are reported.
Funding/Support: This project is funded through a Veterans Health Administration Health Services Research and Development Service Investigator Initiated Research Award (09-058). Drs Heapy, Goulet, and Kerns were supported by the Veterans Health Administration Health Services Research and Development Service Center of Innovation (CIN 13-407). Drs Krein and Piette are VA Career Research Scientists.
Role of the Funder/Sponsor: VA Health Service Research & Development did not participate in or influence the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.
Disclaimer: The views expressed in this article are those of the authors and do not necessarily reflect the position or policy of the Department of Veterans Affairs or the US government.
Meeting Presentations: There have been 2 abstracts containing preliminary trial results published from posters presented at the American Pain Society Annual Scientific Meetings (May 11-14, 2016; Austin, Texas; and April 30-May 3, 2014; Tampa, Florida). Two additional abstracts with preliminary trial results have been presented at the annual meetings of the Society of Behavioral Medicine (April 22-25, 2015; San Antonio, Texas) and VA Health Services Research and Development 9July 8-10, 2015; Philadelphia, Pennsylvania).
Additional Contributions: We thank Joseph Kulas, PhD, ABPP (VA Connecticut Healthcare System Pain Research, Informatics, Multimorbidities, and Education [PRIME] Health Services Research and Development Center of Innovation; and Yale School of Medicine) for providing on-site supervision of nonlicensed study therapists; Dana Cervone, APRN (VA Connecticut Healthcare System PRIME Health Services Research and Development Center of Innovation), Crystelle Egan, PhD (VA Northern California Healthcare System), Kathryn Connolly, PhD (VA Connecticut Healthcare System and Yale School of Medicine), and Lisa Fenton, PsyD (VA Connecticut Healthcare System and Yale School of Medicine), for providing treatment to study participants; Nicolle Marinec, MPH (VA Ann Arbor Center for Clinical Management Research, Health Services Research and Development Center of Innovation), for management of the IVR system development and oversight process; Hallie George, MS (Wayne State University School of Medicine), for rating treatment fidelity; and Joseph Kirlin, BA (Philadelphia VA Medical Center), and Anthony Rinaldi, MA (Canandaigua VA Medical Center), for data collection and daily monitoring of the IVR system. They were not compensated for their contributions. These were paid VA employees at the time but did not receive any special and/or additional compensation.
Create a personal account or sign in to: