[Skip to Navigation]
Sign In
Figure.  Mental Health Utilization Rates in the US by In-Person vs Telehealth Service
Mental Health Utilization Rates in the US by In-Person vs Telehealth Service

The full date range was January 5 to December 21, 2020. The COVID-19 national emergency was declared on March 13, 2020 (dashed vertical lines).

Table 1.  Mental Health Service Utilization Rates by Mode of Service Delivery
Mental Health Service Utilization Rates by Mode of Service Delivery
Table 2.  Mental Health Service Utilization Rates by Sex
Mental Health Service Utilization Rates by Sex
Table 3.  Service Utilization Rates per 10 000 Enrollees Before vs After the COVID-19 National Emergency Declarationa
Service Utilization Rates per 10 000 Enrollees Before vs After the COVID-19 National Emergency Declarationa
Table 4.  Segmented Regression Analysis of Service Utilization Rates Before vs After March 13, 2020a
Segmented Regression Analysis of Service Utilization Rates Before vs After March 13, 2020a
1.
National Institute of Mental Health. Mental illness. 2020. Accessed May 2, 2020. https://www.nimh.nih.gov/health/statistics/mental-illness.shtml
2.
Olfson  M.  Building the mental health workforce capacity needed to treat adults with serious mental illnesses.   Health Aff (Millwood). 2016;35(6):983-990. doi:10.1377/hlthaff.2015.1619 PubMedGoogle ScholarCrossref
3.
Hockenberry  JM, Joski  P, Yarbrough  C, Druss  BG.  Trends in treatment and spending for patients receiving outpatient treatment of depression in the United States, 1998-2015.   JAMA Psychiatry. 2019;76(8):810-817. doi:10.1001/jamapsychiatry.2019.0633 PubMedGoogle ScholarCrossref
4.
Olfson  M, Blanco  C, Wall  MM, Liu  SM, Grant  BF. Treatment of common mental disorders in the United States: results from the National Epidemiologic Survey on Alcohol and Related Conditions-III. J Clin Psychiatry. 2019;80(3):18m12532.
5.
Amsalem  D, Dixon  LB, Neria  Y. The coronavirus disease 2019 (COVID-19) outbreak and mental health: current risks and recommended actions. JAMA Psychiatry. 2021;78(1):9-10. doi:10.1001/jamapsychiatry.2020.1730Crossref
6.
Öngür  D, Perlis  R, Goff  D.  Psychiatry and COVID-19.   JAMA. 2020;324(12):1149-1150. doi:10.1001/jama.2020.14294 PubMedGoogle ScholarCrossref
7.
Breslau  J, Finucane  ML, Locker  AR, Baird  MD, Roth  EA, Collins  RL.  A longitudinal study of psychological distress in the United States before and during the COVID-19 pandemic.   Prev Med. 2021;143:106362. doi:10.1016/j.ypmed.2020.106362 PubMedGoogle ScholarCrossref
8.
Flanagan  EW, Beyl  RA, Fearnbach  SN, Altazan  AD, Martin  CK, Redman  LM.  The impact of COVID-19 stay-at-home orders on health behaviors in adults.   Obesity (Silver Spring). 2021;29(2):438-445. doi:10.1002/oby.23066 PubMedGoogle ScholarCrossref
9.
Harrison  E, Monroe-Lord  L, Carson  AD,  et al.  COVID-19 pandemic-related changes in wellness behavior among older Americans.   BMC Public Health. 2021;21(1):755. doi:10.1186/s12889-021-10825-6 PubMedGoogle ScholarCrossref
10.
Feehan  DM, Mahmud  AS.  Quantifying population contact patterns in the United States during the COVID-19 pandemic.   Nat Commun. 2021;12(1):893. doi:10.1038/s41467-021-20990-2 PubMedGoogle ScholarCrossref
11.
Lund  S, Ellingrud  K, Hancock  B, Manyika  J.  COVID-19 and Jobs: Monitoring the US Impact on People and Places. McKinsey Global Institute; 2020.
12.
Woolf  SH, Chapman  DA, Sabo  RT, Zimmerman  EB.  Excess deaths from COVID-19 and other causes in the US, March 1, 2020, to January 2, 2021.   JAMA. 2021;325(17):1786-1789. doi:10.1001/jama.2021.5199 PubMedGoogle ScholarCrossref
13.
Holingue  C, Badillo-Goicoechea  E, Riehm  KE,  et al.  Mental distress during the COVID-19 pandemic among US adults without a pre-existing mental health condition: findings from American trend panel survey.   Prev Med. 2020;139:106231. doi:10.1016/j.ypmed.2020.106231 PubMedGoogle ScholarCrossref
14.
Ettman  CK, Abdalla  SM, Cohen  GH, Sampson  L, Vivier  PM, Galea  S.  Prevalence of depression symptoms in US adults before and during the COVID-19 pandemic.   JAMA Netw Open. 2020;3(9):e2019686. doi:10.1001/jamanetworkopen.2020.19686 PubMedGoogle ScholarCrossref
15.
McGinty  EE, Presskreischer  R, Han  H, Barry  CL.  Psychological distress and loneliness reported by US adults in 2018 and April 2020.   JAMA. 2020;324(1):93-94. doi:10.1001/jama.2020.9740 PubMedGoogle ScholarCrossref
16.
US Government Accountability Office. Behavioral health: patient access, provider claims payment, and the effects of the COVID-19 pandemic. April 30, 2021. Accessed May 1, 2021. https://www.gao.gov/products/gao-21-437r
17.
National Council for Mental Wellbeing. Resources and tools for addressing coronavirus (COVID-19). Accessed September 22, 2020. https://www.thenationalcouncil.org/wp-content/uploads/2020/04/NCBH_COVID19_Survey_Findings_04152020.pdf?daf=375ateTbd56
18.
Centers for Disease Control and Prevention. COVID-19 data review: update on COVID-19–related mortality. Updated November 16, 2022. Accessed November 21, 2022. https://www.cdc.gov/coronavirus/2019-ncov/science/data-review/index.html
19.
Ziedan  E, Simon  KI, Wing  C. Effects of state COVID-19 closure policy on non-COVID-19 health care utilization. National Bureau of Economic Research working paper 27621. July 2020. Accessed September 22, 2020. https://www.nber.org/papers/w27621.pdf
20.
Hartnett  KP, Kite-Powell  A, DeVies  J,  et al; National Syndromic Surveillance Program Community of Practice.  Impact of the COVID-19 pandemic on emergency department visits—United States, January 1, 2019-May 30, 2020.   MMWR Morb Mortal Wkly Rep. 2020;69(23):699-704. doi:10.15585/mmwr.mm6923e1 PubMedGoogle ScholarCrossref
21.
Bojdani  E, Rajagopalan  A, Chen  A,  et al.  COVID-19 pandemic: impact on psychiatric care in the United States.   Psychiatry Res. 2020;289:113069. doi:10.1016/j.psychres.2020.113069 PubMedGoogle ScholarCrossref
22.
Holland  KM, Jones  C, Vivolo-Kantor  AM,  et al.  Trends in US emergency department visits for mental health, overdose, and violence outcomes before and during the COVID-19 pandemic.   JAMA Psychiatry. 2021;78(4):372-379. doi:10.1001/jamapsychiatry.2020.4402 PubMedGoogle ScholarCrossref
23.
Hollander  JE, Carr  BG.  Virtually perfect? telemedicine for COVID-19.   N Engl J Med. 2020;382(18):1679-1681. doi:10.1056/NEJMp2003539 PubMedGoogle ScholarCrossref
24.
Verma  S. Early impact of CMS expansion of Medicare telehealth during COVID-19. Health Affairs. July 15, 2020. Accessed September 12, 2020. https://www.healthaffairs.org/do/10.1377/hblog20200715.454789/full/
25.
Choi  S, Wilcock  AD, Busch  AB,  et al.  Association of characteristics of psychiatrists with use of telemental health visits in the Medicare population.   JAMA Psychiatry. 2019;76(6):654-657. doi:10.1001/jamapsychiatry.2019.0052 PubMedGoogle ScholarCrossref
26.
Kaiser Family Foundation. State COVID-19 data and policy actions. February 10, 2022. Accessed November 21, 2022. https://www.kff.org/coronavirus-covid-19/issue-brief/state-data-and-policy-actions-to-address-coronavirus/
27.
Centers for Medicare & Medicaid Services. List of telehealth services. Accessed September 22, 2020. https://www.cms.gov/Medicare/Medicare-General-Information/Telehealth/Telehealth-Codes
28.
Cantor  JH, McBain  RK, Pera  MF, Bravata  DM, Whaley  CM.  Who is (and is not) receiving telemedicine care during the COVID-19 pandemic.   Am J Prev Med. 2021;61(3):434-438. doi:10.1016/j.amepre.2021.01.030 PubMedGoogle ScholarCrossref
29.
Fischer  SH, Uscher-Pines  L, Roth  E, Breslau  J.  The transition to telehealth during the first months of the COVID-19 pandemic: evidence from a national sample of patients.   J Gen Intern Med. 2021;36(3):849-851. doi:10.1007/s11606-020-06358-0 PubMedGoogle ScholarCrossref
30.
Busch  AB, Huskamp  HA, Raja  P, Rose  S, Mehrotra  A.  Disruptions in care for Medicare beneficiaries with severe mental illness during the COVID-19 pandemic.   JAMA Netw Open. 2022;5(1):e2145677. doi:10.1001/jamanetworkopen.2021.45677 PubMedGoogle ScholarCrossref
31.
Connolly  SL, Stolzmann  KL, Heyworth  L, Weaver  KR, Bauer  MS, Miller  CJ.  Rapid increase in telemental health within the Department of Veterans Affairs during the COVID-19 pandemic.   Telemed J E Health. 2021;27(4):454-458. doi:10.1089/tmj.2020.0233 PubMedGoogle ScholarCrossref
32.
Patel  SY, Mehrotra  A, Huskamp  HA, Uscher-Pines  L, Ganguli  I, Barnett  ML.  Variation in telemedicine use and outpatient care during the COVID-19 pandemic in the United States.   Health Aff (Millwood). 2021;40(2):349-358. doi:10.1377/hlthaff.2020.01786 PubMedGoogle ScholarCrossref
33.
Lipschitz  JM, Connolly  SL, Van Boxtel  R, Potter  JR, Nixon  N, Bidargaddi  N.  Provider perspectives on telemental health implementation: lessons learned during the COVID-19 pandemic and paths forward.   Psychol Serv. Published online February 24, 2022. doi:10.1037/ser0000625 PubMedGoogle ScholarCrossref
34.
Castlight Health. About us. Accessed September 24, 2020. https://www.castlighthealth.com/about/
35.
World Health Organization.  International Statistical Classification of Diseases and Related Health Problems, Tenth Revision (ICD-10). World Health Organization; 1992.
36.
Trump  DJ. Proclamation on declaring a national emergency concerning the novel coronavirus disease (COVID-19) outbreak. March 13, 2020. Accessed August 10, 2020. https://trumpwhitehouse.archives.gov/presidential-actions/proclamation-declaring-national-emergency-concerning-novel-coronavirus-disease-covid-19-outbreak/
37.
US Census Bureau. American Community Survey 5-year data (2009-2020). March 27, 2022. Accessed July 19, 2020. https://www.census.gov/data/developers/data-sets/acs-5year.html
38.
USAFacts. Understanding the COVID-19 pandemic. Updated November 13, 2022. Accessed November 21, 2022. https://usafacts.org/issues/coronavirus/
39.
US Bureau of Labor Statistics. Databases, tables and calculators by subject. Accessed September 22, 2020. https://www.bls.gov/data/#api
40.
Economic Research Service. State fact sheets. US Department of Agriculture. Accessed September 22, 2020. https://www.ers.usda.gov/data-products/state-fact-sheets/
41.
Wagner  AK, Soumerai  SB, Zhang  F, Ross-Degnan  D.  Segmented regression analysis of interrupted time series studies in medication use research.   J Clin Pharm Ther. 2002;27(4):299-309. doi:10.1046/j.1365-2710.2002.00430.x PubMedGoogle ScholarCrossref
42.
StataCorp. Stata Statistical Software: Release 15. StataCorp LLC; 2017.
43.
Vahratian  A, Blumberg  SJ, Terlizzi  EP, Schiller  JS.  Symptoms of anxiety or depressive disorder and use of mental health care among adults during the COVID-19 pandemic—United States, August 2020-February 2021.   MMWR Morb Mortal Wkly Rep. 2021;70(13):490-494. doi:10.15585/mmwr.mm7013e2 PubMedGoogle ScholarCrossref
44.
Centers for Disease Control and Prevention. Managing healthcare operations during COVID-19. Updated February 8, 2021. Accessed November 21, 2022. https://www.cdc.gov/coronavirus/2019-ncov/hcp/facility-planning-operations.html
45.
Haffajee  RL, Mello  MM.  Thinking globally, acting locally—the US response to COVID-19.   N Engl J Med. 2020;382(22):e75. doi:10.1056/NEJMp2006740 PubMedGoogle ScholarCrossref
46.
US Department of Health and Human Services. Notification of enforcement discretion for telehealth remote communications during the COVID-19 nationwide public health emergency. Accessed November 21, 2022. https://www.hhs.gov/hipaa/for-professionals/special-topics/emergency-preparedness/notification-enforcement-discretion-telehealth/index.html
47.
Center for Connected Health Policy. State telehealth laws and reimbursement policies: at a glance, spring 2021. Accessed November 21, 2022. https://www.cchpca.org/2021/04/Spring2021_Infographic-1.pdf
48.
Lau  J, Knudsen  J, Jackson  H,  et al.  Staying connected in the COVID-19 pandemic: telehealth at the largest safety-net system in the United States.   Health Aff (Millwood). 2020;39(8):1437-1442. doi:10.1377/hlthaff.2020.00903 PubMedGoogle ScholarCrossref
49.
Cai  C, Woolhandler  S, Himmelstein  DU, Gaffney  A. Trends in anxiety and depression symptoms during the COVID-19 pandemic: results from the US Census Bureau’s Household Pulse Survey. J Gen Intern Med. 2021;36(6):1841-1843. doi:10.1007/s11606-021-06759-9Crossref
50.
Reed  ME, Huang  J, Graetz  I,  et al.  Patient characteristics associated with choosing a telemedicine visit vs office visit with the same primary care clinicians.   JAMA Netw Open. 2020;3(6):e205873. doi:10.1001/jamanetworkopen.2020.5873 PubMedGoogle ScholarCrossref
51.
Lam  K, Lu  AD, Shi  Y, Covinsky  KE.  Assessing telemedicine unreadiness among older adults in the United States during the COVID-19 pandemic.   JAMA Intern Med. 2020;180(10):1389-1391. doi:10.1001/jamainternmed.2020.2671 PubMedGoogle ScholarCrossref
52.
Berryhill  MB, Culmer  N, Williams  N,  et al.  Videoconferencing psychotherapy and depression: a systematic review.   Telemed J E Health. 2019;25(6):435-446. doi:10.1089/tmj.2018.0058 PubMedGoogle ScholarCrossref
53.
Ekeland  AG, Bowes  A, Flottorp  S.  Effectiveness of telemedicine: a systematic review of reviews.   Int J Med Inform. 2010;79(11):736-771. doi:10.1016/j.ijmedinf.2010.08.006 PubMedGoogle ScholarCrossref
Original Investigation
January 6, 2023

Mental Health Service Utilization Rates Among Commercially Insured Adults in the US During the First Year of the COVID-19 Pandemic

Author Affiliations
  • 1RAND Corporation, Boston, Massachusetts
  • 2RAND Corporation, Santa Monica, California
  • 3Castlight Health, San Francisco, California
  • 4RAND Corporation, Pittsburgh, Pennsylvania
JAMA Health Forum. 2023;4(1):e224936. doi:10.1001/jamahealthforum.2022.4936
Key Points

Question  Did mental health service utilization in the US change for different psychiatric diagnoses during the first year of the COVID-19 pandemic (January to December 2020)?

Findings  In this cohort study of 5 142 577 commercially insured adults across all 50 US states, the weekly rate of in-person mental health service utilization decreased by more than 50% after the start of the COVID-19 pandemic but concurrent increases in telehealth led to a slight increase in total utilization for anxiety disorders and stability in total volume of service for other disorders.

Meaning  The findings suggest that the pandemic disrupted in-person mental health care but expansion of telehealth enabled care for an increasing number of patients.

Abstract

Importance  The COVID-19 pandemic has been associated with an elevated prevalence of mental health conditions and disrupted mental health care throughout the US.

Objective  To examine mental health service use among US adults from January through December 2020.

Design, Setting, and Participants  This cohort study used county-level service utilization data from a national US database of commercial medical claims from adults (age >18 years) from January 5 to December 21, 2020. All analyses were conducted in April and May 2021.

Main Outcomes and Measures  Per-week use of mental health services per 10 000 beneficiaries was calculated for 5 psychiatric diagnostic categories: major depressive disorder (MDD), anxiety disorders, bipolar disorder, adjustment disorders, and posttraumatic stress disorder (PTSD). Changes in service utilization rates following the declaration of a national public health emergency on March 13, 2020, were examined overall and by service modality (in-person vs telehealth), diagnostic category, patient sex, and age group.

Results  The study included 5 142 577 commercially insured adults. The COVID-19 pandemic was associated with more than a 50% decline in in-person mental health care service utilization rates. At baseline, there was a mean (SD) of 11.66 (118.00) weekly beneficiaries receiving services for MDD per 10 000 enrollees; this declined by 6.44 weekly beneficiaries per 10 000 enrollees (β, –6.44; 95% CI, –8.33 to –4.54). For other disorders, these rates were as follows: anxiety disorders (mean [SD] baseline, 12.24 [129.40] beneficiaries per 10 000 enrollees; β, –5.28; 95% CI, –7.50 to –3.05), bipolar disorder (mean [SD] baseline, 3.32 [60.39] beneficiaries per 10 000 enrollees; β, –1.81; 95% CI, –2.75 to –0.87), adjustment disorders (mean [SD] baseline, 12.14 [129.94] beneficiaries per 10 000 enrollees; β, –6.78; 95% CI, –8.51 to –5.04), and PTSD (mean [SD] baseline, 4.93 [114.23] beneficiaries per 10 000 enrollees; β, –2.00; 95% CI, –3.98 to –0.02). Over the same period, there was a 16- to 20-fold increase in telehealth service utilization; the rate of increase was lowest for bipolar disorder (mean [SD] baseline, 0.13 [16.72] beneficiaries per 10 000 enrollees; β, 1.40; 95% CI, 1.04-1.76) and highest for anxiety disorders (mean [SD] baseline, 0.20 [9.28] beneficiaries per 10 000 enrollees; β, 9.12; 95% CI, 7.32-10.92). When combining in-person and telehealth service utilization rates, an overall increase in care for MDD, anxiety, and adjustment disorders was observed over the period.

Conclusions and Relevance  In this cohort study of US adults, we found that the COVID-19 pandemic was associated with a rapid increase in telehealth services for mental health conditions, offsetting a sharp decline in in-person care and generating overall higher service utilization rates for several mental health conditions compared with prepandemic levels.

Introduction

In a typical year, 1 in 5 US adults are living with a mental illness.1 Of these 50 million individuals, only half received mental health services from 2020 to 2021 due in large part to workforce and other capacity constraints.2 Although treatment prevalence for mental disorders such as depression and anxiety has been gradually increasing,3,4 the global COVID-19 pandemic has risked disrupting these trends in at least 3 ways. First, the prevalence of mental disorders increased significantly from 2020 to 2021.5-7 The pandemic has been associated with decreased social interactions and physical exercise,8-10 threats to individuals’ employment and economic security,11 and an escalation in morbidity and mortality12—all of which are likely to have contributed to widespread psychological distress.13-15

Second, the ability of health facilities to support in-person, nonemergency care contracted, particularly during the early months of the pandemic.16 A survey conducted by the National Council for Mental Well-being in April 2020 found that 93% of responding behavioral health organizations throughout the US reported reduced operations, including 47% furloughing or discharging employees as a result of the COVID-19 pandemic.17 This survey was conducted after publication of Centers for Disease Control and Prevention (CDC) recommendations for enhanced precautions for nonemergency health care18 as well as shelter-in-place ordinances.19 Electronic medical record systems and claims data have also revealed substantial declines in emergency department visits and hospitalizations,20 although the picture for mental health services has been more nuanced, with more recent evidence indicating elevated emergency department visit rates for mental health conditions between March and October 2020.21,22

Third, health systems have promoted rapid expansion of telehealth services,23,24 including the provision of outpatient mental health care.25 This transition was bolstered by legislative mandates requiring private insurers to cover telemental health care and the creation of new Centers for Medicare & Medicaid Services reimbursement codes.26,27 One recent study found a 20-fold increase in the incidence of telemedicine utilization,28 while another found that over 50% of adults receiving behavioral health services from March to May 2020 had done so through teleconference or videoconference.29

Against the backdrop of these trends, it remains unclear how mental health service utilization for specific conditions at a national level has evolved over the course of the pandemic compared with prepandemic levels. Previous studies have examined trends in mental health care utilization during the COVID-19 pandemic by Medicare and Medicare Advantage beneficiaries and veterans30-32 and the perspective of mental health professionals offering telehealth during the COVID-19 pandemic.33 In this study, we analyzed weekly mental health service utilization rates at the US county level among commercially insured adults across all 50 states from January 5 through December 21, 2020, according to 5 diagnostic categories: major depressive disorder, anxiety disorders, bipolar disorder, adjustment disorder, and posttraumatic stress disorder (PTSD). Additionally, we disaggregated analyses according to patient sex, age group, and mode of service delivery.

Methods
Study Design and Participants

In this cohort study, to describe trends in mental health service utilization before vs after the onset of the COVID-19 pandemic in the US, we examined weekly medical claims from commercially insured adults (age >18 years) between January 5 and December 21, 2020. Medical claims information was provided by Castlight Health, a health benefits manager for employer-sponsored health insurance plans for approximately 200 employers across all 50 states.34 We limited our analysis to adults as the service use patterns, prevalence, and sources of care are liable to differ between children and adults. This study was approved by the RAND Human Subjects Protection Committee, which waived informed consent because data were deidentified. The study followed the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) reporting guideline.

Measures

Medical claims were classified according to the International Statistical Classification of Diseases and Related Health Problems, Tenth Revision (ICD-10) primary diagnosis codes for mental disorders at the 3- and 4-digit level to preserve sufficient cell size for anonymity. These included major depressive disorder (F32, F33), anxiety disorders (F40, F41), bipolar disorder (F31), adjustment disorder (F43.2), and PTSD (F43.1).35 We did not include schizophrenia or schizoaffective disorder as the number of individuals within the data set who received these diagnoses was too small to merit inspection. We calculated the weekly number of individuals per 10 000 eligible beneficiaries at the US county level who received services for which each of these code categories was assigned. To ensure that estimates did not reflect dropouts or those who lost coverage during the pandemic, we limited eligible beneficiaries to those with continuous enrollment throughout the duration of the study period. We identified the interval from January 5 to March 13, 2020, the date on which COVID-19 was declared a national public health emergency, as the pre–COVID-19 interval36 and dates following March 13 as the post–COVID-19 interval.

To inspect demographic differences in service utilization rates, we generated separate service utilization rates according to patient age category (19-26, 27-45, 46-59, and ≥60 years) and sex (female, male) and mode of service delivery (telehealth, in-person). In addition, we linked the patient address to county-level demographic characteristics, including the share (percentage) of the adult population that was Black, Hispanic, or White, as indexed in the American Community Survey37; weekly prevalence of SARS-CoV-2 infection cases per 10 000 population, as recorded by USAFacts38; monthly unemployment rates, as reported by the US Bureau of Labor Statistics39; and county-level rurality, as recorded by the US Department of Agriculture from census data.40

Statistical Analysis

To examine the association between mental health service utilization and the onset of the COVID-19 pandemic in the US, we used longitudinal, multivariable fixed-effects regression analyses to estimate change in utilization rates in the weeks following the national emergency declaration compared with prior weeks. In addition to a dichotomous time variable for the national public health emergency declaration, we included the following covariates: patient age and sex, county-level rurality, racial and ethnic composition, monthly unemployment rate, and weekly SARS-CoV-2 infection cases per 10 000 population. Fixed effects were included for calendar week and US state. Standard errors were clustered at the state level. Separate regressions were estimated for each mode of service: in-person and telehealth. We also investigated whether changes in mental health service utilization rates that occurred following the onset of the pandemic varied according to patient age group and sex. These models included the same fixed effects described above but also examined interactions between the dichotomous time variable and the demographic characteristic categories.

Lastly, to examine changes in service utilization over the course of the COVID-19 pandemic, we executed an alternative model specification: a mixed-effects, segmented regression. In this framework, we included separate intercept and slope terms for the pre–COVID-19 and post–COVID-19 periods. This allowed us to examine whether time trends in service utilization differed between intervals as well as whether there was a sudden shift in service utilization following the March 13 national emergency declaration. The preperiod contained 10 time points, while the postperiod contained 40 time points, an interval deemed sufficient for segmented regression.41 Analyses were conducted in April and May 2021. All precision estimates are reported using 2-sided 95% CIs. Analyses were performed in Stata, version 15.1 (StataCorp LLC).42

Results

The study included 5 142 577 commercially insured adults. Prior to the national public health emergency declaration (January 5 to March 13, 2020), mean (SD) weekly mental health service utilization rates among adults ranged from 4.83 (0.27) per 10 000 enrollees for bipolar disorder to 23.28 (1.08) per 10 000 enrollees for anxiety disorders (Table 1). From March 14 through December 20, 2020, service utilization rates increased by 8.0% across the 5 diagnostic categories, ranging from 6.4% for severe stress or adjustment disorders to 14.0% for anxiety disorders. Table 2 shows details of service utilization rates according to period, diagnostic category, mode of service delivery, and patient sex.

As shown in the Figure, service utilization rates declined by 52% to 57% for in-person care following the US national emergency declaration. For example, mean (SD) service utilization for depression care declined from 17.0 (2.0) beneficiaries per 10 000 members per week to 7.2 (0.7) beneficiaries per 10 000 members per week, a 57% decline. Lower rates of in-person service utilization also persisted through December, the last month for which claims data were available. By contrast, utilization rates of telehealth services increased across all diagnostic categories following the national declaration by a factor of 16 to 20 (ie, an increase of 1495.2% to 1925.0%). Unadjusted trends—both declines in in-person care and increases in telehealth—were statistically significant in all instances. Total service utilization from March through December 2020 was higher than prior to COVID-19 for anxiety disorders (β, 3.52; 95% CI, 0.87-6.17), but the difference was not statistically significant for other diagnostic categories. When examining unadjusted trend differences between males and females, we also found that increases in the rate of weekly service utilization (before vs after March 13) were larger for females than for males among those receiving services for anxiety disorders (β, 2.99; 95% CI, 0.48-5.51). Differences were not statistically significant for the remaining diagnostic categories.

Multivariable regression models were used to inspect trends in total service utilization and in-person vs telehealth service utilization by diagnostic category after adjusting for patient- and county-level characteristics. Looking at total service utilization, we found only 1 significant difference between the 2 periods; there was a higher rate of treatment for anxiety disorders following the national declaration (baseline: mean [SD] 12.44 [129.83] beneficiaries per 10 000 enrollees; β, 3.79; 95% CI, 1.19-6.38; P = .005). In interaction models that examined the associations between changes in total service utilization and patient sex and age, we found that uptake was greater for females seeking services for anxiety disorders (β, 3.01; 95% CI, 0.50-5.52; P = .02) and lower for older adults (aged ≥60 years) seeking services for adjustment disorders (β, −3.86; 95% CI, −6.67 to −1.05; P = .008) (Table 3).

In contrast with total service utilization, we observed significant countervailing declines and increases in service utilization of in-person and telehealth care, respectively. With regard to in-person care, we observed decreases in weekly beneficiaries per 10 000 enrollees for major depressive disorder (baseline mean [SD], 11.66 [118.00] beneficiaries per 10 000 enrollees; β, −6.44; 95% CI, −8.33 to −4.54; P < .001), anxiety disorders (baseline mean [SD], 12.24 [129.40] beneficiaries per 10 000 enrollees; β, −5.28; 95% CI, −7.50 to −3.05; P < .001), bipolar disorder (baseline mean [SD], 3.32 [60.39] beneficiaries per 10 000 enrollees; β, −1.81; 95% CI, −2.75 to −0.87; P < .001), adjustment disorders (baseline mean [SD], 12.14 [129.94] beneficiaries per 10 000 enrollees; β, −6.78; 95% CI, −8.51 to −5.04; P < .001), and PTSD (baseline mean [SD], 4.93 [114.23] beneficiaries per 10 000 enrollees; β, −2.00; 95% CI, −3.98 to −0.02; P = .04). With regard to telehealth, we observed increases for major depressive disorder (baseline mean [SD], 0.10 [2.94] beneficiaries per 10 000 enrollees; β, 5.97; 95% CI, 4.94-7.00; P < .001), anxiety disorders (baseline mean [SD], 0.20 [9.28] beneficiaries per 10 000 enrollees; β, 9.12; 95% CI, 7.32-10.92; P < .001), bipolar disorder (baseline mean [SD], 0.13 [16.72] beneficiaries per 10 000 enrollees; β, 1.40; 95% CI, 1.04-1.76; P < .001), adjustment disorders (baseline mean [SD], 0.13 [4.02] beneficiaries per 10 000 enrollees; β, 5.95; 95% CI, 4.59-7.32; P < .001), and PTSD (baseline mean [SD], 0.10 [5.66] beneficiaries per 10 000 enrollees; β, 2.91; 95% CI, 1.29-4.52; P < .001).

Segmented regression analyses were used to model separate intercepts and slopes for both time intervals: before and after the national emergency declaration (Table 4). In the preperiod, we observed stable mental health service utilization rates across all diagnostic categories; none of the pre–COVID-19 slopes differed significantly from 0 except for a modest increase in service utilization for bipolar disorder during this period. Following the national emergency declaration, there was an immediate increase in total service utilization for anxiety disorders (β, 1.62; 95% CI, 0.18-3.06; P = .03), as indicated by the post–COVID-19 intercept term in Table 4. This was not observed for other conditions. We also observed gradually increasing total service utilization rates for the remainder of 2020 for major depressive disorder (β, 0.09; 95% CI, 0.04-0.13; P < .001), anxiety disorders (β, 0.13; 95% CI, 0.03-0.23; P = .01), and adjustment disorders (β, 0.08; 95% CI, 0.02-0.14; P = .007), as indicated by the post–COVID-19 slope terms in Table 4. No other differences were statistically significant.

Discussion

This study found large-scale changes in national mental health service utilization rates throughout 2020 in a broad cross section of commercially insured US adults following the onset of the COVID-19 pandemic. We found a greater than 50% decline in in-person service utilization rates across 5 major diagnostic categories, which was entirely offset by rapid expansion in telehealth service utilization. For 3 categories of conditions (anxiety disorders, major depressive disorder, and adjustment disorders), we also found evidence that service utilization rates increased throughout the pandemic compared with before the pandemic’s onset.

Prior studies have chronicled an elevated prevalence of psychological distress and common mental disorders such as anxiety and depression over the course of the pandemic.14,15 For example, a recent CDC study estimated that the percentage of US adults reporting anxiety or depressive symptoms in the past 7 days during February 2021 was over 40%.43 Examining more than 2 million health care encounters between January and December 2020, we did not observe a comparable increase in service utilization. Rather, we found a gradual increase in service utilization such that, by November and December, utilization rates were roughly 10% to 20% higher than they were in January and February for select diagnostic categories.

Nevertheless, these estimates mask a remarkable transition in the US health system from in-person to virtual care. On the one hand, in-person care for nonemergency services, including outpatient mental health care, rapidly contracted beginning in March 2020, following new guidance from the CDC44 and shelter-in-place ordinances passed by governors and mayors.45 These findings provide evidence of the long-term outcomes of those policies, with in-person mental health services still being roughly 50% lower at the end of 2020 compared with the beginning of the year. On the other hand, the Department of Health and Human Services relaxed Health Insurance Portability and Accountability Act compliance regulations to promote broader adoption of telehealth,46 which was coupled with executive orders and state legislation mandating that commercial health plans reimburse for telehealth services at parity with in-person care.47 While preliminary studies documented a marked increase in scale-up of telehealth services,48 to our knowledge, this is the first study to show that the magnitude of this increase (roughly a 16- to 20-fold increase in utilization) fully compensated for the decline in in-person care.

For the 3 highest-prevalence diagnostic categories, we also found that service utilization continued to increase throughout 2020, primarily in the telehealth context. This was most apparent among those seeking treatment for anxiety, for which we observed more than a 20% increase in service utilization by the end of the year, as well as an immediate increase in treatment seeking following the national emergency declaration on March 13. These findings are in line with prior evidence indicating that heightened anxiety has been the most commonly documented mental health impact of the pandemic.43,49 By contrast, we did not find comparable increases for mental illnesses such as bipolar disorder and PTSD.

Our examination of the demographics associated with mental health service utilization rates had 3 major findings. First, although females had higher utilization rates for several mental health conditions prior to the onset of the pandemic, the increase in service utilization for anxiety disorders throughout the pandemic was larger for females than for males. There may be several explanations for this, such as greater willingness among females compared with males to use telehealth50 or stressors that may have disproportionately been placed on females, such as caring for out-of-school children. Second, we found lower service utilization rates in rural counties that were nonadjacent to metropolitan regions. As 1 recent article indicated, this may be a result of telehealth services failing to reach remote, lower-income communities throughout the US.28 Third, service utilization rates for adults aged 46 years or older were lower than those among younger adults. While this may be partly attributable to a lower prevalence of certain conditions among older adults,51 the consistency of this trend across diagnostic categories suggests that other factors may play a role, including the digital literacy and comfortability of older adults to use videoconferencing for communicating with health care professionals.

Limitations

This study has several limitations. First, it used data from a subset of individuals with employer-based private insurance. As such, those in the data set predominantly represent employed adults with symptom severity below a threshold at which gainful employment may be inhibited. Our data set did not include those who were publicly insured and was not representative of all commercially insured individuals. Second, we do not know the number or proportion of individuals in the study sample who were continuously insured throughout the study period. Changes in the study sample may be responsible for some of our results. Third, our results are limited to 2020. We were not able to determine whether service utilization rates evolved further in the first months of 2021 due to the lag time of claims data. However, the trends we observed were stable over the 9-month period following the national health emergency declaration. Fourth, we did not evaluate the effects of state-level policies, which may have further influenced mental health care utilization.19 Likewise, the national emergency declaration was an important date marking a transition in the US public health system response; however, there was substantial geographic heterogeneity in the onset of the pandemic throughout the nation. Fifth, we were not able to assess quality of care and whether it differed between in-person and telehealth services. Although evidence from previous studies52,53 indicates that telemental health services are comparable with in-person services for conditions such as anxiety and depression, more evidence is required to establish quality of care in this and other samples.

Conclusions

This cohort study found evidence that utilization of telehealth services substantially increased following the national public health emergency declaration on March 13, 2020, a time when mental health services were greatly needed. Moreover, service utilization for anxiety, depression, and adjustment disorders gradually increased throughout 2020, although it is likely that the treatment gap for care remained large. It will be important to observe whether and to what extent these trends continue to shift, particularly if and when impermanent legislation to support telemental health services expires or is withdrawn.

Back to top
Article Information

Accepted for Publication: November 3, 2022.

Published: January 6, 2023. doi:10.1001/jamahealthforum.2022.4936

Open Access: This is an open access article distributed under the terms of the CC-BY License. © 2023 McBain RK et al. JAMA Health Forum.

Corresponding Author: Christopher M. Whaley, PhD, RAND Corporation, 1776 Main St, Santa Monica, CA 90401 (cwhaley@rand.org).

Author Contributions: Dr Whaley had full access to all of the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis.

Concept and design: McBain, Cantor, Whaley.

Acquisition, analysis, or interpretation of data: All authors.

Drafting of the manuscript: McBain, Cantor, Whaley.

Critical revision of the manuscript for important intellectual content: All authors.

Statistical analysis: Cantor, Whaley.

Obtained funding: Whaley.

Administrative, technical, or material support: Pera, Bravata, Whaley.

Supervision: McBain, Breslau, Whaley.

Conflict of Interest Disclosures: Dr Bravata reported receiving personal fees from Castlight Health, outside of regular employment, during the conduct of the study. No other disclosures were reported.

Funding/Support: This study was funded by grant 1K01AG061274 from the National Institute on Aging (Dr Whaley) and the Robert Wood Johnson Foundation (Dr Whaley).

Role of the Funder/Sponsor: The funders had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.

Data Sharing Statement: See Supplement.

References
1.
National Institute of Mental Health. Mental illness. 2020. Accessed May 2, 2020. https://www.nimh.nih.gov/health/statistics/mental-illness.shtml
2.
Olfson  M.  Building the mental health workforce capacity needed to treat adults with serious mental illnesses.   Health Aff (Millwood). 2016;35(6):983-990. doi:10.1377/hlthaff.2015.1619 PubMedGoogle ScholarCrossref
3.
Hockenberry  JM, Joski  P, Yarbrough  C, Druss  BG.  Trends in treatment and spending for patients receiving outpatient treatment of depression in the United States, 1998-2015.   JAMA Psychiatry. 2019;76(8):810-817. doi:10.1001/jamapsychiatry.2019.0633 PubMedGoogle ScholarCrossref
4.
Olfson  M, Blanco  C, Wall  MM, Liu  SM, Grant  BF. Treatment of common mental disorders in the United States: results from the National Epidemiologic Survey on Alcohol and Related Conditions-III. J Clin Psychiatry. 2019;80(3):18m12532.
5.
Amsalem  D, Dixon  LB, Neria  Y. The coronavirus disease 2019 (COVID-19) outbreak and mental health: current risks and recommended actions. JAMA Psychiatry. 2021;78(1):9-10. doi:10.1001/jamapsychiatry.2020.1730Crossref
6.
Öngür  D, Perlis  R, Goff  D.  Psychiatry and COVID-19.   JAMA. 2020;324(12):1149-1150. doi:10.1001/jama.2020.14294 PubMedGoogle ScholarCrossref
7.
Breslau  J, Finucane  ML, Locker  AR, Baird  MD, Roth  EA, Collins  RL.  A longitudinal study of psychological distress in the United States before and during the COVID-19 pandemic.   Prev Med. 2021;143:106362. doi:10.1016/j.ypmed.2020.106362 PubMedGoogle ScholarCrossref
8.
Flanagan  EW, Beyl  RA, Fearnbach  SN, Altazan  AD, Martin  CK, Redman  LM.  The impact of COVID-19 stay-at-home orders on health behaviors in adults.   Obesity (Silver Spring). 2021;29(2):438-445. doi:10.1002/oby.23066 PubMedGoogle ScholarCrossref
9.
Harrison  E, Monroe-Lord  L, Carson  AD,  et al.  COVID-19 pandemic-related changes in wellness behavior among older Americans.   BMC Public Health. 2021;21(1):755. doi:10.1186/s12889-021-10825-6 PubMedGoogle ScholarCrossref
10.
Feehan  DM, Mahmud  AS.  Quantifying population contact patterns in the United States during the COVID-19 pandemic.   Nat Commun. 2021;12(1):893. doi:10.1038/s41467-021-20990-2 PubMedGoogle ScholarCrossref
11.
Lund  S, Ellingrud  K, Hancock  B, Manyika  J.  COVID-19 and Jobs: Monitoring the US Impact on People and Places. McKinsey Global Institute; 2020.
12.
Woolf  SH, Chapman  DA, Sabo  RT, Zimmerman  EB.  Excess deaths from COVID-19 and other causes in the US, March 1, 2020, to January 2, 2021.   JAMA. 2021;325(17):1786-1789. doi:10.1001/jama.2021.5199 PubMedGoogle ScholarCrossref
13.
Holingue  C, Badillo-Goicoechea  E, Riehm  KE,  et al.  Mental distress during the COVID-19 pandemic among US adults without a pre-existing mental health condition: findings from American trend panel survey.   Prev Med. 2020;139:106231. doi:10.1016/j.ypmed.2020.106231 PubMedGoogle ScholarCrossref
14.
Ettman  CK, Abdalla  SM, Cohen  GH, Sampson  L, Vivier  PM, Galea  S.  Prevalence of depression symptoms in US adults before and during the COVID-19 pandemic.   JAMA Netw Open. 2020;3(9):e2019686. doi:10.1001/jamanetworkopen.2020.19686 PubMedGoogle ScholarCrossref
15.
McGinty  EE, Presskreischer  R, Han  H, Barry  CL.  Psychological distress and loneliness reported by US adults in 2018 and April 2020.   JAMA. 2020;324(1):93-94. doi:10.1001/jama.2020.9740 PubMedGoogle ScholarCrossref
16.
US Government Accountability Office. Behavioral health: patient access, provider claims payment, and the effects of the COVID-19 pandemic. April 30, 2021. Accessed May 1, 2021. https://www.gao.gov/products/gao-21-437r
17.
National Council for Mental Wellbeing. Resources and tools for addressing coronavirus (COVID-19). Accessed September 22, 2020. https://www.thenationalcouncil.org/wp-content/uploads/2020/04/NCBH_COVID19_Survey_Findings_04152020.pdf?daf=375ateTbd56
18.
Centers for Disease Control and Prevention. COVID-19 data review: update on COVID-19–related mortality. Updated November 16, 2022. Accessed November 21, 2022. https://www.cdc.gov/coronavirus/2019-ncov/science/data-review/index.html
19.
Ziedan  E, Simon  KI, Wing  C. Effects of state COVID-19 closure policy on non-COVID-19 health care utilization. National Bureau of Economic Research working paper 27621. July 2020. Accessed September 22, 2020. https://www.nber.org/papers/w27621.pdf
20.
Hartnett  KP, Kite-Powell  A, DeVies  J,  et al; National Syndromic Surveillance Program Community of Practice.  Impact of the COVID-19 pandemic on emergency department visits—United States, January 1, 2019-May 30, 2020.   MMWR Morb Mortal Wkly Rep. 2020;69(23):699-704. doi:10.15585/mmwr.mm6923e1 PubMedGoogle ScholarCrossref
21.
Bojdani  E, Rajagopalan  A, Chen  A,  et al.  COVID-19 pandemic: impact on psychiatric care in the United States.   Psychiatry Res. 2020;289:113069. doi:10.1016/j.psychres.2020.113069 PubMedGoogle ScholarCrossref
22.
Holland  KM, Jones  C, Vivolo-Kantor  AM,  et al.  Trends in US emergency department visits for mental health, overdose, and violence outcomes before and during the COVID-19 pandemic.   JAMA Psychiatry. 2021;78(4):372-379. doi:10.1001/jamapsychiatry.2020.4402 PubMedGoogle ScholarCrossref
23.
Hollander  JE, Carr  BG.  Virtually perfect? telemedicine for COVID-19.   N Engl J Med. 2020;382(18):1679-1681. doi:10.1056/NEJMp2003539 PubMedGoogle ScholarCrossref
24.
Verma  S. Early impact of CMS expansion of Medicare telehealth during COVID-19. Health Affairs. July 15, 2020. Accessed September 12, 2020. https://www.healthaffairs.org/do/10.1377/hblog20200715.454789/full/
25.
Choi  S, Wilcock  AD, Busch  AB,  et al.  Association of characteristics of psychiatrists with use of telemental health visits in the Medicare population.   JAMA Psychiatry. 2019;76(6):654-657. doi:10.1001/jamapsychiatry.2019.0052 PubMedGoogle ScholarCrossref
26.
Kaiser Family Foundation. State COVID-19 data and policy actions. February 10, 2022. Accessed November 21, 2022. https://www.kff.org/coronavirus-covid-19/issue-brief/state-data-and-policy-actions-to-address-coronavirus/
27.
Centers for Medicare & Medicaid Services. List of telehealth services. Accessed September 22, 2020. https://www.cms.gov/Medicare/Medicare-General-Information/Telehealth/Telehealth-Codes
28.
Cantor  JH, McBain  RK, Pera  MF, Bravata  DM, Whaley  CM.  Who is (and is not) receiving telemedicine care during the COVID-19 pandemic.   Am J Prev Med. 2021;61(3):434-438. doi:10.1016/j.amepre.2021.01.030 PubMedGoogle ScholarCrossref
29.
Fischer  SH, Uscher-Pines  L, Roth  E, Breslau  J.  The transition to telehealth during the first months of the COVID-19 pandemic: evidence from a national sample of patients.   J Gen Intern Med. 2021;36(3):849-851. doi:10.1007/s11606-020-06358-0 PubMedGoogle ScholarCrossref
30.
Busch  AB, Huskamp  HA, Raja  P, Rose  S, Mehrotra  A.  Disruptions in care for Medicare beneficiaries with severe mental illness during the COVID-19 pandemic.   JAMA Netw Open. 2022;5(1):e2145677. doi:10.1001/jamanetworkopen.2021.45677 PubMedGoogle ScholarCrossref
31.
Connolly  SL, Stolzmann  KL, Heyworth  L, Weaver  KR, Bauer  MS, Miller  CJ.  Rapid increase in telemental health within the Department of Veterans Affairs during the COVID-19 pandemic.   Telemed J E Health. 2021;27(4):454-458. doi:10.1089/tmj.2020.0233 PubMedGoogle ScholarCrossref
32.
Patel  SY, Mehrotra  A, Huskamp  HA, Uscher-Pines  L, Ganguli  I, Barnett  ML.  Variation in telemedicine use and outpatient care during the COVID-19 pandemic in the United States.   Health Aff (Millwood). 2021;40(2):349-358. doi:10.1377/hlthaff.2020.01786 PubMedGoogle ScholarCrossref
33.
Lipschitz  JM, Connolly  SL, Van Boxtel  R, Potter  JR, Nixon  N, Bidargaddi  N.  Provider perspectives on telemental health implementation: lessons learned during the COVID-19 pandemic and paths forward.   Psychol Serv. Published online February 24, 2022. doi:10.1037/ser0000625 PubMedGoogle ScholarCrossref
34.
Castlight Health. About us. Accessed September 24, 2020. https://www.castlighthealth.com/about/
35.
World Health Organization.  International Statistical Classification of Diseases and Related Health Problems, Tenth Revision (ICD-10). World Health Organization; 1992.
36.
Trump  DJ. Proclamation on declaring a national emergency concerning the novel coronavirus disease (COVID-19) outbreak. March 13, 2020. Accessed August 10, 2020. https://trumpwhitehouse.archives.gov/presidential-actions/proclamation-declaring-national-emergency-concerning-novel-coronavirus-disease-covid-19-outbreak/
37.
US Census Bureau. American Community Survey 5-year data (2009-2020). March 27, 2022. Accessed July 19, 2020. https://www.census.gov/data/developers/data-sets/acs-5year.html
38.
USAFacts. Understanding the COVID-19 pandemic. Updated November 13, 2022. Accessed November 21, 2022. https://usafacts.org/issues/coronavirus/
39.
US Bureau of Labor Statistics. Databases, tables and calculators by subject. Accessed September 22, 2020. https://www.bls.gov/data/#api
40.
Economic Research Service. State fact sheets. US Department of Agriculture. Accessed September 22, 2020. https://www.ers.usda.gov/data-products/state-fact-sheets/
41.
Wagner  AK, Soumerai  SB, Zhang  F, Ross-Degnan  D.  Segmented regression analysis of interrupted time series studies in medication use research.   J Clin Pharm Ther. 2002;27(4):299-309. doi:10.1046/j.1365-2710.2002.00430.x PubMedGoogle ScholarCrossref
42.
StataCorp. Stata Statistical Software: Release 15. StataCorp LLC; 2017.
43.
Vahratian  A, Blumberg  SJ, Terlizzi  EP, Schiller  JS.  Symptoms of anxiety or depressive disorder and use of mental health care among adults during the COVID-19 pandemic—United States, August 2020-February 2021.   MMWR Morb Mortal Wkly Rep. 2021;70(13):490-494. doi:10.15585/mmwr.mm7013e2 PubMedGoogle ScholarCrossref
44.
Centers for Disease Control and Prevention. Managing healthcare operations during COVID-19. Updated February 8, 2021. Accessed November 21, 2022. https://www.cdc.gov/coronavirus/2019-ncov/hcp/facility-planning-operations.html
45.
Haffajee  RL, Mello  MM.  Thinking globally, acting locally—the US response to COVID-19.   N Engl J Med. 2020;382(22):e75. doi:10.1056/NEJMp2006740 PubMedGoogle ScholarCrossref
46.
US Department of Health and Human Services. Notification of enforcement discretion for telehealth remote communications during the COVID-19 nationwide public health emergency. Accessed November 21, 2022. https://www.hhs.gov/hipaa/for-professionals/special-topics/emergency-preparedness/notification-enforcement-discretion-telehealth/index.html
47.
Center for Connected Health Policy. State telehealth laws and reimbursement policies: at a glance, spring 2021. Accessed November 21, 2022. https://www.cchpca.org/2021/04/Spring2021_Infographic-1.pdf
48.
Lau  J, Knudsen  J, Jackson  H,  et al.  Staying connected in the COVID-19 pandemic: telehealth at the largest safety-net system in the United States.   Health Aff (Millwood). 2020;39(8):1437-1442. doi:10.1377/hlthaff.2020.00903 PubMedGoogle ScholarCrossref
49.
Cai  C, Woolhandler  S, Himmelstein  DU, Gaffney  A. Trends in anxiety and depression symptoms during the COVID-19 pandemic: results from the US Census Bureau’s Household Pulse Survey. J Gen Intern Med. 2021;36(6):1841-1843. doi:10.1007/s11606-021-06759-9Crossref
50.
Reed  ME, Huang  J, Graetz  I,  et al.  Patient characteristics associated with choosing a telemedicine visit vs office visit with the same primary care clinicians.   JAMA Netw Open. 2020;3(6):e205873. doi:10.1001/jamanetworkopen.2020.5873 PubMedGoogle ScholarCrossref
51.
Lam  K, Lu  AD, Shi  Y, Covinsky  KE.  Assessing telemedicine unreadiness among older adults in the United States during the COVID-19 pandemic.   JAMA Intern Med. 2020;180(10):1389-1391. doi:10.1001/jamainternmed.2020.2671 PubMedGoogle ScholarCrossref
52.
Berryhill  MB, Culmer  N, Williams  N,  et al.  Videoconferencing psychotherapy and depression: a systematic review.   Telemed J E Health. 2019;25(6):435-446. doi:10.1089/tmj.2018.0058 PubMedGoogle ScholarCrossref
53.
Ekeland  AG, Bowes  A, Flottorp  S.  Effectiveness of telemedicine: a systematic review of reviews.   Int J Med Inform. 2010;79(11):736-771. doi:10.1016/j.ijmedinf.2010.08.006 PubMedGoogle ScholarCrossref
×