[Skip to Navigation]
Sign In
Figure.  Study Flow of the Moving to Opportunity Long-term Follow-up Evaluation of Adolescents
Study Flow of the Moving to Opportunity Long-term Follow-up Evaluation of Adolescents

aTarget respondents for the adolescent long-term evaluation included all baseline residents of randomized households who were aged 0 through 8 years at randomization from 1994 to 1998, aged 13 through 17 years at selection in December 2007, and aged 13 through 19 years at interview from June 2008 to April 2010. All adolescents in the eligible age range who lived at baseline in households containing 3 or fewer youth between 10 and 20 years were targeted for follow-up, whereas a random 3 were targeted from baseline households with 4 or more youth. A weight of n/3, for which n equals the number of eligible youths in the baseline household, was used to adjust for the undersampling of youths from baseline households containing more than 3 eligible youth. Phase 1 data collection refers to the efforts made to contact and interview all target respondents until the end of the field period, at which point a random 35% of eligible target respondents (those who had not yet been interviewed, were not deceased or incapacitated, had not declined to participate) were selected for a more intensive Phase 2 data collection effort that included expanded tracing efforts and increased financial incentives. A weight of 1/.35 was used to adjust for the undersampling of the Phase 2 hard-to-recruit youths who were interviewed.
bFor the 693 families excluded before randomization, the number excluded for each reason listed above is not known.

Table 1.  Baseline Characteristics of the Moving to Opportunity Adolescent Boy Long-term Evaluation Sample Groups
Baseline Characteristics of the Moving to Opportunity Adolescent Boy Long-term Evaluation Sample Groups
Table 2.  Baseline Characteristics of the Moving to Opportunity Adolescent Girl Long-term Follow-up Evaluation Sample Groups
Baseline Characteristics of the Moving to Opportunity Adolescent Girl Long-term Follow-up Evaluation Sample Groups
Table 3.  Baseline Moving to Opportunity Neighborhood Characteristics
Baseline Moving to Opportunity Neighborhood Characteristics
Table 4.  Associations of the Interventions With Mental Disorders in the Long-term Follow-up Sample of Adolescent Boys and Girls Combined
Associations of the Interventions With Mental Disorders in the Long-term Follow-up Sample of Adolescent Boys and Girls Combined
Table 5.  Associations of the Interventions With Mental Disorders in the Long-term Follow-up Sample of Adolescent Boys vs Girls Separately
Associations of the Interventions With Mental Disorders in the Long-term Follow-up Sample of Adolescent Boys vs Girls Separately
1.
Leventhal  T, Dupere  V, Brooks-Gunn  J. Neighborhood influences on adolescent development. In: Lerner  RM, Steinberg  L, eds.  Handbook of Adolescent Psychology. Hoboken, NJ: Wiley; 2009:411-443.
2.
Galster  GC. The mechanism(s) of neighborhood effects: Theory, evidence, and policy implications. In: van Ham  M, Manley  D, Bailey  N, Simpson  L, Maclennan  D, eds.  Neighborhood Effects Research: New Perspectives. New York, NY: Springer; 2012:23-56.
3.
Diez Roux  AV, Mair  C.  Neighborhoods and health.  Ann N Y Acad Sci. 2010;1186:125-145.PubMedGoogle ScholarCrossref
4.
Bhui  KS, Lenguerrand  E, Maynard  MJ, Stansfeld  SA, Harding  S.  Does cultural integration explain a mental health advantage for adolescents?  Int J Epidemiol. 2012;41(3):791-802.PubMedGoogle ScholarCrossref
5.
Centers for Disease Control and Prevention.  Healthy communities program.http://www.cdc.gov/healthycommunitiesprogram/. Accessed May 1, 2013.
6.
Feins  JD, Holin  MJ, Phipps  AA, Magri  D.  Implementation assistance and evaluation for the Moving to Opportunity Demonstration: final report.http://www.abtassociates.com/reports/D19950045.pdf. 1995. Accessed October 6, 2006.
7.
Feins  JD, Hollin  MJ, Phipps  A.  Moving to Opportunity for Fair Housing Demonstration: Program operations manual (revised).http://www.abtassociates.com/reports/D19960002.pdf. 1996. Accessed October 6, 2010.
8.
Orr  L, Feins  JD, Jacob  R,  et al.  Moving to Opportunity for Fair Housing Demonstration Program: Interim Impacts Evaluation. Washington, DC: US Dept of Housing and Urban Development, Office of Policy Development and Research; 2003.
9.
Kling  JR, Liebman  JB, Katz  LF.  Experimental analysis of neighborhood effects.  Econometrica. 2007;75(1):83-119.Google ScholarCrossref
10.
Leventhal  T, Dupéré  V.  Moving to Opportunity: does long-term exposure to “low-poverty” neighborhoods make a difference for adolescents?  Soc Sci Med. 2011;73(5):737-743.PubMedGoogle Scholar
11.
Osypuk  TL, Tchetgen  EJ, Acevedo-Garcia  D,  et al.  Differential mental health effects of neighborhood relocation among youth in vulnerable families: results from a randomized trial.  Arch Gen Psychiatry. 2012;69(12):1284-1294.PubMedGoogle ScholarCrossref
12.
Deluca  HF.  Guest editor’s introduction.  Arch Biochem Biophys. 2012;523(1):1-28.PubMedGoogle ScholarCrossref
13.
Ludwig  J, Duncan  GJ, Gennetian  LA,  et al.  Neighborhood effects on the long-term well-being of low-income adults.  Science. 2012;337(6101):1505-1510.PubMedGoogle ScholarCrossref
14.
Ludwig  J, Sanbonmatsu  L, Gennetian  L,  et al.  Neighborhoods, obesity, and diabetes—a randomized social experiment.  N Engl J Med. 2011;365(16):1509-1519.PubMedGoogle ScholarCrossref
15.
Gennetian  LA, Sciandra  M, Sanbonmatsu  L,  et al.  The long-term effects of Moving to Opportunity on youth outcomes.  Cityscape (Wash, DC). 2012;14(2):137-168.Google Scholar
16.
Goering  J, Feins  JD, Richardson  TM. What have we learned from housing mobility and poverty deconcentration? In: Goering  J, Feins  JD, eds.  Choosing a Better Life? Washington, DC: Urban Institute Press; 2003:3-36.
17.
US Bureau of the Census.  Census tracts and block numbering areas.http://www.census.gov/history/www/programs/geography/tracts_and_block_numbering_areas.html. Accessed March 5, 2011.
18.
Olsen  EO. Housing programs for low-income households. In: Moffitt  RA, ed.  Means-Tested Transfer Programs in the United States. Chicago, IL: University of Chicago Press; 2003:365-442.
19.
Gebler  N, Hudson  ML, Sciandra  M, Gennetian  LA, Ward  B.  Achieving MTO’s high effective response rates: strategies and tradeoffs.  Cityscape (Wash, DC). 2012;14(2):57-86.Google Scholar
20.
Rubin  DB.  Multiple imputation after 18+ years.  J Am Stat Assoc. 1996;91(434):473-489.Google ScholarCrossref
21.
 SAS/STAT Software [computer program], Version 9.2 for Unix. Cary, NC: SAS Institute Inc; 2008.
22.
Kessler  RC, Ustün  TB.  The World Mental Health (WMH) survey initiative version of the World Health Organization (WHO) Composite International Diagnostic Interview (CIDI).  Int J Methods Psychiatr Res. 2004;13(2):93-121.PubMedGoogle ScholarCrossref
23.
Kessler  RC, Avenevoli  S, Green  J,  et al.  National comorbidity survey replication adolescent supplement (NCS-A); III: concordance of DSM-IV/CIDI diagnoses with clinical reassessments.  J Am Acad Child Adolesc Psychiatry. 2009;48(4):386-399.PubMedGoogle ScholarCrossref
24.
Gravel  J, Opatrny  L, Shapiro  S.  The intention-to-treat approach in randomized controlled trials: are authors saying what they do and doing what they say?  Clin Trials. 2007;4(4):350-356.PubMedGoogle ScholarCrossref
25.
Hosmer  DW, Lemeshow  S.  Applied Logistic Regression.2nd ed. New York, NY: Wiley; 2001.
26.
Wolter  KM.  Introduction to Variance Estimation. New York, NY: Springer-Verlag; 1985.
27.
 SUDAAN [computer program], Release 10.0.1. Research Triangle Park, NC: Research Triangle Institute; 2009.
28.
Kessler  RC, Avenevoli  S, Costello  EJ,  et al.  Prevalence, persistence, and sociodemographic correlates of DSM-IV disorders in the National Comorbidity Survey Replication Adolescent Supplement.  Arch Gen Psychiatry. 2012;69(4):372-380.PubMedGoogle ScholarCrossref
29.
McLaughlin  KA, Greif Green  J, Gruber  MJ, Sampson  NA, Zaslavsky  AM, Kessler  RC.  Childhood adversities and first onset of psychiatric disorders in a national sample of US adolescents.  Arch Gen Psychiatry. 2012;69(11):1151-1160.PubMedGoogle ScholarCrossref
30.
Benjamini  Y, Hochberg  Y.  Controlling the false discovery rate: a practical and powerful approach to multiple testing.  J R Stat Soc Series B. 1995;57(1):289-300.Google Scholar
31.
American Association for Public Opinion Research.  Standard definitions.http://www.aapor.org/Standard_Definitions/1481.htm. Accessed April 12, 2012.
32.
Briggs  X, Popkin  SJ, Goering  J.  Moving to Opportunity: The Story of an American Experiment to Fight Ghetto Poverty. New York, NY: Oxford University Press; 2010.
33.
Carter  PL.  “Black” cultural capital, status positioning, and schooling conflicts for low-income African American youth.  Soc Probl. 2003;50(1):136-155.Google ScholarCrossref
34.
Clampet-Lundquist  S, Kling  JR, Edin  K, Duncan  GJ.  Moving teenagers out of high-risk neighborhoods: how girls fare better than boys.  Am J Sociol. 2011;116(4):1154-1189.PubMedGoogle ScholarCrossref
35.
Sareen  J, Cox  BJ, Afifi  TO,  et al.  Combat and peacekeeping operations in relation to prevalence of mental disorders and perceived need for mental health care: findings from a large representative sample of military personnel.  Arch Gen Psychiatry. 2007;64(7):843-852.PubMedGoogle ScholarCrossref
36.
US Department of Housing and Urban Development.  Public housing: image vs facts.http://www.huduser.org/periodicals/ushmc/spring95/spring95.html. Accessed May 1, 2013.
37.
Congressional Budget Office.  Growth in means-tested programs and tax credits for low income households.http://www.cbo.gov/publication/43935. Accessed May 12, 2013.
38.
Shroder  MD.  Locational constraint, housing counseling, and successful lease-up in a randomized housing voucher experiment.  J Urban Econ. 2002;51(2):315-338.Google ScholarCrossref
39.
Goering  J, Kraft  J, Feins  D, McInnis  D, Holin  MJ, Elhassan  H.  Moving to Opportunity for Fair Housing Demonstration Program: Current Status and Initial Findings. Washington, DC: US Dept of Housing and Urban Development; 1999.
40.
Lee  MA, Mather  M.  US labor force trends.  Popul Bull. 2008;63(2):1-16.PubMedGoogle Scholar
Original Investigation
March 5, 2014

Associations of Housing Mobility Interventions for Children in High-Poverty Neighborhoods With Subsequent Mental Disorders During Adolescence

Author Affiliations
  • 1Department of Health Care Policy, Harvard Medical School, Boston, Massachusetts
  • 2School of Education, University of California Irvine, Irvine
  • 3National Bureau of Economic Research, Cambridge, Massachusetts
  • 4Department of Economics, Harvard University, Cambridge, Massachusetts
  • 5Congressional Budget Office, Washington, DC
  • 6Harris School of Public Policy, University of Chicago, Chicago, Illinois
JAMA. 2014;311(9):937-947. doi:10.1001/jama.2014.607
Abstract

Importance  Youth in high-poverty neighborhoods have high rates of emotional problems. Understanding neighborhood influences on mental health is crucial for designing neighborhood-level interventions.

Objective  To perform an exploratory analysis of associations between housing mobility interventions for children in high-poverty neighborhoods and subsequent mental disorders during adolescence.

Design, Setting, and Participants  The Moving to Opportunity Demonstration from 1994 to 1998 randomized 4604 volunteer public housing families with 3689 children in high-poverty neighborhoods into 1 of 2 housing mobility intervention groups (a low-poverty voucher group vs a traditional voucher group) or a control group. The low-poverty voucher group (n=1430) received vouchers to move to low-poverty neighborhoods with enhanced mobility counseling. The traditional voucher group (n=1081) received geographically unrestricted vouchers. Controls (n=1178) received no intervention. Follow-up evaluation was performed 10 to 15 years later (June 2008-April 2010) with participants aged 13 to 19 years (0-8 years at randomization). Response rates were 86.9% to 92.9%.

Main Outcomes and Measures  Presence of mental disorders from the Diagnostic and Statistical Manual of Mental Disorders (Fourth Edition) within the past 12 months, including major depressive disorder, panic disorder, posttraumatic stress disorder (PTSD), oppositional-defiant disorder, intermittent explosive disorder, and conduct disorder, as assessed post hoc with a validated diagnostic interview.

Results  Of the 3689 adolescents randomized, 2872 were interviewed (1407 boys and 1465 girls). Compared with the control group, boys in the low-poverty voucher group had significantly increased rates of major depression (7.1% vs 3.5%; odds ratio (OR), 2.2 [95% CI, 1.2-3.9]), PTSD (6.2% vs 1.9%; OR, 3.4 [95% CI, 1.6-7.4]), and conduct disorder (6.4% vs 2.1%; OR, 3.1 [95% CI, 1.7-5.8]). Boys in the traditional voucher group had increased rates of PTSD compared with the control group (4.9% vs 1.9%, OR, 2.7 [95% CI, 1.2-5.8]). However, compared with the control group, girls in the traditional voucher group had a decreased rate of conduct disorder (0.3% vs 2.9%; OR, 0.1 [95% CI, 0.0-0.4]).

Conclusions and Relevance  Interventions to encourage moving out of high-poverty neighborhoods were associated with increased rates of depression, PTSD, and conduct disorder among boys and a reduced rate of conduct disorder among girls. Better understanding of interactions among individual, family, and neighborhood risk factors is needed to guide future public housing policy changes.

Introduction

Observational studies have consistently found that youth in high-poverty neighborhoods have high rates of emotional problems even after controlling for individual-level risk factors.1 These findings raise the possibilities that neighborhood characteristics affect emotional functioning2 and neighborhood-level interventions may reduce emotional problems. Available data from observational studies are unclear and subject to selection bias and the possibility of reverse causality (ie, families with emotional problems end up in poorer neighborhoods). Despite this uncertainty, presumptive neighborhood effects have been characterized,3 causal pathways have been hypothesized,4 and interventions have been implemented.5

It is important to evaluate these causal claims regarding neighborhood effects experimentally. The US Department of Housing and Urban Development (HUD) enacted a housing mobility experiment known as the Moving to Opportunity for Fair Housing Demonstration by randomizing volunteer low-income public housing families with children to receive vouchers to move to lower-poverty neighborhoods.6,7 An interim evaluation 4 to 7 years after randomization showed that the intervention caused families to move to better neighborhoods with lower poverty and crime rates and increased social ties with more affluent people.8 Significant reductions in psychological distress and depression were also found among adolescent girls in the intervention group vs the control group but increased behavior problems were found among adolescent boys in the intervention group vs the control group.9-11 Given the importance of these sex differences, clinically significant mental disorders were included in a long-term (10-15 years after randomization) follow-up assessment. Prior long-term follow-up reports documented effects on improved neighborhood characteristics,12,13 reduced adult extreme obesity and diabetes,14 and improved adult subjective well-being.13 No detectable effects on economic self-sufficiency were found.13 Although long-term evaluation found significantly reduced psychological distress among adolescent girls,15 measures of mental disorders were not examined in previous reports.

The primary objectives of the Moving to Opportunity study were to move families to lower-poverty neighborhoods and increase educational achievement and economic self-sufficiency. Mental disorders were measured as post hoc outcomes. The current report presents the first exploratory analyses evaluating long-term associations of housing mobility randomization with mental disorders among participants who were in early childhood at randomization and adolescence at follow-up.

Methods
Study Design

Quiz Ref IDFamilies (n=4604) in the Moving to Opportunity study were recruited by public housing authorities from 1994 to 1998.16 Families had to reside in public or project-based assisted housing in high-poverty census tracts (>40% of families in poverty) in Baltimore, Boston, Chicago, Los Angeles, or New York; be eligible for Section 8 housing; and have 1 or more children age younger than 18 years. Census tracts contain 2500 to 8000 people and are defined by the US Census Bureau to be “homogeneous with respect to population characteristics, economic status, and living conditions.”17 Housing authorities sent recruitment letters, held information sessions, and asked families to complete applications within 4 weeks of the invitation. Signed consents and baseline questionnaires were obtained during intake sessions prior to randomization. Families were then randomized into 1 of 3 groups using a computerized random-number generator: a low-poverty voucher group, a traditional voucher group, or a control group. In the low-poverty voucher group, families were offered a standard rent-subsidy voucher restricted to low-poverty census tracts (<10% of families in poverty). Vouchers provided subsidies for private-market housing equal to the difference between a rent threshold and the family’s rent contribution (30% of income, identical to public housing).18 Families remained eligible for vouchers as long as they met income and other criteria. Families also received short-term housing counseling during their initial housing search.6,7 After 1 year, families in the low-poverty voucher group could use their voucher to relocate to a different tract, including those with higher-poverty rates, or could remain in the tract where they originally moved even if the poverty rate of that tract fell out of the low-poverty range. In the traditional voucher group, families were offered a standard rent-subsidy voucher without restriction on location as well as standard mobility counseling.6,7 In the control group, families were offered no new assistance. Enhanced mobility counseling was offered to low-poverty voucher group families because of restrictions on where they could move. The protocol was approved by the Office of Management and Budget and HUD. Twenty-three percent of invited families applied,6 and ultimately 48% of low-poverty voucher families and 63% of traditional voucher families used their vouchers to move.7

Interim (4-7 years after randomization) and long-term (10-15 years after randomization) evaluation surveys were carried out with household heads and residents who were children at baseline randomization and adolescents at follow-up. Most adolescents in the interim evaluation were in middle childhood or early adolescence (ages 9-16 years) at randomization, whereas most adolescents in the long-term evaluation were in early childhood (ages 0-8 years) at randomization. Long-term assessments were performed June 2008 through April 2010 by interviewers blinded to group assignment. All adolescents from households with 1 to 3 baseline children and 3 randomly selected adolescents from households with 4 or more baseline children were targeted for interview. Large households were purposely undersampled to reduce household burden.

Recruitment for long-term assessment began with telephone tracking and networking to locate hard-to-recruit participants. Potential respondents were offered $50 for completing interviews. Although most interviews were performed face-to-face, some were performed by telephone. Of the hard-to-recruit nonrespondents, 35% were randomly selected for intensive recruitment with increased financial incentives.19(p64) Written informed parental consent and adolescent assent were obtained before interviews. These procedures were approved by the Office of Management and Budget, HUD, and the institutional review boards of the National Bureau of Economic Research, University of Chicago, University of Michigan, and Northwestern University.

Measures

Baseline head-of-household questionnaires focused largely on sociodemographics and neighborhood experiences (eg, social networks and crime victimization). Mental disorders were not assessed. Item-level missing data on the variables assessed was less than 5% for all but 5 variables (low birth weight; hospitalization before first birthday; baseline health problems that restricted normal activities; parent educational level; whether someone read to the child more than once daily during his/her early childhood; 5.5% to 11.2% missing). There were no missing values on the intervention variables. Item-level missing data were imputed using multiple imputation20 using SAS software.21

The long-term assessment included the Composite International Diagnostic Interview (CIDI),22 a widely used psychiatric diagnostic evaluation tool known to have good concordance with clinical diagnoses of mental disorders based on the Diagnostic and Statistical Manual of Mental Disorders (Fourth Edition) (DSM-IV).23 The CIDI questions were read word-for-word and responses recorded in prespecified (mostly yes/no) format. Diagnoses were generated by CIDI algorithms operationalizing DSM-IV inclusion criteria. Diagnoses were made for DSM-IV disorders present within the past 12 months. Item-level missing data were less than 1% for each symptom question and were recoded conservatively to assume the symptom was absent. We focused on 6 DSM-IV/CIDI disorders: mood (major depression), anxiety (panic, posttraumatic stress), and disruptive behavior (oppositional-defiant, intermittent explosive, conduct). Bipolar disorder was also assessed, but was not analyzed due to low prevalence and insufficient statistical power to detect meaningful associations (eTable 1 in Supplement 1).

Statistical Analysis

Sample size was determined by the Moving to Opportunity study budget ($70 million Congressional authorization, additional vouchers from local housing authorities, and counseling donated by nonprofit agencies). Randomization was designed to yield equal numbers of families within cities using vouchers in each intervention group. The number of families in the control group invited was set to equal the mean number invited in the 2 intervention groups. As voucher use percentages were determined only after randomization, proportions randomized across groups were modified during the study to adjust for observed rates of voucher use. The HUD determined that this design would yield 80% power to detect an effect of $2000 in increased earnings in each intervention group with a one-sided α of .05.6(pE-4,exhibit,E4) Post hoc power calculations showed that the long-term follow-up sample of adolescents had at least 80% power to detect an odds ratio (OR) for each of the 6 mental disorders considered herein of 1.4-1.8 (eTable 1 in Supplement 1).

Intention-to-treat24 logistic regression analysis25 was used to estimate associations of the interventions with the outcomes. Across-time variation in the intervention vs control group selection ratios from 1994 to 1998 was corrected for by weighting. Case-level multiple imputation based on 20 pseudosamples was used to adjust for the fact that not all baseline participants completed follow-up interviews. The Taylor series method26 implemented in SUDAAN27 was used to adjust for weighting and clustering (cities, housing projects, families). The significance of sex differences was assessed by estimating a logistic regression equation to predict each disorder that included dummy variables for each intervention, a dummy variable for sex, and 2 dummy variables for the interactions of interventions with sex. A 2-degree-of-freedom χ2 test was used to evaluate the significance of the interactions. In cases for which the test was significant, associations of the interventions with the disorder were considered separately for each sex. The evaluation of sex differences was carried out because significant sex differences had been found in previous interim evaluations.9-11 The 6 mental disorders were considered separately because risk factors vary across these disorders.28,29 The Benjamini-Hochberg method30 was used to adjust significance tests across outcomes for the false discovery rate.

Logistic regression coefficients and standard errors were exponentiated to create ORs and 95% confidence intervals. Mental disorder prevalence estimates in the intervention and control groups were used to calculate absolute risk (AR) and absolute risk reduction (ARR). The jack-knife repeated replications method in SAS26 was used to generate confidence intervals for the estimates of AR and ARR. Statistical significance was evaluated using a 2-sided α of .05.

Results
Response Rates

The 3689 adolescents assessed were aged 0 through 8 years (median age, 4 years) at baseline and aged 13 through 19 years (median age, 16 years) at the time of long-term follow-up interviews. A total of 2872 adolescents were interviewed (1407 boys and 1465 girls from 2134 families), including 1165 in the low-poverty voucher group (843 families), 799 in the traditional voucher group (615 families), and 908 in the control group (676 families), out of the 3689 eligible in the baseline sample (77.8% participation rate). An additional 643 adolescents were randomly excluded (188 from families with >4 eligible respondents and 455 due to difficult recruitment) and 174 were lost to follow-up (including 18 deceased) (Figure). The weighted response rates were 92.9% (low-poverty voucher group), 86.9% (traditional voucher group), and 89.4% (control group) using the American Association of Public Opinion Research definition.31(p51) Respondents were more likely to be girls and non-Hispanic black but did not differ significantly from nonrespondents on other baseline personal, family, and neighborhood characteristics (eTable 2 in Supplement 1).

Sample Characteristics

Baseline sociodemographic characteristics of adolescents were largely comparable across the 3 groups for both boys (Table 1) and girls (Table 2). Most respondents were non-Hispanic black (61.8%-66.2% of groups) or Hispanic (27.7%-33.2% of groups). The majority of respondents were ages 0 through 5 years at baseline (82.2%-87.9% of groups), with mean age of 3.6 years in each group and range of 0 through 7 years in the low-poverty voucher group and 0 through 8 years in traditional voucher and control groups. The majority of baseline families received Aid to Families with Dependent Children (79.1%-85.1% of groups). Mean baseline neighborhood poverty rates were 53.6% to 54.9% (Table 3).

Mental Disorder Prevalence Within the Past 12 Months

The most prevalent mental disorders within the past 12 months were found to be intermittent explosive disorder (14.2% of boys and 16.0% of girls) and oppositional-defiant disorder (6.8% of boys and 8.4% of girls), followed by major depressive disorder (5.5% of boys and 7.9% of girls), posttraumatic stress disorder (PTSD) (4.4% of boys and 6.6% of girls), conduct disorder (4.3% of boys and 1.6% of girls), and panic disorder (4.1% of boys and 3.7% of girls) (eTable 3 in Supplement 1).

Associations of Interventions With Mental Disorders Among Boys and Girls Combined

Adjusting for the false discovery rate, respondents in the low-poverty voucher group had significantly elevated prevalence of PTSD (7.2% [95% CI, 5.7%-8.6%]; OR, 1.8 [95% CI, 1.2-2.7]) compared with the control group (4.2% [95% CI, 3.2%-5.2%]) (Table 4). None of the other 11 comparisons of low-poverty or traditional voucher groups with the control group was significant. Odds ratios comparing the low-poverty voucher group with the control group were in the range 0.7-1.6 (P = .13-.84). Odds Ratios comparing the traditional voucher group with the control group were in the range of 0.9-1.1 (P = .70).

After adjusting for the false discovery rate, the ORs comparing the low-poverty and traditional voucher groups with the control group varied significantly by respondent sex for 3 of the 6 outcomes: major depression (χ22 = 14.1, P = .007), PTSD (χ22 = 9.0, P = .03), and conduct disorder (χ22 = 11.7, P = .01). Odds ratios were not significantly different by sex for panic disorder (χ22 = 6.2, P = .08), oppositional-defiant disorder (χ22 = 4.4, P = .16), or intermittent explosive disorder (χ22 = 1.3, P = .60). Based on these results, the remaining analyses focused on major depression, PTSD, and conduct disorder separately for boys and girls.

Associations of Interventions With Mental Disorders Among Boys

Adjusting for the false discovery rate, boys had significantly elevated rates of major depression in the low-poverty voucher group (7.1% [95% CI, 4.1%-10.1%]; OR, 2.2 [95% CI, 1.2-3.9]) compared with the control group (3.5% [95% CI, 2.3%-4.6%]), elevated rates of PTSD in both the low-poverty voucher group (6.2% [95% CI, 4.7%-7.7%]; OR, 3.4 [95% CI, 1.6-7.4]) and the traditional voucher group (4.9% [95% CI, 3.0%-6.8%]; OR, 2.7 [95% CI, 1.2-5.8]) compared with the control group (1.9% [95% CI, 0.9%-2.9%]), and of conduct disorder in the low-poverty voucher group (6.4% [95% CI, 4.7%-8.1%]; OR, 3.1 [95% CI, 1.7-5.8]) compared with the control group (2.1% [95% CI, 1.1%-3.2%]) (Table 5). Neither of the other 2 comparisons between intervention and control groups was significantly different, with ORs in the range 1.7-2.0 (P = .23).

Associations of Interventions With Mental Disorders Among Girls

Adjusting for the false discovery rate, girls in the traditional voucher intervention group had a significantly reduced rate of conduct disorder in the traditional voucher group (0.3% [95% CI, −0.1%-0.7%]; OR, 0.1 [95% CI, 0.0-0.4]) compared with the control group (2.9% [95% CI, 1.1%-4.7%]) (Table 5). The number needed to treat (NNT) (inverse of ARR) among girls was 38 for conduct disorder. None of the other 5 comparisons between intervention and control groups was significantly different, with ORs in the range 0.5-1.2 (P = .06-.40).

Discussion

Our post hoc exploratory analysis found that interventions to encourage moving out of high-poverty neighborhoods were associated with increased depression, PTSD, and conduct disorder among adolescent boys and reduced conduct disorder among adolescent girls randomized at ages 0 through 8 years. These sex differences were broadly consistent with interim follow-up results in suggesting that girls profited more than boys from moving to better neighborhoods.8,9,11 An exception is that the interim analysis found that the intervention led to significantly reduced prevalence of major depression among girls, whereas this association was not significant in the current analysis either among girls in the low-poverty voucher group (6.5% [95% CI, 4.7%-8.3%]; OR, 0.6 [95% CI, 0.3-1.0]) or among girls in the traditional voucher group (6.5% [95% CI, 4.5%-8.4%]; OR, 0.6 [95% CI, 0.3-0.9]) compared with the control group (10.9% [95% CI, 8.4%-13.4%]), P = .06 for the OR in each of these 2 comparisons when corrected for false discovery rate. Qualitative evidence obtained in the interim evaluation suggested that the finding that the intervention had negative effects on boys but not girls was due to sex differences in both neighborhood experiences and in the social skills needed to capitalize on the new opportunities presented by their improved neighborhoods.32-34 Although the magnitudes of these significant associations of the interventions with mental disorders were modest in the intention-to-treat analyses, these estimates would be larger if the analyses were restricted to movers. It is also noteworthy that these ORs are comparable in size with those published in studies of risk factors considered to be of high policy significance. For example, the elevated OR of PTSD found among low-poverty voucher boys is comparable in size to the ORs found between combat exposure and PTSD in epidemiological studies of the military.35 Furthermore, it is important to recognize that these associations were evaluated 10 to 15 years after randomization. It is not clear if the magnitudes of the associations were stable over this entire time, but if so, they would be substantial despite the relatively high NNT.

External validity was reduced by the fact that only 23% of eligible families volunteered for the Moving to Opportunity study. However, the public housing population is large and therefore even this small fraction represents more than 300 000 low-income US children,36 making the volunteer families significant from a policy perspective even though they were only a minority of all public housing families. A question might be raised about whether the added costs of developing a special housing intervention for such a small proportion of public housing recipients could be justified by the small proportion accepting the offer, but this concern is mitigated by the fact that many housing economists believe the true costs of housing vouchers are actually lower than those of conventional public housing because of the increased efficiency of the open housing market.18

It is nonetheless difficult to draw policy implications from these results, because the findings suggest that the interventions might have had harmful effects on boys but protective effects on girls. Future governmental decisions regarding widespread implementation of changes in public housing policy will have to grapple with this complexity based on the realization that no policy decision will have benign effects on both boys and girls. One way to do so might be to develop more nuanced assignment rules than currently exist or additional intervention elements to mitigate the adverse effects of the intervention on boys while maintaining the protective effects on girls.

Development of such refinements will require a better understanding of the interactions of influences among individual, family, and neighborhood characteristics leading to child and adolescent mental disorders. Although the Moving to Opportunity study was not designed to produce this kind of understanding, these results should create an impetus to do so by documenting that neighborhoods do matter. The challenge for future research is to increase understanding enough to guide allocation of the substantial amount of money spent on public housing in the United States each year (more than $36 billion in fiscal year 2012)37 to maximize the health and well-being of all family members rather than to maximize value for some family members at the expense of other family members.

The Moving to Opportunity study had several strengths, including an experimental design, large sample size, and long follow-up. However, it also had several noteworthy limitations: only 23% of eligible families volunteered, and families offered vouchers had rather severe time limits on enrollment and practical constraints on finding new housing that might have artificially reduced uptake.38 These factors may reduce the generalizability of the results.39 Other limitations include the fact that nonrespondents might have differed systematically from respondents; that the experiment was implemented when the unemployment rate was much lower than it is today;40 that the CIDI and other mental health measures were not administered at baseline; and that, as with all policy experiments, the study design made it impossible to trace intervening processes that might account for aggregate intervention effects. In addition, the Moving to Opportunity study was underpowered to detect effects of the 2 separate intervention groups on uncommon adolescent mental disorders.

Despite these limitations, we found significant associations of the study interventions to reduce neighborhood-level poverty with several important adolescent mental disorders, providing evidence that experimental manipulation of incentives to move is associated with adolescent emotional functioning. However, because the interventions were also associated with changes in many other aspects of neighborhoods and participant experiences, pathways accounting for the associations of the interventions with adolescent mental disorders remain unclear, creating a challenge for future research to develop nuanced decision rules for matching public housing families with neighborhoods to maximize the health and well-being of all family members.

Conclusions

Interventions to encourage moving out of high-poverty neighborhoods were associated with increased rates of depression, PTSD, and conduct disorder among boys and a reduced rate of conduct disorder among girls. Better understanding of interactions among individual, family, and neighborhood risk factors is needed to guide future public housing policy changes.

Back to top
Article Information

Corresponding Author: Ronald C. Kessler, PhD, Department of Health Care Policy, Harvard Medical School, 180 Longwood Ave, Boston, MA 02115 (kessler@hcp.med.harvard.edu).

Retraction and Replacement: This article was retracted and replaced on June 17, 2016, to fix errors in the abstract, text, Table 4, Table 5, and the References (see Supplement 2 for the retracted article with corrections shown).

Author Contributions: Drs Kessler and Ludwig had full access to all of the data in the study and take responsibility for the integrity of the data and accuracy of the data analysis.

Study concept and design: Kessler, Duncan, Gennetian, Katz, Kling, Sanbonmatsu, Ludwig.

Acquisition of data: Gennetian, Sanbonmatsu, Ludwig.

Analysis and interpretation of data: Kessler, Duncan, Gennetian, Katz, Kling, Sampson, Sanbonmatsu, Zaslavsky, Ludwig.

Drafting of the manuscript: Kessler.

Critical revision of the manuscript for important intellectual content: Duncan, Gennetian, Katz, Kling, Sampson, Sanbonmatsu, Zaslavsky, Ludwig.

Statistical analysis: Kessler, Duncan, Katz, Kling, Zasavsky, Ludwig.

Obtaining funding: Katz, Kling, Ludwig.

Study supervision: Kessler, Gennetian, Sampson, Sanbonmatsu, Zaslavsky, Ludwig.

Administrative, technical, or material support: Gennetian, Sanbonmatsu.

Conflict of Interest Disclosures: All authors have completed and submitted the ICMJE Form for Disclosure of Potential Conflicts of Interest. Dr Kessler reported that he has been a consultant for AstraZeneca, Analysis Group, Bristol-Myers Squibb, Cerner-Galt Associates, Eli Lilly, GlaxoSmithKline Inc, HealthCore Inc, Health Dialog, Hoffman-LaRoche Inc, Integrated Benefits Institute, J & J Wellness & Prevention Inc, John Snow Inc, Kaiser Permanente, Lake Nona Institute, Matria Inc, Mensante, Merck Inc, Ortho-McNeil Janssen Scientific Affairs, Pfizer Inc, Primary Care Network, Research Triangle Institute, sanofi-aventis, Shire US Inc, SRA International, Takeda Global Research & Development, Transcept Pharmaceuticals Inc, and Wyeth-Ayerst; has served on advisory boards for Appliance Computing II, Eli Lilly, Mindsite, Ortho-McNeil Janssen Scientific Affairs, Johnson & Johnson, Plus One Health Management, and Wyeth-Ayerst; has had research support for his epidemiological studies from Analysis Group Inc, Bristol-Myers Squibb, Eli Lilly & Company, EPI-Q, GlaxoSmithKline, Johnson & Johnson Pharmaceuticals, Ortho-McNeil Janssen Scientific Affairs, Pfizer Inc, sanofi-aventis, Shire US Inc, and Walgreens; and owns 25% share in DataStat Inc. Dr Gennetian reported that he has served on advisory boards for Family Self Sufficiency TWG, Administration for Children and Families, and National Opinion Research Center, University of Chicago. Dr Katz reported that he has served on advisory boards for Manpower Demonstration Research Corporation and the Russell Sage Foundation. Dr Ludwig reported that he serves on advisory boards (uncompensated) for Uhlich Children’s Advantage Network (Chicago), and the Board on Children, Youth and Families Institute of Medicine/National Academy of Sciences; and has served as a consultant for the MacArthur Foundation Network on Children and Housing and the MDRC Early Childhood Institute. The remaining authors report no conflicts of interest.

Funding/Support: Support for the current report was provided by a grant from the US Department of Housing and Urban Development (HUD) (C-CHI-00808). Additional funders include: the National Science Foundation (SES-0527615), the National Institute for Child Health and Human Development (R01-HD040404, R01-HD040444), the US Centers for Disease Control and Prevention (R49-CE000906), the National Institute of Mental Health (R01-MH077026), the National Institute on Aging (P30 AG012810, R01-AG031259, P01-AG005842-22S1), the National Opinion Research Center’s Population Research Center (through R24-HD051152-04 from the National Institute of Child Health and Human Development), the University of Chicago Center for Health Administration Studies, the US Department of Education/Institute of Education Sciences (R305U070006), the John D. and Catherine T. MacArthur Foundation, the Smith Richardson Foundation, the SpencerFoundation, the Annie E. Casey Foundation, the Bill & Melinda Gates Foundation, and the Russell Sage Foundation. The work of Dr Duncan was additionally supported in part by a Robert Wood JohnsonFoundation Investigator in Health Policy award, while the work of Dr Ludwig was additionally supported in part by a Robert Wood Johnson Foundation Investigator in Health Policy award, a Russell Sage Foundation visiting scholar award, and a visiting scholar award from LIEPP (Interdisciplinary Research Center for the Evaluation of Public Policies) at Sciences Po.

Role of the Sponsors: HUD assisted with the study design and reviewed the manuscript prior to submission, but had no other involvement with the study. The other funders of the project had no involvement in the study design or conduct; data collection, management, analysis, and interpretation; in the preparation, review, or approval of the manuscript; or in the decision to submit the manuscript for publication.

Disclaimer: The findings and conclusions in this report are those of the authors and do not necessarily represent those of the Congressional Budget Office, HUD, or the National Institute of Mental Health.

Additional Contributions: Outstanding assistance with the data preparation and analysis was provided by Joe Amick, MPA, Ryan Gillette, MPP, Ijun Lai, MPP, Jordan Marvakov, PhD, Nicholas Potter, MS, Matt Sciandra, MPP, Fanghua Yang, MPP Sabrina Yusuf, MPP, and Michael Zabek, BA, at the National Bureau of Economic Research and by Irving Hwang, MA, Maria Petukhova, PhD, Nancy A. Sampson, BA, and Benjamin Wu, MS, at Harvard Medical School, each of whom was an employee of our research team for this study. The survey data collection effort was led by Nancy Gebler, MA, PMP, at the University of Michigan’s Survey Research Center under subcontract to our research team. Helpful comments were provided (uncompensated) by Todd M. Richardson, MPP, and Mark D. Shroder, PhD, of HUD.

References
1.
Leventhal  T, Dupere  V, Brooks-Gunn  J. Neighborhood influences on adolescent development. In: Lerner  RM, Steinberg  L, eds.  Handbook of Adolescent Psychology. Hoboken, NJ: Wiley; 2009:411-443.
2.
Galster  GC. The mechanism(s) of neighborhood effects: Theory, evidence, and policy implications. In: van Ham  M, Manley  D, Bailey  N, Simpson  L, Maclennan  D, eds.  Neighborhood Effects Research: New Perspectives. New York, NY: Springer; 2012:23-56.
3.
Diez Roux  AV, Mair  C.  Neighborhoods and health.  Ann N Y Acad Sci. 2010;1186:125-145.PubMedGoogle ScholarCrossref
4.
Bhui  KS, Lenguerrand  E, Maynard  MJ, Stansfeld  SA, Harding  S.  Does cultural integration explain a mental health advantage for adolescents?  Int J Epidemiol. 2012;41(3):791-802.PubMedGoogle ScholarCrossref
5.
Centers for Disease Control and Prevention.  Healthy communities program.http://www.cdc.gov/healthycommunitiesprogram/. Accessed May 1, 2013.
6.
Feins  JD, Holin  MJ, Phipps  AA, Magri  D.  Implementation assistance and evaluation for the Moving to Opportunity Demonstration: final report.http://www.abtassociates.com/reports/D19950045.pdf. 1995. Accessed October 6, 2006.
7.
Feins  JD, Hollin  MJ, Phipps  A.  Moving to Opportunity for Fair Housing Demonstration: Program operations manual (revised).http://www.abtassociates.com/reports/D19960002.pdf. 1996. Accessed October 6, 2010.
8.
Orr  L, Feins  JD, Jacob  R,  et al.  Moving to Opportunity for Fair Housing Demonstration Program: Interim Impacts Evaluation. Washington, DC: US Dept of Housing and Urban Development, Office of Policy Development and Research; 2003.
9.
Kling  JR, Liebman  JB, Katz  LF.  Experimental analysis of neighborhood effects.  Econometrica. 2007;75(1):83-119.Google ScholarCrossref
10.
Leventhal  T, Dupéré  V.  Moving to Opportunity: does long-term exposure to “low-poverty” neighborhoods make a difference for adolescents?  Soc Sci Med. 2011;73(5):737-743.PubMedGoogle Scholar
11.
Osypuk  TL, Tchetgen  EJ, Acevedo-Garcia  D,  et al.  Differential mental health effects of neighborhood relocation among youth in vulnerable families: results from a randomized trial.  Arch Gen Psychiatry. 2012;69(12):1284-1294.PubMedGoogle ScholarCrossref
12.
Deluca  HF.  Guest editor’s introduction.  Arch Biochem Biophys. 2012;523(1):1-28.PubMedGoogle ScholarCrossref
13.
Ludwig  J, Duncan  GJ, Gennetian  LA,  et al.  Neighborhood effects on the long-term well-being of low-income adults.  Science. 2012;337(6101):1505-1510.PubMedGoogle ScholarCrossref
14.
Ludwig  J, Sanbonmatsu  L, Gennetian  L,  et al.  Neighborhoods, obesity, and diabetes—a randomized social experiment.  N Engl J Med. 2011;365(16):1509-1519.PubMedGoogle ScholarCrossref
15.
Gennetian  LA, Sciandra  M, Sanbonmatsu  L,  et al.  The long-term effects of Moving to Opportunity on youth outcomes.  Cityscape (Wash, DC). 2012;14(2):137-168.Google Scholar
16.
Goering  J, Feins  JD, Richardson  TM. What have we learned from housing mobility and poverty deconcentration? In: Goering  J, Feins  JD, eds.  Choosing a Better Life? Washington, DC: Urban Institute Press; 2003:3-36.
17.
US Bureau of the Census.  Census tracts and block numbering areas.http://www.census.gov/history/www/programs/geography/tracts_and_block_numbering_areas.html. Accessed March 5, 2011.
18.
Olsen  EO. Housing programs for low-income households. In: Moffitt  RA, ed.  Means-Tested Transfer Programs in the United States. Chicago, IL: University of Chicago Press; 2003:365-442.
19.
Gebler  N, Hudson  ML, Sciandra  M, Gennetian  LA, Ward  B.  Achieving MTO’s high effective response rates: strategies and tradeoffs.  Cityscape (Wash, DC). 2012;14(2):57-86.Google Scholar
20.
Rubin  DB.  Multiple imputation after 18+ years.  J Am Stat Assoc. 1996;91(434):473-489.Google ScholarCrossref
21.
 SAS/STAT Software [computer program], Version 9.2 for Unix. Cary, NC: SAS Institute Inc; 2008.
22.
Kessler  RC, Ustün  TB.  The World Mental Health (WMH) survey initiative version of the World Health Organization (WHO) Composite International Diagnostic Interview (CIDI).  Int J Methods Psychiatr Res. 2004;13(2):93-121.PubMedGoogle ScholarCrossref
23.
Kessler  RC, Avenevoli  S, Green  J,  et al.  National comorbidity survey replication adolescent supplement (NCS-A); III: concordance of DSM-IV/CIDI diagnoses with clinical reassessments.  J Am Acad Child Adolesc Psychiatry. 2009;48(4):386-399.PubMedGoogle ScholarCrossref
24.
Gravel  J, Opatrny  L, Shapiro  S.  The intention-to-treat approach in randomized controlled trials: are authors saying what they do and doing what they say?  Clin Trials. 2007;4(4):350-356.PubMedGoogle ScholarCrossref
25.
Hosmer  DW, Lemeshow  S.  Applied Logistic Regression.2nd ed. New York, NY: Wiley; 2001.
26.
Wolter  KM.  Introduction to Variance Estimation. New York, NY: Springer-Verlag; 1985.
27.
 SUDAAN [computer program], Release 10.0.1. Research Triangle Park, NC: Research Triangle Institute; 2009.
28.
Kessler  RC, Avenevoli  S, Costello  EJ,  et al.  Prevalence, persistence, and sociodemographic correlates of DSM-IV disorders in the National Comorbidity Survey Replication Adolescent Supplement.  Arch Gen Psychiatry. 2012;69(4):372-380.PubMedGoogle ScholarCrossref
29.
McLaughlin  KA, Greif Green  J, Gruber  MJ, Sampson  NA, Zaslavsky  AM, Kessler  RC.  Childhood adversities and first onset of psychiatric disorders in a national sample of US adolescents.  Arch Gen Psychiatry. 2012;69(11):1151-1160.PubMedGoogle ScholarCrossref
30.
Benjamini  Y, Hochberg  Y.  Controlling the false discovery rate: a practical and powerful approach to multiple testing.  J R Stat Soc Series B. 1995;57(1):289-300.Google Scholar
31.
American Association for Public Opinion Research.  Standard definitions.http://www.aapor.org/Standard_Definitions/1481.htm. Accessed April 12, 2012.
32.
Briggs  X, Popkin  SJ, Goering  J.  Moving to Opportunity: The Story of an American Experiment to Fight Ghetto Poverty. New York, NY: Oxford University Press; 2010.
33.
Carter  PL.  “Black” cultural capital, status positioning, and schooling conflicts for low-income African American youth.  Soc Probl. 2003;50(1):136-155.Google ScholarCrossref
34.
Clampet-Lundquist  S, Kling  JR, Edin  K, Duncan  GJ.  Moving teenagers out of high-risk neighborhoods: how girls fare better than boys.  Am J Sociol. 2011;116(4):1154-1189.PubMedGoogle ScholarCrossref
35.
Sareen  J, Cox  BJ, Afifi  TO,  et al.  Combat and peacekeeping operations in relation to prevalence of mental disorders and perceived need for mental health care: findings from a large representative sample of military personnel.  Arch Gen Psychiatry. 2007;64(7):843-852.PubMedGoogle ScholarCrossref
36.
US Department of Housing and Urban Development.  Public housing: image vs facts.http://www.huduser.org/periodicals/ushmc/spring95/spring95.html. Accessed May 1, 2013.
37.
Congressional Budget Office.  Growth in means-tested programs and tax credits for low income households.http://www.cbo.gov/publication/43935. Accessed May 12, 2013.
38.
Shroder  MD.  Locational constraint, housing counseling, and successful lease-up in a randomized housing voucher experiment.  J Urban Econ. 2002;51(2):315-338.Google ScholarCrossref
39.
Goering  J, Kraft  J, Feins  D, McInnis  D, Holin  MJ, Elhassan  H.  Moving to Opportunity for Fair Housing Demonstration Program: Current Status and Initial Findings. Washington, DC: US Dept of Housing and Urban Development; 1999.
40.
Lee  MA, Mather  M.  US labor force trends.  Popul Bull. 2008;63(2):1-16.PubMedGoogle Scholar
×