Best-fitting model for the entire National Comorbidity Survey, a 3-factor variant of the 2-factor internalizing/externalizing model. All parameter estimates are standardized and significant at P<.05.
Krueger RF. The Structure of Common Mental Disorders. Arch Gen Psychiatry. 1999;56(10):921-926. doi:10.1001/archpsyc.56.10.921
This report presents the results of confirmatory factor analyses of patterns of comorbidity among 10 common mental disorders in the National Comorbidity Survey, a national probability sample of US civilians who completed structured diagnostic interviews.
Patterns of comorbidity among DSM-III-R mental disorders were analyzed via confirmatory factor analyses for the entire National Comorbidity Survey sample (N=8098; age range, 15-54 years), for random halves of the sample, for men and women separately, and for a subsample of participants who were seeing a professional about their mental health problems. Four models were compared: a 1-factor model, a 2-factor model in which some disorders represented internalizing problems and others represented externalizing problems, a 3-factor variant of the 2-factor model in which internalizing was modeled as having 2 subfactors (anxious-misery and fear), and a 4-factor model in which the disorders represented separate affective, anxiety, substance dependence, and antisocial factors.
The 3-factor model provided the best fit in the entire sample. This result was replicated across random halves of the sample as well as across women and men. The substantial empirical intercorrelation between anxious-misery and fear (0.73) suggested that these factors were most appropriately conceived as subfactors of a higher-order internalizing factor. In the treatment sample, the 2-factor model fit best.
The results offer a novel perspective on comorbidity, suggesting that comorbidity results from common, underlying core psychopathological processes. The results thereby argue for focusing research on these core processes themselves, rather than on their varied manifestations as separate disorders.
COMORBIDITY among mental disorders is commonly observed in both clinical and epidemiological samples.1- 5 The robustness of this observation is rarely questioned; however, what is at issue is its meaning. Is comorbidity "noise"—nuisance covariance that researchers should eliminate by seeking "pure" cases for their studies—or a "signal"—an indication that current diagnostic systems are lacking in parsimony and are not "carving nature at its joints?"
Recently, my colleagues and I6 argued that the latter position deserved greater attention and empirical scrutiny. Comorbidity may be a signal with fundamental implications for refining current conceptualizations of mental disorders. In the current report, analyses of data from the National Comorbidity Survey (NCS),7 a landmark study of mental disorders in the 48 coterminous United States, were undertaken to extend and build on our previous work.
Comorbidity presents a serious challenge to current research paradigms. Consider the impact of comorbidity on two typical research strategies. The first strategy limits the investigation to those persons who meet the criteria for a specific disorder but not the criteria for any other mental disorder. This strategy is problematic because it identifies an atypical sample as most people with one disorder also suffer from other mental disorders. Moreover, pure cases of mental disorder (persons meeting the criteria for only one disorder) are not only atypical, they are also less severely impaired.1 Thus, restricting a study to pure cases limits not only the generalizability of the study, but also the ability to detect the correlates of more severe mental disorders.
A second strategy involves selecting persons with a target disorder without regard for other disorders for which they might meet criteria. This strategy is equally problematic; in this case, a clear interpretation of the findings is compromised8; that is, the findings could be due to the disorder of interest, or they could be due to other disorders.
A dimensional approach offers potential means for resolving these problems. Rather than conceiving of common mental disorders as discrete, dichotomous entities, these disorders are conceived as extreme points on continua that span a range of emotional and behavioral functioning. This dimensional conception brings the robust empirical data on comorbidity into sharper resolution. If such continua underlie multiple common mental disorders, these disorders should show strong patterns of covariance (ie, comorbidity).
In the current research, diagnoses of major depressive episode (MDE), dysthymia (DYS), panic disorder (PD), agoraphobia (AGPH), social phobia (SOP), simple phobia (SIP), generalized anxiety disorder (GAD), alcohol dependence (AD), drug dependence (DD), and antisocial personality disorder (APD) were submitted to confirmatory factor analysis (CFA), a formal statistical means of evaluating dimensional accounts of comorbidity among mental disorders. Four competing models, positing from 1 to 4 latent factors, were evaluated to determine their fit in the entire NCS sample, in random halves of the sample, in the male and female halves of the sample, and in a subsample of persons in treatment for mental disorder.
The NCS participants constitute a national probability sample of noninstitutionalized US civilians aged 15 to 54 years (N=8098).7 Data were collected between September 1990 and February 1992, with an overall response rate of 82.6%. Informed consent was obtained from all participants and also from the parents of minor participants. The data were weighted to adjust for nonresponse, to adjust for variation in probability of selection within and between households, and to approximate the distribution of major demographic variables in the US population. Results from the NCS have been covered extensively in the ARCHIVES and elsewhere7; these previous publications may be consulted for further details about the NCS.
The analyses in this report focused on lifetime diagnoses in the NCS, which were based on DSM-III-R9 criteria. In accordance with standard practice in psychiatric epidemiology, the diagnoses examined were made without the imposition of hierarchical exclusionary rules.7,10 Interviews were conducted by trained nonclinician interviewers using a modified version of the World Health Organization Composite International Diagnostic Interview (CIDI): the University of Michigan CIDI. Acceptable reliability and validity data have been obtained for the CIDI11 and the University of Michigan CIDI.12,13
The NCS diagnostic data were analyzed via CFA. Briefly, CFA is a means of explaining the correlations (ie, patterns of comorbidity) among variables (ie, DSM-III-R mental disorders) by postulating that these correlations arose because of the influence of a smaller number of underlying, latent dimensions. Specifically, the computer program PRELIS (version 2.20; Scientific Software International Inc, Lincolnwood, Ill) was used to create tetrachoric correlation matrices and asymptotic covariance matrices from the NCS lifetime diagnostic variables. Tetrachoric correlations are appropriate indices of association when one adopts a liability-threshold model for the disorders of interest—a model appropriate for common mental disorders.14
My analyses focused on a subset of the DSM-III-R disorders assessed in the NCS. To ensure reliable, stable estimates of interrelationships among disorders, the lowest base rate disorders (ie, nonaffective psychosis and mania) were excluded. Clinical reappraisal studies in the NCS have documented the low prevalence (<1%) of verifiable cases of these disorders.7,15 With rare disorders, the confidence intervals surrounding correlations estimated between these disorders and other disorders become unacceptably large, approaching the size of the correlations themselves (analyses verifying this in the NCS can be obtained from the author on request). Alcohol abuse, drug abuse, panic attack, adult antisocial behavior, and conduct disorder were excluded because their more severe variants (AD, DD, PD, and APD) were included. In addition, posttraumatic stress disorder was excluded because this disorder requires the occurrence of an event external to the person and is therefore a less meaningful indicator of a latent, endogenous "core psychopathological process" and because this disorder was only assessed for a subset of the total NCS sample.16 The lifetime disorders remaining after these exclusions were made—MDE, DYS, PD, AGPH, SOP, SIP, GAD, AD, DD, and APD—were submitted to CFA.
Four competing models were evaluated. First, a 1-factor model was evaluated in which all disorders were presumed to be indicators of a single, unitary propensity to experience common mental disorders.17 Although this model may at first seem far-fetched, overall severity of maladjustment has been recognized by the DSM-III, DSM-III-R, and DSM-IV, but is recorded on the fifth axis as the Global Assessment of Functioning score (as opposed to being offered as an account of comorbidity among Axis I disorders). Second, a 2-factor model was evaluated in which affective and anxiety disorders were presumed to reflect internalizing problems, and alcohol/drug dependence and antisocial personality to reflect externalizing problems. This model was inspired by reports on childhood behavioral and emotional problems, which consistently show a conceptually similar 2-factor pattern.18,19 Third, a 3-factor variant of the 2-factor model was evaluated. Initial exploratory factor analyses of the NCS data suggested that the internalizing factor has 2 highly correlated subfactors: an anxious-misery factor formed by MDE, DYS, and GAD and a fear factor formed by PD, AGPH, SOP, and SIP. The externalizing factor in this model remains as it was in the 2-factor model (ie, a factor indicated by AD, DD, and APD). Finally, a 4-factor model inspired by the organizational schemes of recent DSMs and by current trends in research specialization was evaluated. In this model, MDE and DYS formed an affective disorders factor; GAD, PD, AGPH, SOP, and SIP formed an anxiety disorders factor; AD and DD formed a substance dependence disorders factor; and APD formed an antisocial behavior disorder factor.
The models were examined in the entire sample, in random halves of the sample, in both sexes, and within a treatment-seeking subsample, identified as follows. A subsample of selected NCS participants (n=5877) were administered a more extensive interview (part II of the total NCS assessment), one section of which inquired about health status and health services utilization. Respondents were asked if they were currently seeing a professional about their emotional and/or substance use problems; persons who responded affirmatively to this question were selected for inclusion in the clinical subsample, which was weighted using a weight specifically designed for the analysis of part II participants (n=251).
The CFA models were tested using the LISREL computer program (version 8.20; Scientific Software International Inc). The model parameters were estimated using weighed least squares, a procedure that requires the aforementioned asymptotic covariance matrices. The weighted least squares procedure is appropriate for the analysis of patterns of comorbidity among common mental disorders because, unlike other fit functions (such as maximum likelihood), it does not assume that the measured variables (ie, mental disorders) have a joint multivariate normal distribution in the population. The fit of the models was evaluated using multiple fit indices: the χ2 goodness of fit statistic, the root mean residual (RMR), and the Bayesian information criterion (BIC). Each of these indices is commonly reported in CFA analyses, and each provides a complementary perspective on the fit of a CFA model. Briefly, the χ2 value for a model indexes the discrepancy between the model-estimated and sample-derived correlations; smaller χ2 values result from better-fitting models. The RMR indexes how far off the model-estimated correlations are from sample-derived correlations (on average) and hence should be small for well-fitting models. Finally, the BIC deserves special mention in the current context, as it has been very useful in balancing fit and parsimony considerations in large samples (such as the NCS).20 Because models with more parameters make weaker claims about the structure of the data, simply including more parameters can typically reduce the χ2 value for a model. Such "overparameterized" models are scientifically unappealing because they lack parsimony. The BIC prefers models that succeed in maximizing both fit and parsimony. Larger, more negative values of BIC are found for such models. Moreover, when comparing 2 models, the difference between these models' BIC scores corresponds directly with the posterior odds—the odds ratio formed by taking the probability that the second model is correct, given the data, over the probability that the first model is correct, given the data.20 Specifically, a difference of 6 between 2 BIC scores corresponds with posterior odds of 20:1 and is regarded as "strong" evidence in favor of the model with the larger, more negative BIC score. A difference in BIC of 10 corresponds with posterior odds of 150:1 and is regarded as "very strong" evidence in favor of the model with the larger, more negative BIC score.
Tetrachoric correlations among the 10 lifetime mental disorders were computed, along with their SEs (Table 1). (These correlations cannot be properly analyzed without their accompanying asymptotic covariances; this matrix is too large to reproduce here but is available from the author on request.) A 2-factor pattern is noticeable in these correlations, with larger values occurring in the upper left (above AD) and lower right (to the right of PD) triangles and smaller values occurring in the lower left rectangle (beneath PD and to the left of AD). Thus, not only are the liabilities to experience these common mental disorders correlated, they are systematically correlated. Specifically, the liabilities to experience affective and anxiety disorders are highly correlated, the liabilities to experience substance disorders and APD are highly correlated, and the correlations between these two broad domains are smaller. Also, the SEs for these correlations are relatively small. It is reasonably certain that these correlations present an accurate representation of the structure of lifetime mental disorders in the US population as they were accurately estimated in the NCS sample, which was painstakingly designed to represent the US population.
Fit indices were computed for the 4 potential dimensional models in the entire sample (Table 2). Looking across the 3 fit indices, a compelling argument can be made for the superior fit of the 3-factor model. The 3-factor model achieved the only negative BIC value and was superior to the other models at reproducing the observed sample correlations (RMR, 0.06).
Examination of the standardized parameter estimates from the 3-factor model revealed a high correlation (0.73) between the anxious-misery and fear factors. The size of this correlation suggested that both anxious-misery and fear are subfactors of a higher-order internalizing factor. The 3-factor model was therefore reparameterized by defining fear and anxious-misery as latent indicators of a higher-order internalizing factor (Figure 1). The higher-order internalizing factor in Figure 1 is simply an alternate way of expressing the 0.73 correlation between anxious-misery and fear—one can trace through the paths connecting these factors to recover their correlation in the original 3-factor model (ie, 0.93×0.78=0.73). Because the postulated higher-order internalizing factor in Figure 1 had very large loadings on its subfactors (0.93 and 0.78), it is a reasonable and meaningful way to express the 3-factor model.
The SEs for the parameters in this model (Figure 1) ranged from 0.02 to 0.04, and hence all the parameters were significant, with z values ranging from 2.29 to 41.34 (P<.05 for all). The factor labels were generated by considering the core features of the disorders loading on each factor. These labels highlight a novel finding: GAD has a greater affinity for MDE and DYS than for the other anxiety disorders (this can also be seen by examining the GAD correlations in Table 1). Another notable finding is that the factor loadings in Figure 1 are uniformly large; each disorder is a reliable indicator of its corresponding factor.
To alleviate concerns that these findings were specific to lifetime disorders, the models were refitted using past-year diagnoses in place of lifetime diagnoses (with the exception of APD, which was assessed only on a lifetime basis). The 3-factor model was also the best-fitting model when past-year diagnoses were used. Discrepancies between the standardized parameter estimates in Figure 1 and those obtained using past-year diagnoses were minor, ranging from 0.00 to 0.07.
First, the NCS participant sample was split into random halves. Because this random split was performed on the actual, unweighted participants, when these participants' weights were reapplied, the weighted sample sizes for the halves were roughly but not exactly equal. Nevertheless, the CFA results within these random halves were similar (Table 2). The 3-factor model emerged as the best-fitting model, producing the consistently best indices of fit. Moreover, standardized parameter estimates derived from the 3-factor model for both random halves were similar to each other and to those for the total sample. Comparing each half with the total sample, standardized parameter estimate discrepancies ranged from 0.00 to 0.08; comparing the halves with each other, standardized parameter estimate discrepancies ranged from 0.00 to 0.15.
Second, the sample was split by sex. Fit indices for the 4 models for women and men were computed (Table 2). Examination of these fit indices suggested that the 3-factor model continued to fit best, achieving the smallest RMR value and largest negative BIC score. Parameter estimates derived from the 3-factor model for both women and men were similar—both to each other and to those for the total sample. Comparing women with the total sample and men with the total sample, parameter estimate discrepancies ranged from 0.00 to 0.11; comparing men with women, parameter estimate discrepancies ranged from 0.00 to 0.10.
The 4 models were fitted in the treatment-seeking subsample (Table 2). The 2-factor model achieved the best fit. Although RMR values suggested that 2-, 3-, and 4-factor models were all reasonable, the 2-factor model achieved the largest negative BIC value.
This article examined the factor structure of 10 common mental disorders in the NCS, the first epidemiological study to administer a structured psychiatric interview to a US national probability sample. For the entire NCS sample, across sexes, and across random halves, a 3-factor model provided the best fit to the correlations among the 10 disorders. Because of the high correlation between the anxious-misery and fear factors in the 3-factor model (0.73), these factors were meaningfully expressed as subfactors of a higher-order internalizing factor. However, in a treatment-seeking subsample, the 2-factor model provided the best fit. Thus, at the highest level of the factor hierarchy, a broad internalizing factor (with anxious-misery and fear subfactors) and a broad externalizing factor explained the pattern of correlations among liabilities to experience common mental disorders. Within a treatment-seeking sample, however, it was not possible to recover the subfactors of internalization.
The strengths and weaknesses of the study should be kept in mind when interpreting these results. The NCS sample is a strength because of its large size and representativeness; results from this study can be safely generalized to the population of US adults and its subcomponents (ie, men, women, and people who seek treatment). This extends and replicates my prior work on the 2-factor structure of common mental disorders,6 which was limited to people in late adolescence and did not examine replicability across sex and treatment-seeking status.
Nevertheless, two weaknesses are notable. First, interviews in the NCS were administered by nonclinicians, and supplementary information, such as informant reports, was not used in making the diagnoses. Examination of the factor structure of common mental disorders when clinicians make diagnoses using all available information is an important goal for future research. Second, the NCS study was cross-sectional, and hence, of necessity, retrospective reports were relied on when lifetime diagnoses were made. Although logistically daunting in terms of time and expense, fine-grained longitudinal studies of the experience of common mental disorders and their symptoms in large, representative samples would be valuable in refining our current nosological understanding.
In spite of these concerns, the value of the study rests on the utility and generativity of the structural model in Figure 1. Evidence that the model helps to organize observations and suggest directions for future research comes from three domains: psychiatric epidemiology, psychopharmacology, and psychiatric genetics. First, the model organizes key findings from psychiatric epidemiology. One key finding is that common mental disorders exhibit consistently positive intercorrelations (ie, comorbidity) that vary in magnitude (ie, rate of comorbidity) (Table 1). Rather than viewing these correlations as nuisance covariance, the model in Figure 1 renders them psychologically sensible. The model organizes common psychopathological variance into internalizing patterns, such as pervasive anxiety and sadness (anxious-misery) and phobic avoidance of others and the external world (fear) as well as externalizing patterns involving antisocial behaviors (APD) and lifestyles (AD, DD). Psychologically speaking, the model suggests that maladjustment can be expressed primarily inward, as anxious-misery and/or fear, or primarily outward, as antisocial, disruptive behavior.
Another key finding from psychiatric epidemiology is the positive association between comorbidity and severity of psychopathological dysfunction; that is, the severity of a disorder predicts not only its intensity and longevity, but also the likelihood of meeting criteria for other disorders.1 The model in Figure 1 also renders this finding sensible. If multiple mental disorders are indicators of a finite number of latent, continuous factors, those mental disorders should be correlated (ie, they should be comorbid).
Second, the model predicts the observed effectiveness of similar pharmacological interventions for putatively different common mental disorders. For example, the selective serotonin reuptake inhibitors (SSRIs), although initially regarded as antidepressants, have been found to be effective in treating other internalizing conditions, such as PD21 and DYS.22 Indeed, the SSRIs are now being marketed as treatments for diverse internalizing conditions. The SSRIs may be effective in treating all these conditions because they influence a core internalizing process—perhaps the personality trait of neuroticism/negative emotionality, which has also been shown to be reduced by SSRI administration.23,24
Third, consider research on the genetic etiology of common mental disorders. Internalizing disorders share genetic variance. As predicted by the model in Figure 1, MDE and GAD are closely linked,25,26 PD and the phobias are closely linked,27 and MDE and the phobias, although significantly linked, are linked to a lesser degree.28 In addition, APD and substance use disorders share significant genetic variance.29- 31 Although multivariate and molecular genetic research framed in terms of the model in Figure 1 is needed to verify this possibility, the existing research suggests that the model in Figure 1 may organize common psychopathological variance by shared genetic etiology. These three lines of evidence from psychiatric epidemiology, psychopharmacology, and psychiatric genetics support the utility of the model in Figure 1. Considered together, they make a strong case for refocusing the study of common mental disorders on their common substrates: broad, higher-order internalizing and externalizing dimensions.
Accepted for publication April 8, 1999.
The National Cormobidity Survey is funded by grants R01 MH/DA46376 and R01 MH49098 from the National Institute of Mental Health, Bethesda, Md, with supplemental support from grant R01 MH/DA46376 from the National Institute on Drug Abuse, Bethesda, and by grant 90135190 from the William T. Grant Foundation, New York, NY.
Reprints: Robert F. Krueger, PhD, Department of Psychology, University of Minnesota, 75 E River Rd, Minneapolis, MN 55455.