Context
Early detection and prospective evaluation of clinical high-risk (CHR) individuals who may develop schizophrenia or other psychotic disorders is critical for predicting psychosis onset and for testing preventive interventions.
Objectives
To elucidate the neuropsychology of the CHR syndrome, to determine the association of neuropsychological function with conversion to psychosis and family history of psychosis, and to examine whether baseline neuropsychological functioning predicts subsequent psychosis.
Design
Longitudinal study with 2½ years of follow-up.
Setting
Eight centers participating in the North American Prodrome Longitudinal Study.
Participants
Three hundred four prospectively identified CHR individuals meeting Structured Interview for Prodromal Syndromes criteria, 52 non-CHR persons with a family history of psychosis in first- or second-degree relatives (family high-risk group), and 193 normal controls with neither a family history of psychosis nor a CHR syndrome, all of whom underwent baseline neuropsychological evaluations.
Main Outcome Measures
A neurocognitive composite score, 8 individual neuropsychological measures, an IQ estimate, and high-risk status.
Results
Global (“composite”) neuropsychological functioning was comparably impaired in the CHR and family high-risk groups compared with controls, but profiles differed significantly between groups. Neuropsychological functioning in the CHR group was significantly lower in persons who progressed to psychosis than in those who did not and was worst in the subgroup with a family history of psychosis. Tests of processing speed and verbal learning and memory were most sensitive in discriminating CHR individuals from controls, although reductions were less severe than in established schizophrenia. Neuropsychological functioning did not contribute uniquely to the prediction of psychosis beyond clinical criteria, but worse verbal memory predicted more rapid conversion.
Conclusions
These findings document that CHR individuals have significant neuropsychological difficulties, particularly those who later develop psychosis. This dysfunction is generally of moderate severity but less than in first-episode schizophrenia, suggesting that further decline may occur after baseline CHR assessment.
Substantial neuropsychological deficits, first described by Kraepelin1 and Bleuler,2 have subsequently been observed in all phases of schizophrenia, beginning in the premorbid period and continuing throughout life. Patients in the first psychotic episode and during chronic periods manifest large neuropsychological impairments with effect sizes (ESs) averaging approximately 1.0.3,4 The degree of impairment depends on the domain measured, with verbal memory and processing speed typically eliciting the largest deficits (ES, 1.3-1.6 by Cohen d).3,4 Moreover, because neuropsychological functions are important as windows into pathophysiology5 and because they are strongly associated with functional outcomes in schizophrenia,6 they may be important in risk prediction of psychosis.
The robust finding of premorbid neuropsychological impairment indicates that these measures may have utility as predictors of schizophrenia, an idea frequently evaluated in persons at genetic (familial) high risk (FHR),7-9 and recently in clinical high-risk (CHR) or putatively “prodromal” samples.10 Clinical high risk requires the presence of specific subsyndromal psychotic symptoms, while FHR is defined solely by the presence of a family history (FH) of psychosis.
Compared with healthy control subjects, ESs of neuropsychological deficits in offspring and adult nonpsychotic relatives of persons with schizophrenia range between 0.3 and 0.6, reflecting moderate deficits in the absence of psychosis.11-15 These findings suggest that cognitive deficits are associated with the neural substrates of the illness16,17 and that they may be attributable largely to inherited variations.16,18 These impairments have considerable validity because they are not confounded by psychosis or medication. Commonly identified deficits in FHR samples include lower verbal ability, general intelligence (IQ), declarative and working memory, sustained attention, processing speed, and executive and motor functions.7,8,11-15,17,19,20
While identification of neuropsychological impairments in FHR samples supports a neurodevelopmental model of vulnerability to schizophrenia,20-22 their utility for prediction of psychosis is limited by modest lifetime conversion rates of approximately 10%. The problem of relatively low conversion rates in FHR samples and the notion that early detection and intervention may prevent clinical expression of psychosis or functional deterioration have stimulated a new direction in psychiatry research aimed at reducing morbidity and mortality,23 similar to prevention efforts in other branches of medicine.24,25 This approach has focused on developing and validating criteria for ascertaining individuals at risk of imminent onset of psychosis and observing them over time.26-28 Advantages of this approach over FHR methods include more efficient timing of assessments proximate to illness onset and reduction of false-positive rates.29,30 Because the modal period of onset in schizophrenia is between ages 18 and 30 years, “case identification” during adolescence and young adulthood is essential.
During the past 5 years, at least 10 research groups have published studies of neuropsychological functioning in CHR samples.10 Findings from cross-sectional CHR studies have consistently documented that neuropsychological deficits are intermediate between control and first-episode psychosis samples,10,31-54 and one has shown that neuropsychological functioning is related to illness course.50 Several specific deficits have been observed, most reliably in spatial35-38 and verbal46 working memory, verbal declarative memory,39,40,43,52 and attention.31,32,40-44,48 Deficits in olfaction47 and executive functions, as measured by verbal fluency, matrices, and set shifting, and visual form perception have been less consistently tested or identified.31,32,35,36,40,43,46-48,52,54 Some deficits (eg, in sustained attention) may represent stable vulnerability markers,40,41 while others (such as in verbal memory, working memory, processing speed, and verbal IQ) may be predictive of conversion to psychosis.39,40,48,49,53
Despite substantial progress, variability in test batteries and small samples complicate interpretation. Moreover, only 2 studies36,51 have integrated FHR and CHR methods, and the few studies that compared individuals who did and did not convert to illness were limited by small samples and brief follow-ups. Because many patients with neuropsychiatric disorders manifest neuropsychological deficits, it is important to compare CHR individuals who develop psychosis with those who do not. Longitudinal designs including follow-up into conversion may identify neuropsychological deficits that predict psychosis.
The North American Prodrome Longitudinal Study (NAPLS) is a consortium of 8 research centers, ascertaining CHR individuals and observing them for up to 2½ years.30,55,56 Although originally developed as independent studies, the sites used similar ascertainment and diagnostic methods, making it possible to form a standardized protocol for mapping data into a new scheme representing the common components across sites,30,55 yielding the largest database of longitudinally followed CHR cases worldwide.
The primary aims of this study were to characterize the neuropsychology of the psychosis prodrome by comparing performance of CHR individuals with that of normal controls (NCs) and FHR subjects and to examine the value of neuropsychological function for predicting conversion to psychosis. Our hypotheses were that persons who subsequently convert to psychosis are more impaired at baseline than nonconverters, that this effect would be amplified in persons with an FH of psychosis, and that poorer neuropsychological performance would predict more rapid conversion to psychosis.
Study protocols and informed consent documents, including procedures for data pooling and secondary data analysis, were approved by the institutional review boards of the participating sites (Emory University; Harvard University; University of California, Los Angeles [UCLA]; University of California, San Diego [UCSD]; University of North Carolina; University of Toronto; Yale University; and Zucker Hillside Hospital). The NAPLS methods and details of the federated database not specific to the present study are described elsewhere.30,55,56 Nine reports of neuropsychological function have been published on 4 smaller CHR samples by NAPLS centers: 3 from the Prevention Through Risk Identification, Management, and Education (PRIME) multisite study (including Yale, University of North Carolina, and University of Toronto sites),31-33 2 from Zucker-Hillside,37,40 2 from UCLA,44,50 and 2 from UCSD.48,49 However, these neuropsychological data were not previously combined, did not include a 2.5-year follow-up (a smaller PRIME study included a 2-year follow-up33), and did not evaluate the impact of neuropsychological functioning on conversion to psychosis in relation to FH and other possible predictors.
Participants from the NAPLS database who completed any baseline neuropsychological testing were included, yielding 304 CHR individuals, 52 persons with an FH of psychosis without prodromal symptoms, and 193 NCs without an FH of psychosis or prodromal symptoms. Of the 304 CHR subjects, 269 (88.5%) were observed for up to 2½ years to assess for conversion to psychosis. The 35 CHR participants without any follow-up were excluded from analyses that took conversion status into account. Of the 304 CHR subjects, 89 (29.3%) converted to psychosis, of whom 73 (82.0%) had baseline neurocognitive data.
The Structured Interview for Prodromal Syndromes57,58 criteria were used for study entry, and the Structured Clinical Interview for DSM-IV59,60 was most commonly used to assess general psychopathology. Structured Interview for Prodromal Syndromes criteria57 for a CHR syndrome emphasize onset or worsening of attenuated positive symptoms in the past 12 months in at least 1 of 5 symptom domains: unusual thought content, suspicion/paranoia, grandiosity, perceptual anomalies, and disorganized communication. Subjects also qualified for a CHR syndrome if they showed onset of brief intermittent positive psychotic symptoms in the past 3 months but below the threshold required for a DSM-IV Axis I psychotic disorder diagnosis or if they had a genetic risk for psychosis and deterioration of 30% or more on the Global Assessment of Functioning scale in the past 12 months, where genetic risk is defined by having an FH of psychosis or a diagnosis of schizotypal personality disorder.61,62 All NAPLS sites demonstrated good reliability by using the Structured Interview for Prodromal Syndromes criteria (κ values ranged from 0.80 to 1.00 across sites).57 At each site, raters were MA, PhD, or MD specialists in mental health.
The Structured Interview for Prodromal Syndromes was readministered at 6-month intervals up to 30 months. If clinical deterioration was observed during interim periods, a reassessment was conducted before regularly scheduled assessments. Because treatment was not standardized, information on dosing and duration of antipsychotic treatments was unavailable for the majority of cases.
Baseline napls neuropsychological assessment protocol
Cognitive performance variables presented unique challenges in the development of an omnibus protocol.55 Sixty-eight neurocognitive measures derived from 40 separate tests were used across sites. Criteria for test inclusion in the federated database included the following: (1) representation across at least 4 sites; (2) comparability of test versions, administration procedures, and scoring; and (3) coverage of presumed areas of separable cognitive impairment in schizophrenia.63 Thirteen cognitive variables, derived from 8 tests, were initially selected for the omnibus battery. However, to enhance commonality, to carry out multivariate statistical analyses, and to create a composite score for use in prediction analyses, the number of variables examined in these analyses was reduced to 8: Vocabulary,64-67 measuring verbal comprehension; Block Design,64-66 measuring visual-perceptual organization; Continuous Performance Test–Identical Pairs (CPT-IP) digits,68 measuring vigilance; Digit Symbol–Coding (hereinafter referred to as “Coding”)64-66 and Trail Making Test Part B,69 both measuring speed of processing; Controlled Oral Word Association (COWA) test70 for verbal fluency and Wisconsin Card Sorting Test71,72 for problem solving, both measures of executive functioning; and a verbal learning and memory variable, consisting of story recall tests from the Wechsler Memory Scale73,74 for participants 17 years or older and Children's Memory Scale75 for those younger than 17 years, as well as list learning on the Hopkins Verbal Learning Test–Revised,76 Rey Auditory Verbal Learning Test,77 and California Verbal Learning Test adult and child versions.78,79 Additional information regarding variable construction is available in an online supplement.
Data analyses consisted of 2 approaches: a univariate approach that included all subjects for whom data were available in an individual cognitive domain and a multivariate approach that included all cognitive domains and construction of a composite score. To support the multivariate approach, a series of decision rules for acceptable subject inclusion were created and imputation steps were implemented. This resulted in a multivariate sample (n = 325) that is a subset (59.2%) of the univariate sample (n = 549), including reduced samples of CHR subjects (167 subjects [55% of the CHR subjects in the univariate sample]), FHR (49 [94%]), and NCs (109 [56%]). Because of substantial subject loss in the multivariate sample, both samples were analyzed and compared. The univariate analyses are presented in an online supplement, and significant findings are integrated within the “Results” section.
Formation of the Multivariate Sample
Inclusion in the multivariate sample required subjects to have a minimum of 75% complete data (ie, completed at least 6 of 8 tests), thus reducing the total missing data to less than 10%, which was our maximum threshold for data loss before imputation. Multiple imputation methods were used to address missing data. In contrast to listwise deletion, which has the disadvantages of loss of observations and reduced statistical power, multiple imputation permits analysis of complete data by calculating estimates of missing values with the use of other variables in the model as predictors.80-82 Details of the data imputation methods are in the online supplement.
The groups compared were CHR, FHR, and NC. The CHR group was further subdivided into converters to psychosis (CHR+) and nonconverters (CHR−). Six comparisons were made within both the multivariate and univariate samples: (1) CHR vs NC, (2) FHR vs NC, (3) CHR vs FHR, (4) CHR+ vs NC, (5) CHR− vs NC, and (6) CHR+ vs CHR−. A small subgroup of CHR+ with a positive FH (CHR+FH+) were analyzed within the univariate sample because of its larger CHR+FH+ subsample.
Statistical analyses were performed with SPSS version 17 (SPSS Inc, Chicago, Illinois) or SAS version 9.1 (SAS Institute Inc, Cary, North Carolina) statistical software. One-way analysis of variance and χ2 tests were conducted to compare groups on demographics. For the multivariate sample, neuropsychological measures were compared by multivariate analysis of variance (MANOVA), multivariate analysis of covariance (MANCOVA), univariate analysis of covariance, and profile analysis.
In some contrasts, groups were significantly different on education, parental education, sex, and ethnicity. Because ethnicity and parental education were correlated and because parental education is strongly associated with neurocognition, parental education was controlled for. In contrast, subjects' own education is likely to be affected by illness and was not controlled for. Because small differences in age can influence neuropsychological functioning in adolescence, analyses controlled for age as well as parental education and sex. We also tested for the effects of site. To examine whether neuropsychological impairments were significant beyond general intellectual impairment, we used MANCOVA controlling for age, sex, and full-scale IQ (FSIQ) estimate83 (after removing Vocabulary and Block Design tests that compose estimated FSIQ from the profiles). To test whether the shape of neuropsychological profiles differed for selected contrasts, unadjusted scores were analyzed by means of the general linear model repeated-measures function. For profile analyses, the 8 measures were standardized against the NCs within each of the 5 imputed data sets and then pooled across imputed data sets. In addition, a composite score was constructed as the mean of the 8 standardized scores within each imputed data set and then pooled.
Statistical significance was set at P < .05 by means of 2-tailed tests for multivariate analyses (MANOVA, MANCOVA, profile analyses, and composite score). Bonferroni correction was used to control the type I error rate for univariate analyses (.05/8 or ≤.00625). Comparisons that remained significant at the Bonferroni-corrected level are shown in boldface in the tables and presented in the “Results” section. Effect sizes (unadjusted) were calculated with Cohen d.84
Primary analyses were followed by tests of association between neurocognitive functioning and psychosis progression for the multivariate sample. To identify the cognitive variables most predictive of psychosis progression, we first examined the predictive value of the baseline composite score, FSIQ, Coding, and Verbal Memory in separate Cox regression models. The latter 3 were chosen because they are most sensitive in FHR and patients with schizophrenia, respectively.3,4,8 A multivariate Cox regression using backward selection was conducted to identify which of the 8 cognitive test scores have unique predictive associations with conversion. A second set of multivariate Cox regressions was used to determine whether any of the 10 cognitive variables added unique prediction beyond the multivariate NAPLS clinical algorithm previously reported.30
Demographic characteristics
Comparing CHR and FHR participants with NCs showed no significant group differences in age (Table 1 and eTable 1). The CHR subjects attained significantly less education than NCs. The FHR group showed significantly less parental education than NCs. The CHR group had significantly fewer females than the FHR and NC groups. The groups differed on race, with significantly more whites in the CHR than other groups. Parental education was significantly lower in the CHR+ than CHR− subgroup.
Demographic comparisons were the same in the univariate and multivariate sample comparisons with the following additions: (1) parental education was significantly lower in the CHR group than in NCs; (2) there were significantly fewer African Americans in the CHR than other groups; (3) the FHR group had significantly fewer Asian Americans than other groups; and (4) the CHR+ and CHR− subgroups did not differ significantly on any variable (eTable 1).
The 167 CHR subjects in the multivariate sample did not differ significantly on any demographic variable from the additional 137 CHR subjects who together formed the univariate sample. (Results are available on request from the first author.)
Neuropsychological functioning
Multivariate. Raw data are presented in Table 2 and statistical results in Table 3. The MANOVA and MANCOVA for the 8 tests were statistically significant. The MANCOVA, controlling for FSIQ (covariate effect; F = 0.26, P = .62, d = 0.16), was significant, and Coding (d = 0.56), COWA (d = 0.48), Verbal Memory (d = 0.45), CPT-IP (d = 0.39), and the composite score (d = 0.45) were significant. See Figure 1 for profile.
Univariate. Raw data are presented in eTable 2 and results in eTable 3. Significant tests were Coding (d = 0.58), Verbal Memory (d = 0.54), COWA (d = 0.47), and CPT-IP digits (d = 0.43).
Multivariate. The MANOVA and MANCOVA were statistically significant. The MANCOVA controlling for FSIQ (covariate effect; F = 8.76, P = .004, d = 0.70) was not significant. Vocabulary (d = 0.70), Coding (d = 0.66), and the composite score (d = 0.75) were significant. See Figure 1 for profile.
Univariate. Significant tests were Vocabulary (d = 0.89), Coding (d = 0.66), and COWA (d = 0.59).
Multivariate. The MANOVA and MANCOVA were statistically significant. The MANCOVA controlling for FSIQ (covariate effect; F = 4.07, P = .045, d = 0.44) was significant. Verbal Memory (d = 0.40) was significant. The composite score was not significant (d = 0.16). When CHR and FHR were compared, a test × group interaction was observed (F = 4.99, P < .001), indicating a differential (ie, nonparallel) pattern of scores (Figure 1). There was no main effect for group, indicating comparable overall performance (F = 0.06, P = 82). Table 3 shows that the differential pattern of performance is accounted for by the FHR group exhibiting somewhat greater impairment on Vocabulary, while the CHR group exhibited significantly greater impairment in Verbal Memory.
Univariate. No tests were significantly different.
Multivariate. The MANOVA and MANCOVA were statistically significant. The MANCOVA controlling for FSIQ (covariate effect; F = 2.34, P = .13, d = 0.34) was significant. Coding (d = 0.69), Verbal Memory (d = 0.65), Vocabulary (d = 0.50), and the composite score (d = 0.72) were significant. See Figure 1 for profile.
Univariate. Verbal Memory (d = 0.79), Coding (d = 0.68), COWA (d = 0.68), Vocabulary (d = 0.65), and CPT-IP digits (d = 0.62) were significant.
Multivariate. The MANOVA and MANCOVA were statistically significant. The MANCOVA controlling for FSIQ (covariate effect; F = 0.05, P = .84, d = 0.07) was significant. Coding (d = 0.50) was significant. The composite score was not significant (d = 0.36). See Figure 1 for profile.
Univariate. Significant tests were Coding (d = 0.57), Verbal Memory (d = 0.46), and CPT-IP digits (d = 0.39).
Multivariate. The MANOVA was significant and the MANCOVA showed a marginal trend (P = .08). The MANCOVA controlling for FSIQ (covariate effect; F = 1.90, P = .17, d = 0.26) was not significant. The composite score (d = 0.40) and Vocabulary (d = 0.46) were significant. A test of profile shape showed no significant test × group interaction (F = 1.65, P = .14). A main effect of test was observed (F = 8.56, P < .001), indicating that differential performance was observed across tests, independent of the groups. In addition, there was a main effect of group, indicating that the profiles differed in overall neuropsychological performance (F = 6.47, P = .01). See Figure 1.
Univariate. Vocabulary was significant (d = 0.43).
Univariate. Because the sample was small (CHR+FH+ maximum, n = 13), only the univariate sample data were analyzed. Statistically significant, large effects were obtained on Verbal Memory (d = 0.99), CPT-IP digits (d = 0.98), and Coding (d = 0.87). The overall mean ES, weighted for the sample size for each test, suggested a dose response and was largest in the CHR+FH+ group (Figure 2).
Site. Although group ascertainment differed significantly by site (see online supplement), MANCOVAs using site showed minimal impact, affecting only 1 of 6 contrasts (CHR+ vs CHR−; Table 3).
Sensitivity of Individual Tests. Twelve of 48 tests (25%) in the multivariate sample and 16 of 48 tests (33%) in the univariate sample (which included 45% more subjects) were statistically significant at the Bonferroni level. Coding was significant 4 of 6 times and Verbal Memory was significant 3 of 6 times in each sample, indicating that they were most likely to show impairment. Block Design, Trail Making Test Part B, and Wisconsin Card Sorting Test perseverative errors were not significant at the Bonferroni level in any comparisons, suggesting that they are less affected in high-risk samples.
Prediction of Progression to Psychosis With Neuropsychological Tests. Cox regression models were estimated to identify baseline cognitive variables that were most predictive of time to conversion to psychosis. In the first set of analyses, only 4 selected variables were examined. The composite score (χ21 = 3.05, P = .08), FSIQ (χ21 = 2.63, P = .11), and Coding (χ2 = 0.14, P = .71) were not significant. In contrast, Verbal Memory was a significant predictor of time to conversion (χ2 = 6.1, P = .01) and demonstrated a hazard ratio of 0.79, suggesting that CHR subjects with impaired verbal memory were likely to progress to psychosis more rapidly. A second analysis used backward selection to identify which among the 8 cognitive variables were the best predictors of rate of progression to psychosis. The log-rank test was not significant (χ21 = 13.18, P = .11). A third Cox regression examined whether the cognitive variables (composite, FSIQ, Coding, and Verbal Memory) added to the multivariate NAPLS prediction model.30 None contributed uniquely to the prediction of psychosis beyond clinical variables.
As predicted, CHR subjects were significantly impaired in neuropsychological functioning compared with NCs after statistically adjusting for age, sex, parental education, and site as well as for IQ, indicating that impairments were not simply a general intellectual deficit. Impairments were significantly more severe in the CHR+ group than in the CHR− group but modestly so (composite score, d = 0.40), suggesting that neuropsychological deficits are associated strongly with risk states for psychosis and additionally with conversion. The CHR and FHR groups were similarly impaired in composite neuropsychological functioning relative to NCs, but their profiles differed distinctly. Thus, risk status based on clinical symptoms and that based on FH both index neuropsychological vulnerability to psychosis, but they appear to be characterized by different impairments. Impairments were most severe in the converters who also had an FH of psychosis, suggesting a synergistic, dose-response effect (Figure 2), although this group was small and the result requires replication. Tests of verbal learning and memory and processing speed were most sensitive in discriminating CHR and control groups, and verbal memory predicted more rapid conversion. However, neuropsychological measures did not significantly enhance the NAPLS clinical prediction algorithm reported previously.30
The severity and pattern of impairment in CHR compared with results from first-episode psychosis studies is informative (see Table 4). First, it is of interest that the 2 most impaired tests found in first-episode samples, Coding and Verbal Memory, were the 2 most impaired tests in our CHR+ sample. These tasks rely heavily on verbal skills, processing speed, and new learning, functions that are reliably impaired in schizophrenia and clearly presage the disorder. Second, tasks such as Block Design, Trail Making Test Part B, and Wisconsin Card Sorting Test, although impaired in first-episode samples, were less sensitive measures in CHR+ subjects. Tasks that are more visual and less verbal, and explicitly require executive functions, were affected somewhat less than verbal tasks. Alternatively, the psychometric characteristics of the Verbal Memory and Coding tests may be superior to those of other measures, making them more sensitive to the presence of deficits of any severity. However, because most clinical neuropsychological tests are multifactorial, more refined cognitive neuroscience measures are needed to determine which cognitive mechanisms are impaired.
From a staging perspective, as further explicated in Table 4, neurocognitive deficit apparently increases in severity from prodrome to first episode, and this growing impairment is accompanied by increasing executive dysfunction.4 This suggests that additional neuropsychological deterioration in those developing psychosis may continue to occur during the late prodromal phase and possibly during and subsequent to the first episode of psychosis. However, this proposition can be addressed definitively only in longitudinal studies that monitor cognitive function in the same subjects. The literature on this issue is sparse, with only 1 published study having similar neuropsychological data collected relatively close to and after the first episode; significant decline was reported on 2 of the 4 tests.85
A major strength of this study is its large sample size, larger at baseline and follow-up than any previously published study of neurocognition in CHR individuals. Few published reports on CHR have included neuropsychological functioning in persons who convert to psychosis.32,33,39,40,48,49,53 With the exception of the Melbourne (n = 34)39 and German (n = 44)52 projects, sample sizes are small (<21 converters). Thus, this study, which compared neuropsychological functioning on as many as 71 converters, provides the most robust data indicating that persons who later convert to psychosis are especially impaired at baseline (composite score d = 0.72). While the overall (composite score) ES difference between the CHR+ and CHR− groups was modest (d = 0.40), the effect was consistent in that CHR+ subjects performed worse than CHR− subjects on all 8 neuropsychological measures. On the basis of the Cox regression analyses, only verbal memory was associated with a significant decrease in time to conversion. When the 8 neurocognitive variables, FSIQ, or the composite score were added separately to the multivariate NAPLS prediction algorithms,30 none of the prediction statistics for the neurocognitive variables was significant, indicating that none added unique variance to prediction beyond clinical variables. It remains possible that future large-scale studies that include a uniformly broader range of neuropsychological tests, particularly measures of olfaction and working memory (shown in previous studies to be associated with conversion but unavailable in this data set), may add unique predictive power to risk algorithms.
The neuropsychological functioning of the FHR sample was consistent with the extant literature, yielding ES differences of 0.20 to 0.70 for many functions. This suggests that a modest proportion of the variance in neuropsychological function is putatively associated with genetic factors, presumably expressing themselves through brain dysfunction.16,17,21,28,86,87 What is striking about our findings is that CHR and FHR had different patterns of impairment, and thus FHR may contribute additional cognitive impairments to CHR status. This was observed in the larger ESs in the CHR+FH+ subgroup, although small sample size precludes firm conclusions. We found only 2 studies that linked FH and conversion to psychosis, the Edinburgh51 and Palau36 high-risk studies. These studies used very different designs and ascertainment criteria, making findings difficult to integrate. Nonetheless, both studies show a trend for persons with FHR plus prodromal symptoms to be particularly neuropsychologically impaired.
This study has a number of limitations, the most important being variability in the specific tests administered across NAPLS sites resulting in relatively high rates of missing data for some measures and inconsistent sample sizes across tests. We addressed this problem by creating a multivariate sample in which we reduced the number of tests and subjects and then imputed data. Although this resulted in substantial subject loss, we were able to demonstrate that the results were consistent across the smaller multivariate subsample and the full univariate sample as observed by comparable ESs (see Table 4). We also constrained our conclusions about individual tests with Bonferroni corrections. Another limitation was the domains assessed (eg, social cognition, olfaction, and other measures of executive function were not assessed). Future work should combine large samples with a common neuropsychological battery, selected to maximize predictive value. In addition, because it is likely that some CHR subjects will convert to psychosis later,88 “misclassifying” some subjects as nonconverters may have reduced the differences observed in CHR+ and CHR− contrasts. Subjects were followed up for variable periods, but even a 2.5-year follow-up duration is unlikely to identify all persons who convert. We also had limited data on medication status and other treatment exposures. It will be important in future CHR studies to account for the effects of psychopharmacologic and other treatments.
Despite these limitations, our study is largely consistent with the results of other research groups, including those comparing converters with nonconverters.53 These findings document that prospective ascertainment of individuals at CHR of psychosis demonstrates significant neuropsychological impairment, especially among those who later convert to psychosis, and these effects are amplified among those with an FH of psychosis. Because neuropsychological tests are relatively inexpensive, have extensive normative data, and are heavily used by school personnel, in conjunction with FH and attenuated clinical symptoms, they may have potential as early indicators of risk of psychosis as well as other important outcomes such as functional disability.
Correspondence: Larry J. Seidman, PhD, Department of Psychiatry, Massachusetts Mental Health Center Public Psychiatry Division of the Beth Israel Deaconess Medical Center, 401 Park Dr, Boston, MA 02215 (lseidman@bidmc.harvard.edu).
Submitted for Publication: July 13, 2009; final revision received November 10, 2009; accepted November 18, 2009.
NAPLS Group Members: Jean Addington, PhD, Diane Kirsopp, BA, Ivana Furimsky, MN, Irvin Epstein, MD, and Robert Zipursky, MD (Toronto, Ontario, Canada); Donald Addington, MD, and Anna Gresko, BN (Calgary, Alberta, Canada); Kristin Cadenhead, MD, Kathleen Shafer, BS, Iliana Marks, MA, Katherine Seeber, MD, Nasra Haroun, MD, and Karin Kristensen, PsyD (UCSD); Tyrone Cannon, PhD, Jennifer Johnson, PhD, Carrie Bearden, PhD, Mary O’Brien, PhD, Melita Daley, MD, Tara Niendam, PhD, and Jamie Zinberg, MA (UCLA); Barbara Cornblatt, PhD, MBA, Christopher Smith, PhD, Andrea Auther, PhD, Pradeep Nagachandran, MD, and Joshua Biener, BA (Zucker Hillside Hospital); Diana O. Perkins, MD, MPH, Jennifer Nieri, MSW, LCSW, and Karen Graham, MD (University of North Carolina); Larry Seidman, PhD, Ming Tsuang, MD, PhD, Anthony Giuliano, PhD, Eric Meyer, PhD, and Lynda Tucker (Harvard University); Elaine Walker, PhD, and Shivali Dhruv, BA (Emory University); Scott Woods, MD, Thomas McGlashan, MD, Tandy Miller, PhD (deceased), Roy Money, MS, and Philip Markovich, BA (Yale University); and Robert Heinssen, PhD (National Institute of Mental Health).
Financial Disclosure: Dr Seidman has received investigator-initiated research funding support from multiple not-for-profit entities including the National Institute of Mental Health, the National Institute on Aging, the Commonwealth of Massachusetts Department of Mental Health, the National Alliance for Research on Schizophrenia and Depression (NARSAD), and the Sidney R. Baer Jr. Foundation. He has not received funding from for-profit entities in the past 12 months. In the past he received unrestricted educational support from Janssen Pharmaceuticals and has served as a consultant for Shire. Dr Giuliano has received investigator-initiated research funding support from multiple not-for-profit entities including the National Institute of Mental Health and NARSAD. Dr Meyer has received investigator-initiated research funding support from the US Department of Veterans Affairs. Dr Addington has received investigator-initiated research funding support from multiple not-for-profit entities including the National Institute of Mental Health, Ontario Mental Health Foundation, and the Schizophrenia Society of Ontario. Dr Addington has served as a consultant for Pfizer, AstraZeneca Pharmaceuticals, and Janssen Pharmaceuticals. Dr Cadenhead has received investigator-initiated research funding support from the National Institute of Mental Health. Dr Cannon has received investigator-initiated research funding support from multiple not-for-profit entities including the National Institute of Mental Health, NARSAD, and the Staglin Music Festival for Mental Health. Dr Cannon has served as a consultant for Janssen Pharmaceuticals and Eli Lilly and Company. Dr McGlashan has received investigator-initiated research funding support from the National Institute of Mental Health, the Personality Disorder Research Foundation, and Eli Lilly and Company. Dr McGlashan has served as a consultant for Eli Lilly and Company, Pfizer, Solvay/Wyeth, and Roche Pharmaceuticals. Dr Perkins has received research funding from Janssen Pharmaceuticals and Dainippon Sumitomo Pharma in the past 12 months. In the past Dr Perkins received research funding from AstraZeneca Pharmaceuticals, Bristol-Myers Squibb, Otsuka Pharmaceutical Co Ltd, Eli Lilly and Company, Janssen Pharmaceuticals, and Pfizer and consulting and educational fees from AstraZeneca Pharmaceuticals, Bristol-Myers Squibb, Eli Lilly and Company, Janssen Pharmaceuticals, GlaxoSmithKline, Forest Labs, Pfizer, and Shire. Dr Tsuang has received investigator-initiated research funding support from multiple not-for-profit entities including the National Institute of Mental Health and has received research grants from Janssen Pharmaceuticals. Dr Walker has received investigator-initiated research funding support from not-for-profit entities including the National Institute of Mental Health and NARSAD. She has not received funding from for-profit entities. Dr Woods has received investigator-initiated research funding support from multiple not-for-profit entities including the National Institute of Mental Health, the Donaghue and Stanley foundations, and NARSAD. In addition, he has received investigator-initiated research funding support from multiple for-profit entities including UCB Pharma and Bristol-Myers Squibb and has consulted for Otsuka and Schering-Plough. Dr Woods has not served on speaker's bureaus. Dr Bearden has received investigator-initiated research funding support from the National Institute of Mental Health. She has not received funding from for-profit entities in the past 12 months. Dr Christensen has received investigator-initiated research funding support from multiple not-for-profit entities including the Canadian Institutes of Health Research, Ontario Neurotrauma Foundation, and Ontario Mental Health Foundation. He has not received funding from for-profit entities in the past 12 months. In the past he received research support from Eli Lilly and Company and has served as a consultant for Janssen Pharmaceuticals. Dr Hawkins has received funding support from the National Institute of Mental Health, the Alzheimer's Disease Association, and the Department of Mental Health and Addiction Services of the State of Connecticut. Dr Heaton has received investigator-initiated funding from the National Institute of Mental Health, the National Institute on Drug Abuse, and the National Institute of Neurological Disorders and Stroke. Dr Keefe has received investigator-initiated research funding support from the National Institute of Mental Health and the Singapore National Medical Research Council and an unrestricted educational grant from AstraZeneca Pharmaceuticals. He has received honoraria or served as a consultant or advisory board member for Abbott Laboratories, AstraZeneca Pharmaceuticals, BiolineRx, Bristol-Myers Squibb, Cephalon, Dainippon Sumitomo Pharma, Eli Lilly and Company, Johnson & Johnson, Lundbeck, Memory Pharmaceuticals, Merck, Neurosearch, Orion, Orexigen, Otsuka, Pfizer, Roche, Sanofi-aventis, Shire, Targacept, Wyeth, and Xenoport. In the past, he has received honoraria or served as a consultant or advisory board member for Acadia, Cortex, Cyberonics, Forest, Gabriel, GlaxoSmithKline, Repligen, Saegis, and Schering-Plough and has received research funding from AstraZeneca Pharmaceuticals, Eli Lilly and Company, Janssen Pharmaceuticals, and Pfizer. Dr Keefe receives royalties from the Brief Assessment of Cognition in Schizophrenia (BACS) testing battery and the MATRICS Battery (BACS Symbol Coding). Dr Heinssen is an employee of the nonprofit National Institutes of Health and has had no financial relationships with for-profit entities. Dr Cornblatt has received investigator-initiated research funding support from not-for-profit entities including the National Institute of Mental Health and the Stanley Medical Research Institute. She has also served as a consultant for Eli Lilly and Company, Bristol-Myers Squibb, and Janssen Pharmaceuticals and has received unrestricted educational grants from Janssen Pharmaceuticals.
Funding/Support: This study was supported by the National Institute of Mental Health (grants R18 MH 43518, U01 MH081928, and P50 MH080272 to Dr Seidman; grant U01 MH066134 to Dr Addington; grants R01 MH60720 and K24 MH76191 to Dr Cadenhead; grant R01 MH65079 to Dr Cannon; grant K05MH01654 to Dr McGlashan; grants U01 MH066069 and P50 MH064065 to Dr Perkins; grant R18 MH 43518 to Dr Tsuang; grants RO1MH062066 and 5 U01 MH081988 to Dr Walker; grants U01 MH74356, U01 MH082022, and R41 MH083436 to Dr Woods; and grant R01 MH061523 to Dr Cornblatt).
Disclaimer: The views expressed are those of the authors and do not necessarily reflect the official views of the National Institute of Mental Health, the National Institutes of Health, or any other branch of the US Department of Health and Human Services.
Additional Contributions: We acknowledge the substantial contributions of Jennifer Johnson, PhD (UCLA), Diane Kirsopp, BA (University of Toronto), and Roy Money, MS (Yale University), to the creation of the federated NAPLS database described in this article.
1.Kraepelin
E Dementia Praecox and Paraphrenia. Edinburgh, Scotland:
E & S Livingston;
1919
2.Bleuler
E Dementia Praecox or the Group of Schizophrenias. New York, NY:
International Universities Press;
1950
3.Heinrichs
RWZakzanis
KK Neurocognitive deficits in schizophrenia: a quantitative review of the evidence.
Neuropsychology 1998;12
(3)
426- 445
PubMedGoogle Scholar 4.Mesholam-Gately
RIGiuliano
AJGoff
KPFaraone
SVSeidman
LJ Neurocognition in first-episode schizophrenia.
Neuropsychology 2009;23
(3)
315- 336
PubMedGoogle Scholar 5.Seidman
LJ Schizophrenia and brain dysfunction: an integration of recent neurodiagnostic findings.
Psychol Bull 1983;94
(2)
195- 238
PubMedGoogle Scholar 6.Green
MF What are the functional consequences of neurocognitive deficits in schizophrenia?
Am J Psychiatry 1996;153
(3)
321- 330
PubMedGoogle Scholar 7.Cornblatt
BAErlenmeyer-Kimling
L Global attentional deviance as a marker of risk for schizophrenia: specificity and predictive validity.
J Abnorm Psychol 1985;94
(4)
470- 486
PubMedGoogle Scholar 8.Woodberry
KAGiuliano
AJSeidman
LJ Premorbid IQ in schizophrenia: a meta-analytic review.
Am J Psychiatry 2008;165
(5)
579- 587
PubMedGoogle Scholar 9.Niemi
LTSuvisaari
JTuulio-Henriksson
ALonnqvist
J Childhood developmental abnormalities in schizophrenia.
Schizophr Res 2003;60
(2-3)
239- 258
PubMedGoogle Scholar 10.Brewer
WJWood
SJPhillips
LJFrancey
SMPantelis
CYung
ARCornblatt
B McGorry
PD Generalized and specific cognitive performance in clinical high-risk cohorts: a review highlighting potential vulnerability markers for psychosis.
Schizophr Bull 2006;32
(3)
538- 555
PubMedGoogle Scholar 11.Kremen
WSSeidman
LJPepple
JRLyons
MJTsuang
MTFaraone
SV Neuropsychological risk indicators for schizophrenia: a review of family studies.
Schizophr Bull 1994;20
(1)
103- 119
PubMedGoogle Scholar 12.Sitskoorn
MMAleman
AEbisch
SJAppels
MCKahn
RS Cognitive deficits in relatives of patients with schizophrenia.
Schizophr Res 2004;71
(2-3)
285- 295
PubMedGoogle Scholar 13.Snitz
BEMacdonald
AW
IIICarter
CS Cognitive deficits in unaffected first-degree relatives of schizophrenia patients.
Schizophr Bull 2006;32
(1)
179- 194
PubMedGoogle Scholar 14.Trandafir
AMéary
ASchürhoff
FLeboyer
MSzöke
A Memory tests in first-degree adult relatives of schizophrenic patients: a meta-analysis.
Schizophr Res 2006;81
(2-3)
217- 226
PubMedGoogle Scholar 15.Szöke
ASchurhoff
FMathieu
FMeary
AIonescu
SLeboyer
M Test of executive functions in first-degree relatives of schizophrenic patients: a meta-analysis.
Psychol Med 2005;35
(6)
771- 782
PubMedGoogle Scholar 16.Gottesman
IIGould
TD The endophenotype concept in psychiatry: etymology and strategic intentions.
Am J Psychiatry 2003;160
(4)
636- 645
PubMedGoogle Scholar 17.Gur
RECalkins
MEGur
RCHoran
WPNuechterlein
KHSeidman
LJStone
WS The consortium on the genetics of schizophrenia: neurocognitive endophenotypes.
Schizophr Bull 2007;33
(1)
49- 68
PubMedGoogle Scholar 18.Harrison
PJWeinberger
DR Schizophrenia genes, gene expression, and neuropathology.
Mol Psychiatry 2005;10
(1)
40- 68, image 5
PubMedGoogle Scholar 19.Seidman
LJGiuliano
AJSmith
CWStone
WSGlatt
SJMeyer
EFaraone
SVTsuang
MTCornblatt
B Neuropsychological functioning in adolescents and young adults at genetic risk for schizophrenia and affective psychoses.
Schizophr Bull 2006;32
(3)
507- 524
PubMedGoogle Scholar 20.Nuechterlein
KHDawson
ME Information processing and attentional functioning in the developmental course of schizophrenia disorders.
Schizophr Bull 1984;10
(2)
160- 203
PubMedGoogle Scholar 21.Seidman
LJ The neuropsychology of schizophrenia: a neurodevelopmental and case study approach.
J Neuropsychiatry Clin Neurosci 1990;2
(3)
301- 312
PubMedGoogle Scholar 22.Cornblatt
BALencz
TSmith
CECorrell
CUAuther
AMNakayama
E The schizophrenia prodrome revisited.
Schizophr Bull 2003;29
(4)
633- 651
PubMedGoogle Scholar 23.Insel
TRScolnick
EM Cure therapeutics and strategic prevention: raising the bar for mental health research.
Mol Psychiatry 2006;11
(1)
11- 17
PubMedGoogle Scholar 24.Peters
ALDavidson
MBSchriger
DLHasselblad
VMeta-analysis Research Group on the Diagnosis of Diabetes Using Glycated Hemoglobin Levels, A clinical approach for the diagnosis of diabetes mellitus: an analysis using glycosylated hemoglobin levels.
JAMA 1996;276
(15)
1246- 1252
PubMedGoogle Scholar 25.Adams
EKBreen
NJoski
PJ Impact of the National Breast and Cervical Cancer Early Detection Program on mammography and Pap test utilization among white, Hispanic, and African American women: 1996-2000.
Cancer 2007;109
(2)
(suppl)348- 358
PubMedGoogle Scholar 26.Yung
AR McGorry
PD The prodromal phase of first-episode psychosis: past and current conceptualizations.
Schizophr Bull 1996;22
(2)
353- 370
PubMedGoogle Scholar 27. McGlashan
THJohannessen
JO Early detection and intervention with schizophrenia: rationale.
Schizophr Bull 1996;22
(2)
201- 222
PubMedGoogle Scholar 28.Cornblatt
B From the prediction of schizophrenia to prevention: the New York High Risk Project to the Hillside Recognition and Prevention (RAP) Program.
Am J Med Genet B Neuropsychiatr Genet 2002;114
(8)
956- 966doi:10.1002/ajmg.b.10520
Google Scholar 29.Cannon
TD Clinical and genetic high-risk strategies in understanding vulnerability to psychosis.
Schizophr Res 2005;79
(1)
35- 44
PubMedGoogle Scholar 30.Cannon
TDCadenhead
KSCornblatt
BWoods
SWAddington
JWalker
EFSeidman
LJPerkins
DOTsuang
MT McGlashan
THHeinssen
R Prediction of psychosis in youth at high clinical risk: a multi-site longitudinal study in North America.
Arch Gen Psychiatry 2008;65
(1)
28- 37
PubMedGoogle Scholar 31.Hawkins
KAAddington
JKeefe
RSChristensen
BPerkins
DOZipurksy
RWoods
SWMiller
TJMarquez
EBreier
A McGlashan
TH Neuropsychological status of subjects at high risk for a first episode of psychosis.
Schizophr Res 2004;67
(2-3)
115- 122
PubMedGoogle Scholar 32.Keefe
RSEPerkins
DOGu
HZipursky
RBChristensen
BKLieberman
JA A longitudinal study of neurocognitive function in individuals at-risk for psychosis.
Schizophr Res 2006;88
(1-3)
26- 35
PubMedGoogle Scholar 33.Hawkins
KAKeefe
RSChristensen
BKAddington
JWoods
SWCallahan
JZipursky
RBPerkins
DOTohen
MBreier
A McGlashan
TH Neuropsychological course in the prodrome and first episode of psychosis: findings from the PRIME North America Double Blind Treatment Study.
Schizophr Res 2008;105
(1-3)
1- 9
PubMedGoogle Scholar 34.Silverstein
SUhlhaas
PJEssex
BHalpin
SSchall
UCarr
V Perceptual organization in first episode schizophrenia and ultra-high-risk states.
Schizophr Res 2006;83
(1)
41- 52
PubMedGoogle Scholar 35.Bartók
EBerecz
RGlaub
TDegrell
I Cognitive functions in prepsychotic patients.
Prog Neuropsychopharmacol Biol Psychiatry 2005;29
(4)
621- 625
PubMedGoogle Scholar 36.Myles-Worsley
MOrd
LMNgiralmau
HWeaver
SBlailes
FFaraone
SV The Palau Early Psychosis Study: neurocognitive functioning in high-risk adolescents.
Schizophr Res 2007;89
(1-3)
299- 307
PubMedGoogle Scholar 37.Smith
CWPark
SCornblatt
B Spatial working memory deficits in adolescents at clinical high risk for schizophrenia.
Schizophr Res 2006;81
(2-3)
211- 215
PubMedGoogle Scholar 38.Wood
SJPantelis
CProffitt
TPhillips
LJStuart
GWBuchanan
JMahony
KBrewer
WJSmith
D McGorry
PD Spatial working memory ability is a marker of risk-for-psychosis.
Psychol Med 2003;33
(7)
1239- 1247
PubMedGoogle Scholar 39.Brewer
WJFrancey
SMWood
SJJackson
HJPantelis
CPhillips
LJYung
ARAnderson
VA McGorry
PD Memory impairments identified in people at ultra-high risk for psychosis who later develop first-episode psychosis.
Am J Psychiatry 2005;162
(1)
71- 78
PubMedGoogle Scholar 40.Lencz
TSmith
CW McLaughlin
DAuther
ANakayama
EHovey
LCornblatt
BA Generalized and specific neurocognitive deficits in prodromal schizophrenia.
Biol Psychiatry 2006;59
(9)
863- 871
PubMedGoogle Scholar 41.Francey
SMJackson
HJPhillips
LJWood
SJYung
AR McGorry
PD Sustained attention in young people at high risk of psychosis does not predict transition to psychosis.
Schizophr Res 2005;79
(1)
127- 136
PubMedGoogle Scholar 42.Gschwandtner
UPflüger
MAston
JBorgwardt
SDrewe
MStieglitz
RDRiecher-Rössler
A Fine motor function and neuropsychological deficits in individuals at risk for schizophrenia.
Eur Arch Psychiatry Clin Neurosci 2006;256
(4)
201- 206
PubMedGoogle Scholar 43.Hambrecht
MLammertink
MKlosterkotter
JMatuschek
EPukrop
R Subjective and objective neuropsychological abnormalities in a psychosis prodrome clinic.
Br J Psychiatry Suppl 2002;43s30- s37
PubMedGoogle Scholar 44.Niendam
TABearden
CEJohnson
JK McKinley
MLoewy
RO’Brien
MNuechterlein
KHGreen
MFCannon
TD Neurocognitive performance and functional disability in the psychosis prodrome.
Schizophr Res 2006;84
(1)
100- 111
PubMedGoogle Scholar 45.Gschwandtner
UAston
JBorgwardt
SDrewe
MFeinendegen
CLacher
DLanzarone
AStieglitz
RDRiecher-Rössler
ABasel Early Detection of Psychosis Study–Früherkennung von Psychosen (FEPSY), Neuropsychological and neurophysiological findings in individuals suspected to be at risk for schizophrenia.
Acta Psychiatr Scand 2003;108
(2)
152- 155
PubMedGoogle Scholar 46.Pflueger
MOGschwandtner
UStieglitz
RDRiecher-Rossler
A Neuropsychological deficits in individuals with an at risk mental state for psychosis: working memory as a potential trait marker.
Schizophr Res 2007;97
(1-3)
14- 24
PubMedGoogle Scholar 47.Brewer
WJWood
SJ McGorry
PDFrancey
SMPhillips
LJYung
ARAnderson
VCopolov
DLSingh
BVelakoulis
DPantelis
C Impairment of olfactory identification ability in individuals at ultra-high risk for psychosis who later develop schizophrenia.
Am J Psychiatry 2003;160
(10)
1790- 1794
PubMedGoogle Scholar 48.Eastvold
ADHeaton
RKCadenhead
KS Neurocognitive deficits in the (putative) prodrome and first episode of psychosis.
Schizophr Res 2007;93
(1-3)
266- 277
PubMedGoogle Scholar 49.Jahshan
CHeaton
RKGolshan
SCadenhead
KS Course of neurocognitive deficits in the prodrome and first episode of schizophrenia.
Neuropsychology 2010;24
(1)
109- 120
PubMedGoogle Scholar 50.Niendam
TABearden
CEZinberg
JJohnson
JKO’Brien
MCannon
TD The course of neurocognition and social functioning in individuals at ultra high risk for psychosis.
Schizophr Bull 2007;33
(3)
772- 781
PubMedGoogle Scholar 51.Cosway
RByrne
MClafferty
RHodges
AGrant
EAbukmeil
SSLawrie
SMMiller
PJohnstone
EC Neuropsychological change in young people at high risk for schizophrenia.
Psychol Med 2000;30
(5)
1111- 1121
PubMedGoogle Scholar 52.Pukrop
RSchultze-Lutter
FRuhrmann
SBrockhaus-Dumke
ATendolkar
IBechdolf
AMatuschek
EKlosterkötter
J Neurocognitive functioning in subjects at risk for a first episode of psychosis compared with first- and multiple-episode schizophrenia.
J Clin Exp Neuropsychol 2006;28
(8)
1388- 1407
PubMedGoogle Scholar 53.Pukrop
RRuhrmann
SSchultze-Lutter
FBechdolf
ABrockhaus-Dumke
AKlosterkötter
J Neurocognitive indicators for a conversion to psychosis: comparison of patients in a potentially initial prodromal state who did or did not convert to a psychosis.
Schizophr Res 2007;92
(1-3)
116- 125
PubMedGoogle Scholar 54.Kimhy
DCorcoran
CHarkavy-Friedman
JMRitzler
BJavitt
DCMalaspina
D Visual form perception: a comparison of individuals at high risk for psychosis, recent onset schizophrenia and chronic schizophrenia.
Schizophr Res 2007;97
(1-3)
25- 34
PubMedGoogle Scholar 55.Addington
JCadenhead
KSCannon
TDCornblatt
B McGlashan
THPerkins
DOSeidman
LJTsuang
MWalker
EFWoods
SWHeinssen
RNorth American Prodrome Longitudinal Study, North American Prodrome Longitudinal Study: a collaborative multisite approach to prodromal schizophrenia research.
Schizophr Bull 2007;33
(3)
665- 672
PubMedGoogle Scholar 56.Woods
SWAddington
JCadenhead
KSCannon
TDCornblatt
BAHeinssen
RPerkins
DOSeidman
LJTsuang
MTWalker
EF McGlashan
TH Validity of the prodromal risk syndrome for first psychosis: findings from the North American Prodrome Longitudinal Study.
Schizophr Bull 2009;35
(5)
894- 908
PubMedGoogle Scholar 57.Miller
TJ McGlashan
THRosen
JLCadenhead
KCannon
TVentura
J McFarlane
WPerkins
DOPearlson
GDWoods
SW Prodromal assessment with the structured interview for prodromal syndromes and the scale of prodromal symptoms.
Schizophr Bull 2003;29
(4)
703- 715
PubMedGoogle Scholar 58.Miller
TJ McGlashan
THRosen
JLSomjee
LMarkovich
PJStein
KWoods
SW Prospective diagnosis of the initial prodrome for schizophrenia based on the Structured Interview for Prodromal Syndromes: preliminary evidence of interrater reliability and predictive validity.
Am J Psychiatry 2002;159
(5)
863- 865
PubMedGoogle Scholar 59.American Psychiatric Association Diagnostic and Statistical Manual of Mental Disorders. 4th ed. Washington, DC:
American Psychiatric Association;
1994
60.Spitzer
RLWilliams
JBGibbon
M Instruction Manual for the Structured Clinical Interview for DSM-IV. New York:
Biometrics Research Dept, New York State Psychiatric Institute;
1994
61.Kendler
KSGruenberg
AMStrauss
JS An independent analysis of the Copenhagen sample of the Danish adoption study of schizophrenia, II: the relationship between schizotypal personality disorder and schizophrenia.
Arch Gen Psychiatry 1981;38
(9)
982- 984
PubMedGoogle Scholar 62.Siever
LJDavis
K The pathophysiology of schizophrenia disorders: perspectives from the spectrum
Am J Psychiatry 2004;161
(3)
398- 413
PubMedGoogle Scholar 63.Nuechterlein
KHBarch
DMGold
JMGoldberg
TEGreen
MFHeaton
RK Identification of separable cognitive factors in schizophrenia.
Schizophr Res 2004;72
(1)
29- 39
PubMedGoogle Scholar 64.Wechsler
D Manual for the Wechsler Intelligence Scale for Children. 3rd ed. San Antonio, TX:
Psychological Corp;
1991
65.Wechsler
D Manual for the Wechsler Adult Intelligence Scale-Revised. San Antonio, TX:
Psychological Corp;
1981
66.Wechsler
D Wechsler Adult Intelligence Scale. 3rd ed. San Antonio, TX:
Psychological Corp;
1997
67.Wechsler
D Manual for the Wechsler Abbreviated Intelligence Scale (WASI). San Antonio, TX:
Psychological Corp;
1999
68.Cornblatt
BARisch
NJFaris
GFriedman
DErlenmeyer-Kimling
L The Continuous Performance Test, Identical Pairs version (CPT-IP), I: new findings about sustained attention in normal families.
Psychiatry Res 1988;26
(2)
223- 238
PubMedGoogle Scholar 69.Reitan
RWolfson
D The Halstead-Reitan Neuropsychological Test Battery: Theory and Clinical Interpretation. 2nd ed. Tucson, AZ:
Neuropsychology Press;
1993
70.Benton
AHamsher
KSivan
A Multilingual Aphasia Examination. 3rd ed. Iowa City, IA:
AJA Associates;
1983
71.Heaton
RKChelune
GJTalley
JLKay
GGCurtiss
G Wisconsin Card Sort Test Manual: Revised and Expanded. Odessa, FL:
Psychological Assessment Resources, Inc;
1993
72.Kongs
SKThompson
LLIverson
GLHeaton
RK Wisconsin Card Sorting Test-64 Card Version. Lutz, FL:
Psychological Assessment Resources;
2000
73.Wechsler
D The Wechsler Memory Scale-Revised: Manual. San Antonio, TX:
Psychological Corp;
1987
74.Wechsler
D Manual for the Wechsler Memory Scale. 3rd ed. San Antonio, TX:
Psychological Corp;
1997
75.Cohen
M Children's Memory Scale. San Antonio, TX:
Psychological Corp;
1997
76.Brandt
JBenedict
RHB Hopkins Verbal Learning Test–Revised (HVLT-R). Odessa, FL:
Psychological Assessment Resources Inc;
1998
77.Lezak
MD Neuropsychological Assessment. 3rd ed. New York, NY:
Oxford University Press;
1995
78.Delis
DCKramer
JHKaplan
EOber
BA California Verbal Learning Test. 2nd ed. San Antonio, TX:
Psychological Corp;
2000
79.Delis
DKramer
JKaplan
EOber
B The California Verbal Learning Test-Children's Version. San Antonio, TX:
Psychological Corp;
1994
80.Rubin
DB Multiple Imputation for Nonresponse in Surveys. New York, NY:
John Wiley & Sons;
1987
81.Little
RJARubin
DB Statistical Analysis With Missing Data. New York, NY:
John Wiley & Sons;
2002
82.Schafer
JLGraham
JW Missing data: our view of the state of the art.
Psychol Methods 2002;7
(2)
147- 177
PubMedGoogle Scholar 83.Brooker
BHCyr
JJ Tables for clinicians to use to convert WAIS-R short forms.
J Clin Psychol 1986;42
(6)
982- 986doi:10.1002/1097-4679(198611)42:6<982::AID-JCLP2270420624>3.0.CO;2-G
Google Scholar 84.Cohen
J Statistical Power Analysis for the Behavioral Sciences. 2nd ed. Hillsdale, NJ:
Erlbaum;
1988
85.Caspi
AReichenberg
AWeiser
MRabinowitz
JKaplan
ZKnobler
HDavidson-Sagi
NDavidson
M Cognitive performance in schizophrenia patients assessed before and following the first psychotic episode.
Schizophr Res 2003;65
(2-3)
87- 94
PubMedGoogle Scholar 86.Seidman
LJFaraone
SVGoldstein
JMKremen
WSHorton
NJMakris
NToomey
RKennedy
DCaviness
VSTsuang
MT Left hippocampal volume as a vulnerability indicator for schizophrenia: a magnetic resonance imaging morphometric study of non-psychotic first-degree relatives.
Arch Gen Psychiatry 2002;59
(9)
839- 849
PubMedGoogle Scholar 87.Seidman
LJThermenos
HWPoldrack
RAPeace
NKKoch
JKFaraone
SVTsuang
MT Altered brain activation in dorsolateral prefrontal cortex in adolescents and young adults at genetic risk for schizophrenia: an fMRI study of working memory.
Schizophr Res 2006;85
(1-3)
58- 72
PubMedGoogle Scholar 88.Klosterkötter
JHellmich
MSteinmeyer
EMSchultze-Lutter
F Diagnosing schizophrenia in the initial prodromal phase.
Arch Gen Psychiatry 2001;58
(2)
158- 164
PubMedGoogle Scholar