Key PointsQuestion
What are the levels of plasma glial fibrillary acidic protein (GFAP) throughout the Alzheimer disease (AD) continuum, and how do they compare with the levels of cerebrospinal fluid (CSF) GFAP?
Findings
In this cross-sectional study, plasma GFAP levels were elevated in the preclinical and symptomatic stages of AD, with levels higher than those of CSF GFAP. Plasma GFAP had a higher accuracy than CSF GFAP to discriminate between amyloid-β (Aβ)–positive and Aβ-negative individuals, also at the preclinical stage.
Meaning
This study suggests that plasma GFAP is a sensitive biomarker that significantly outperforms CSF GFAP in indicating Aβ pathology in the early stages of AD.
Importance
Glial fibrillary acidic protein (GFAP) is a marker of reactive astrogliosis that increases in the cerebrospinal fluid (CSF) and blood of individuals with Alzheimer disease (AD). However, it is not known whether there are differences in blood GFAP levels across the entire AD continuum and whether its performance is similar to that of CSF GFAP.
Objective
To evaluate plasma GFAP levels throughout the entire AD continuum, from preclinical AD to AD dementia, compared with CSF GFAP.
Design, Setting, and Participants
This observational, cross-sectional study collected data from July 29, 2014, to January 31, 2020, from 3 centers. The Translational Biomarkers in Aging and Dementia (TRIAD) cohort (Montreal, Canada) included individuals in the entire AD continuum. Results were confirmed in the Alzheimer’s and Families (ALFA+) study (Barcelona, Spain), which included individuals with preclinical AD, and the BioCogBank Paris Lariboisière cohort (Paris, France), which included individuals with symptomatic AD.
Main Outcomes and Measures
Plasma and CSF GFAP levels measured with a Simoa assay were the main outcome. Other measurements included levels of CSF amyloid-β 42/40 (Aβ42/40), phosphorylated tau181 (p-tau181), neurofilament light (NfL), Chitinase-3-like protein 1 (YKL40), and soluble triggering receptor expressed on myeloid cells 2 (sTREM2) and levels of plasma p-tau181 and NfL. Results of amyloid positron emission tomography (PET) were available in TRIAD and ALFA+, and results of tau PET were available in TRIAD.
Results
A total of 300 TRIAD participants (177 women [59.0%]; mean [SD] age, 64.6 [17.6] years), 384 ALFA+ participants (234 women [60.9%]; mean [SD] age, 61.1 [4.7] years), and 187 BioCogBank Paris Lariboisière participants (116 women [62.0%]; mean [SD] age, 69.9 [9.2] years) were included. Plasma GFAP levels were significantly higher in individuals with preclinical AD in comparison with cognitively unimpaired (CU) Aβ-negative individuals (TRIAD: Aβ-negative mean [SD], 185.1 [93.5] pg/mL, Aβ-positive mean [SD], 285.0 [142.6] pg/mL; ALFA+: Aβ-negative mean [SD], 121.9 [42.4] pg/mL, Aβ-positive mean [SD], 169.9 [78.5] pg/mL). Plasma GFAP levels were also higher among individuals in symptomatic stages of the AD continuum (TRIAD: CU Aβ-positive mean [SD], 285.0 [142.6] pg/mL, mild cognitive impairment [MCI] Aβ-positive mean [SD], 332.5 [153.6] pg/mL; AD mean [SD], 388.1 [152.8] pg/mL vs CU Aβ-negative mean [SD], 185.1 [93.5] pg/mL; Paris: MCI Aβ-positive, mean [SD], 368.6 [158.5] pg/mL; AD dementia, mean [SD], 376.4 [179.6] pg/mL vs CU Aβ-negative mean [SD], 161.2 [67.1] pg/mL). Plasma GFAP magnitude changes were consistently higher than those of CSF GFAP. Plasma GFAP more accurately discriminated Aβ-positive from Aβ-negative individuals than CSF GFAP (area under the curve for plasma GFAP, 0.69-0.86; area under the curve for CSF GFAP, 0.59-0.76). Moreover, plasma GFAP levels were positively associated with tau pathology only among individuals with concomitant Aβ pathology.
Conclusions and Relevance
This study suggests that plasma GFAP is a sensitive biomarker for detecting and tracking reactive astrogliosis and Aβ pathology even among individuals in the early stages of AD.
The rapid advancements in the development of blood biomarkers to accurately detect Alzheimer disease (AD) point to a prompt application of these biomarkers in clinical routine and clinical trials. This application is especially true for individuals with preclinical AD, as scalable and less invasive biomarkers are needed to screen large populations of cognitively unimpaired (CU) individuals to test innovative interventions.
Currently, the most promising blood biomarkers for detecting AD are the phosphorylated tau species (p-tau)1-6 and amyloid-β 42/40 (Aβ42/40) ratio.7-12 However, it is still desirable to have more sensitive blood biomarkers for preclinical AD. Alzheimer disease pathology is associated with morphologic, molecular, and functional remodeling of astrocytes, a process termed reactive astrogliosis.13,14 However, few astrocyte imaging and fluid biomarkers have been investigated.15 Blood levels of glial fibrillary acidic protein (GFAP), a reactive astrogliosis biomarker, are higher in individuals with preclinical AD, constituting a promising candidate biomarker for this early stage of the disease.16 A recent meta-analysis demonstrated that GFAP levels were consistently altered in the cerebrospinal fluid (CSF) of symptomatic patients with AD, but studies of blood GFAP present relatively high variability.17
It is not yet well known how plasma GFAP levels change across the overall AD continuum and whether GFAP concentrations in CSF and blood reflect the same pathologic processes because reactive astrocytes assume multiple states—the so-called astrocyte heterogeneity. Thus, our main aim was to evaluate the levels of plasma GFAP throughout the AD continuum and compare them with the levels of CSF GFAP, with particular attention to preclinical AD. We hypothesized that plasma GFAP levels are already higher early in the preclinical stage and further elevated in symptomatic stages.
This cross-sectional study, which included participants from 3 cohorts, collected data from July 29, 2014, to January 31, 2020. The Translational Biomarkers in Aging and Dementia (TRIAD) cohort (Montreal, Canada)18 comprised 300 individuals (177 women [59.0%]; mean [SD] age, 64.6 [17.6] years), including young CU adults, elderly CU adults, individuals with mild cognitive impairment (MCI), and patients with AD dementia. The ALFA+ cohort (Barcelona, Spain),19 which is a nested study of the ALFA (for Alzheimer’s and Families) study, included 384 middle-aged CU individuals (234 women [60.9%]; mean [SD] age, 61.1 [4.7] years) at elevated risk for AD. The BioCogBank Paris Lariboisière cohort (Paris, France)20 included 166 patients with cognitive disorders from the Center of Cognitive Neurology, Lariboisière Hospital, as well as 21 CU individuals. In addition to clinical classification (CU, MCI, and dementia), participants were categorized according to Aβ status (Aβ-positive [Aβ+] and Aβ-negative [Aβ–]), defined by results of Aβ positron emission tomography (PET) in TRIAD and the CSF Aβ42/40 ratio in ALFA+ and Paris, if not otherwise specified. ALFA+ participants were also classified using the AT (Aβ and tau pathology) classification.21,22 Participants with non–AD dementia (frontotemporal dementia [FTD] or dementia with Lewy bodies) from the TRIAD and Paris cohorts were included for supplementary analysis. All studies have been approved by their regional ethical committees (TRIAD: McGill University and Douglas Hospital Research Centre institutional review boards; ALFA+: Independent Ethics Committee “Parc de Salut Mar,” Barcelona; and Paris Cohort: Bichat Ethics Comittee), and all participants provided written informed consent. Additional details of the 3 cohorts are reported in the eMethods in Supplement 1.
Fluid and Neuroimaging Biomarkers
Plasma and CSF samples from the 3 cohorts were independently analyzed at the Clinical Neurochemistry Laboratory, University of Gothenburg, Gothenburg, Sweden. Plasma and CSF GFAP levels were quantified for all cohorts on the Simoa HD-X (Quanterix) using the commercial single-plex assay (No. 102336). A comprehensive description of the fluid and neuroimaging biomarker measurements can be found in the eMethods in Supplement 1.
We used linear regression models to assess the association between plasma or CSF GFAP levels and the other biomarkers. Similar models were applied to evaluate group differences and associations with age and sex; the Tukey honestly significant difference test was used for post hoc pairwise comparisons. Fold changes and the effect size of the differences (estimated with Cohen d ) were calculated using Aβ– CU (CU–) individuals (TRIAD and Paris) and Aβ– and tau– (A–T–) individuals or Aβ− individuals (ALFA+) as reference groups. All analyses were adjusted for age and sex if not otherwise specified. The Spearman rank test was used for correlations using raw biomarker values. Receiver operating curve (ROC) analyses provided the area under the curve (AUC) for Aβ positivity or diagnostic groups. The “pROC” package in R, version 3.6.3 (R Group for Statistical Computing) was used to compare AUCs, and the false discovery rate was used to correct P values for multiple comparisons. Mediation analyses were performed with the R package “mediation.” All tests were 2-tailed, with a significance level of α = .05. All statistical analyses and figures were performed with R, version 3.6.3. Further details are provided in the eMethods in Supplement 1.
Participants’ Characteristics and Correlations Between Biomarkers
Demographic and clinical data from the 3 studies are summarized in Table 1 and eTable 1 in Supplement 1. There was a positive association between age and both plasma and CSF GFAP levels in the 3 cohorts (TRIAD: plasma, β [SE] = 0.64 [0.13]; P < .001; CSF, β [SE] = 0.35 [0.15]; P = .02); ALFA+: plasma, β [SE] = 0.38 [0.048]; P < .001; CSF, β [SE] = 0.26 [0.049]; P < .001; and Paris: plasma, β [SE] = 0.26 [0.06]; P < .001; CSF, β [SE] = 0.32 [0.07]; P < .001), which can also be evidenced when comparing plasma or CSF GFAP mean levels between young CU participants and elderly CU– individuals (TRIAD: plasma, CU– mean [SD], 185.1 [93.5] pg/mL; young CU mean [SD], 95.1 [62.1] pg/mL; P = .001; CSF, CU– mean [SD], 12 506 [5148] pg/mL; young CU mean [SD], 4134 [1483] pg/mL; P < .001). Plasma GFAP levels were higher in CU women than in CU men (TRIAD: mean [SD], 161.0 [81.7] pg/mL in men vs 239.01 [123.84] pg/mL in women; P < .001; ALFA+: mean [SD], 128.9 [59.7] pg/mL in men vs 145.6 [63.1] pg/mL in women; P < .001) and were also higher specifically in CU– women compared with CU– men (TRIAD: mean [SD], 142.5 [63.2] pg/mL in men vs 209.1 [99.5] pg/mL in women; P < .001; ALFA+: mean [SD], 117.0 [43.9] pg/mL in men vs 125.1 [41.2] pg/mL in women; P = .01; and Paris cohort: mean [SD], 118.9 [34.6] pg/mL in men vs 179.34 [68.26] pg/mL in women; P = .03). The same sex differences were also observed when all participants were included (adjusting for age and diagnosis, TRIAD: mean [SD], 224.7 [153.2] pg/mL in men vs 248.1 [146.1] pg/mL in women; P = .002; Paris: mean [SD], 262.7 [138.4] pg/mL in men vs 326.7 [189.6] pg/mL in women; P < .001). APOE ε4 carriership (NCBI Gene ID: 348) was not associated with plasma or CSF GFAP levels in any of the cohorts when models accounted for Aβ status or clinical diagnosis.
There was a positive correlation between plasma and CSF GFAP levels in the 3 cohorts (eFigure 1 in Supplement 1). Spearman rank correlations between plasma and CSF GFAP levels and other biomarkers are presented in eFigure 2 in Supplement 1.
Plasma GFAP Levels Throughout the AD Continuum
In the TRIAD cohort, levels of plasma and CSF GFAP were higher across the AD continuum, namely, in Aβ+ CU (CU+) individuals (ie, preclinical AD), individuals with Aβ+ MCI (MCI+; ie, MCI due to AD), and individuals with AD dementia (Figure 1A). Compared with the CU– group, plasma GFAP levels were higher in the CU+ group (54% increase; P = .001; d = 0.66), in the MCI+ group (79% increase; P < .001; d = 1.35), and in the AD dementia group (107% increase; P < .001; d = 2.10). Patients with FTD had plasma GFAP levels as low as CU– individuals (eFigure 3A in Supplement 1). Levels of CSF GFAP were also higher in the AD continuum groups compared with CU– individuals (Figure 1B), but the group differences were not significant after correction for multiple comparisons. The magnitude of the CSF GFAP changes was not as large as that of the plasma GFAP changes (the CSF GFAP level increases with CU– individuals as the reference group: CU+ individuals, 24% increase; P = .24; d = 0.56; individuals with MCI+, 35% increase; P = .06; d = 0.82; and individuals with AD dementia, 30% increase; P = .03; d = 0.86). Similar to plasma GFAP levels, patients with FTD had lower CSF GFAP levels than patients on the AD continuum (eFigure 3B in Supplement 1).
In ALFA+, we used the biomarker-based AT classification21,22 to study 2 stages in preclinical AD: Aβ+ but tau– (A+T–) and Aβ+ and tau+ (A+T+) and compared it with the A–T– stage. Plasma GFAP levels were significantly higher in the A+T– group compared with the A–T– group (32% increase; P < .001; d = 0.55) (Figure 1C), whereas CSF GFAP levels were not (1% increase; P = .99; d = 0.01; Figure 1D). Both plasma and CSF GFAP were significantly higher in the A+T+ group compared with the A–T– group (plasma: 60% increase; P < .001; d = 1.09; CSF: 77% increase; P < .001; d = 1.18). Participants in the Aβ– and tau+ (A–T+ group) did not have higher plasma or CSF GFAP levels compared with the A–T– group. To further test whether plasma and CSF GFAP levels were increased in the earliest stage of the preclinical AD continuum, we analyzed a group of individuals with a low burden of Aβ pathology, namely, a positive CSF Aβ42/40 ratio but Aβ PET centiloids lower than 3023 (eMethods in Supplement 1). We observed that plasma GFAP levels were significantly higher in this group compared with Aβ– participants (28% increase; P < .001; d = 0.57; eFigure 4A in Supplement 1) while CSF GFAP levels were not (8% increase; P = .37; d = 0.16; eFigure 4B in Supplement 1).
In the Paris cohort, plasma and CSF GFAP levels followed similar patterns to those described for TRIAD. Plasma GFAP levels were higher in individuals with MCI+ (128% increase; P < .001; d = 1.40) and in those with AD dementia (133% increase; P < .001; d = 1.37) compared with the CU– group, and no difference was found between the CU– group and non-AD group (Figure 1E). Levels of CSF GFAP were higher in individuals with MCI+ (72% increase; d = 0.44) and AD dementia (89% increase; d = 0.64) compared with CU– individuals, but differences were not statistically significant after correction for multiple comparisons (Figure 1F). Similar to TRIAD, patients with FTD and dementia with Lewy bodies had plasma and CSF GFAP levels comparable to CU– individuals (eFigure 3C and 3D in Supplement 1).
Association of Plasma GFAP Levels With Aβ Pathology and Discrimination of Aβ Status
We evaluated the association of plasma and CSF GFAP levels with Aβ pathology as measured with CSF Aβ42/40 or Aβ PET. Because our aim was to study the AD continuum, for all subsequent analyses, we included only CU individuals, those with MCI, and those with AD dementia (for TRIAD and Paris cohorts). In the ALFA+ cohort, we excluded individuals with an A–T+ (non-AD pathologic change) biomarker profile. In TRIAD, both plasma and CSF GFAP levels were negatively associated with CSF Aβ42/40 (plasma GFAP, P < .001; ηp2 = 0.26; CSF GFAP, P = .01; ηp2 = 0.11; Figure 2A and B) and positively associated with Aβ PET (plasma GFAP, P < .001; ηp2 = 0.32; CSF GFAP, P < .001; ηp2 = 0.10; eFigure 5A and 5B in Supplement 1). The sizes of the associations of Aβ pathology (either CSF Aβ42/40 or Aβ PET) with plasma GFAP levels were larger than those with CSF GFAP levels. We performed the same analyses within the CU individuals, and plasma GFAP levels were significantly associated with both Aβ biomarkers (CSF Aβ42/40: P = .008; ηp2 = .07; Aβ PET: P < .001; ηp2 = .06). In contrast, CSF GFAP levels were not significantly associated with CSF Aβ42/40 (P = .18) or Aβ PET (P = .07) within the CU individuals.
In ALFA+, plasma GFAP levels were positively associated with Aβ pathology as shown by a significant negative association with CSF Aβ42/40 in the whole sample (P < .001; ηp2 = 0.13) but also in the CU– group (P = .002; ηp2 = 0.04) and CU+ group (P = .03; ηp2 = 0.04) (Figure 2D). Levels of CSF GFAP also showed a negative association with CSF Aβ42/40 in the whole sample (P = .02; ηp2 = 0.01; Figure 2E) and in the CU+ group (P = .005; ηp2 = 0.06). Conversely, a positive association between CSF GFAP levels and CSF Aβ42/40 was observed in CU– participants (P = .02; ηp2 = 0.02). Both plasma and CSF GFAP levels were associated with Aβ deposition as quantified by Aβ PET (eFigure 5C and D in Supplement 1) in the whole sample (plasma GFAP, P < .001; ηp2 = 0.10; CSF GFAP, P = .001; ηp2 = 0.04).
The same analysis was repeated in the Paris cohort, and the size of the association of CSF Aβ42/40 with plasma GFAP levels (plasma, P < .001; ηp2 = 0.41) was greater than that with CSF GFAP levels (CSF, P = .006; ηp2 = 0.16; Figure 2G and H).
We next investigated how plasma and CSF GFAP levels discriminate Aβ status using ROC analysis (Table 2 and Figure 2). Aβ statuses were defined by CSF Aβ42/40, Aβ PET visual read, or the Aβ PET centiloids cutoffs used in each cohort (Table 2). In the entire TRIAD cohort, plasma GFAP as a biomarker accurately discriminated Aβ+ from Aβ− individuals, with an AUC ranging from 0.82 to 0.85. In contrast, CSF GFAP as a biomarker had an AUC of 0.75. In CU individuals, plasma GFAP as a biomarker distinguished Aβ status with an AUC of 0.75 to 0.79, whereas CSF GFAP as a biomarker had AUCs of 0.74 to 0.76. In ALFA+, plasma GFAP as a biomarker discriminated with an AUC of 0.69 to 0.82, while for CSF GFAP as a biomarker, AUCs were 0.59 to 0.76. In the Paris cohort, plasma GFAP as a biomarker accurately differentiated CSF Aβ42/40 status with an AUC of 0.86, while CSF GFAP as a biomarker had an AUC of 0.68. In addition, ROCs were performed contrasting CU– individuals with those with MCI+, individuals with Aβ– MCI (MCI–) with those with MCI+, and CU– individuals with those with AD (eTable 2 in Supplement 1). For comparison purposes, we also performed ROC analyses with plasma tau phosphorylated at threonine 181 (p-tau181) and neurofilament light chain (NfL), and none of them performed better than plasma GFAP.
We also performed analyses comparing different combinations of plasma biomarkers (eTable 3 in Supplement 1). We found that adding plasma GFAP to any of the other plasma biomarkers (either p-tau181 or NfL) was associated with improved accuracy to discriminate Aβ status (as measured by CSF Aβ42/40) in the 3 cohorts.
Association of Plasma GFAP Levels With Tau Pathology Among Individuals With Concomitant Aβ Pathology
We evaluated the associations between GFAP levels and tau biomarkers (CSF p-tau181 and tau PET). In TRIAD, higher plasma and CSF GFAP levels were associated with increased tau PET burden (plasma GFAP, P < .001; ηp2 = 0.29; CSF GFAP, P = .005; ηp2 = 0.08; eFigure 6A and B in Supplement 1). Both plasma and CSF GFAP levels were significantly associated with CSF p-tau181 levels in the 3 cohorts (Figure 3A-F).
We conducted a mediation analysis to assess whether the associations between GFAP levels and tau biomarkers were mediated by Aβ status. Results in TRIAD indicated that the association of plasma GFAP levels with tau was mediated by Aβ (eFigure 7A in Supplement 1), with a significant indirect association corresponding to 60% of the total association of tau with plasma GFAP levels. These findings were replicated using PET biomarkers (eFigure 7A in Supplement 1). A similar analysis was performed with CSF GFAP levels as the response variable, and tau had both a direct and an indirect association with CSF GFAP levels.
Results were consistent across cohorts (eFigure 7B and C in Supplement 1). In the ALFA+ and Paris cohorts, the association of CSF p-tau181 with plasma GFAP levels was mediated by CSF Aβ42/40, with a significant indirect association corresponding to 62% and 63% of the total association of CSF p-tau181 with plasma GFAP levels, respectively. Conversely, CSF p-tau181 did not show a significant indirect association with CSF GFAP levels, suggesting Aβ-independent effects.
Association of CSF and Plasma GFAP Levels With Neuroinflammation
Finally, we explored how plasma and CSF GFAP levels are associated with other glial biomarkers. In TRIAD, levels of CSF GFAP, but not plasma GFAP, showed a positive association with CSF soluble triggering receptor expressed on myeloid cells 2 (sTREM2) and Chitinase-3-like protein 1 (YKL40) (TRIAD: plasma GFAP association with sTREM2, β [SE] = 0.11 [0.08]; P = .17; YKL40, β [SE] = 0.02 [0.06]; P = .67; CSF GFAP association with sTREM2, β [SE] = 0.25 [0.09]; P < .001; YKL40, β [SE] = 0.32 [0.07]; P < .001) (eFigure 8A and B in Supplement 1). Similar results were observed in the ALFA+ and Paris cohorts (ALFA+: plasma GFAP association with sTREM2, β [SE] = 0.083 [0.086]; P = .14; YKL40, β [SE] = 0.075 [0.051]; P = .14; CSF GFAP association with sTREM2, β [SE] = 0.41 [0.048]; P < .001; YKL40, β [SE] = 0.40 [0.045]; P < .001; and Paris: plasma GFAP association with YKL40, β [SE] = 0.06 [0.09]; P = .49; CSF GFAP association with YKL40, β [SE] = 0.52 [0.12]; P < .001) (eFigure 8C-E in Supplement 1).
In this study, which includes 3 thoroughly characterized cohorts, we showed that plasma GFAP levels were significantly higher among individuals with preclinical AD and reached their higher levels at symptomatic stages of AD. The effect sizes of the increases of plasma GFAP levels were always larger than those of CSF GFAP levels. Therefore, plasma GFAP levels appear to be a superior biomarker tracking Aβ pathology than its CSF counterpart. This finding is particularly evident for individuals with preclinical AD; plasma GFAP levels were significantly higher in CU+ individuals and significantly discriminated them from CU– individuals, whereas CSF did not.
Previous studies showed that plasma and serum GFAP levels are higher in those with symptomatic AD,9,24-27 results that are in line with those reported for CSF GFAP levels.24,28-31 However, less is known about plasma GFAP levels among individuals along the whole AD continuum and, particularly, in those with preclinical AD. A recent study demonstrated that plasma GFAP levels were higher in a group of 33 CU+ individuals compared with 63 CU– individuals (AUC = 0.795).16 Preceding studies showed that plasma GFAP levels were associated with both clinical diagnosis and Aβ status.25 Another study revealed a quadratic (inverted U-shape) association between plasma GFAP levels and Aβ deposition.26 To our knowledge, no other studies investigated the whole AD continuum or included participants with preclinical AD, and no other studies compared plasma and CSF compartments in the same individuals.
We also analyzed the association of plasma GFAP levels with Aβ pathology (either CSF Aβ42/40 ratio or Aβ PET), and we found a positive association between plasma GFAP levels and Aβ pathology in all cohorts and high rates of accuracy to discriminate Aβ+ from Aβ– individuals (AUC = 0.82-0.86). It was also apparent when assessing the whole AD continuum that plasma GFAP levels were higher in individuals with a more advanced clinical diagnosis (CU+ less than MCI+, which was less than AD dementia). In contrast, CSF GFAP levels showed no significant difference across the AD continuum groups. Consistent with this finding, we observed a significant association between plasma GFAP levels and tau PET findings.
We included many individuals with preclinical AD: 42 in TRIAD and 135 in ALFA+. Plasma GFAP discriminated CU+ individuals from CU– individuals with an AUC of 0.75 to 0.79 in TRIAD, similar to the AUC of 0.795 previously described.16 Furthermore, in ALFA+, we studied the earliest phase of preclinical AD. We assessed 104 individuals who were A+T– (ie, had Aβ pathology but not yet tau pathology) and 89 individuals with a low Aβ burden (ie, they had decreased CSF Aβ42/40 but not yet a positive Aβ PET result). Both groups had significantly higher plasma GFAP levels but not CSF GFAP levels, reinforcing the idea that plasma GFAP may be an early biomarker of AD pathologic changes. Levels of CSF GFAP only become significantly higher in the A+T+ group when there is biomarker evidence of both Aβ and tau pathology. Data from cellular models indicate that astrocytes react to early preplaque-insoluble Aβ oligomeric species.32 Our results can be contextualized with findings using other fluid or imaging biomarkers of reactive astrogliosis. Studies using the PET tracer 11C-deuterium-L-deprenyl ([11C]DED), which binds to monoamine oxidase-B, mainly expressed in reactive astrocytes, support fluctuations during the AD continuum in reactive astrocyte states. More specifically, [11C]DED binding in the frontal and parietal cortices is significantly increased in those with prodromal AD compared with CU individuals.33 Early increases in [11C]DED binding have also been found in autosomal carriers of a dominant AD variation almost 30 years before the emergence of symptoms.34 In a transgenic mouse model that overexpresses the human APPswe variation, increased [11C]DED binding precedes detectable Aβ pathology.35 Moreover, CSF YKL40, a biomarker of a subset of reactive astrocytes, is also elevated in those with preclinical AD.36,37 Recently, a model of reactive astrogliosis in the AD continuum15 has been proposed that would encompass early reactive astrocytes in the preclinical stage (supported by in vivo evidence of higher monoamine oxidase-B expression), followed by more widespread reactivity (supported by increases in CSF YKL40, GFAP, and S100b) and, finally, the end-stage reactive astrocytes, in which their physiological function may be lost. Our findings situate plasma GFAP levels as a marker of early reactive astrocytes.
Our results point to plasma GFAP as a possible biomarker specific for Aβ pathology. First, plasma GFAP levels were not higher among individuals with non-AD neurodegenerative diseases in the TRIAD and Paris cohorts. Plasma GFAP levels were normal in those with FTD despite gliosis being a characteristic of FTD.38,39 Second, in ALFA+, the A–T+ group did not have high plasma GFAP levels; this finding may suggest that plasma GFAP levels specifically reflect Aβ pathology in preclinical stages, but a direct comparison with the preclinical stage of other neurodegenerative diseases should be performed. Third, the association between plasma GFAP levels and tau pathology was mediated by Aβ pathology. These results are consistent with the increased expression of GFAP surrounding Aβ plaques.40-43 Although CSF GFAP levels were associated with other glial biomarkers (YKL40 and sTREM2), plasma GFAP levels were not. It is possible that CSF GFAP better reflects reactive astrocytes in response to neuroinflammatory changes, such as microglial activation, while plasma GFAP is more closely associated with reactive astrogliosis because of Aβ burden. High levels of blood GFAP can be found in individuals with other neurodegenerative diseases,24,44,45 but this finding occurs at the symptomatic, and thus advanced, stages of the disease. The increase in blood GFAP levels after acute brain conditions, such as subarachnoid hemorrhage and traumatic and hypoxic brain injury, has been extensively documented,46-50 but this increase may come through other mechanisms, such as a trauma-induced temporary opening of the blood-brain barrier. Based on these findings, it would seem that GFAP responds to acute neuronal injury; however, in a chronic neurodegenerative disease, and unlike NfL, plasma GFAP may principally (but not exclusively) reflect Aβ pathology.
A unique feature of our study is that we measured both plasma and CSF GFAP levels in the same participants. This feature allowed us to draw one of the main conclusions of this study, namely, that differences in plasma GFAP levels are larger than those of CSF GFAP levels between the groups, and the effect sizes of the associations between plasma GFAP levels and biomarkers of Aβ are greater than those of CSF GFAP levels. Moreover, the AUCs to discriminate Aβ status are higher for plasma GFAP than CSF GFAP, especially when Aβ pathology is defined by CSF Aβ42/40, suggesting an early increase of plasma GFAP levels. This result is surprising because neurologically associated blood biomarkers have usually been considered a proxy of the CSF biomarkers. A possible explanation of why plasma GFAP outperforms CSF GFAP would be the different clearance mechanisms into the biofluids. Astrocytes are part of the neurovascular unit and the blood-brain barrier, which is altered in individuals with AD.51 Astrocytic end-feet cover brain capillaries, which may be a direct route for the release of GFAP from reactive astrocytes to the bloodstream.52 It could be speculated that blood-brain barrier dysfunction facilitates the release of GFAP into the bloodstream; this may also explain the elevations of plasma GFAP in individuals with acute neurologic injuries. Astrocytes are also part of the glymphatic system, which is a highly organized system that clears the brain of insoluble proteins and metabolites by draining them into the venous system.53 GFAP may also reach the bloodstream via the meningeal lymphatic system.54 Finally, preanalytical and analytical factors that need to be further studied may also account for these differences. A previous study described that plasma GFAP is very stable to freeze-thaw cycles,55 whereas CSF GFAP is far more sensitive over time.56 The fact that plasma GFAP has a wider range of values than CSF GFAP may also be associated with the higher accuracy of the former.
It remains unanswered which plasma biomarker (GFAP, Aβ42/40, or forms of p-tau) is more accurately associated with Aβ pathology in particular in the preclinical stage. A head-to-head comparison of these biomarkers in several independent cohorts is needed. However, GFAP is an additional tool that has shown consistent results across multiple cohorts and is easily detectable using commercially available immunoassays. Moreover, we show that adding plasma GFAP to models with other plasma biomarkers (p-tau181 and/or NfL) improves their accuracy. All of these biomarkers perform satisfactorily, but a combination of some will probably render the highest accuracy for Aβ pathology. This is particularly true in preclinical AD, when the individual increases of these biomarkers may be statistically significant, but the effect sizes of these increases are not large.
This study has some limitations. It is a cross-sectional study, and findings need to be confirmed with longitudinal data. The 3 cohorts have differences in the design and goals, and not all of them had the same data available. Also, the definitions of Aβ pathology differed between cohorts, which may limit comparability between them; however, the fact that the main results are validated in diverse studies confirms the robustness of our results. Finally, we did not include measurements of Aβ in blood.
Altogether, these results suggest that high plasma GFAP levels are found early in the AD continuum and become greater during disease progression, in parallel with clinical syndrome severity and markers of tau pathology. Our findings have important implications in facilitating the detection of AD, particularly in its preclinical stage. This earlier detection may accelerate primary and secondary prevention trials and the design of interventional studies at early stages of AD. Plasma GFAP, alone or in combination with other biomarkers, could be used to screen for Aβ+ individuals at any stage across the AD continuum.
Accepted for Publication: August 16, 2021.
Published Online: October 18, 2021. doi:10.1001/jamaneurol.2021.3671
Open Access: This is an open access article distributed under the terms of the CC-BY License. © 2021 Benedet AL et al. JAMA Neurology.
Corresponding Authors: Kaj Blennow, MD, PhD, Institute of Neuroscience and Physiology, Department of Psychiatry and Neurochemistry, The Sahlgrenska Academy, University of Gothenburg, SE 43180 Gothenburg, Sweden (kaj.blennow@neuro.gu.se); Marc Suárez-Calvet, MD, PhD, Alzheimer Prevention Program–Barcelonaßeta Brain Research Center, Wellington 30, 08005 Barcelona, Spain (msuarez@barcelonabeta.org).
Author Contributions: Drs Blennow and Suárez-Calvet had full access to all of the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis. Dr Benedet, Ms Milà-Alomà, and Dr Vrillon contributed equally to this work. Drs Paquet, Rosa-Neto, Blennow, and Suárez-Calvet are equal co–senior authors on this work.
Concept and design: Benedet, Milà-Alomà, Vrillon, Ashton, Karikari, Minguillon, Zetterberg, Molinuevo, Rosa-Neto, Suárez-Calvet.
Acquisition, analysis, or interpretation of data: Benedet, Milà-Alomà, Vrillon, Ashton, Pascoal, Lussier, Karikari, Hourregue, Cognat, Dumurgier, Stevenson, Rahmouni, Pallen, Poltronetti, Salvadó, Shekari, Operto, Gispert, Fauria, Kollmorgen, Suridjan, Zimmer, Zetterberg, Paquet, Rosa-Neto, Blennow, Suárez-Calvet.
Drafting of the manuscript: Benedet, Milà-Alomà, Vrillon, Ashton, Pallen, Paquet, Rosa-Neto, Suárez-Calvet.
Critical revision of the manuscript for important intellectual content: Benedet, Milà-Alomà, Vrillon, Ashton, Pascoal, Lussier, Karikari, Hourregue, Cognat, Dumurgier, Stevenson, Rahmouni, Poltronetti, Salvadó, Shekari, Operto, Gispert, Minguillon, Fauria, Kollmorgen, Suridjan, Zimmer, Zetterberg, Molinuevo, Rosa-Neto, Blennow, Suárez-Calvet.
Statistical analysis: Benedet, Milà-Alomà, Ashton, Salvadó, Gispert, Rosa-Neto, Suárez-Calvet.
Obtained funding: Gispert, Suridjan, Molinuevo, Rosa-Neto, Blennow, Suárez-Calvet.
Administrative, technical, or material support: Benedet, Pascoal, Lussier, Karikari, Stevenson, Rahmouni, Operto, Fauria, Kollmorgen, Suridjan, Zetterberg, Paquet, Rosa-Neto, Suárez-Calvet.
Supervision: Ashton, Minguillon, Molinuevo, Rosa-Neto, Blennow, Suárez-Calvet.
Conflict of Interest Disclosures: Dr Vrillon reported receiving grants from Fondation Ophtalmologique Adolphe de Rothschild, Fondation Philipe Chatrier, Amicale des Anciens Internes des Hôpitaux de Paris, and Fondation Vaincre Alzheimer during the conduct of the study. Dr Gispert reported receiving grants from GE Healthcare, Roche Diagnostics, and F. Hoffman-La Roche; and speaker’s fees from Philips and Biogen during the conduct of the study. Dr Suridjan reported being an employee of and owning stocks in Roche Diagnostics. Dr Zetterberg reported receiving personal fees from Alector, Eisai, Denali, Roche Diagnostics, Wave, Samumed, Siemens Healthineers, Pinteon Therapeutics, Nervgen, AZTherapies, CogRx, Red Abbey Labs, Cellectricon, Alzecure, Fujirebio, and Biogen and also reported being cofounder of and holding stock in Brain Biomarker Solutions in Gothenburg AB outside the submitted work. Dr Molinuevo reported receiving in-kind reagents from Roche Diagnostics and GE Healthcare and grants from “La Caixa” Foundation NA and Alzheimer’s Association NA during the conduct of the study as well as being an employee of Lundbeck A/S and serving on the advisory board for Genentech, Roche Diagnostics, Novartis, Genentech, Oryzon, Biogen, Lilly, Janssen, Green Valley, MSD, Eisai, Alector, BioCross, and ProMis Neurosciences outside the submitted work. Dr Paquet reported receiving personal fees from Roche, Biogen, and Lilly during the conduct of the study. Dr Blennow reported personal fees from Abcam, Axon, Biogen, JOMDD/Shimadzu, Lilly, MagQu, Novartis, Roche Diagnostics, and Siemens outside the submitted work and being cofounder of Brain Biomarker Solutions in Gothenburg AB, which is a part of the GU Ventures Incubator Program. Dr Suárez-Calvet reported receiving personal fees from Roche Diagnostics International and Roche Farma, SA outside the submitted work. No other disclosures were reported.
Funding/Support: The Translational Biomarkers in Aging and Dementia (TRIAD) is supported by the Canadian Institutes of Health Research (MOP-11-51-31; RFN 152985, 159815, 162303); Canadian Consortium of Neurodegeneration and Aging (MOP-11-51-31 -team 1); Weston Brain Institute, Brain Canada Foundation (Canadian Foundation for Innovation Project 34874; 33397), and the Fonds de Recherche du Québec–Santé (Chercheur Boursier, 2020-VICO-279314). The Alzheimer’s and Families (ALFA) study receives funding from “La Caixa” Foundation (LCF/PR/GN17/10300004) and the Alzheimer’s Association and an international anonymous charity foundation through the TriBEKa Imaging Platform project (TriBEKa-17-519007). Dr Benedet is supported by the Swedish Alzheimer Foundation, Stiftelsen för Gamla Tjänarinnor, and Stohne Stiftelsen. Dr Vrillon is supported by Fondation Adolphe de Rotschild, Fondation Philippe Chatrier, Association des Anciens Internes des Hôpitaux de Paris, Fondation Vaincre Alzheimer, Stiftelsen för Gamla Tjänarinnor, Demensfundet, and Stohne Stiftelsen. Dr Zetterberg is a Wallenberg Scholar supported by grants from the Swedish Research Council (grant 2018-02532), the European Research Council (grant 681712), Swedish State Support for Clinical Research (grant ALFGBG-720931), the Alzheimer Drug Discovery Foundation (ADDF) (grant 201809-2016862), the Alzheimer Disease (AD) Strategic Fund and the Alzheimer’s Association (grants ADSF-21-831376-C, ADSF-21-831381-C, and ADSF-21-831377-C), the Olav Thon Foundation, the Erling-Persson Family Foundation, Stiftelsen för Gamla Tjänarinnor, Hjärnfonden, Sweden (grant FO2019-0228), the European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No 860197 (MIRIADE), and the UK Dementia Research Institute at University College London. Dr Blennow is supported by the Swedish Research Council (grant 2017-00915), the ADDF (grant RDAPB-201809-2016615), the Swedish Alzheimer Foundation (grant AF-742881), Hjärnfonden, Sweden (grant FO2017-0243), the Swedish state under the agreement between the Swedish government and the County Councils, the Avtal om Läkarutbildning och Forskining agreement (grant ALFGBG-715986), the European Union Joint Program for Neurodegenerative Disorders (grant JPND2019-466-236), and the National Institutes of Health (grant 1R01AG068398-01). Dr Suárez-Calvet receives funding from the European Research Council under the European Union’s Horizon 2020 research and innovation programme (grant 948677), the Instituto de Salud Carlos III (grant PI19/00155), and the Spanish Ministry of Science, Innovation and Universities (Juan de la Cierva Programme grant IJC2018-037478-I).
Role of the Funder/Sponsor: The funding sources had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.
Group Information: The members of the TRIAD study, ALFA study, and BioCogBank Paris Lariboisière cohort are listed in Supplement 2.
Additional Contributions: The authors would like to express their most sincere gratitude to the TRIAD, ALFA, and BioCogBank Paris project participants and relatives without whom this research would have not been possible. The authors thank all of the staff at the University of Gothenburg, Sahlgrenska University Hospital, McGill University Research Centre for Studies, and Montreal Neurological Institute who supported this project. The authors thank Roche Diagnostics International Ltd for providing the kits to measure cerebrospinal fluid biomarkers, Cerveau Technologies for MK-6240, and GE Healthcare for the [18F]flutemetamol doses for ALFA+ study participants.
Additional Information: This publication is part of the TRIAD, the ALFA, and the BioCogBank Paris Lariboisière studies. ELECSYS, COBAS, and COBAS E are trademarks of Roche. The Roche NeuroToolKit is a panel of exploratory prototype assays designed to robustly evaluate biomarkers associated with key pathologic events characteristic of Alzheimer disease and other neurologic disorders, used for research purposes only and not approved for clinical use. All requests for raw and analyzed data and materials will be promptly reviewed by the senior authors to verify whether the request is subject to any intellectual property or confidentiality obligations. Bulk anonymized data can be shared by request from any qualified investigator for the sole purpose of replicating procedures and results presented in the article, providing data transfer is in agreement with European Union legislation and decisions by the institutional review board of each participating center.
1.Janelidze
S, Mattsson
N, Palmqvist
S,
et al. Plasma p-tau181 in Alzheimer’s disease: relationship to other biomarkers, differential diagnosis, neuropathology and longitudinal progression to Alzheimer’s dementia.
Nat Med. 2020;26(3):379-386. doi:
10.1038/s41591-020-0755-1
PubMedGoogle ScholarCrossref 2.Karikari
TK, Pascoal
TA, Ashton
NJ,
et al. Blood phosphorylated tau 181 as a biomarker for Alzheimer’s disease: a diagnostic performance and prediction modelling study using data from four prospective cohorts.
Lancet Neurol. 2020;19(5):422-433. doi:
10.1016/S1474-4422(20)30071-5
PubMedGoogle ScholarCrossref 3.Thijssen
EH, La Joie
R, Wolf
A,
et al; Advancing Research and Treatment for Frontotemporal Lobar Degeneration (ARTFL) investigators. Diagnostic value of plasma phosphorylated tau181 in Alzheimer’s disease and frontotemporal lobar degeneration.
Nat Med. 2020;26(3):387-397. doi:
10.1038/s41591-020-0762-2
PubMedGoogle ScholarCrossref 4.Lantero Rodriguez
J, Karikari
TK, Suárez-Calvet
M,
et al. Plasma p-tau181 accurately predicts Alzheimer’s disease pathology at least 8 years prior to post-mortem and improves the clinical characterisation of cognitive decline.
Acta Neuropathol. 2020;140(3):267-278. doi:
10.1007/s00401-020-02195-x
PubMedGoogle ScholarCrossref 9.Simrén
J, Leuzy
A, Karikari
TK,
et al; AddNeuroMed consortium. The diagnostic and prognostic capabilities of plasma biomarkers in Alzheimer’s disease.
Alzheimers Dement. 2021;17(7):1145-1156. doi:
10.1002/alz.12283
PubMedGoogle ScholarCrossref 12.Keshavan
A, Pannee
J, Karikari
TK,
et al. Population-based blood screening for preclinical Alzheimer’s disease in a British birth cohort at age 70.
Brain. 2021;144(2):434-449. doi:
10.1093/brain/awaa403PubMedGoogle Scholar 24.Oeckl
P, Halbgebauer
S, Anderl-Straub
S,
et al; Consortium for Frontotemporal Lobar Degeneration German. Glial fibrillary acidic protein in serum is increased in Alzheimer’s disease and correlates with cognitive impairment.
J Alzheimers Dis. 2019;67(2):481-488. doi:
10.3233/JAD-180325
PubMedGoogle ScholarCrossref 25.Verberk
IMW, Thijssen
E, Koelewijn
J,
et al. Combination of plasma amyloid beta
(1-42/1-40) and glial fibrillary acidic protein strongly associates with cerebral amyloid pathology.
Alzheimers Res Ther. 2020;12(1):118. doi:
10.1186/s13195-020-00682-7
PubMedGoogle ScholarCrossref 26.Asken
BM, Elahi
FM, La Joie
R,
et al. Plasma glial fibrillary acidic protein levels differ along the spectra of amyloid burden and clinical disease stage.
J Alzheimers Dis. 2020;78(1):265-276. doi:
10.3233/JAD-200755PubMedGoogle ScholarCrossref 28.Ishiki
A, Kamada
M, Kawamura
Y,
et al. Glial fibrillar acidic protein in the cerebrospinal fluid of Alzheimer’s disease, dementia with Lewy bodies, and frontotemporal lobar degeneration.
J Neurochem. 2016;136(2):258-261. doi:
10.1111/jnc.13399
PubMedGoogle ScholarCrossref 29.Fukuyama
R, Izumoto
T, Fushiki
S. The cerebrospinal fluid level of glial fibrillary acidic protein is increased in cerebrospinal fluid from Alzheimer’s disease patients and correlates with severity of dementia.
Eur Neurol. 2001;46(1):35-38. doi:
10.1159/000050753
PubMedGoogle ScholarCrossref 30.Jesse
S, Steinacker
P, Cepek
L,
et al. Glial fibrillary acidic protein and protein S-100B: different concentration pattern of glial proteins in cerebrospinal fluid of patients with Alzheimer’s disease and Creutzfeldt-Jakob disease.
J Alzheimers Dis. 2009;17(3):541-551. doi:
10.3233/JAD-2009-1075
PubMedGoogle ScholarCrossref 33.Carter
SF, Schöll
M, Almkvist
O,
et al. Evidence for astrocytosis in prodromal Alzheimer disease provided by
11C-deuterium-L-deprenyl: a multitracer PET paradigm combining
11C-Pittsburgh compound B and
18F-FDG.
J Nucl Med. 2012;53(1):37-46. doi:
10.2967/jnumed.110.087031
PubMedGoogle ScholarCrossref 34.Schöll
M, Carter
SF, Westman
E,
et al. Early astrocytosis in autosomal dominant Alzheimer’s disease measured in vivo by multi-tracer positron emission tomography.
Sci Rep. 2015;5(1):16404. doi:
10.1038/srep16404
PubMedGoogle ScholarCrossref 35.Rodriguez-Vieitez
E, Ni
R, Gulyás
B,
et al. Astrocytosis precedes amyloid plaque deposition in Alzheimer APPswe transgenic mouse brain: a correlative positron emission tomography and in vitro imaging study.
Eur J Nucl Med Mol Imaging. 2015;42(7):1119-1132. doi:
10.1007/s00259-015-3047-0
PubMedGoogle ScholarCrossref 37.Milà-Alomà
M, Salvadó
G, Gispert
JD,
et al; ALFA study. Amyloid beta, tau, synaptic, neurodegeneration, and glial biomarkers in the preclinical stage of the Alzheimer’s continuum.
Alzheimers Dement. 2020;16(10):1358-1371. doi:
10.1002/alz.12131
PubMedGoogle ScholarCrossref 38.Cairns
NJ, Bigio
EH, Mackenzie
IRAA,
et al; Consortium for Frontotemporal Lobar Degeneration. Neuropathologic diagnostic and nosologic criteria for frontotemporal lobar degeneration: consensus of the Consortium for Frontotemporal Lobar Degeneration.
Acta Neuropathol. 2007;114(1):5-22. doi:
10.1007/s00401-007-0237-2
PubMedGoogle ScholarCrossref 39.Kövari E. Neuropathological spectrum of frontal lobe dementias.
Front Neurol Neurosci. 2009;24:49-159. doi:
10.1159/000197894PubMed 42.Muramori
F, Kobayashi
K, Nakamura
I. A quantitative study of neurofibrillary tangles, senile plaques and astrocytes in the hippocampal subdivisions and entorhinal cortex in Alzheimer’s disease, normal controls and non-Alzheimer neuropsychiatric diseases.
Psychiatry Clin Neurosci. 1998;52(6):593-599. doi:
10.1111/j.1440-1819.1998.tb02706.x
PubMedGoogle ScholarCrossref 44.Benussi
A, Ashton
NJ, Karikari
TK,
et al. Serum glial fibrillary acidic protein (GFAP) is a marker of disease severity in frontotemporal lobar degeneration.
J Alzheimers Dis. 2020;77(3):1129-1141. doi:
10.3233/JAD-200608
PubMedGoogle ScholarCrossref 45.Sun
M, Liu
N, Xie
Q,
et al. A candidate biomarker of glial fibrillary acidic protein in CSF and blood in differentiating multiple sclerosis and its subtypes: a systematic review and meta-analysis.
Mult Scler Relat Disord. 2021;51:102870. doi:
10.1016/j.msard.2021.102870
PubMedGoogle Scholar 46.Papa
L, Lewis
LM, Falk
JL,
et al. Elevated levels of serum glial fibrillary acidic protein breakdown products in mild and moderate traumatic brain injury are associated with intracranial lesions and neurosurgical intervention.
Ann Emerg Med. 2012;59(6):471-483. doi:
10.1016/j.annemergmed.2011.08.021
PubMedGoogle ScholarCrossref 47.Papa
L, Brophy
GM, Welch
RD,
et al. Time course and diagnostic accuracy of glial and neuronal blood biomarkers GFAP and UCH-L1 in a large cohort of trauma patients with and without mild traumatic brain injury.
JAMA Neurol. 2016;73(5):551-560. doi:
10.1001/jamaneurol.2016.0039
PubMedGoogle ScholarCrossref 53.Iliff
JJ, Wang
M, Liao
Y,
et al. A paravascular pathway facilitates CSF flow through the brain parenchyma and the clearance of interstitial solutes, including amyloid β.
Sci Transl Med. 2012;4(147):147ra111. doi:
10.1126/scitranslmed.3003748PubMedGoogle Scholar 55.Ashton
NJ, Suárez-Calvet
M, Karikari
TK,
et al. Effects of pre-analytical procedures on blood biomarkers for Alzheimer’s pathophysiology, glial activation, and neurodegeneration.
Alzheimers Dement (Amst). 2021;13(1):e12168. doi:
10.1002/dad2.12168PubMedGoogle Scholar 56.Abdelhak
A, Hottenrott
T, Morenas-Rodríguez
E,
et al. Glial activation markers in CSF and serum from patients with primary progressive multiple sclerosis: potential of serum GFAP as disease severity marker?
Front Neurol. 2019;10:280. doi:
10.3389/fneur.2019.00280
PubMedGoogle ScholarCrossref