A, Distribution of Pearson correlations between whole-exome sequencing (WES) and different numbers of genes randomly chosen (50 times) from gene panels. Syn + and Syn − indicate that synonymous mutations were included or excluded, respectively. B, Comparison of the performance of the NCC-GP150 panel and 150 randomly extracted genes (RAN150) among different tumor types. C, Pearson correlation of TMB between different public cancer gene panels and WES. D, Progression-free survival (PFS) by TMB status based on NCC-GP150 genes in the cohort studied by Rizvi et al.6 F1CDx indicates FoundationOne CDx; MSK-IMPACT, Memorial Sloan Kettering Cancer Center’s Integrated Mutation Profiling of Actionable Cancer Targets.
A, Progression-free survival (PFS) by bTMB status. B, Waterfall plot of observed best response from anti–programmed cell death 1 (anti–PD-1) and anti–programmed cell death ligand 1 (anti–PD-L1) checkpoint inhibitors. C, Comparison of objective response rates (ORRs) between the high and low bTMB groups (P = .02). D, Comparison of bTMB level between nonresponse and response groups (P = .02). HR indicates hazard ratio.
eMethods 1. Gene Panel Design and Virtual Validation
eMethods 2. Technical Validation and Clinical Validation
eMethods 3. Assessment of Clinical Outcomes
eMethods 4. DNA Extraction
eMethods 5. Library Preparation, Target Capture and DNA Sequencing
eMethods 6. WES Analysis Pipeline
eMethods 7. bTMB Detection Pipeline
eFigure 1. Flow Diagram of the Study
eFigure 2. Flow Diagram for the Technical and Clinical Validation Cohorts
eFigure 3. Venn Diagram and Flow Diagram Showing the Numbers and Percentages of Overlapping Gene Numbers Among NCC-GP150, F1CDx, MSK-IMPACT, and Guardant360
eFigure 4. Comparison of Panel Performance Between TCGA NSCLC Populations With and Without EGFR or KRAS Driver Mutation
eFigure 5. Technical Validation of the Association Between bTMB Estimated by NCC-GP150 and WES
eFigure 6. Comparison of Progression-Free Survival Between Patients in the bTMB-H and bTMB-L Groups With Different Cut-Points for bTMB
eFigure 7. Comparison of Progression-Free Survival Between bTMB-H and bTMB-L With Different Cut-Points for bTMB in Patients With Anti-PD1/PD-L1 Therapy as First- or Second-Line Treatment
eFigure 8. Association Between bTMB and Clinical Outcomes in Patients With Anti-PD1/PD-L1 Therapy as First- or Second-Line Treatment
eTable 1. Detailed list of Genes in the NCC-GP150 Panel
eTable 2. Summary of Pearson Correlation Between Different Public Panels and WES for Different Tumor Types
eTable 3. Detailed Clinicopathologic Features of 48 NSCLC Patients for bTMB Technical Validation
eTable 4. Summary of Sensitivity, Specificity and Youden's Index at Different Cutoffs for bTMB-H in the Matched Tissue/Blood TMB Comparison
eTable 5. Detailed Clinicopathologic Features of 50 NSCLC Patients for bTMB Clinical Validation by bTMB Status
Customize your JAMA Network experience by selecting one or more topics from the list below.
Wang Z, Duan J, Cai S, et al. Assessment of Blood Tumor Mutational Burden as a Potential Biomarker for Immunotherapy in Patients With Non–Small Cell Lung Cancer With Use of a Next-Generation Sequencing Cancer Gene Panel. JAMA Oncol. Published online February 28, 20195(5):696–702. doi:10.1001/jamaoncol.2018.7098
Is blood tumor mutational burden estimated by a next-generation gene sequencing panel with an optimized panel size and algorithm associated with clinical outcomes in patients with non–small cell lung cancer treated with anti–programmed cell death 1 (anti–PD-1) and anti–programmed cell death ligand 1 (anti–PD-L1) agents?
This study of 2 independent cohorts of patients (48 in cohort 1 and 50 in cohort 2) found that NCC-GP150 was a cost-effective panel for tumor mutational burden estimation with satisfactory performance. Blood tumor mutational burden estimated by NCC-GP150 correlated well with tissue tumor mutational burden calculated by whole-exome sequencing, and a blood tumor mutational burden of 6 or higher was positively associated with clinical benefits of anti–PD-1 and anti–PD-L1 therapy in patients with advanced non–small cell lung cancer.
The findings suggest that blood tumor mutational burden measured by NCC-GP150 is a potential biomarker to identify patients with non–small cell lung cancer who could benefit from anti–PD-1 and anti–PD-L1 therapy.
Tumor mutational burden (TMB), as measured by whole-exome sequencing (WES) or a cancer gene panel (CGP), is associated with immunotherapy responses. However, whether TMB estimated by circulating tumor DNA in blood (bTMB) is associated with clinical outcomes of immunotherapy remains to be explored.
To explore the optimal gene panel size and algorithm to design a CGP for TMB estimation, evaluate the panel reliability, and further validate the feasibility of bTMB as a clinical actionable biomarker for immunotherapy.
Design, Setting, and Participants
In this cohort study, a CGP named NCC-GP150 was designed and virtually validated using The Cancer Genome Atlas database. The correlation between bTMB estimated by NCC-GP150 and tissue TMB (tTMB) measured by WES was evaluated in matched blood and tissue samples from 48 patients with advanced NSCLC. An independent cohort of 50 patients with advanced NSCLC was used to identify the utility of bTMB estimated by NCC-GP150 in distinguishing patients who would benefit from anti–programmed cell death 1 (anti–PD-1) and anti–programmed cell death ligand 1 (anti–PD-L1) therapy. The study was performed from July 19, 2016, to April 20, 2018.
Main Outcomes and Measures
Assessment of the Spearman correlation coefficient between bTMB estimated by NCC-GP150 and tTMB calculated by WES. Evaluation of the association of bTMB level with progression-free survival and response to anti–PD-1 and anti–PD-L1 therapy.
This study used 2 independent cohorts of patients with NSCLC (cohort 1: 48 patients; mean [SD] age, 60  years; 15 [31.2%] female; cohort 2: 50 patients; mean [SD] age, 58  years; 15 [30.0%] female). A CGP, including 150 genes, demonstrated stable correlations with WES for TMB estimation (median r2 = 0.91; interquartile range, 0.89-0.92), especially when synonymous mutations were included (median r2 = 0.92; interquartile range, 0.91-0.93), whereas TMB estimated by the NCC-GP150 panel found higher correlations with TMB estimated by WES than most of the randomly sampled 150-gene panels. Blood TMB estimated by NCC-GP150 correlated well with the matched tTMB calculated by WES (Spearman correlation = 0.62). In the anti–PD-1 and anti–PD-L1 treatment cohort, a bTMB of 6 or higher was associated with superior progression-free survival (hazard ratio, 0.39; 95% CI, 0.18-0.84; log-rank P = .01) and objective response rates (bTMB ≥6: 39.3%; 95% CI, 23.9%-56.5%; bTMB <6: 9.1%; 95% CI, 1.6%-25.9%; P = .02).
Conclusions and Relevance
The findings suggest that established NCC-GP150 with an optimized gene panel size and algorithm is feasible for bTMB estimation, which may serve as a potential biomarker of clinical benefit in patients with NSCLC treated with anti–PD-1 and anti–PD-L1 agents.
High tumor mutational burden (TMB), which represents genomic instability, has the potential to induce neoantigen production and further immunogenicity improvement.1 Recent studies have confirmed that TMB measured by whole-exome sequencing (WES) or a next-generation sequencing (NGS) cancer gene panel (CGP) can serve as a candidate biomarker of clinical outcome from immune checkpoint blockades (ICBs)2,3 in melanoma,4,5 lung cancer,6-9 and urothelial carcinoma.10 However, a considerable proportion of patients with advanced cancer could not provide sufficient tumor tissue for molecular testing.8,11 Therefore, whether TMB can be measured using circulating tumor DNA (ctDNA) (namely, blood TMB [bTMB]) as a noninvasive approach to guide ICB therapies has attracted widespread attention from practitioners. A previous study12 found that blood-derived variants of unknown significance were correlated with ICB responses. More recently, Gandara et al13 reported that bTMB is associated with progression-free survival (PFS) benefit from atezolizumab over docetaxel in non–small cell lung cancers (NSCLCs). Further evaluation of bTMB will be performed in patients undergoing first-line treatment in a prospective, phase 3 randomized clinical trial (A Study of Atezolizumab as First-line Monotherapy for Advanced or Metastatic Non–Small Cell Lung Cancer [B-F1RST]).14 However, the reliability of ctDNA detection is still under debate15,16; thus, more supported evidence of bTMB is needed to promote its clinical value on guiding ICB delivery. In this study, we aimed to explore the optimal gene panel size and algorithm to design a CGP for TMB estimation, evaluate the panel reliability, and further validate the feasibility of bTMB as a clinically actionable biomarker for immunotherapy.
This study contained 4 sections (eFigure 1 in the Supplement), including panel design (named NCC-GP150), virtual validation (eMethods 1 in the Supplement), technical validation, and clinical validation (eMethods 2 in the Supplement). The WES data from The Cancer Genome Atlas (TCGA) were used for panel design and virtual validation. Tumor mutational burden estimated by NCC-GP150 was compared with those by established gene panels, including Memorial Sloan Kettering Cancer Center’s Integrated Mutation Profiling of Actionable Cancer Targets (MSK-IMPACT), FoundationOne CDx (F1CDx), Guardant360, PlasmaSELECT 64, and FoundationACT (Assay for Circulating Tumor DNA). A public NSCLC cohort from Rizvi et al6 was used to evaluate the performance of NCC-GP150–based TMB to stratify ICB survival outcomes. Patients with NSCLC with sufficient tumor tissue samples and matched plasma samples were enrolled for technical validation to investigate the correlation between bTMB from the NCC-GP150 panel and tTMB from WES (eFigure 2A in the Supplement). Last, an independent cohort of patients with advanced NSCLC who were undergoing on-study anti–programmed cell death 1 (anti–PD-1) and anti–programmed cell death ligand 1 (anti–PD-L1) therapy was analyzed to validate the utility of bTMB by NCC-GP150 in identifying patients who could benefit from anti–PD-1 and anti–PD-L1 therapy (eFigure 2B and eMethods 3 in the Supplement). The study was performed from July 19, 2016, to April 20, 2018. For more details about the methods for DNA extraction, library preparation, target capture and DNA sequencing, WES analysis pipeline, and bTMB detection pipeline, see eMethods 4 to 7 in the Supplement. This study was approved by the ethics committees of the National Cancer Center, and all patients provided written informed consent. All data were deidentified.
Correlations of TMB between WES and gene panels with different gene counts and algorithms were examined by the Pearson correlation coefficient (r2). The correlation between tissue-based TMB by WES and ctDNA-based bTMB by NCC-GP150 was determined by the Spearman rank correlation coefficient. Categorical variables were expressed as percentages, means (SDs) were provided for normally distributed data, and medians (interquartile ranges) were provided for data that are not normally distributed. Differences between the 2 groups were examined by the 2-tailed, unpaired t test for normally distributed variables or by the Mann-Whitney test for nonnormally distributed variable. The χ2 test or Fisher exact test was used to test the difference of categorical variables between the 2 groups. For PFS analysis, Kaplan-Meier curves were compared by using a log-rank test, and the hazard ratio (HR) was determined through a Cox proportional hazards regression model. The proportionality assumption was verified. Logistic regression was used to test the correlations between different variables and the objective response rate (ORR), with the results presented as odds ratios (ORs) and 95% CIs. Baseline variables that achieved a level of significance of P < . 05 in the univariable analysis were entered into multivariable models. All reported P values were 2-tailed, and P < .05 was considered to be statistically significant. Statistical analyses were performed with GraphPad Prism software, version 5.0 (GraphPad Software Inc) and R software, version 3.5.0 (R Foundation for Statistical Computing).
This study used 2 independent cohorts of patients with NSCLC (cohort 1: 48 patients; mean [SD] age, 60  years; 15 [31.2%] female; cohort 2: 50 patients; mean [SD] age, 58  years; 15 [30.0%] female) to examine the correlation between bTMB estimated by NCC-GP150 and tTMB measured by WES and to identify the utility of bTMB estimated by NCC-GP150 in distinguishing patients who would benefit from anti–PD-1 and anti–PD-L1 therapy.
With the WES data of 9205 samples from TCGA, randomized genes were extracted to generate panels for TMB estimation and compared with WES-based TMB. With the increase in randomized gene number included in TMB calculation, a gradually increasing correlation between the panel- and WES-based TMB was observed along with a decreasing SD, reaching a plateau when 150 genes were included (Figure 1A). An NGS CGP, named NCC-GP150, was designed that covered whole exon regions of 150 selected cancer-related genes (eTable 1 in the Supplement). NCC-GP150 exhibited a better performance than most of the randomly sampled panels in most cancer types based on TCGA data (Figure 1B).
Subsequently, NCC-GP150 was compared with 5 established NGS gene panels, including MSK-IMPACT (468 cancer-related genes), F1CDx (324 cancer-related genes), Guardant360 (73 cancer-related genes), PlasmaSELECT 64 (64 cancer-related genes), and FoundationACT (62 cancer-related genes). The analysis of overlapping genes among these panels is shown in eFigure 3 in the Supplement. Among these gene panels, MSK-IMPACT exhibited a leading correlation with WES-based TMB (r2 = 0.97), followed by F1CDx (r2 = 0.96) and NCC-GP150 (r2 = 0.96) (Figure 1C). The performance of NCC-GP150 for TMB estimation in various cancers by virtual validation is given in eTable 2 in the Supplement.
Considering the different prevalence of oncogenic driver mutations in NSCLC between Asian and white populations,17 we conducted another virtual validation of NCC-GP150 with established panels between TCGA NSCLC populations with and without EGFR (OMIM 131550) and/or KRAS (OMIM 190070) driver mutation. The NCC-GP150 demonstrated a consistently satisfactory performance for bTMB estimation vs TMB from TCGA WES data (eFigure 4 in the Supplement).
Next, we used a published clinical data set6 that included 34 patients with NSCLC treated with PD-1 to further test the practicability of NCC-GP150. The PFS was significantly longer in patients with high TMB (TMB greater than the median: PFS, 14.5 months; 95% CI, 8.3 months to not reached [NR]) than in patients with low TMB (TMB less than the median: PFS, 5.2 months; 95% CI, 2.1-8.3 months), with an HR of 0.36 (95% CI, 0.14-0.93, log-rank P = .03) (Figure 1D).
To investigate the reliability of bTMB from ctDNA-derived sequencing by the NCC-GP150 panel, 48 patients with advanced NSCLC with qualified tumor tissue samples and matched plasma samples provided for synchronous WES and NCC-GP150 sequencing, respectively, were enrolled for technical validation (cohort 1) (eFigure 2A and eTable 3 in the Supplement). The Spearman correlation coefficient between NCC-GP150–based bTMB and WES-based TMB reached 0.62 (eFigure 5A in the Supplement). With the TMB median (75 for WES) as the cut point, we found that a bTMB of 6 or higher had an optimal Youden index of 0.59, with a sensitivity of 0.88 and a specificity of 0.71 (eFigure 5B and eTable 4 in the Supplement).
To unravel whether bTMB could identify patients benefiting from ICB therapy, another independent cohort of 50 patients with advanced NSCLC treated with anti–PD-1 and anti–PD-L1 agents (cohort 2) (eFigure 2B and eTable 5 in the Supplement) was used for analysis. Methods for the assessment of clinical outcomes are provided in eMethods 3 in the Supplement.
The bTMB and PD-L1 expression were not correlated (eTable 5 in the Supplement), which is consistent with previous results.8,13,18,19 When the bTMB cut point was set to 6, both HRs and P values reached a minimum (eFigure 6 in the Supplement). Compared with patients with low bTMB (bTMB<6, n = 22), patients with high bTMB (bTMB≥6, n = 28) demonstrated superior PFS (high bTMB: PFS, NR; 95% CI, 2.8 months to NR; low bTMB: PFS, 2.9 months; 95% CI, 2.7 months to NR; HR, 0.39; 95% CI, 0.18-0.84; log-rank P = .01) (Figure 2A) and were more likely to undergo tumor shrinkage (Figure 2B). In addition, high bTMB (39.3%; 95% CI, 23.9%-56.5%) was associated with a higher ORR than was low bTMB (9.1%; 95% CI, 1.6%-25.9%; P = .02) (Figure 2C). Similarly, responders had significantly higher bTMB levels than did nonresponders (Mann-Whitney P = .02) (Figure 2D).
In the univariable Cox proportional hazards regression model, the Eastern Cooperative Oncology Group (ECOG) and treatment lines were also associated with PFS (ECOG: HR, 2.67; 95% CI, 1.21-5.88; P = .02; treatment lines: HR, 4.50; 95% CI, 2.05-9.89; P < .001), and the association between PD-L1 of 1% or higher and benefits for immunotherapy tended to be significant (HR, 0.49; 95% CI, 0.21-1.15; P = .10) (Table). In the multivariate Cox proportional hazards regression model that included bTMB, ECOG, and treatment lines, the association between bTMB and PFS remained significant (HR, 0.44; 95% CI, 0.20-0.99; P = .05). In the multivariate logistic regression analysis that included ECOG and treatment lines, bTMB status was also positively associated with an ORR (odds ratio, 11.69; 95% CI, 2.16-111.6; P = .01) (Table).
We further explored the association between bTMB and PFS in first-line or second-line NSCLC as a subgroup analysis. The HRs and P values still reached a minimum, with a high bTMB cut point of 6 (HR, 0.08; 95% CI, 0.02-0.36; P = .001) (eFigure 7 in the Supplement). Patients with a bTMB of 6 or higher in this subgroup yielded significantly prolonged PFS (NR) compared with patients with a bTMB of less than 6 (2.9 months; 95% CI, 2.7 months to NR; HR, 0.08; 95% CI, 0.02-0.36; log-rank P < .001) (eFigure 8A in the Supplement). In addition, patients with a bTMB of 6 or higher had an increased ORR (61.1%; 95% CI, 39.2%-80.1%) compared with patients with a bTMB less than 6 (6.7%, 95% CI, 0.3%-27.9%; P = .003) (eFigure 8B in the Supplement). Responders had significantly higher bTMB levels (median, 10; interquartile range, 7-13) than did nonresponders (median, 5; interquartile range, 3-9; Mann-Whitney P = .008) (eFigure 8C in the Supplement). Collectively, bTMB measured by the NCC-GP150 panel was confirmed to be a potential clinical actionable biomarker for ICB therapy in patients with NSCLC.
Our findings suggest that NCC-GP150, a panel through rational design on TCGA, could be used for bTMB estimation as a surrogate for WES-based TMB. We also validated bTMB as a potential biomarker to identify patients with NSCLC who could obtain significant improvements from immunotherapy.
Blood TMB profiled with ctDNA sequencing is a promising strategy for TMB and ICB response estimation. Most recently, Gandara et al13 published the first study, to our knowledge, to identify bTMB of 16 or higher as an indicator of PFS benefit in patients with NSCLC treated with atezolizumab vs docetaxel. However, several key questions remained to be answered, including the suitable panel size and the kind of variants that should be included for TMB calling. In addition, in the reported study, analyses were made between bTMB and tTMB that were derived from the same gene panel but not with WES-based TMB as the criterion standard.
We present the first study, to our knowledge, to systematically explore the optimal gene panel size and algorithm of a CGP design for TMB (especially bTMB) estimation. With WES data from TCGA, we found that a minimum gene panel size of 150 was sufficient for TMB estimation. The NCC-GP150 panel was then established through rational design with 150 selected genes and performed at the forefront for TMB estimation among most random-sampling models. We also found that the incorporation of synonymous mutations into panel-derived TMB calculation enhanced its correlation with WES, which agrees with the previous finding.20 Furthermore, in our independent cohort 1, we validated the satisfactory correlation of NCC-GP150–based bTMB with WES-based tTMB. Taken together, NCC-GP150 with a smaller panel size and satisfactory performance may be more accessible for clinic use with superior cost-effectiveness.
Our study also found that bTMB may be a potential biomarker to differentiate patients benefiting from anti–PD-1 and anti–PD-L1 therapy. The utility of the NCC-GP150 panel seemed to be more significant when ICBs were used as a first- or second-line rather than a later-line treatment. In addition, ECOG performance status and treatment lines were found to be negatively correlated with PFS, suggesting that patients with previous treatment might receive limited benefit from ICB therapy, which agrees with previous reports.21,22 Therefore, early use of therapy with ICBs should be considered in clinical practice.
There are several limitations to our study. First, the clinical validation was retrospective, and the limited sample sizes might yield statistical bias. Second, the clinical cohort was obtained from different trials, including anti–PD-1 and anti–PD-L1 treatment, which might potentially influence the ultimate survival outcomes. Third, we used TCGA data for virtual validation but a Chinese cohort for technical and clinical validation. The different population-based prevalence in oncogenic driver mutations may have a potential confounding effect on the validity of analyses,17 although NCC-GP150 still demonstrated consistently satisfactory performance for TCGA based-TMB estimation and Chinese cohort–based bTMB estimation after excluding patients with EGFR/KRAS driver mutations.
We developed and evaluated the clinical feasibility of the NCC-GP150 panel for TMB estimation through virtual, technical, and clinical validation. The findings suggest that a ctDNA-based bTMB measured by the NCC-GP150 panel could be used as a potential biomarker for anti–PD-1 and anti–PD-L1 treatment in patients with NSCLC.
Accepted for Publication: December 6, 2018.
Published Online: February 28, 2019. doi:10.1001/jamaoncol.2018.7098
Open Access: This is an open access article distributed under the terms of the CC-BY License. © 2019 Wang Z et al. JAMA Oncology.
Corresponding Authors: Jie Wang, MD, PhD, State Key Laboratory of Molecular Oncology, Department of Medical Oncology, National Cancer Center/Cancer Hospital, Chinese Academy of Medical Sciences & Peking Union Medical College, 17 Pan-jia-yuan South Ln, Chaoyang District, Beijing 100021, China (email@example.com).
Author Contributions: Drs Z. Wang, Duan, Cai, and M. Han contributed equally to this work. Drs Z. Wang, Duan, Cai, and M. Han serve as co–first authors, each with equal contribution to the manuscript. Drs J. Wang and Z. Wang had full access to all the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis.
Concept and design: Z. Wang, Cai, Dong, J. Wang.
Acquisition, analysis, or interpretation of data: All authors.
Drafting of the manuscript: All authors.
Critical revision of the manuscript for important intellectual content: Z. Wang, Cai, J. Wang.
Statistical analysis: M. Han, Dong, Lu, Cao, J. Zhao.
Obtained funding: Z. Wang, J. Wang.
Administrative, technical, or material support: Z. Wang, Duan, Cai, Dong, H. Bai, J. Han, D. Wang, Chen, J. Wang.
Supervision: J. Wang.
Conflict of Interest Disclosures: Drs M. Han, Dong, Lu, Cao, Li, D. Wang, Chen, Xu, X. Zhao, G. Wang, Y. Bai, J. Zhao, Z. Zhao, Zhang, Xiong, and Cai are employees of 3D Medicines Inc. No other disclosures were reported.
Funding/Support: This work was supported by grants 81630071 (Dr J. Wang) and 81330062 from the National Natural Sciences Foundation Key Program (Dr J. Wang), grant 2016YFC0902300 from the National Key R&D Program of China (Dr J. Wang), grant CIFMS 2016-I2M-3-008 from the Chinese Academy of Medical Sciences (CAMS) Innovation Fund for Medical Sciences (CIFMS) (Dr J. Wang), grant 81871889 from the China National Natural Sciences Foundation (Dr Z. Wang), grant 7172045 from the Beijing Natural Science Foundation and Beijing Novel Program (Dr Z. Wang), cross-cooperation grant Z181100006218130 (Dr J. Wang), grant IRT-17R10 from the Ministry of Education Innovation Team development project (Dr J. Wang), CAMS Key Lab of Translational Research on Lung Cancer, grant IRT13003 from the Education Ministry Innovative Research Team Program (Dr J. Wang), the CAMS Innovation Fund for Medical Sciences (Dr J. Wang), and grant KY201701 from the Aiyou Foundation (Dr J. Wang).
Role of the Funder/Sponsor: The funding sources had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.
Create a personal account or sign in to: