Europe PMC

This website requires cookies, and the limited processing of your personal data in order to function. By using the site you are agreeing to this as outlined in our privacy notice and cookie policy.

Abstract 


The administration of antibodies blocking the immune checkpoint molecules programmed cell death protein 1 (PD-1) or programmed cell death 1 ligand 1 (PD-L1) has evolved as a very promising treatment option for cancer patients. PD-1/PD-L1 inhibition has significantly enhanced expansion, cytokine secretion, and cytotoxic activity of CD4+ and CD8+ T lymphocytes, resulting in enhanced antitumor responses. Anti-PD-1 or anti-PD-L1 therapy has induced tumor regression and improved clinical outcome in patients with different tumor entities, including melanoma, non-small-cell lung cancer, and renal cell carcinoma. These findings led to the approval of various anti-PD-1 or anti-PD-L1 antibodies for the treatment of tumor patients. However, the majority of patients have failed to respond to this treatment modality. Comprehensive immune monitoring of clinical trials led to the identification of potential biomarkers distinguishing between responders and non-responders, the discovery of modes of treatment resistance, and the design of improved immunotherapeutic strategies. In this review article, we summarize the evolving landscape of biomarkers for anti-PD-1 or anti-PD-L1 therapy.

Free full text 


Logo of jclinmedLink to Publisher's site
J Clin Med. 2019 Oct; 8(10): 1534.
Published online 2019 Sep 25. https://doi.org/10.3390/jcm8101534
PMCID: PMC6832659
PMID: 31557787

The Evolving Landscape of Biomarkers for Anti-PD-1 or Anti-PD-L1 Therapy

Abstract

The administration of antibodies blocking the immune checkpoint molecules programmed cell death protein 1 (PD-1) or programmed cell death 1 ligand 1 (PD-L1) has evolved as a very promising treatment option for cancer patients. PD-1/PD-L1 inhibition has significantly enhanced expansion, cytokine secretion, and cytotoxic activity of CD4+ and CD8+ T lymphocytes, resulting in enhanced antitumor responses. Anti-PD-1 or anti-PD-L1 therapy has induced tumor regression and improved clinical outcome in patients with different tumor entities, including melanoma, non-small-cell lung cancer, and renal cell carcinoma. These findings led to the approval of various anti-PD-1 or anti-PD-L1 antibodies for the treatment of tumor patients. However, the majority of patients have failed to respond to this treatment modality. Comprehensive immune monitoring of clinical trials led to the identification of potential biomarkers distinguishing between responders and non-responders, the discovery of modes of treatment resistance, and the design of improved immunotherapeutic strategies. In this review article, we summarize the evolving landscape of biomarkers for anti-PD-1 or anti-PD-L1 therapy.

Keywords: cancer immunotherapy, immune monitoring, immune checkpoints, programmed cell death protein 1, programmed cell death 1 ligand 1

1. Introduction

Recent studies revealed that targeting the immune checkpoint molecules programmed cell death protein 1 (PD-1) or programmed cell death 1 ligand 1 (PD-L1) by antibodies can significantly improve T cell-mediated antitumor responses and can induce objective clinical responses in about 20–40% of patients with different tumor types [1,2,3]. PD-1 is expressed on the cell surface of activated T cells, natural killer (NK) cells, and B cells, and binds to PD-L1 and PD-L2 [4,5]. PD-L1 is widely expressed on tumor cells, as well as hematopoietic and non-hematopoietic cells, and can be induced by proinflammatory cytokines such as interferon (IFN)-γ. PD-L2 has a higher affinity to PD-1, but its expression is more restricted, being mainly expressed by antigen-presenting cells (APCs) and induced mostly by interleukin-4 and granulocyte-macrophage colony-stimulating factor [6,7,8,9]. PD-L1 can also interact with CD80 on T cells, thereby delivering another inhibitory signal [10]. PD-1 plays an important role in modulating the immune response of antigen-experienced effector T cells. In peripheral tissues, activated T cells express PD-1 that binds to PD-L1 and PD-L2 on various tissue-associated cell types. PD-1 ligand expression is induced by proinflammatory molecules. PD-1 signaling results in inhibition of T cell proliferation, cytokine production, and cytotoxicity, protecting the tissue against collateral damage during immune responses [6,11,12]. This pathway is adopted by tumors to prevent themselves from immune attack [13].

Based on these findings, the efficacy of anti-PD-1 or anti-PD-L1 antibodies to significantly enhance T cell-mediated antitumor immunity has been explored in preclinical models. For example, it has been demonstrated in a murine pancreatic cancer model that anti-PD-1/PD-L1 blockade efficiently inhibits tumor growth [14]. When investigating the underlying mechanisms, an increased frequency of infiltrating CD8+ T cells as well as a higher expression of IFN-γ, granzyme B and perforin was found in tumors of treated mice. In another study, various patient-derived xenograft tumors were established in a humanized mouse model to explore the efficacy and mechanisms of anti-PD-1 therapy. Treatment with anti-PD-1 antibodies led to significant tumor growth inhibition, which was mediated by CD8+ T cells [15]. In clinical trials, anti-PD-1/PD-L1 blockade resulted in objective clinical responses in patients with melanoma [16,17,18], non-small-cell lung cancer (NSCLC) [19,20,21], renal cell carcinoma (RCC) [22,23], bladder cancer [24,25], and Hodgkin’s lymphoma [26]. More recently, it has been reported that overall survival (OS) curves show estimated 5-year rates of 34.2% among patients with melanoma, 27.7% among patients with RCC, and 15.6% among patients with NSCLC, indicating that anti-PD-1 treatment is associated with long-term survival in a subset of patients [27]. Due to their clinical efficacy, the U.S. Food and Drug Administration (FDA) approved anti-PD-1 or anti-PD-L1 antibody treatment for various tumor entities [28,29]. To further improve the clinical outcome in tumor patients, combinations of anti-PD-1/PD-L1 antibodies and other treatment options have been applied. For example, it has been reported that the combination of anti-PD-1 and anti-cytotoxic T lymphocyte antigen 4 (CTLA-4) antibody treatment results in a longer progression-free survival (PFS) than single agent therapy among previously untreated patients with metastatic melanoma [30]. In addition, objective response rates and OS were significantly higher with combined anti-PD-1 and anti-CTLA-4 therapy than with sunitinib among patients with previously untreated advanced RCC [31]. When combining anti-PD-1 treatment with chemotherapy, Paz-Ares et al. found that the addition of pembrolizumab to chemotherapy with carboplatin plus paclitaxel or nab-paclitaxel results in significantly longer OS and PFS than chemotherapy alone in patients with previously untreated metastatic, squamous NSCLC [32]. More recently, the clinical efficacy of anti-PD-1/PD-L1 antibodies and therapeutic strategies inhibiting the vascular endothelial growth factor (VEGF)/VEGF receptor axis has been evaluated in RCC patients. Thus, it has been reported that the combination of anti-PD-1 and axitinib leads to significantly longer OS and PFS compared to sunitinib among patients with previously untreated advanced RCC [33]. Furthermore, Rini et al. demonstrated that combined anti-PD-L1 and anti-VEGF therapy prolong PFS compared to sunitinib in RCC patients [34].

However, the majority of tumor patients do not respond to anti-PD-1/PD-L1 therapy. Therefore, the identification of biomarkers to predict treatment responders and therapy-related side effects is needed [35,36,37,38,39]. In addition, the discovery of mechanisms underlying anti-PD-1/PD-L1 therapy and modes of resistance is useful for improving current treatment modalities [35,36,37,38,39,40]. Here, we summarize recent findings on the PD-L1 expression or mutational load of tumor tissues, the frequency and phenotype of tumor-infiltrating or blood-circulating immune cells, and the microbiome in patients prior to and during anti-PD-1/PD-L1 treatment.

2. Results

2.1. Frequency and Phenotype of Tumor-Infiltrating Immune Cells

Previous reports provided evidence that the tumor immune contexture plays a critical role for the clinical outcome of patients [41,42,43]. For example, it has been shown that high densities of CD45RO+ T helper 1 cells and CD8+ T cells are associated with improved survival of colorectal cancer patients [44,45]. These results led to the development of a so-called “immunoscore” for an optimized tumor classification [46]. Accumulating evidence revealed that the tumor immune architecture also essentially contributes to the clinical efficacy of anti-PD-1/PD-L1 therapy. Thus, pretreatment melanoma samples from patients who displayed a clinical response to anti-PD-1 therapy showed higher CD8+ T cell frequencies compared to samples from patients with progressive disease during therapy [47], indicating that pre-existing tumor-infiltrating CD8+ T cells are predictors of a clinical response to PD-1 blockade. Another study revealed that a high T effector gene signature expression in tumor tissues at baseline was associated with improved overall response rate and PFS of RCC patients treated with anti-PD-L1 and anti-VEGF antibodies [48]. In contrast, a high myeloid inflammation gene signature expression was correlated with reduced PFS in patients receiving anti-PD-L1 alone or anti-PD-L1 and VEGF antibodies. Moreover, Thommen et al. identified three distinct intratumoral CD8+ T cell subsets based on PD-1 expression in NSCLC patients [49]. Besides the CD8+ T cell subsets with intermediate (PD-1N) and no PD-1 expression, a subpopulation with high PD-1 expression (PD-1T) was detected that showed a markedly different transcriptional and metabolic profile. The presence of PD-1T T cells was strongly predictive for the clinical outcome of anti-PD-1-treated NSCLC patients [49]. Single cell profiling of tumor-infiltrating immune cells from 32 metastatic melanoma patients treated with anti-PD-1- and/or CTLA-4 antibodies identified two major CD8+ T cell states associated with clinical outcome [50]. CD8+ T cells with increased expression of genes linked to memory, activation and cell survival were enriched in responding melanoma lesions. In contrast, CD8+ T cells with increased expression of genes linked to exhaustion were enriched in non-responding lesions. Thus, the ratio of memory-like to exhausted CD8+ T cells was associated with response to checkpoint inhibitor (CPI) therapy. In addition, elevated frequencies of melanoma-infiltrating TCF7+CD8+ T cells were found to predict positive clinical outcome in an independent cohort of anti-PD-1-treated patients [50].

Further studies explored the impact of anti-PD-1 blockade on tumor-infiltrating T cells (TILs). Thus, it has been shown that PD-1 therapy preferentially induces proliferation of exhausted-like tumor-infiltrating CD8+ T lymphocytes [51]. Furthermore, Ribas et al. reported that anti-PD-1 blockade leads to a higher TIL density in treatment responders [52]. In addition, it has been found that CD4+FoxP3-PD-1hi T cells (4PD-1hi) accumulate intratumorally in NSCLC patients and that a lack of effective 4PD-1hi reduction after anti-PD-1 therapy correlates with poor prognosis [53]. Taube et al. investigated the infiltrating immune cells of PD-L1+ and PD-L1 melanomas and found an IFN-γ-dominated cytokine expression pattern in TILs of PD-L1+ melanomas [13]. This can be explained by the mechanism that the recognition of tumor antigens by activated TILs leads to a PD-1 upregulation and induction of IFN-γ secretion. Consequently, tumor cells enhance PD-L1 expression, thereby protecting the tumor from PD-1+ effector T cell-mediated elimination.

Verma et al. demonstrated that the status of CD8+ T cell priming essentially contributes to anti-PD-1 therapeutic resistance [54]. Thus, PD-1 blockade in unprimed or suboptimally primed CD8+ T cell conditions resulted in the induction of dysfunctional PD-1+CD38hi CD8+ cells, leading to anti-PD-1 antibody resistance and treatment failure. In contrast, PD-1 blockade of optimally primed CD8+ T lymphocytes prevented the induction of dysfunctional CD8+ cells, reversing resistance. They also reported that a high frequency of tumor-infiltrating or blood-circulating PD-1+CD38hi CD8+ cells in melanoma patients can serve as a biomarker of anti-PD-1 resistance.

2.2. PD-L1 Expression by Tumor Cells and Tumor-Infiltrating Immune Cells

In order to treat a patient with an antibody directed to PD-1 or PD-L1, a positive PD-L1 status is required for the majority of tumor entities, at least in first-line therapy. This currently applies to NSCLC, gastric or gastroesophageal junction adenocarcinoma, cervical cancer, urothelial carcinoma, head and neck squamous cell carcinoma, and esophageal squamous cell carcinoma [55]. In this case, testing of the tissue before therapy is mandatory in the sense of a so-called “companion diagnostic”, whereby the situation in Europe (testing is required, open methods) differs from the situation in the sphere of influence of the FDA (testing with a specific diagnostic antibody required).

Various clinical studies have shown that patients with a higher PD-L1 expression had a better response to a corresponding therapy [56,57,58]. Unlike, for example, a genetic test, PD-L1 expression is not a “digital” marker in the sense of present/not present, but a value that must be defined as positive or negative according to empirical surveys. The current IMpassion 130 study on triple negative breast carcinomas showed that even very low positivity rates of 1% can be sufficient. This study compared PD-L1 blockade and nab-paclitaxel versus placebo and nab-paclitaxel in metastatic tumors that had not previously undergone systemic therapy. An expression on ≥ 1% of intra- and peritumoral immune cells was defined as PD-L1 positive, which was the case in 40.9% of the total 902 patients. A consistent benefit was observed for PFS and OS across the PD-L1 positive subgroup, whereas no efficacy benefit was seen in the PD-L1 negative subgroup. Interestingly, however, this does not seem to be a linear relationship, in the sense of a continuously improved response at expression rates higher than 1% [59]. The fact that a positive PD-L1 status not only serves to optimize response rates for successful therapy, but can also protect patients from damage, was recently described in urothelial carcinoma of the urinary bladder. In first-line therapy with anti-PD-L1 antibodies (IMvigor 130) and anti-PD-1 antibodies (Keynote-361), an increased mortality rate [60,61,62] was observed in the group of PD-L1 negative patients treated with CPIs. However, the immunohistochemically-determined PD-L1 status as a biomarker can only be an approximation, which is also shown by the fact that patients do not respond clinically to an appropriate therapy despite a positive PD-L1 status. Thus, it has been demonstrated that RCC patients with 1% or greater PD-L1 expression have reduced OS compared to patients with less than 1% [23]. These patients were previously treated with antiangiogenic agents and then assigned to receive anti-PD-1 treatment. Furthermore, Gettinger et al. found no clear association between PD-L1 expression and survival in NSCLC patients receiving anti-PD-1 therapy [63].

Although the immunohistochemically-determined PD-L1 status is not an optimal biomarker to predict a response to CPI therapy, it is currently the best established and validated marker. The fact that the test is fast, material- and cost-saving and can be carried out in almost any pathological institute is also a clear advantage of this method. One of the decisive challenges here is not so much the technical implementation of the staining as the correct interpretation and evaluation, which is also reflected by the results of the interlaboratory comparisons within the framework of quality assurance in pathology [64]. For pathologists, the complexity lies in the multitude of available antibodies or assays, each of which has its own scoring algorithms and cut-off values, which can differ from entity to entity, and also the question of whether tumor and/or immune cells should be tested. The PD-L1 status can be specified using various scores. IC scoring (e.g., for first-line therapy with atezolizumab in urothelial carcinoma) only considers immune cells, not expression on tumor cells. The expression is evaluated as a percentage of the tumor area in four categories (IC 0 to IC 3; <1% to ≥10%) [65]. Another approach underlies the dimensionless “combined positivity score—CPS”. In this evaluation strategy, both tumor and immune cells are taken into account, whereby the expression of tumor and immune cells is jointly related to the population of tumor cells. This means that a value greater than 100 is possible here; however, it is limited to the maximum value of 100 [66]. Another score applied in practice is the “tumor proportion score—TPS”, which reports the percentage of immunohistochemically positive, epithelial tumor cells in the entire tumor. In general, it has been shown that the various scoring algorithms can be implemented accurately and with high reproducibility by pathologists after appropriate training [67,68,69].

On questions of analytical comparability and technical reproducibility of immunohistochemical staining, great efforts have been made both at national and international level, which essentially show that the assays and antibodies 22C3, 28-8 and SP263 used in clinical studies can be regarded as comparable and interchangeable with regard to immune cells. A similar picture can be seen with tumor cells, where SP142 has a reduced sensitivity and therefore detects fewer tumor cells than the other assays mentioned above [68,69,70,71,72]. This difference in staining and detection behavior should be considered, especially if not only the IC score but also the CPS has to be determined on a sample.

2.3. Tumor Mutational and Neoantigen Burden

Accumulating evidence suggests that the tumor mutational burden (TMB) can significantly influence the immune contexture and the sensitivity to CPI therapy. A higher mutational load increases the probability of immunogenic mutations, providing neoantigens for T cell responses. Recent studies explored the impact of the TMB and derived neoantigens on the sensitivity of tumors to PD-1 blockade. Thus, it has been reported that a higher non-synonymous mutation or candidate neoantigen burden in tumors was associated with improved PFS of anti-PD-1-treated NSCLC patients [73]. In addition, Le et al. demonstrated that anti-PD-1 antibody-treated patients with mismatch repair-deficient colorectal cancer showed a higher immune-related objective response rate and immune-related PFS rate than patients with mismatch repair-proficient colorectal cancer [74]. Analyzing the sequence of the whole exome revealed that tumors with a deficiency in mismatch repair displayed a significantly higher number of somatic mutations per tumor compared to tumors proficient in mismatch repair. Longer PFS was correlated with high numbers of somatic mutations and potential mutation-associated neoantigens [74]. More recently, they extended the study to explore the clinical outcome of anti-PD-1-treated patients with advanced mismatch repair-deficient cancers across 12 different tumor types [75]. Objective radiographic responses were observed in 53% of patients, and complete responses were achieved in 21% of patients, indicating that a mismatch repair-deficiency can make the tumor sensitive to PD-1 blockade, regardless of the cancers’ tissue of origin. Another study found 70% objective clinical responses, including 32% complete responses in anti-PD-1-treated patients with desmoplastic melanoma [76]. The high number of detected somatic mutations and a frequent pre-existing adaptive immune response may essentially contribute to the impressive clinical response rates. Furthermore, it has been reported that anti-PD-1 antibody-treated RCC patients bearing loss-of-function mutations in the PBRM1 gene experienced a clinical benefit [77]. These findings were confirmed in an independent validation cohort of 63 patients treated with PD-1 or PD-L1 blockade therapy alone or in combination with anti-CTLA-4 [77]. In contrast, McDermott et al. found no correlation between mutational or neoantigen burden and PFS of ccRCC patients treated with anti-PD-L1 alone or combined with anti-VEGF antibodies [48]. Notably, mutations in tumors can also be associated with resistance to PD-1 blockade. Thus, it has been reported that the anti-PD-1-treated subgroup of KRAS-mutant lung adenocarcinoma patients with a STK11/LKB1 co-mutation exhibits shorter PFS and OS compared to the only KRAS-mutant lung adenocarcinoma cohort or the KRAS- and TP53-mutant lung adenocarcinoma subgroup. These findings provide evidence that STK11/LKB1 may be critical for anti-PD-1 resistance in KRAS-mutant lung adenocarcinoma patients [78].

When investigating an association between intratumoral neoantigen load and responsiveness to PD-1 blockade, McGranahan et al. found that a high clonal neoantigen burden in tumors of anti-PD-1 antibody-treated NSCLC patients is associated with improved clinical outcome [79]. In addition, Łuksza et al. described a neoantigen fitness model based on the likelihood of neoantigen presentation by HLA molecules and subsequent T cell recognition, which is able to predict clinical outcome of anti-PD-1 antibody-treated tumor patients [80]. Riaz et al. investigated the mechanisms by which PD-1 blockade modulates tumor evolution during therapy. Therefore, genomic changes in tumors from 68 patients with advanced melanomas, who progressed on anti-CTLA-4 treatment or were anti-CTLA-4 therapy-naïve, before and after anti-PD-1 initiation were determined [81]. After 4 weeks of anti-PD-1 therapy, a marked reduction of mutation and neoantigen load among patients with objective clinical responses was observed.

Chowell et al. explored the impact of the HLA class I genotype on the response of a large cohort of advanced cancer patients treated with anti-CTLA-4 and/or anti-PD-1 antibodies [82]. Maximal heterozygosity at HLA class I loci improved OS after CPI therapy compared with patients who were homozygous for at least one HLA class I locus, indicating that the HLA class I genotype significantly influences tumor sensitivity to this treatment modality.

Further studies discovered mechanisms of resistance to PD-1 blockade therapy in tumor patients. Thus, loss-of-function mutations in genes encoding interferon-receptor-associated Janus kinase 1 (JAK1) or JAK2 were detected, resulting in a lack of response to IFN-γ-mediated antitumor effects [83]. Another mode of resistance is based on a defective antigen presentation by tumor cells. Point mutations, deletions or loss of heterozygosity in beta-2-microglobulin (B2M) were found, leading to an insufficient HLA class I surface expression [83,84,85].

2.4. Frequency and Phenotype of Blood-Circulating Immune Cells and Soluble Molecules

Further studies investigated the frequency and phenotype of circulating immune cells and the concentration of soluble molecules in blood from anti-PD-1-treated tumor patients to identify potential biomarkers for the prediction of clinical responses. Thus, anti-PD-1 treatment resulted in an expansion of blood-circulating PD-1+ CD8+ T cells in NSCLC patients [86]. PD-1+ CD8+ T cell responses were observed in the majority of patients with clinical benefit. In addition, Takeuchi et al. found an increase in a subset of central memory CD4+ T cells, defined by the phenotype CD27+Fas-CD45RA-CCR7+, in blood of melanoma patients after anti-PD-1 treatment, which is associated with clinical responses [87]. A further study revealed that the magnitude of reinvigoration of T cells with an exhausted phenotype determined in relation to pretreatment tumor burden is correlated with clinical responses in anti-PD-1-treated melanoma patients [88]. More recently, it has been shown that PD-1 expression was significantly higher on CD4+ T cells and T-cell immunoglobulin and mucin containing protein 3 (TIM-3) expression was significantly higher on CD8+ T cells in blood of melanoma patients that respond to anti-PD-1 therapy compared to non-responders [89]. However, it is not only the T cell compartment that may serve as a potential biomarker for clinical responses. Krieg et al. reported that the frequency of classical blood monocytes at baseline in anti-PD-1-treated melanoma patients is a predictor of PFS and OS [90]. Furthermore, high relative eosinophil counts and relative lymphocyte counts in peripheral blood at baseline were associated with favorable OS of melanoma patients receiving anti-PD-1 antibodies [91].

When exploring soluble molecules as potential biomarkers for treatment response, it has been demonstrated that low lactate dehydrogenase (LDH) in blood at baseline was correlated with improved OS in anti-PD-1-treated melanoma patients [91]. Significantly lower baseline serum levels of monocyte chemoattractant protein 1, leucocyte inhibition factor, and CTLA-4 were associated with hyperprogressive metastatic gastrointestinal cancer among patients receiving CPI therapy [92]. Chow et al. reported that intratumoral expression and activity of the chemokine receptor CXCR3 is crucial for the efficacy of anti-PD-1 treatment in tumor-bearing mice [93]. In this context, CXCR3 was required for improving the intratumoral CD8+ T cell response, but not for the CD8+ T cell migration into the tumor. When investigating the plasma concentration of the CXCR3 ligands CXCL9 and CXCL10 in tumor patients treated with anti-PD-1 alone or anti-PD-1 and anti-CTLA-4 antibodies, it was found that the treatment responder group has elevated levels within the first few months after therapy. Moreover, Chen et al. observed an increase of melanoma-derived exosomes carrying PD-L1 on their surface in the blood of patients during early stages of anti-PD-1 therapy [94]. This phenomenon is associated with clinical responses, indicating that exosomal PD-L1 can serve as a predictor for anti-PD-1 therapy.

As described above, several studies have shown that a high TMB in anti-PD-1 antibody-treated patients is associated with improved clinical outcome. Following this finding, Gandara et al. explored the potential of TMB in blood of anti-PD-L1-treated NSCLC patients as a predictor of clinical benefit [95]. They found that blood-based TMB identifies patients with significant improvements in PFS.

2.5. Microbiome

Recent findings in tumor patients indicate that the diversity and composition of the gut microbiota have an impact on the efficacy of CPI therapy [96]. Thus, a correlation between the gut microbiome of tumor patients and their clinical response to anti-PD-1 blockade has been discovered [97,98]. The gut microbiome of responding melanoma patients showed a significantly higher alpha diversity and a relative abundance of bacteria of the Ruminococcaceae family [97]. The Bacteroidales order was enriched in non-responders. Immune profiling revealed a higher density of melanoma-infiltrating CD8+ T cells at baseline and a higher frequency of blood-circulating CD8+ and CD4+ T cells in responder patients with a favorable gut microbiome [97]. In another study, the bacterial species Bifidobacterium longum, Collinsella aerofaciens, and Enterococcus faecium were more abundant in responders [99]. Routy and colleagues found that the relative abundance of Akkermansia munciniphila is significantly associated with a favorable clinical outcome of patients with advanced NSCLC, RCC, and urothelial carcinoma [98]. These findings indicate that the efficacy of anti-PD-1 therapy can be markedly influenced by the gut microbiome in tumor patients. Based on these findings, the impact of antibiotic use on the efficacy of PD-1 blockade has been investigated. Notably, PFS and OS were significantly shorter in antibiotic-treated patients [98]. In line with this study, it has been reported that antibiotic use within 30 days prior to the initiation of CPI treatment was associated with decreased PFS [100]. These results provide evidence that antibiotics may significantly influence the efficacy of CPI-based therapy in tumor patients.

3. Conclusions

Targeting the PD-1/PD-L1 axis can induce objective clinical responses and improve survival in patients with various tumor types such as melanoma, NSCLC, and RCC. However, the majority of tumor patients do not respond to anti-PD-1/PD-L1 therapy. Various potential biomarkers in the blood or tumor tissues of anti-PD-1/PD-L1-treated patients have been discovered that may predict clinical outcome and, therefore, may discriminate between treatment responders and non-responders. However, clinical trials have yielded contradictory results concerning the suitability of some of these potential biomarkers. In addition, the potential of some newly described biomarkers has to be validated in large cohorts of anti-PD-1/PD-L1-treated patients. Based on these issues, a single biomarker that can be widely used to predict the clinical outcome is not available. The design of predictive models combining the most promising single biomarkers described so far may improve the identification of patients who will benefit from anti-PD-1/PD-L1 therapy.

Recently, various mechanisms of resistance underlying an inefficient anti-PD-1/PD-L1 therapy have been discovered. Based on these findings, improved treatment modalities can be designed. Thus, a low degree of tumor-infiltrating T cells before anti-PD-1/PD-L1 therapy is associated with progressive disease during treatment. This suggests that the administration of drugs that promote T cell trafficking to tumors before anti-PD-1/PD-L1 therapy may improve the clinical outcome for patients with an insufficient density of pre-existing tumor-infiltrating T cells. This may be achieved by the application of epigenetic modulators that remove the repressed intratumoral secretion of T cell-attracting chemokines, leading to increased T cell infiltration. Furthermore, PD-1 blockade in unprimed or suboptimally primed CD8+ T cell conditions induces dysfunctional CD8+ T cells, resulting in anti-PD-1 antibody resistance. This observation indicates that the generation of optimally primed CD8+ T lymphocytes by activating strategies such as adjuvant-based vaccination or radiotherapy may prevent resistance to anti-PD-1 therapy.

Summary

A summary of potential biomarkers for the prediction of clinical responses to anti-PD-1/PD-L1 therapy is given in Figure 1 and Table 1.

An external file that holds a picture, illustration, etc.
Object name is jcm-08-01534-g001.jpg

Immune profile of tumor patients receiving anti-PD-1 or anti-PD-L1 antibodies associated with favorable clinical outcome. In peripheral blood, higher numbers of eosinophils, lymphocytes, PD-1+ T cells, TIM-3+ CD8+ T cells, central memory CD4+ T cells, and classical monocytes are associated with improved clinical responses. Furthermore, low levels of LDH and elevated levels of CXCL9, CXCL10, as well as PD-L1+ exosomes are predictive for a clinical outcome. Within the tumor, higher densities of CD8+ T cells in pretreatment tumor samples and an increase in intratumoral CD8+ T cell frequencies during anti-PD-1 therapy are detectable in patients that show a clinical response. The presence of PD-1T T cells and an elevated frequency of TCF7+CD8+ T cells is also associated with a favorable outcome as well as high numbers of CD45RO+ Th1 cells and high PD-L1 expression on tumor cells and infiltrating immune cells. Further studies indicate that a high intratumoral mutational and neoantigen load, heterozygosity at the HLA I loci, and a deficiency in the mismatch repair system, which may lead to a higher level of somatic mutations in the tumor cells, are correlated with an improved survival of patients. In addition, a significantly higher alpha diversity or a relative abundance of Ruminococcaceae bacteria as well as of the bacterial species Akkermansia munciniphila, Bifidobacterium longum, Collinsella aerofaciens, and Enterococcus faecium in the gut microbiome are associated with a favorable clinical outcome for tumor patients. Eo—eosinophil; T—T cell; Mo—monocyte; Exo—exosome; Th1—T helper cell type.

Table 1

Biomarkers associated with clinical response to anti-PD-1 or anti-PD-L1 treatment.

BiomarkerAssociation with Clinical OutcomeMalignancyTreatmentTissue Type for Biomarker AssessmentReferences
Pre-existing and highly frequent tumor-infiltrating CD8+ T cellsPositiveMelanomaAnti-PD-1Tumor tissue[47,52]
High T effector gene signature expressionPositiveRCCAnti-PD-L1 and anti-VEGFTumor tissue[48]
High myeloid inflammation gene signature expressionNegativeRCCAnti-PD-L1/Anti-PD-L1 and anti-VEGFTumor tissue[48]
PD-1hiCD8+ T cellsPositiveNSCLCAnti-PD-1Tumor tissue[49]
Ratio memory-like to exhausted CD8+ T cellsPositiveMelanomaAnti-PD-1 and/or anti-CTLA-4Tumor tissue[50]
TCF7+CD8+ T cellsPositiveMelanomaAnti-PD-1Tumor tissue[50]
CD4+FoxP3-PD-1hi T cellsNegativeNSCLCAnti-PD-1Tumor tissue[53]
PD-1+CD38hiCD8+ T cellsNegativeMelanomaAnti-PD-1Tumor tissue, blood[54]
PD-L1 expressionPositiveMultiple cancer typesAnti-PD-1/Anti-PD-L1Tumor tissue[56,57,58]
Tumor mutational and neoantigen loadPositiveNSCLCAnti-PD-1/Anti-PD-L1Tumor tissue, blood[73,79,95]
Mismatch repair-deficiencyPositiveMultiple cancer typesAnti-PD-1Tumor tissue[74,75,76]
Loss-of-function mutations in PBRM1PositiveRCCAnti-PD-1/Anti-PD-L/Anti-PD-1 or anti-PD-L1 and anti-CTLA-4Tumor tissue[77]
STK11/LKB1 mutationsNegativeKRAS-mutant lung adeno-carcinomaAnti-PD-1Tumor tissue[78]
Reduction of mutational and neoantigen load under therapyPositiveMelanomaAnti-PD-1Tumor tissue[81]
HLA class I heterozygosityPositiveMelanoma, NSCLCAnti-PD-1 and/or anti-CTLA-4Blood[82]
JAK1/JAK2 mutationsNegativeMelanomaAnti-PD-1Tumor tissue[83]
B2M mutationsNegativeMelanoma, NSCLC Anti-PD-1Tumor tissue[83,84,85]
PD-1+CD8+ T cellsPositiveNSCLCAnti-PD-1Blood[86]
CD27+Fas-CD45RA-CCR7+CD4+ T cellsPositiveMelanomaAnti-PD-1Blood[87]
PD-1+CD4+ T cellsPositiveMelanomaAnti-PD-1Blood[89]
TIM-3+CD8+ T cellsPositiveMelanomaAnti-PD-1Blood[89]
Classical monocytesPositiveMelanomaAnti-PD-1Blood[90]
High relative eosinophil countsPositiveMelanomaAnti-PD-1Blood[91]
High relative lymphocyte countsPositiveMelanomaAnti-PD-1Blood[91]
Low LDHPositiveMelanomaAnti-PD-1Blood[91]
Low MCP1, LIF, CTLA-4NegativeGastro-intestinal cancerAnti-PD-1/Anti-PD-L1/Anti-CTLA-4Blood[92]
High CXCL9 and CXCL10PositiveMelanomaAnti-PD-1/Anti-PD-1 and anti-CTLA-4Blood[93]
PD-L1+ ExosomesPositiveMelanomaAnti-PD-1Blood[94]
High alpha diversityPositiveMelanomaAnti-PD-1Gut[97]
Bacteria of the Ruminococcaceae familyPositiveMelanomaAnti-PD-1Gut[97]
Bacteria of the Bacteroidales orderNegativeMelanomaAnti-PD-1Gut[97]
Bifidobacterium longum, Collinsella aerofaciens, Enterococcus faeciumPositiveMelanomaAnti-PD-1Gut[99]
Akkermansia munciniphila PositiveNSCLC, RCC, urothelial carcinomaAnti-PD-1Gut[98]

Author Contributions

A.T. and U.S. drafted the manuscript. R.W., A.S.K., M.-O.G., M.P.B, U.P., M.B., G.B. and M.S. reviewed and edited the manuscript. All authors read and approved the manuscript.

Conflicts of Interest

The authors declare no conflict of interest.

References

1. Postow M.A., Callahan M.K., Wolchok J.D. Immune Checkpoint Blockade in Cancer Therapy. J. Clin. Oncol. 2015;33:1974–1982. 10.1200/JCO.2014.59.4358. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
2. Sharma P., Allison J.P. The future of immune checkpoint therapy. Science. 2015;348:56–61. 10.1126/science.aaa8172. [Abstract] [CrossRef] [Google Scholar]
3. Ribas A., Wolchok J.D. Cancer immunotherapy using checkpoint blockade. Science. 2018;359:1350–1355. 10.1126/science.aar4060. [Abstract] [CrossRef] [Google Scholar]
4. Pardoll D.M. The blockade of immune checkpoints in cancer immunotherapy. Nat. Rev. Cancer. 2012;12:252–264. 10.1038/nrc3239. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
5. Baumeister S.H., Freeman G.J., Dranoff G., Sharpe A.H. Coinhibitory Pathways in Immunotherapy for Cancer. Annu. Rev. Immunol. 2016;34:539–573. 10.1146/annurev-immunol-032414-112049. [Abstract] [CrossRef] [Google Scholar]
6. Keir M.E., Butte M.J., Freeman G.J., Sharpe A.H. PD-1 and Its Ligands in Tolerance and Immunity. Annu. Rev. Immunol. 2008;26:677–704. 10.1146/annurev.immunol.26.021607.090331. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
7. Dong H., Zhu G., Tamada K., Chen L. B7-H1, a third member of the B7 family, co-stimulates T-cell proliferation and interleukin-10 secretion. Nat. Med. 1999;5:1365–1369. 10.1038/70932. [Abstract] [CrossRef] [Google Scholar]
8. Latchman Y., Wood C.R., Chernova T., Chaudhary D., Borde M., Chernova I., Iwai Y., Long A.J., Brown J.A., Nunes R., et al. PD-L2 is a second ligand for PD-1 and inhibits T cell activation. Nat. Immunol. 2001;2:261–268. 10.1038/85330. [Abstract] [CrossRef] [Google Scholar]
9. Swallow M.M., Wallin J.J., Sha W.C. B7h, a novel costimulatory homolog of B7.1 and B7.2, is induced by TNFalpha. Immunity. 1999;11:423–432. 10.1016/S1074-7613(00)80117-X. [Abstract] [CrossRef] [Google Scholar]
10. Park J.-J., Omiya R., Matsumura Y., Sakoda Y., Kuramasu A., Augustine M.M., Yao S., Tsushima F., Narazaki H., Anand S., et al. B7-H1/CD80 interaction is required for the induction and maintenance of peripheral T-cell tolerance. Blood. 2010;116:1291–1298. 10.1182/blood-2010-01-265975. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
11. Keir M.E., Liang S.C., Guleria I., Latchman Y.E., Qipo A., Albacker L.A., Koulmanda M., Freeman G.J., Sayegh M.H., Sharpe A.H. Tissue expression of PD-L1 mediates peripheral T cell tolerance. J. Exp. Med. 2006;203:883–895. 10.1084/jem.20051776. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
12. Fife B.T., Pauken K.E., Eagar T.N., Obu T., Wu J., Tang Q., Azuma M., Krummel M.F., Bluestone J.A. Interactions between PD-1 and PD-L1 promote tolerance by blocking the TCR-induced stop signal. Nat. Immunol. 2009;10:1185–1192. 10.1038/ni.1790. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
13. Taube J.M., Anders R.A., Young G.D., Xu H., Sharma R., McMiller T.L., Chen S., Klein A.P., Pardoll D.M., Topalian S.L., et al. Colocalization of inflammatory response with B7-h1 expression in human melanocytic lesions supports an adaptive resistance mechanism of immune escape. Sci. Transl. Med. 2012;4:127ra37. 10.1126/scitranslmed.3003689. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
14. Nomi T., Sho M., Akahori T., Hamada K., Kubo A., Kanehiro H., Nakamura S., Enomoto K., Yagita H., Azuma M., et al. Clinical significance and therapeutic potential of the programmed death-1 ligand/programmed death-1 pathway in human pancreatic cancer. Clin. Cancer Res. 2007;13:2151–2157. 10.1158/1078-0432.CCR-06-2746. [Abstract] [CrossRef] [Google Scholar]
15. Wang M., Yao L.-C., Cheng M., Cai D., Martinek J., Pan C.-X., Shi W., Ma A.-H., De Vere White R.W., Airhart S., et al. Humanized mice in studying efficacy and mechanisms of PD-1-targeted cancer immunotherapy. FASEB J. 2018;32:1537–1549. 10.1096/fj.201700740R. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
16. Topalian S.L., Sznol M., McDermott D.F., Kluger H.M., Carvajal R.D., Sharfman W.H., Brahmer J.R., Lawrence D.P., Atkins M.B., Powderly J.D., et al. Survival, durable tumor remission, and long-term safety in patients with advanced melanoma receiving nivolumab. J. Clin. Oncol. 2014;32:1020–1030. 10.1200/JCO.2013.53.0105. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
17. Hamid O., Robert C., Daud A., Hodi F.S., Hwu W.-J., Kefford R., Wolchok J.D., Hersey P., Joseph R.W., Weber J.S., et al. Safety and tumor responses with lambrolizumab (anti-PD-1) in melanoma. N. Engl. J. Med. 2013;369:134–144. 10.1056/NEJMoa1305133. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
18. Robert C., Long G.V., Brady B., Dutriaux C., Maio M., Mortier L., Hassel J.C., Rutkowski P., McNeil C., Kalinka-Warzocha E., et al. Nivolumab in previously untreated melanoma without BRAF mutation. N. Engl. J. Med. 2015;372:320–330. 10.1056/NEJMoa1412082. [Abstract] [CrossRef] [Google Scholar]
19. Garon E.B., Rizvi N.A., Hui R., Leighl N., Balmanoukian A.S., Eder J.P., Patnaik A., Aggarwal C., Gubens M., Horn L., et al. KEYNOTE-001 Investigators Pembrolizumab for the treatment of non-small-cell lung cancer. N. Engl. J. Med. 2015;372:2018–2028. 10.1056/NEJMoa1501824. [Abstract] [CrossRef] [Google Scholar]
20. Brahmer J., Reckamp K.L., Baas P., Crinò L., Eberhardt W.E.E., Poddubskaya E., Antonia S., Pluzanski A., Vokes E.E., Holgado E., et al. Nivolumab versus Docetaxel in Advanced Squamous-Cell Non-Small-Cell Lung Cancer. N. Engl. J. Med. 2015;373:123–135. 10.1056/NEJMoa1504627. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
21. Antonia S.J., Villegas A., Daniel D., Vicente D., Murakami S., Hui R., Kurata T., Chiappori A., Lee K.H., de Wit M., et al. PACIFIC Investigators Overall Survival with Durvalumab after Chemoradiotherapy in Stage III NSCLC. N. Engl. J. Med. 2018;379:2342–2350. 10.1056/NEJMoa1809697. [Abstract] [CrossRef] [Google Scholar]
22. Motzer R.J., Rini B.I., McDermott D.F., Redman B.G., Kuzel T.M., Harrison M.R., Vaishampayan U.N., Drabkin H.A., George S., Logan T.F., et al. Nivolumab for Metastatic Renal Cell Carcinoma: Results of a Randomized Phase II Trial. J. Clin. Oncol. 2015;33:1430–1437. 10.1200/JCO.2014.59.0703. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
23. Motzer R.J., Escudier B., McDermott D.F., George S., Hammers H.J., Srinivas S., Tykodi S.S., Sosman J.A., Procopio G., Plimack E.R., et al. CheckMate 025 Investigators Nivolumab versus Everolimus in Advanced Renal-Cell Carcinoma. N. Engl. J. Med. 2015;373:1803–1813. 10.1056/NEJMoa1510665. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
24. Sharma P., Retz M., Siefker-Radtke A., Baron A., Necchi A., Bedke J., Plimack E.R., Vaena D., Grimm M.-O., Bracarda S., et al. Nivolumab in metastatic urothelial carcinoma after platinum therapy (CheckMate 275): A multicentre, single-arm, phase 2 trial. Lancet Oncol. 2017;18:312–322. 10.1016/S1470-2045(17)30065-7. [Abstract] [CrossRef] [Google Scholar]
25. Massard C., Gordon M.S., Sharma S., Rafii S., Wainberg Z.A., Luke J., Curiel T.J., Colon-Otero G., Hamid O., Sanborn R.E., et al. Safety and Efficacy of Durvalumab (MEDI4736), an Anti-Programmed Cell Death Ligand-1 Immune Checkpoint Inhibitor, in Patients With Advanced Urothelial Bladder Cancer. J. Clin. Oncol. 2016;34:3119–3125. 10.1200/JCO.2016.67.9761. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
26. Ansell S.M., Lesokhin A.M., Borrello I., Halwani A., Scott E.C., Gutierrez M., Schuster S.J., Millenson M.M., Cattry D., Freeman G.J., et al. PD-1 blockade with nivolumab in relapsed or refractory Hodgkin’s lymphoma. N. Engl. J. Med. 2015;372:311–319. 10.1056/NEJMoa1411087. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
27. Topalian S.L., Hodi F.S., Brahmer J.R., Gettinger S.N., Smith D.C., McDermott D.F., Powderly J.D., Sosman J.A., Atkins M.B., Leming P.D., et al. Five-Year Survival and Correlates Among Patients With Advanced Melanoma, Renal Cell Carcinoma, or Non–Small Cell Lung Cancer Treated With Nivolumab. JAMA Oncol. 2019 10.1001/jamaoncol.2019.2187. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
28. Gong J., Chehrazi-Raffle A., Reddi S., Salgia R. Development of PD-1 and PD-L1 inhibitors as a form of cancer immunotherapy: A comprehensive review of registration trials and future considerations. J. Immunother. Cancer. 2018;6:8. 10.1186/s40425-018-0316-z. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
29. Riley R.S., June C.H., Langer R., Mitchell M.J. Delivery technologies for cancer immunotherapy. Nat. Rev. Drug Discov. 2019;18:175–196. 10.1038/s41573-018-0006-z. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
30. Larkin J., Chiarion-Sileni V., Gonzalez R., Grob J.J., Cowey C.L., Lao C.D., Schadendorf D., Dummer R., Smylie M., Rutkowski P., et al. Combined Nivolumab and Ipilimumab or Monotherapy in Untreated Melanoma. N. Engl. J. Med. 2015;373:23–34. 10.1056/NEJMoa1504030. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
31. Motzer R.J., Tannir N.M., McDermott D.F., Arén Frontera O., Melichar B., Choueiri T.K., Plimack E.R., Barthélémy P., Porta C., George S., et al. CheckMate 214 Investigators Nivolumab plus Ipilimumab versus Sunitinib in Advanced Renal-Cell Carcinoma. N. Engl. J. Med. 2018;378:1277–1290. 10.1056/NEJMoa1712126. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
32. Paz-Ares L., Luft A., Vicente D., Tafreshi A., Gümüş M., Mazières J., Hermes B., Çay Şenler F., Csőszi T., Fülöp A., et al. KEYNOTE-407 Investigators Pembrolizumab plus Chemotherapy for Squamous Non-Small-Cell Lung Cancer. N. Engl. J. Med. 2018;379:2040–2051. 10.1056/NEJMoa1810865. [Abstract] [CrossRef] [Google Scholar]
33. Rini B.I., Plimack E.R., Stus V., Gafanov R., Hawkins R., Nosov D., Pouliot F., Alekseev B., Soulières D., Melichar B., et al. Pembrolizumab plus Axitinib versus Sunitinib for Advanced Renal-Cell Carcinoma. N. Engl. J. Med. 2019;380:1116–1127. 10.1056/NEJMoa1816714. [Abstract] [CrossRef] [Google Scholar]
34. Rini B.I., Powles T., Atkins M.B., Escudier B., McDermott D.F., Suarez C., Bracarda S., Stadler W.M., Donskov F., Lee J.L., et al. IMmotion151 Study Group Atezolizumab plus bevacizumab versus sunitinib in patients with previously untreated metastatic renal cell carcinoma (IMmotion151): A multicentre, open-label, phase 3, randomised controlled trial. Lancet (Lond. Engl.) 2019;393:2404–2415. 10.1016/S0140-6736(19)30723-8. [Abstract] [CrossRef] [Google Scholar]
35. Kohrt H.E., Tumeh P.C., Benson D., Bhardwaj N., Brody J., Formenti S., Fox B.A., Galon J., June C.H., Kalos M., et al. Cancer Immunotherapy Trials Network (CITN) Immunodynamics: A cancer immunotherapy trials network review of immune monitoring in immuno-oncology clinical trials. J. Immunother. Cancer. 2016;4:15. 10.1186/s40425-016-0118-0. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
36. Topalian S.L., Taube J.M., Anders R.A., Pardoll D.M. Mechanism-driven biomarkers to guide immune checkpoint blockade in cancer therapy. Nat. Rev. Cancer. 2016;16:275–287. 10.1038/nrc.2016.36. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
37. Hegde P.S., Karanikas V., Evers S. The Where, the When, and the How of Immune Monitoring for Cancer Immunotherapies in the Era of Checkpoint Inhibition. Clin. Cancer Res. 2016;22:1865–1874. 10.1158/1078-0432.CCR-15-1507. [Abstract] [CrossRef] [Google Scholar]
38. Nishino M., Ramaiya N.H., Hatabu H., Hodi F.S. Monitoring immune-checkpoint blockade: Response evaluation and biomarker development. Nat. Rev. Clin. Oncol. 2017;14:655–668. 10.1038/nrclinonc.2017.88. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
39. Havel J.J., Chowell D., Chan T.A. The evolving landscape of biomarkers for checkpoint inhibitor immunotherapy. Nat. Rev. Cancer. 2019;19:133–150. 10.1038/s41568-019-0116-x. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
40. Pitt J.M., Vétizou M., Daillère R., Roberti M.P., Yamazaki T., Routy B., Lepage P., Boneca I.G., Chamaillard M., Kroemer G., et al. Resistance Mechanisms to Immune-Checkpoint Blockade in Cancer: Tumor-Intrinsic and -Extrinsic Factors. Immunity. 2016;44:1255–1269. 10.1016/j.immuni.2016.06.001. [Abstract] [CrossRef] [Google Scholar]
41. Fridman W.H., Zitvogel L., Sautès-Fridman C., Kroemer G. The immune contexture in cancer prognosis and treatment. Nat. Rev. Clin. Oncol. 2017;14:717–734. 10.1038/nrclinonc.2017.101. [Abstract] [CrossRef] [Google Scholar]
42. Binnewies M., Roberts E.W., Kersten K., Chan V., Fearon D.F., Merad M., Coussens L.M., Gabrilovich D.I., Ostrand-Rosenberg S., Hedrick C.C., et al. Understanding the tumor immune microenvironment (TIME) for effective therapy. Nat. Med. 2018;24:541–550. 10.1038/s41591-018-0014-x. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
43. Galon J., Bruni D. Approaches to treat immune hot, altered and cold tumours with combination immunotherapies. Nat. Rev. Drug Discov. 2019;18:197–218. 10.1038/s41573-018-0007-y. [Abstract] [CrossRef] [Google Scholar]
44. Galon J., Costes A., Sanchez-Cabo F., Kirilovsky A., Mlecnik B., Lagorce-Pagès C., Tosolini M., Camus M., Berger A., Wind P., et al. Type, density, and location of immune cells within human colorectal tumors predict clinical outcome. Science. 2006;313:1960–1964. 10.1126/science.1129139. [Abstract] [CrossRef] [Google Scholar]
45. Pagès F., Kirilovsky A., Mlecnik B., Asslaber M., Tosolini M., Bindea G., Lagorce C., Wind P., Marliot F., Bruneval P., et al. In situ cytotoxic and memory T cells predict outcome in patients with early-stage colorectal cancer. J. Clin. Oncol. 2009;27:5944–5951. 10.1200/JCO.2008.19.6147. [Abstract] [CrossRef] [Google Scholar]
46. Pagès F., Mlecnik B., Marliot F., Bindea G., Ou F.-S., Bifulco C., Lugli A., Zlobec I., Rau T.T., Berger M.D., et al. International validation of the consensus Immunoscore for the classification of colon cancer: A prognostic and accuracy study. Lancet (Lond. Engl.) 2018;391:2128–2139. 10.1016/S0140-6736(18)30789-X. [Abstract] [CrossRef] [Google Scholar]
47. Tumeh P.C., Harview C.L., Yearley J.H., Shintaku I.P., Taylor E.J.M., Robert L., Chmielowski B., Spasic M., Henry G., Ciobanu V., et al. PD-1 blockade induces responses by inhibiting adaptive immune resistance. Nature. 2014;515:568–571. 10.1038/nature13954. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
48. McDermott D.F., Huseni M.A., Atkins M.B., Motzer R.J., Rini B.I., Escudier B., Fong L., Joseph R.W., Pal S.K., Reeves J.A., et al. Clinical activity and molecular correlates of response to atezolizumab alone or in combination with bevacizumab versus sunitinib in renal cell carcinoma. Nat. Med. 2018;24:749–757. 10.1038/s41591-018-0053-3. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
49. Thommen D.S., Koelzer V.H., Herzig P., Roller A., Trefny M., Dimeloe S., Kiialainen A., Hanhart J., Schill C., Hess C., et al. A transcriptionally and functionally distinct PD-1+ CD8+ T cell pool with predictive potential in non-small-cell lung cancer treated with PD-1 blockade. Nat. Med. 2018;24:994–1004. 10.1038/s41591-018-0057-z. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
50. Sade-Feldman M., Yizhak K., Bjorgaard S.L., Ray J.P., de Boer C.G., Jenkins R.W., Lieb D.J., Chen J.H., Frederick D.T., Barzily-Rokni M., et al. Defining T Cell States Associated with Response to Checkpoint Immunotherapy in Melanoma. Cell. 2018;175:998–1013.e20. 10.1016/j.cell.2018.10.038. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
51. Wei S.C., Levine J.H., Cogdill A.P., Zhao Y., Anang N.-A.A.S., Andrews M.C., Sharma P., Wang J., Wargo J.A., Pe’er D., et al. Distinct Cellular Mechanisms Underlie Anti-CTLA-4 and Anti-PD-1 Checkpoint Blockade. Cell. 2017;170:1120–1133.e17. 10.1016/j.cell.2017.07.024. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
52. Ribas A., Shin D.S., Zaretsky J., Frederiksen J., Cornish A., Avramis E., Seja E., Kivork C., Siebert J., Kaplan-Lefko P., et al. PD-1 Blockade Expands Intratumoral Memory T Cells. Cancer Immunol. Res. 2016;4:194–203. 10.1158/2326-6066.CIR-15-0210. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
53. Zappasodi R., Budhu S., Hellmann M.D., Postow M.A., Senbabaoglu Y., Manne S., Gasmi B., Liu C., Zhong H., Li Y., et al. Non-conventional Inhibitory CD4+Foxp3−PD-1hi T Cells as a Biomarker of Immune Checkpoint Blockade Activity. Cancer Cell. 2018;33:1017–1032.e7. 10.1016/j.ccell.2018.05.009. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
54. Verma V., Shrimali R.K., Ahmad S., Dai W., Wang H., Lu S., Nandre R., Gaur P., Lopez J., Sade-Feldman M., et al. PD-1 blockade in subprimed CD8 cells induces dysfunctional PD-1+CD38hi cells and anti-PD-1 resistance. Nat. Immunol. 2019;20:1231–1243. 10.1038/s41590-019-0441-y. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
55. U.S. Food and Drug Administration List of Cleared or Approved Companion Diagnostic Devices (In Vitro and Imaging Tools) [(accessed on 18 August 2019)]; Available online: https://www.fda.gov/medical-devices/vitro-diagnostics/list-cleared-or-approved-companion-diagnostic-devices-vitro-and-imaging-tools/
56. Brahmer J.R., Drake C.G., Wollner I., Powderly J.D., Picus J., Sharfman W.H., Stankevich E., Pons A., Salay T.M., McMiller T.L., et al. Phase I study of single-agent anti-programmed death-1 (MDX-1106) in refractory solid tumors: Safety, clinical activity, pharmacodynamics, and immunologic correlates. J. Clin. Oncol. 2010;28:3167–3175. 10.1200/JCO.2009.26.7609. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
57. Topalian S.L., Hodi F.S., Brahmer J.R., Gettinger S.N., Smith D.C., McDermott D.F., Powderly J.D., Carvajal R.D., Sosman J.A., Atkins M.B., et al. Safety, activity, and immune correlates of anti-PD-1 antibody in cancer. N. Engl. J. Med. 2012;366:2443–2454. 10.1056/NEJMoa1200690. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
58. Taube J.M. Unleashing the immune system: PD-1 and PD-Ls in the pre-treatment tumor microenvironment and correlation with response to PD-1/PD-L1 blockade. Oncoimmunology. 2014;3:e963413. 10.4161/21624011.2014.963413. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
59. Schmid P., Adams S., Rugo H.S., Schneeweiss A., Barrios C.H., Iwata H., Diéras V., Hegg R., Im S.-A., Shaw Wright G., et al. IMpassion130 Trial Investigators Atezolizumab and Nab-Paclitaxel in Advanced Triple-Negative Breast Cancer. N. Engl. J. Med. 2018;379:2108–2121. 10.1056/NEJMoa1809615. [Abstract] [CrossRef] [Google Scholar]
60. U.S. Food and Drug Administration FDA Alerts Health Care Professionals and Oncology Clinical Investigators about an Efficacy Issue Identified in Clinical Trials for Some Patients Taking Keytruda (pembrolizumab) or Tecentriq (atezolizumab) as Monotherapy to Treat Urothelial Cancer with Low Expression of PD-L1. [(accessed on 18 August 2019)]; Available online: https://www.fda.gov/drugs/drug-safety-and-availability/fda-alerts-health-care-professionals-and-oncology-clinical-investigators-about-efficacy-issue.
61. European Medicines Agency EMA. [(accessed on 18 August 2019)]; Available online: https://www.ema.europa.eu/en/news/ema-restricts-use-keytruda-tecentriq-bladder-cancer.
62. Gourd E. EMA restricts use of anti-PD-1 drugs for bladder cancer. Lancet. Oncol. 2018;19:e341. 10.1016/S1470-2045(18)30433-9. [Abstract] [CrossRef] [Google Scholar]
63. Gettinger S.N., Horn L., Gandhi L., Spigel D.R., Antonia S.J., Rizvi N.A., Powderly J.D., Heist R.S., Carvajal R.D., Jackman D.M., et al. Overall Survival and Long-Term Safety of Nivolumab (Anti–Programmed Death 1 Antibody, BMS-936558, ONO-4538) in Patients With Previously Treated Advanced Non–Small-Cell Lung Cancer. J. Clin. Oncol. 2015;33:2004–2012. 10.1200/JCO.2014.58.3708. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
64. Weichert W., Schwamborn K., Boxberg M., Scheel A., Büttner R., Schildhaus H., Schirmacher P., Lasitschka F., Kirchner T., Reu S., et al. QUIP-Ringversuch zur PD-L1 Expressionsbestimmung in nicht kleinzelligen Lungenkarzinomen (NSCLC)-German. Der Pathol. 2017;6:563–564. [Google Scholar]
65. VENTANA PD-L1 (SP142) Assay Interpretation Manual, TNBC. [(accessed on 18 August 2019)]; Available online: https://diagnostics.roche.com/content/dam/diagnostics/us/en/resource-center/VENTANA-PD-L1-(SP142)-Assay-Interpretation-Guide.pdf.
66. Agilent PD-L1 IHC 22C3 pharmDx, Interpretation Manual, Urothelial Carcinoma. [(accessed on 18 August 2019)]; Available online: https://www.agilent.com/en-us/library/usermanuals?N=135&Ntt=22C3&redirect=0.
67. Rimm D.L., Han G., Taube J.M., Yi E.S., Bridge J.A., Flieder D.B., Homer R., West W.W., Wu H., Roden A.C., et al. A Prospective, Multi-institutional, Pathologist-Based Assessment of 4 Immunohistochemistry Assays for PD-L1 Expression in Non-Small Cell Lung Cancer. JAMA Oncol. 2017;3:1051–1058. 10.1001/jamaoncol.2017.0013. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
68. Schwamborn K., Ammann J.U., Knüchel R., Hartmann A., Baretton G., Lasitschka F., Schirmacher P., Braunschweig T., Tauber R., Erlmeier F., et al. Multicentric analytical comparability study of programmed death-ligand 1 expression on tumor-infiltrating immune cells and tumor cells in urothelial bladder cancer using four clinically developed immunohistochemistry assays. Virchows Arch. 2019:1–10. 10.1007/s00428-019-02610-z. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
69. Sommer U., Eckstein M., Ammann J., Braunschweig T., Macher-Goeppinger S., Schwamborn K., Hieke-Schulz S., Wullich B., Wirth M., Roth W., et al. Analytical and inter-observer comparability of 4 clinically developed programmed death-ligand 1 (PD-L1) immunohistochemistry assays in clear cell renal cell carcinoma (CCRCC); Proceedings of the AACR Annual Meeting; Atlanta, GA, USA. 29 March–3 April 2019. [Google Scholar]
70. Eckstein M., Erben P., Kriegmair M.C., Worst T.S., Weiß C.-A., Wirtz R.M., Wach S., Stoehr R., Sikic D., Geppert C.I., et al. Performance of the Food and Drug Administration/EMA-approved programmed cell death ligand-1 assays in urothelial carcinoma with emphasis on therapy stratification for first-line use of atezolizumab and pembrolizumab. Eur. J. Cancer. 2019;106:234–243. 10.1016/j.ejca.2018.11.007. [Abstract] [CrossRef] [Google Scholar]
71. Scheel A.H., Dietel M., Heukamp L.C., Jöhrens K., Kirchner T., Reu S., Rüschoff J., Schildhaus H.-U., Schirmacher P., Tiemann M., et al. Harmonized PD-L1 immunohistochemistry for pulmonary squamous-cell and adenocarcinomas. Mod. Pathol. 2016;29:1165–1172. 10.1038/modpathol.2016.117. [Abstract] [CrossRef] [Google Scholar]
72. Scheel A.H., Baenfer G., Baretton G., Dietel M., Diezko R., Henkel T., Heukamp L.C., Jasani B., Jöhrens K., Kirchner T., et al. Interlaboratory concordance of PD-L1 immunohistochemistry for non-small-cell lung cancer. Histopathology. 2018;72:449–459. 10.1111/his.13375. [Abstract] [CrossRef] [Google Scholar]
73. Rizvi N.A., Hellmann M.D., Snyder A., Kvistborg P., Makarov V., Havel J.J., Lee W., Yuan J., Wong P., Ho T.S., et al. Cancer immunology. Mutational landscape determines sensitivity to PD-1 blockade in non-small cell lung cancer. Science. 2015;348:124–128. 10.1126/science.aaa1348. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
74. Le D.T., Uram J.N., Wang H., Bartlett B.R., Kemberling H., Eyring A.D., Skora A.D., Luber B.S., Azad N.S., Laheru D., et al. PD-1 Blockade in Tumors with Mismatch-Repair Deficiency. N. Engl. J. Med. 2015;372:2509–2520. 10.1056/NEJMoa1500596. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
75. Le D.T., Durham J.N., Smith K.N., Wang H., Bartlett B.R., Aulakh L.K., Lu S., Kemberling H., Wilt C., Luber B.S., et al. Mismatch repair deficiency predicts response of solid tumors to PD-1 blockade. Science. 2017;357:409–413. 10.1126/science.aan6733. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
76. Eroglu Z., Zaretsky J.M., Hu-Lieskovan S., Kim D.W., Algazi A., Johnson D.B., Liniker E., Kong B., Munhoz R., Rapisuwon S., et al. High response rate to PD-1 blockade in desmoplastic melanomas. Nature. 2018;553:347–350. 10.1038/nature25187. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
77. Miao D., Margolis C.A., Gao W., Voss M.H., Li W., Martini D.J., Norton C., Bossé D., Wankowicz S.M., Cullen D., et al. Genomic correlates of response to immune checkpoint therapies in clear cell renal cell carcinoma. Science. 2018;359:801–806. 10.1126/science.aan5951. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
78. Skoulidis F., Goldberg M.E., Greenawalt D.M., Hellmann M.D., Awad M.M., Gainor J.F., Schrock A.B., Hartmaier R.J., Trabucco S.E., Gay L., et al. V STK11/LKB1 Mutations and PD-1 Inhibitor Resistance in KRAS-Mutant Lung Adenocarcinoma. Cancer Discov. 2018;8:822–835. 10.1158/2159-8290.CD-18-0099. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
79. McGranahan N., Furness A.J.S., Rosenthal R., Ramskov S., Lyngaa R., Saini S.K., Jamal-Hanjani M., Wilson G.A., Birkbak N.J., Hiley C.T., et al. Clonal neoantigens elicit T cell immunoreactivity and sensitivity to immune checkpoint blockade. Science. 2016;351:1463–1469. 10.1126/science.aaf1490. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
80. Łuksza M., Riaz N., Makarov V., Balachandran V.P., Hellmann M.D., Solovyov A., Rizvi N.A., Merghoub T., Levine A.J., Chan T.A., et al. A neoantigen fitness model predicts tumour response to checkpoint blockade immunotherapy. Nature. 2017;551:517–520. 10.1038/nature24473. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
81. Riaz N., Havel J.J., Makarov V., Desrichard A., Urba W.J., Sims J.S., Hodi F.S., Martín-Algarra S., Mandal R., Sharfman W.H., et al. Tumor and Microenvironment Evolution during Immunotherapy with Nivolumab. Cell. 2017;171:934–949.e16. 10.1016/j.cell.2017.09.028. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
82. Chowell D., Morris L.G.T., Grigg C.M., Weber J.K., Samstein R.M., Makarov V., Kuo F., Kendall S.M., Requena D., Riaz N., et al. Patient HLA class I genotype influences cancer response to checkpoint blockade immunotherapy. Science. 2018;359:582–587. 10.1126/science.aao4572. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
83. Zaretsky J.M., Garcia-Diaz A., Shin D.S., Escuin-Ordinas H., Hugo W., Hu-Lieskovan S., Torrejon D.Y., Abril-Rodriguez G., Sandoval S., Barthly L., et al. Mutations Associated with Acquired Resistance to PD-1 Blockade in Melanoma. N. Engl. J. Med. 2016;375:819–829. 10.1056/NEJMoa1604958. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
84. Sade-Feldman M., Jiao Y.J., Chen J.H., Rooney M.S., Barzily-Rokni M., Eliane J.-P., Bjorgaard S.L., Hammond M.R., Vitzthum H., Blackmon S.M., et al. Resistance to checkpoint blockade therapy through inactivation of antigen presentation. Nat. Commun. 2017;8:1136. 10.1038/s41467-017-01062-w. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
85. Gettinger S., Choi J., Hastings K., Truini A., Datar I., Sowell R., Wurtz A., Dong W., Cai G., Melnick M.A., et al. Impaired HLA Class I Antigen Processing and Presentation as a Mechanism of Acquired Resistance to Immune Checkpoint Inhibitors in Lung Cancer. Cancer Discov. 2017;7:1420–1435. 10.1158/2159-8290.CD-17-0593. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
86. Kamphorst A.O., Pillai R.N., Yang S., Nasti T.H., Akondy R.S., Wieland A., Sica G.L., Yu K., Koenig L., Patel N.T., et al. Proliferation of PD-1+ CD8 T cells in peripheral blood after PD-1-targeted therapy in lung cancer patients. Proc. Natl. Acad. Sci. USA. 2017;114:4993–4998. 10.1073/pnas.1705327114. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
87. Takeuchi Y., Tanemura A., Tada Y., Katayama I., Kumanogoh A., Nishikawa H. Clinical response to PD-1 blockade correlates with a sub-fraction of peripheral central memory CD4+ T cells in patients with malignant melanoma. Int. Immunol. 2018;30:13–22. 10.1093/intimm/dxx073. [Abstract] [CrossRef] [Google Scholar]
88. Huang A.C., Postow M.A., Orlowski R.J., Mick R., Bengsch B., Manne S., Xu W., Harmon S., Giles J.R., Wenz B., et al. T-cell invigoration to tumour burden ratio associated with anti-PD-1 response. Nature. 2017;545:60–65. 10.1038/nature22079. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
89. Graves M., CelliMarchett G., van Zyl B., Tang D., Vilain R.E., van der Westhuizen A., Bowden N.A. Monitoring Patient Response to Pembrolizumab With Peripheral Blood Exhaustion Marker Profiles. Front. Med. 2019;6:113. 10.3389/fmed.2019.00113. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
90. Krieg C., Nowicka M., Guglietta S., Schindler S., Hartmann F.J., Weber L.M., Dummer R., Robinson M.D., Levesque M.P., Becher B. High-dimensional single-cell analysis predicts response to anti-PD-1 immunotherapy. Nat. Med. 2018;24:144–153. 10.1038/nm.4466. [Abstract] [CrossRef] [Google Scholar]
91. Weide B., Martens A., Hassel J.C., Berking C., Postow M.A., Bisschop K., Simeone E., Mangana J., Schilling B., Di Giacomo A.M., et al. Baseline Biomarkers for Outcome of Melanoma Patients Treated with Pembrolizumab. Clin. Cancer Res. 2016;22:5487–5496. 10.1158/1078-0432.CCR-16-0127. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
92. Lu Z., Zou J., Hu Y., Li S., Zhou T., Gong J., Li J., Zhang X., Zhou J., Lu M., et al. Serological Markers Associated With Response to Immune Checkpoint Blockade in Metastatic Gastrointestinal Tract Cancer. JAMA Netw. Open. 2019;2:e197621. 10.1001/jamanetworkopen.2019.7621. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
93. Chow M.T., Ozga A.J., Servis R.L., Frederick D.T., Lo J.A., Fisher D.E., Freeman G.J., Boland G.M., Luster A.D. Intratumoral Activity of the CXCR3 Chemokine System Is Required for the Efficacy of Anti-PD-1 Therapy. Immunity. 2019;50:1498–1512.e5. 10.1016/j.immuni.2019.04.010. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
94. Chen G., Huang A.C., Zhang W., Zhang G., Wu M., Xu W., Yu Z., Yang J., Wang B., Sun H., et al. Exosomal PD-L1 contributes to immunosuppression and is associated with anti-PD-1 response. Nature. 2018;560:382–386. 10.1038/s41586-018-0392-8. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
95. Gandara D.R., Paul S.M., Kowanetz M., Schleifman E., Zou W., Li Y., Rittmeyer A., Fehrenbacher L., Otto G., Malboeuf C., et al. Blood-based tumor mutational burden as a predictor of clinical benefit in non-small-cell lung cancer patients treated with atezolizumab. Nat. Med. 2018;24:1441–1448. 10.1038/s41591-018-0134-3. [Abstract] [CrossRef] [Google Scholar]
96. Zitvogel L., Ma Y., Raoult D., Kroemer G., Gajewski T.F. The microbiome in cancer immunotherapy: Diagnostic tools and therapeutic strategies. Science. 2018;359:1366–1370. 10.1126/science.aar6918. [Abstract] [CrossRef] [Google Scholar]
97. Gopalakrishnan V., Spencer C.N., Nezi L., Reuben A., Andrews M.C., Karpinets T.V., Prieto P.A., Vicente D., Hoffman K., Wei S.C., et al. Gut microbiome modulates response to anti-PD-1 immunotherapy in melanoma patients. Science. 2018;359:97–103. 10.1126/science.aan4236. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
98. Routy B., Le Chatelier E., Derosa L., Duong C.P.M., Alou M.T., Daillère R., Fluckiger A., Messaoudene M., Rauber C., Roberti M.P., et al. Gut microbiome influences efficacy of PD-1-based immunotherapy against epithelial tumors. Science. 2018;359:91–97. 10.1126/science.aan3706. [Abstract] [CrossRef] [Google Scholar]
99. Matson V., Fessler J., Bao R., Chongsuwat T., Zha Y., Alegre M.-L., Luke J.J., Gajewski T.F. The commensal microbiome is associated with anti-PD-1 efficacy in metastatic melanoma patients. Science. 2018;359:104–108. 10.1126/science.aao3290. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
100. Elkrief A., El Raichani L., Richard C., Messaoudene M., Belkaid W., Malo J., Belanger K., Miller W., Jamal R., Letarte N., et al. Antibiotics are associated with decreased progression-free survival of advanced melanoma patients treated with immune checkpoint inhibitors. Oncoimmunology. 2019;8:e1568812. 10.1080/2162402X.2019.1568812. [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]

Articles from Journal of Clinical Medicine are provided here courtesy of Multidisciplinary Digital Publishing Institute (MDPI)

Citations & impact 


Impact metrics

Jump to Citations

Citations of article over time

Alternative metrics

Altmetric item for https://www.altmetric.com/details/67302334
Altmetric
Discover the attention surrounding your research
https://www.altmetric.com/details/67302334

Article citations


Go to all (29) article citations