Europe PMC

This website requires cookies, and the limited processing of your personal data in order to function. By using the site you are agreeing to this as outlined in our privacy notice and cookie policy.

Abstract 


Background

The systemic inflammation-based prognostic scores, modified Glasgow Prognostic Score (mGPS) and the neutrophil-lymphocyte ratio (NLR) are now recognised to be useful in predicting survival in a variety of solid organ malignancies, including colorectal cancer (CRC) before treatment. However, there would appear to have been no direct comparison of these longitudinal measurements of systemic inflammation. Therefore, the aim of the present study was to compare the prognostic value of longitudinal measures of systemic inflammation, the mGPS and NLR in patients undergoing potentially curative resection for CRC.

Methods

Three hundred and twenty-six patients underwent potentially curative resection for CRC between 2006 and 2010. Full biochemical and haematological data both pre- and post-operatively (3-6 months) were available for 206 patients.

Results

In 206 patients, there was no significant overall change in either the mGPS or the NLR, from pre- to post-operatively. On univariate survival analysis, T-stage (P<0.001), tumour, node, metastasis stage (P<0.005), pre-operative mGPS (P<0.05), pre-operative NLR (<0.05), post-operative mGPS (P<0.001) and post-operative NLR (P<0.005) were associated with cancer-specific survival. On multivariate survival analysis, comparing pre-operative mGPS and NLR, both pre-operative mGPS and NLR were independently associated with reduced cancer-specific survival (mGPS hazard ratio (HR) 1.97, CI 1.16-3.34, P<0.05, and NLR HR 3.07, CI 1.23-7.63, P<0.05). When the same multivariate comparison was carried out on post-operative data, only the post-operative mGPS was independently associated with cancer-specific survival (HR 4.81, CI 2.13-10.83, P<0.001).

Conclusion

The results of the present study support the longitudinal assessment of the systemic inflammatory response, in particular the mGPS, in patients undergoing potentially curative resection for CRC.

Free full text 


Logo of brjcancerBJC HomepageBJC Advance online publicationBJC Current IssueSubmitting an article to BJCWeb feeds
Br J Cancer. 2013 Jul 9; 109(1): 24–28.
Published online 2013 Jun 25. https://doi.org/10.1038/bjc.2013.330
PMCID: PMC3708558
PMID: 23799846

Comparison of the prognostic value of longitudinal measurements of systemic inflammation in patients undergoing curative resection of colorectal cancer

Abstract

Background:

The systemic inflammation-based prognostic scores, modified Glasgow Prognostic Score (mGPS) and the neutrophil-lymphocyte ratio (NLR) are now recognised to be useful in predicting survival in a variety of solid organ malignancies, including colorectal cancer (CRC) before treatment. However, there would appear to have been no direct comparison of these longitudinal measurements of systemic inflammation. Therefore, the aim of the present study was to compare the prognostic value of longitudinal measures of systemic inflammation, the mGPS and NLR in patients undergoing potentially curative resection for CRC.

Methods:

Three hundred and twenty-six patients underwent potentially curative resection for CRC between 2006 and 2010. Full biochemical and haematological data both pre- and post-operatively (3–6 months) were available for 206 patients.

Results:

In 206 patients, there was no significant overall change in either the mGPS or the NLR, from pre- to post-operatively. On univariate survival analysis, T-stage (P<0.001), tumour, node, metastasis stage (P<0.005), pre-operative mGPS (P<0.05), pre-operative NLR (<0.05), post-operative mGPS (P<0.001) and post-operative NLR (P<0.005) were associated with cancer-specific survival. On multivariate survival analysis, comparing pre-operative mGPS and NLR, both pre-operative mGPS and NLR were independently associated with reduced cancer-specific survival (mGPS hazard ratio (HR) 1.97, CI 1.16–3.34, P<0.05, and NLR HR 3.07, CI 1.23–7.63, P<0.05). When the same multivariate comparison was carried out on post-operative data, only the post-operative mGPS was independently associated with cancer-specific survival (HR 4.81, CI 2.13–10.83, P<0.001).

Conclusion:

The results of the present study support the longitudinal assessment of the systemic inflammatory response, in particular the mGPS, in patients undergoing potentially curative resection for CRC.

Keywords: Glasgow Prognostic Score, neutrophil-lymphocyte ratio, colorectal cancer

Colorectal cancer (CRC) is the third most common cancer in males and females in the United Kingdom with ~40 000 new cases recorded each year, and is the second most common cause of cancer death in both men and women in the United Kingdom with 16 000 deaths per year (Cancerstats, 2010). Despite improvements in treatment, outcomes remain poor with approximately half of those undergoing curative surgery subsequently dying from the disease (Oliphant et al, 2013).

Cancer-associated inflammation, both in the tumour microenvironment and in the systemic circulation, is now widely recognised to be a key determinant of disease progression and survival in CRC. In particular, many studies have shown that the host response in the form of systemic inflammation is a key factor in determining outcomes in CRC, and as such the measurement of various circulating markers of systemic inflammation are useful in predicting survival. Indeed, it has been shown that a simple objective scoring system, that is, the modified Glasgow Prognostic Score (mGPS), which measures systemic inflammation using C-reactive protein (CRP) and albumin, is effective at predicting overall and cancer-specific survival in a variety of solid organ malignancies including CRC (McMillan, 2012). Similarly, it has become clear that the systemic inflammatory response results in changes in circulating white blood cells, and that components of the full blood count, in particular the neutrophil-lymphocyte ratio (NLR), also are useful in predicting overall and cancer-specific survival in a variety of solid organ malignancies, including CRC (Guthrie et al, 2013).

Recently, these systemic inflammation-based prognostic scores, mGPS and NLR were compared in a large cross-sectional cohort of unselected patients with cancer (Proctor et al, 2011); however, to our knowledge, there has been no direct comparison of the longitudinal measurement of the mGPS and NLR.

The clinical utility of such systemic inflammation-based prognostic scores would be enhanced if they were shown to have prognostic value over time and after therapeutic intervention. This would provide the basis of interventions directed at systemic inflammation, maintaining low levels of systemic inflammation and active surveillance, following resection of the CRC.

Therefore, the aim of the present study was to compare the prognostic value of longitudinal measurements of systemic inflammation in patients undergoing curative resection of the CRC.

Materials and methods

Patients with histologically proven CRC who, on the basis of laparotomy findings and pre-operative abdominal computed tomography, were considered to have undergone potentially curative resection between 2006 and 2010 in a single surgical unit at Glasgow Royal Infirmary were included in the study. The patients were identified from a prospectively maintained database and included both elective and emergency resections. Exclusion criteria were: clinical evidence of active infection, presence of a chronic inflammatory condition, and death within 30 days of surgery. Tumours were staged using the conventional tumour, node, metastasis (TNM) staging system, 7th Edition, 2010 (AJCC, 2010).

Longitudinal measurements of a differential white cell count, neutrophil and lymphocyte counts, CRP and albumin were recorded before surgery and between 3 and 6 months (median 3.5 months) following surgery.

The mGPS was constructed using CRP and albumin using previously described thresholds (McMillan, 2012). A score of 2 was allocated to those patients with both elevated CRP (>10 mg l−1) and hypoalbuminaemia (<35 g−1), those with only an elevated CRP (>10 mg l−1) were allocated a score of 1, whereas those with normal CRP ([less-than-or-eq, slant]10 mg l−1) were allocated a score of 0.

The NLR ratio was constructed using previously documented thresholds (Guthrie et al, 2013). Briefly, NLR was determined by dividing the absolute neutrophil count by the absolute lymphocyte count; the NLR data was then dichotomised using the most commonly used threshold of [less-than-or-eq, slant]5 : 1 out of [gt-or-equal, slanted]5 : 1, and the NLR given a score of 0 ([less-than-or-eq, slant]5 : 1=low) and 1 ([gt-or-equal, slanted]5 : 1=high).

Date and cause of death was cross-checked with that data held by the National Cancer Registry and the Registrar General (Scotland), and 1 December 2011 served as the censor date. Cancer-specific and overall survival were calculated from the date of post-operative blood sample until the date of death.

The study was approved by the Research Ethics Committee, Glasgow Royal Infirmary.

Statistics

The prognostic value of the pre-operative measure of the systemic inflammatory response was assessed using survival calculated from the date of the pre-operative blood test until the date of death. While the prognostic value of the post-operative measure of the systemic inflammatory response was assessed using survival calculated from the date of the post-operative blood test until the date of death.

Univariate survival analysis was carried out using the Kaplan–Meier method with the log rank test and associations between categorical variables examined using the χ2-test for linear trend. The Wilcoxon Rank test was used to test the related samples pre-operative mGPS and post-operative mGPS, and pre-operative NLR and post-operative NLR. Cox proportional hazard regression was used to calculate hazard ratio (HR) and 95% confidence intervals (95% CI). A P-value of <0.05 was considered to be significant. Analysis was performed using SPSS software version 19 (SPSS Inc., Chicago, IL, USA).

Results

Three hundred and twenty-six patients undergoing potentially curative resection for CRC were identified from a prospectively maintained database and studied. Full biochemical and haematological data both pre- and post-operatively were available for 206 patients. The patient characteristics of those patients with longitudinal measurements were not significantly different to those without (data not shown).

The baseline characteristics of patients for whom full pre- and post-operative biochemical and haematological data were available are shown in Table 1. One hundred and twenty-nine (63%) patients underwent surgery for colonic tumours, whereas 77 (37%) had surgery for rectal tumours. The majority of patients were >65 years old (64%), were male (58%), had TNM stage I/II disease, and were carried out electively. Fifty-eight (28%) patients received adjuvant therapy following resection of the primary tumour.

Table 1

Baseline clinicopathological characteristics of patients undergoing potentially curative resection for colorectal cancer
 Number of patients (n=206)
Age
<65/65–74/>75
74 (36%)/79 (38%)/53 (26%)
Sex
Male/female
120 (58%)/86 (42%)
Presentation
Elective/emergency
187 (91%)/19 (9%)
Site
Colon/rectum
129 (63%) 77 (37%)
T-stage
Colon
Rectum
T18 (4%)6 (3%)
T212 (6%)9 (4%)
T363 (31%)49 (24%)
T4
46 (22%)
12 (6%)
TNM stage
I32 (16%)
II85 (41%)
III87 (42%)
IV
2 (1%)
Adjuvant chemotherapy
No/yes148 (72%)/58 (28%)
Measurement of systemic inflammatory response (TNM I–IV)Pre-operative (n=206)Post-operative (n=206)P-value*
mGPS
   
0132 (64%)140 (68%)0.926
133 (16%)18 (9%) 
2
41 (20%)
48 (23%)
 
NLR
   
0 (<5)161 (78%)170 (82%)0.216
1 (>5)45 (22%)36 (18%) 
Measurement of systemic inflammatory response (TNM I–II)Pre-operative (n=117)Post-operative (n=117)P-value*
mGPS
   
074 (63%)82 (70%)0.427
117 (15%)10 (9%) 
2
26 (22%)
25 (21%)
 
NLR
   
0 (<5)90 (77%)93 (79%)0.577
1 (>5)27 (23%)24 (21%) 

Abbreviations: mGPS=modified Glasgow Prognostic Score; NLR=neutrophil-lymphocyte ratio; TNM=tumour, node, metastasis.

*Wilcoxon Rank test.

Twenty five patients received neoadjuvant therapy. Although pre- (P<0.005) and post-operative (P<0.001) NLR were associated with administration of neoadjuvant therapy, there was no association between pre- or post-operative mGPS.

The majority of patients (91%) included in the present study were elective resections.

Emergency presentation was significantly associated with a higher pre-operative mGPS (P<0.001), whereas pre-operative NLR was not (P=0.116). However, in the present, relatively small study, mode of presentation itself was not significantly associated with cancer-specific survival and was not significantly associated with either post-operative mGPS or NLR.

With regard to more traditional predictors of poor outcome, neither pre- or post-operative mGPS, or pre- or post-operative NLR were associated with TNM stage, whereas only pre-operative NLR (P<0.05) and post-operative mGPS (P<0.05) were associated with margin status.

In the 206 patients with longitudinal measurements, 74 (36%) patients had an elevated mGPS, pre-operatively. Following resection, 66 (32%) had an elevated mGPS. With regard to the NLR, 46 (22%) had an elevated NLR pre-operatively, whereas 36 (18%) had an elevated NLR post-operatively.

Analysis of the relationship between the pre- and post-operative samples using the Wilcoxon Rank test, showed no significant difference between both the pre- and post-operative mGPS, and the pre- and post-operative NLR (Table 1, both P>0.10).

Of the 132 patients with an mGPS of 0 pre-operatively, 98 (74%) had an mGPS of 0 on follow-up, 9 (7%) had an mGPS of 1 on follow-up, and 25 (19%) had an mGPS of 2 on follow-up. Of the 33 patients with an mGPS of 1 pre-operatively, 20 (61%) had an mGPS of 0 on follow-up, 3 (9%) patients had an mGPS of 1 on follow-up, and 10 (30%) had an mGPS of 2 on follow-up. Of the 41 patients with an mGPS of 2 pre-operatively, 22 (54%) had an mGPS of 0 on follow-up, 6 (15%) had an mGPS of 1 on follow-up, and 13 (32%) had an mGPS of 2 on follow-up. Of the 161 patients with an NLR of 0 pre-operatively, 139 (86%) had an NLR of 0 on follow-up, whereas 22 (14%) patients had an NLR of 1 on follow-up. Of the 45 patients with an NLR of 1 pre-operatively, 31 (69%) patients had an NLR of 0 on follow-up, whereas 14 (31%) had an NLR of 1 on follow-up. Similarly, there was no significant difference between both the pre- and post-operative mGPS and the pre- and post-operative NLR in patients with node-negative disease (both P>0.10).

The relationship between clinicopathological characteristics and survival in patients undergoing potentially curative resection for CRC are shown in Table 2. In the present study, the minimum follow-up period was 12 months and the median follow-up period of those who remained alive was 36 months (range 12–71) months. On follow-up, 41 patients died, of which 29 patients died of CRC and 12 from other causes. No patients were lost to follow-up.

Table 2

The relationship between clinicopathological characteristics and survival in patients undergoing potentially curative resection for colorectal cancer
 
All patients (n=206)
Node negative (n=117)
 Cancer-specific survivalCancer-specific survival
 
Univariate analysis
Univariate analysis
 HR95% CIP-valueHR95% CIP-value
Age (<65/65–74/>75)
0.79
0.49–1.27
0.330
0.10
0.24–1.14
0.101
Gender (male/female)
1.24
0.58–2.63
0.570
4.23
0.92–19.41
0.064
Site (colon/rectum)
1.03
0.49–2.19
0.930
1.55
0.49–4.80
0.450
T-stage (T1/T2/T3/T4)
2.75
0.49–5.07
0.001
1.69
0.77–3.70
0.190
TNM stage I/II/III/IV
2.31
1.28–4.17
0.005
4.13
0.53–32.08
0.180
Pre-operative mGPS (0/1/2)
1.94
1.17–3.21
0.010
2.57
1.10–5.96
0.028
Pre-operative NLR (<5/>5)
3.28
1.36–7.93
0.008
2.08
0.62–2.09
0.233
Post-operative mGPS (0/1/2)
3.31
2.15–5.09
<0.001
4.81
2.13–10.83
<0.001
Post-operative NLR (<5/>5)3.071.42–6.620.0043.100.98–9.840.054

Abbreviations: CI=confidence intervals; HR=hazard ratio.

On univariate survival analysis in 206 patients, T-stage (P<0.001), TNM stage (P=0.005), pre-operative mGPS (P<0.05, Figure 1a) and NLR (P<0.05, Figure 1b) were significantly associated with cancer-specific survival.

An external file that holds a picture, illustration, etc.
Object name is bjc2013330f1.jpg

The relationship between pre-operative assessment of systemic inflammation as evidence by mGPS (A) and NLR (B) and cancer-specific survival in patients undergoing potentially curative resection of CRC.

Similarly, on univariate survival analysis post-operative mGPS (P<0.001, Figure 2a) and NLR (P<0.005, Figure 2b) were both significantly associated with cancer-specific survival.

An external file that holds a picture, illustration, etc.
Object name is bjc2013330f2.jpg

The relationship between post-operative assessment of systemic inflammation as evidence by mGPS (A) and NLR (B) and cancer-specific survival in patients undergoing potentially curative resection of CRC.

On multivariate survival analysis, comparing pre-operative mGPS with NLR, both pre-operative mGPS (HR 1.97, confidence intervals (CI) 1.16–3.34, P<0.05) and NLR (HR 3.07, CI 1.23–7.63, P<0.05) were independently associated with reduced cancer-specific survival (mGPS and NLR). When the same multivariate comparison was carried out on post-operative measurements, only the post-operative mGPS was independently associated with the cancer-specific survival (HR 4.81, CI 2.13–10.83, P<0.001).

On univariate survival analysis in 117 node-negative patients, only pre-operative mGPS (P<0.05) was associated with cancer-specific survival. On univariate analysis using the date of post-operative sample to the date of death, only post-operative mGPS (P<0.001) was significantly associated with cancer-specific survival.

Discussion

In the present study, we report, for the first time, a longitudinal comparison of systemic inflammation-based prognostic scores in patients with CRC. The results are consistent with previous studies that have reported the prognostic value of the pre-operative assessment of the mGPS and the NLR. Further, the post-operative assessments (3–6 months) also had prognostic value in patients with CRC. Therefore, it is clear that the persistent elevation of the systemic inflammatory response, before and following resection of CRC, is associated with poor survival. Taken together, there is clearly a role for the routine monitoring of the systemic inflammatory response in patients undergoing potentially curative resection of CRC.

In the present study, it was of interest that the systemic inflammatory response, whether measured using the mGPS or NLR, was not subject to significant overall change from the pre- to post-operative period. The majority of patients, before surgery, had no evidence of a systemic inflammatory response. In these patients, the majority remained systemically noninflamed following surgery. Of the patients who had evidence of a systemic inflammatory response before surgery, a small proportion became systemically noninflamed following resection of the primary tumour. The consequence of these changes may be that the post-operative measurement of the systemic inflammatory response better predicts outcome (McMillan et al, 2003; Jamieson et al, 2005). Indeed, these results are consistent with previous studies that reported the prognostic value of CRP alone, both pre- and post-operatively (McMillan et al, 2003; Jamieson et al, 2005). When the post-operative mGPS and NLR were compared, it was clear that the mGPS had superior prognostic value. Further studies are warranted.

Recently, it has been reported that the NLR was associated with a higher mortality in patients with coronary artery disease (Park et al, 2013). Given that this is a major cause of non-cancer death, it is probable that some of the patients in the present study died of coronary artery disease. However, the small numbers of non-cancer deaths in the present study precluded meaningful statistical analysis.

In the present study, we assessed the prognostic value of longitudinal measurements of systemic inflammation in patients undergoing curative resection of the CRC. In our centre, CEA is not routinely analysed because of the well-established findings that pre-operative CEA poorly predicts outcome in patients undergoing curative resection of CRC (Lewi et al, 1984).

Although there is good evidence that presence of the systemic inflammatory response, evidenced by mGPS or NLR, is associated with poorer outcomes in patients with cancer (McMillan, 2012), (Guthrie et al, 2013) the mechanism underlying persistent activation of the systemic inflammatory response in patients who have undergone resection of the primary CRC remains unclear. It may be secondary to chronic dysregulation of immune and inflammatory responses owing to activation by micrometastatic disease or non-malignant disease invoking tissue injury/necrosis. Plausible mediators of these immune and inflammatory responses are the pro-inflammatory cytokines that have been reported to be present at elevated concentrations in the circulation of patients with CRC (Kantola et al, 2012; Guthrie and McMillan, 2013). In particular, the pleiotropic pro-inflammatory cytokine interleukin-6 (IL-6), upregulated by tissue injury/necrosis and inflammatory cells such as macrophages, has the ability to activate and maintain the systemic inflammatory response through trans-signalling pathways involving the soluble IL-6 receptor (Guthrie et al, 2012).

The reasons for those patients with persistently activated systemic inflammatory responses having worse prognosis is becoming increasingly clear. In addition to the recognised detrimental effect on nutritional and functional status (McMillan, 2012), there is increasing evidence that an elevated systemic inflammatory response is associated with dysregulated, in particular upregulation of innate immune responses and downregulation of adaptive immune responses promoting tumour dissemination and progression (Roxburgh and McMillan, 2010; Guthrie et al, 2012; McMillan, 2012).

In summary, the results of the present study support the longitudinal assessment of the systemic inflammatory response, in particular using the mGPS, in patients undergoing potentially curative resection for CRC.

Footnotes

This work is published under the standard license to publish agreement. After 12 months the work will become freely available and the license terms will switch to a Creative Commons Attribution-NonCommercial-Share Alike 3.0 Unported License.

References

  • AJCC 2010Colon and Rectum Cancer Staging AJCC Cancer Staging Manual7th EdnSpringer, New York.
  • Cancerstats 2010Cancer Research UKAvailable at http://www.cancerresearchuk.org/cancer-info/cancerstats/types/bowel/?script=true .
  • Guthrie G, McMillan DC.2013. Reply:. Comment on ‘stage-dependent alterations of the serum cytokine pattern in colorectal carcinoma' Br J Cancer 1081915–1916. [Europe PMC free article] [Abstract] [Google Scholar]
  • Guthrie GJ, Roxburgh CS, Horgan PG, McMillan DC. Does interleukin-6 link explain the link between tumour necrosis, local and systemic inflammatory responses and outcome in patients with colorectal cancer. Cancer Treat Rev. 2012;39:89–96. [Abstract] [Google Scholar]
  • Guthrie GJK, Charles KA, Roxburgh CS, Horgan PG, McMillan DC, Clarke SJ. The systemic inflammation-based neutrophil-lymphocyte ration: experience in patients with cancer. Crit Rev Oncol Hematol. 2013;S1040-8428:00070-X. [Abstract] [Google Scholar]
  • Jamieson NB, Glen P, McMillan DC, Mckay CJ, Foulis AK, Carter R, Imrie CW. Systemic inflammatory response predicts outcome in patients undergoing resection for ductal adenocarcinoma head of pancreas. Br J Cancer. 2005;92:21–23. [Europe PMC free article] [Abstract] [Google Scholar]
  • Kantola T, Klintrup K, Vayrynen JP, Vornanen J, Bloigu R, Karhu T, Herzig KH, Napankangas J, Makela J, Karttunen TJ, Tuomisto A, Makinen MJ. Stage-dependent alterations of the serum cytokine pattern in colorectal carcinoma. Br J Cancer. 2012;107:1729–1736. [Europe PMC free article] [Abstract] [Google Scholar]
  • Lewi H, Blumgart LH, Carter DC, Gillis CR, Hole D, Ratcliffe JG, Wood CB, Mcardle CS. Pre-operative carcino-embryonic antigen and survival in patients with colorectal cancer. Br J Surg. 1984;71:206–208. [Abstract] [Google Scholar]
  • McMillan DC. The systemic inflammation-based Glasgow Prognostic Score: a decade of experience in patients with cancer. Cancer Treat Rev. 2012;39:534–540. [Abstract] [Google Scholar]
  • McMillan DC, Canna K, Mcardle CS. Systemic inflammatory response predicts survival following curative resection of colorectal cancer. Br J Surg. 2003;90:215–219. [Abstract] [Google Scholar]
  • Oliphant R, Nicholson G, Horgan P, Molloy R, McMillan D, Morrison D. Deprivation and colorectal cancer surgery: longer-term survival inequalities are due to differential postoperative mortality between socioeconomic groups. Ann Surg Oncol. 2013;20:2132–2139. [Abstract] [Google Scholar]
  • Park JJ, Jang H-J, Oh I-Y, Yoon C-H, Suh J-W, Cho Y-S, Youn T-J, Cho G-Y, Chae I-H, Choi D-J. Prognostic value of neutrophil to lymphocyte ratio in patients presenting with st-elevation myocardial infarction undergoing primary percutaneous coronary intervention. Am J Cardiol. 2013;111:636–642. [Abstract] [Google Scholar]
  • Proctor MJ, Morrison DS, Talwar D, Balmer SM, Fletcher CD, O'reilly DS, Foulis AK, Horgan PG, McMillan DC. A comparison of inflammation-based prognostic scores in patients with cancer. A Glasgow Inflammation Outcome Study. Eur J Cancer. 2011;47:2633–2641. [Abstract] [Google Scholar]
  • Roxburgh C. S., McMillan D. C. Role of systemic inflammatory response in predicting survival in patients with primary operable cancer. Future Oncol. 2010;6:149–163. [Abstract] [Google Scholar]

Articles from British Journal of Cancer are provided here courtesy of Cancer Research UK

Citations & impact 


Impact metrics

Jump to Citations

Citations of article over time

Alternative metrics

Altmetric item for https://www.altmetric.com/details/1588646
Altmetric
Discover the attention surrounding your research
https://www.altmetric.com/details/1588646

Smart citations by scite.ai
Smart citations by scite.ai include citation statements extracted from the full text of the citing article. The number of the statements may be higher than the number of citations provided by EuropePMC if one paper cites another multiple times or lower if scite has not yet processed some of the citing articles.
Explore citation contexts and check if this article has been supported or disputed.
https://scite.ai/reports/10.1038/bjc.2013.330

Supporting
Mentioning
Contrasting
4
86
2

Article citations


Go to all (82) article citations

Data 


Data behind the article

This data has been text mined from the article, or deposited into data resources.