Skip to main content
  • Research article
  • Open access
  • Published:

Urgent referral for suspected CNS cancer: which clinical features are associated with a positive predictive value of 3 % or more?

Abstract

Background

Urgent referral for suspected central nervous system (CNS) cancer is recommended, but little analysis of the referral criteria diagnostic performance has been conducted. New 2015 NICE guidance recommends direct brain imaging for patients with symptoms with positive predictive values (PPV) of 3 %, but further guidance is needed.

Methods

A 12-month retrospective evaluation of 393 patients referred under previous 2005 NICE 2-week rule criteria was conducted. Analysis was based on the three groups of symptoms forming the referral criteria, (1) CNS symptoms, (2) recent onset headaches, (3) rapidly progressive subacute focal deficit/cognitive/behavioural/personality change. Comparison was made with neuroimaging findings.

Results

Twelve (3.1 %) of 383 patients who attended clinic had CNS cancer suggesting the combination of clinical judgement and application of 2005 criteria matched the 2015 guideline’s PPV threshold. PPVs for the three groups of symptoms were (1) 4.1 % (95 % CIs 2.0 to 7.4 %), (2) 1.2 % (0.1 to 4.3 %) and (3) 3.7 % (0.1 to 19.0 %). Sensitivities were (1) 83.3 % (95 % CIs 51.6 to 97.9 %), (2) 16.7 % (2.1 to 48.4 %), and (3) 8.3 % (0.2 to 38.5 %); specificities were (1) 37.2 % (32.3 to 42.3 %), (2) 55.5 % (50.3 to 60.7 %) and (3) 93.0 % (89.9 to 95.4 %). Of 288 patients who underwent neuroimaging, 59 (20.5 %) had incidental findings, most commonly cerebrovascular disease.

Conclusions

The 2015 guidance is less prescriptive than previous criteria making clinical judgement more important. CNS symptoms had greatest sensitivity, while PPVs for CNS symptoms and rapidly progressive subacute deficit/cognitive/behavioural/personality change were closest to 3 %. Recent onset headaches had the lowest sensitivity and PPV.

Peer Review reports

Background

The 1990s saw rising waiting times in the United Kingdom (UK) for patients undergoing investigation of suspected cancer, including suspected central nervous system (CNS) cancer. This prompted the Department of Health to introduce guidelines in 2000 for referral, with structured pathways and a waiting time target of 2 weeks [1, 2]. The referral guidelines for suspected cancer were revised in 2005 [3] and completely overhauled in 2015 [4] because of concerns that cancer survival in the UK is lower than in other developed countries. The latest guidelines for adults with suspected CNS cancer (Table 1), which advocate direct referral for brain imaging to be performed within 2 weeks, represent a substantial shift from the 2005 guidelines (Table 2) which comprised clinical criteria based on groups of symptoms for urgent outpatient referral (typically to neurology) to be seen within 2 weeks, or for referral to be considered.

Table 1 (From 2015 guidelines [4])
Table 2 (From 2005 guidelines [3])

Currently, the extent of implementation of the 2015 guidelines for suspected CNS cancer is somewhat variable, with gradual transition being expected from the 2005 to the 2015 guidelines while the implications for clinical practice, including referral pathways and impact on imaging and reporting capacity etc., are understood.

The 2015 guidelines advise that adults with clinical features that are associated with a positive predictive value (PPV) of 3 % or more for CNS cancer should be referred urgently for investigation [4]. The new guidelines are much less prescriptive in their wording, particularly, in respect of which clinical features might be the most relevant. Relatively little is known about the diagnostic performance of the 2005 referral criteria, or diagnosis rate of CNS cancer among patients referred using those criteria [5]. The likely effects of the 2015 guidelines upon referral behaviour and the implications for direct access imaging requests is, to all intents and purposes, unknown. An improved understanding of the diagnostic performance of the 2005 criteria and which clinical features are relevant in determining whether there is a 3 % or greater likelihood of CNS cancer will surely be helpful. In addition, relatively little is known about the implications for patients and clinical pathways upon the identification of incidental findings when imaging is being requested directly from primary care [6].

We have undertaken a retrospective study of patients referred under the ‘2 week rule’ for suspected CNS cancer according to the 2005 guidelines over a 12 month period. We have analysed (1) the diagnostic performance of the 2005 criteria, with a clinical and radiological diagnosis of CNS cancer as the primary outcome, (2) the symptom frequencies amongst all referred patients and those with CNS cancer, and (3) incidental findings.

Methods

Data extraction and validation

Routine clinical data were extracted from referral letters, clinic letters and imaging reports for all patients referred under the ‘2 week rule’ for suspected CNS cancer to the regional neurology service based at the Royal Preston Hospital (serving a population of approximately 1.6 million) between 1st June 2012 and 31st May 2013. Data were extracted by one junior doctor (HM, who was an undergraduate at the time of data collection), and were independently validated by a second junior doctor (JB) working in neurology. One year after data collection, all patients’ records were reviewed to determine whether any other visits/imaging had occurred.

Classification of 2005 referral criteria and analysis

Referral criteria (2005 criteria) were grouped as follows: group 1 – symptoms related to the CNS (all new-onset or recent-onset seizures were included in this group), group 2 – headaches of recent onset accompanied by features suggestive of raised intracranial pressure (ICP), and group 3 – rapidly progressive subacute focal deficit/cognitive/behavioural or personality change. Presenting symptoms were classified into one of these three groups. The primary outcome was the presence/absence of CNS cancer on the basis of clinical assessment and, where applicable, neuroimaging findings (CT brain/MRI brain). Sensitivity, specificity, positive and negative predictive values were calculated for each symptom group.

Statistical methods

Statistical analysis was performed using Stata (StataCorp. 2013. Stata Statistical Software: Release 13. College Station, TX: StataCorp LP) and StatsDirect (StatsDirect Ltd. StatsDirect statistical software. http://www.statsdirect.com. England: StatsDirect Ltd. 2013).

Presenting symptoms were reported for all referrals and by CNS cancer diagnosis using frequencies and percentages. Comparisons of presenting symptoms by CNS cancer diagnosis were performed using the Fisher’s exact test. To avoid multiple testing, comparisons were made only for the overall presenting symptom groups: symptoms related to CNS cancer, headaches of recent onset accompanied by features suggestive of raised intracranial pressure and consider urgent referral. The significance threshold was set at p ≤ 0.05. Measures of diagnostic performance, sensitivity, specificity, positive predictive value and negative predictive value were reported for each of the symptom groups based on participants who were referred and attended clinic. Diagnosis of CNS cancer was based on clinical decision and radiological findings. Please see Additional file 1: Appendix for raw data calculations.

Results

Between 1st June 2012 and 31st May 2013, 393 adult patients were referred under the ‘2 week rule’ for suspected CNS cancer. Ten patients did not attend their appointment or were seen at another hospital. Three hundred and eighty-three patients attended clinic, of whom 95 did not undergo neuroimaging (and did not undergo imaging by July 2014) on account of the neurologist considering there to be no clinical suspicion of CNS cancer and no other indication for scanning. Two hundred and eighty eight patients underwent neuroimaging (Fig. 1).

Fig. 1
figure 1

Flow chart of patients recruited in the study

CNS cancer diagnoses

Twelve patients were found to have CNS cancer. This constitutes 3.1 % of the total number of referred patients who attended their appointment and 4.2 % of patients who underwent imaging. Histopathological diagnoses were grade IV glioblastoma in 4 cases, lung cancer metastases in 2 cases, and anaplastic oligoastrocytoma in 1 case. No biopsies were available in the remaining 5 cases. Radiological and clinical diagnoses of these 5 cases were: cystic glioma, metastases from unknown source in parasagittal region, lung metastases in posterior corpus callosum, non-small cell carcinoma metastases in right parietal tissue and C2 vertebral body metastases without frank spinal cord compression.

Diagnostic performance of 2005 referral criteria

The frequency of presenting symptoms and symptom groups are shown in Table 3. Two hundred and forty-three patients were referred with group 1 symptoms, 167 with group 2 symptoms, and 27 with group 3 symptoms. For group 1 (symptoms related to the CNS), the sensitivity was 83.3 % (95 % CI 51.6 to 97.9 %), specificity 37.2 % (95 % CI 32.3 to 42.3 %), PPV 4.1 % (95 % CI 2.0 to 7.4 %) and negative predictive value (NPV) 98.6 % (95 % CI 94.9 to 99.8 %). For group 2 (headaches of recent onset accompanied by features suggestive of raised intracranial pressure), the sensitivity was 16.7 % (95 % CI 2.1 to 48.4 %), specificity 55.5 % (95 % CI 50.3 to 60.7 %), PPV 1.2 % (95 % CI 0.1 to 4.3 %) and NPV 95.4 % (95 % CI 91.7 to 97.8 %). For group 3 (rapidly progressive subacute focal deficit/cognitive/behavioural or personality change), the sensitivity was 8.3 % (95 % CI 0.2 to 38.5 %), specificity 93.0 % (95 % CI 89.9 to 95.4 %), PPV 3.7 % (95 % CI 0.1 to 19.0 %) and NPV 96.9 % (95 % CI 94.5 to 98.4 %).

Table 3 The prevalence of symptoms in referrals under the 2-week rule for suspected CNS cancer

Incidental findings

Of 288 patients who underwent neuroimaging, 59 (20.5 %) were found to have incidental findings (Table 4). Cerebrovascular disease (11.1 %), degenerative spine disease (3.5 %) and sinus disease (3.1 %) were the most frequent incidental findings.

Table 4 Summary of incidental findings on neuroimaging

Discussion

This study, to our knowledge, is the first to consider the implications of the recently revised NICE guidelines for suspected CNS cancer, and specifically which clinical features are associated with a PPV of 3 % or more by analysing the diagnostic performance of previous referral criteria [5].

Anecdotally, there can appear to be excessive ‘2 week rule’ referrals for suspected CNS cancer to neurology clinics. With the 2015 guidelines advocating direct referral for imaging, fewer patients with suspected CNS cancer might be expected to attend neurology clinics, although the identification of incidental findings will inevitably also have implications for clinical care. In the present study, ‘2 week rule’ referrals constituted approximately 3 % of the total number of new outpatient referrals to the regional neurology service (ca. 12,000). The overall CNS cancer diagnosis rate among the ‘2 week rule’ referral population was 3.1 % (i.e. 12 CNS cancer diagnoses among 383 patients who were referred by this route and who attended clinic). This finding would appear to suggest that intriguingly, through clinical judgement and the application of the 2005 referral criteria, there was a pattern of referral behaviour for suspected CNS cancer matching the PPV threshold of 3 % at which patients should be urgently referred, according to the 2015 guidelines [4].

Now that the referral criteria are much less prescriptive, referrers will, more than ever, have to employ clinical judgement when considering referral. But which clinical features would suggest a PPV of 3 % or more? Headache often tends to prompt concerns in the patient and the referrer about the possibility of CNS cancer but performs very poorly as a predictor [7]. Probably undue emphasis is placed on headache per se, and the findings in the present study support the usual view that as a single symptom it does tend to be a poor discriminator with respect to the presence/absence of CNS cancer. Nonetheless, headache accounts for 4.4 % of primary care consultations and up to 30 % of outpatient neurology referrals in the UK [8, 9]. However, the current analysis highlights focal deficits (subacute or progressive), new-onset seizures, or cognitive/behavioural/personality changes, as being more strongly predictive of CNS cancer in the appropriate clinical context. New-onset seizures in particular, whether focal or secondary generalised, can be an important early manifestation of a brain tumour. In a previous study of clinical features and the risk of primary brain tumours, in which new-onset epilepsy had an overall risk of 1.2 %, rising to 2.3 % if the patient was >60 years of age, in marked contrast to the risk with headache, which was associated with a risk of less than 1 in 1000 [10].

It should be noted that diagnostic performance of all three symptom groups in this study was poor by comparison with usual expectations for a good diagnostic test which would have both a high sensitivity and specificity (both around 90.0 %) [11]. Headaches of recent onset accompanied by features suggestive of raised ICP were actually less frequent among patients found to have CNS cancer than among the total referral population. Potentially this suggests difficulties in clinical recognition of features of raised ICP. Uncertainty among referrers over headache diagnosis has certainly been reported previously [12].

Bypassing a neurology clinical opinion en route to brain imaging may raise some issues in patient management, particularly with respect to relative lack of a detailed neurological assessment which, at least anecdotally, can be helpful for contextualising incidental findings. Impact of the NICE guidance with respect to imaging and reporting capacity is uncertain. An international report published by the Organisation for Economic Cooperation and Development (OECD) found that the UK had fewer magnetic resonance imaging (MRI) scanners than almost any other Western country including developing countries such as Turkey and Slovakia [13]. Out of 32 countries in the OECD the UK stands 26th. For computerised tomography (CT) scanning, the UK is 30th of 32 [13].

Brain scans are preferably reported by a neuroradiologist, which creates issues of hospital’s reporting capacity.

Implementation of the 2015 NICE criteria also needs to take into account the frequent identification of incidental findings. A systematic review and meta-analysis reported incidental findings of 2.7 % from 19,559 participants [14]. The study suggested that at the very least clinicians should counsel patients about the chance of incidental findings prior to requesting a scan and that a mechanism for their management would need to be implemented [14]. There is considerable uncertainty surrounding the management of some incidental findings on brain imaging, including balancing risk/benefit of intervention for intracranial aneurysms [15, 16], unruptured arteriovenous malformations [17], low grade glioma [18] and arachnoid cysts [14]. There is little evidence to guide the management of incidental radiological cerebrovascular disease. This lack of certainty can create significant patient anxiety, lead to additional referrals/investigations, sometimes with significant implications for the patient [1921]. It seems wise for pre-imaging counselling to make reference not only to the possibility of incidental findings but also uncertainty in their management.

By necessity, given the study design, the calculation of PPVs and NPVs is based on the referral population. This does limit the extent to which these values are directly applicable to the total population (i.e. including an unknown number of unreferred patients with relevant symptoms). Clearly, the balance of positive and negative imaging findings among unreferred patients is also unknown.

Conclusions

The new 2015 guidance is less prescriptive than previous CNS cancer referral criteria making clinical judgement even more important. Symptoms related to the CNS had the greatest sensitivity, while PPVs for symptoms related to the CNS and rapidly progressive subacute deficit/cognitive/behavioural/personality change were closest to the NICE referral figure of 3 %. Headaches of recent onset had the lowest sensitivity and PPV; diagnostic performance with respect to sensitivity and specificity was poor for all three symptom groups. The frequent occurrence of incidental findings also needs to be taken into account when requesting imaging and planning services.

Abbreviations

CNS:

Central nervous system

CT:

Computerised tomography

ICP:

Intracranial pressure

MRI:

Magnetic resonance imaging

NPV:

Negative predictive value

NHS:

National health service

OECD:

Organisation for Economic Cooperation and Development

PPV:

Positive predictive value

UK:

United Kingdom

References

  1. Department of Health. The NHS Cancer Plan A plan for investment, a plan for reform. (cited 24th April 2016). https://www.thh.nhs.uk/documents/_Departments/Cancer/NHSCancerPlan.pdf, 2000; Available from: HMSO.

  2. NHS Executive. Referral guidelines for suspected cancer. DOH 2000. (cited 24th April 2015). http://webarchive.nationalarchives.gov.uk/20130107105354/http://www.dh.gov.uk/prod_consum_dh/groups/dh_digitalassets/@dh/@en/documents/digitalasset/dh_4012253.pdf.

  3. NICE. Referral guidlines for suspected cancer. NICE, 2005: p. 21. (cited 24th April 2016). http://www.rcpch.ac.uk/sites/default/files/asset_library/Research/Clinical%20Effectiveness/Endorsed%20guidelines/Cancer,%20Referral%20for%20Suspected%20(NICE)/Referral%20for%20suspected%20cancer.quick%20reference%20guide.pdf.

  4. NICE. Suspected cancer: recognition and referral. NCC-C, 2015 p. 244–253. (Cited 24th April 2016). https://www.nice.org.uk/guidance/ng12.

  5. Hamdan A, Mitchell P. The two-week wait guideline for suspected CNS tumours: a decade analysis. Br J Neurosurg. 2013;27(5):642–5.

    Article  CAS  PubMed  Google Scholar 

  6. Salman RA-S, Whiteley WN, Warlow C. Screening using whole-body magnetic resonance imaging scanning: who wants an incidentaloma? J Med Screen. 2007;14(1):2–4.

    Article  Google Scholar 

  7. Scottish Intercollegiate Guidelines Network. Diagnosis and management of headache in adults. Edinburgh: NHS Quality Improvement Scotland; 2008. (cited 24th April 2016), http://www.sign.ac.uk/pdf/sign107.pdf.

    Google Scholar 

  8. Latinovic R, Gulliford M, Ridsdale L. Headache and migraine in primary care: consultation, prescription, and referral rates in a large population. J Neurol Neurosurg Psychiatry. 2006;77(3):385–7.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  9. Larner A. Guidelines for primary headache disorders in primary care: an ‘intervention’ study. Headache Care. 2006;3(1):1–2.

    Article  Google Scholar 

  10. Hamilton W, Kernick D. Clinical features of primary brain tumours: a case-control study using electronic primary care records. Br J Gen Pract. 2007;57(542):695–9.

    PubMed  PubMed Central  Google Scholar 

  11. Bekkelund S, Salvesen R. Is uncertain diagnosis a more frequent reason for referring migraine patients to neurologist than other headache syndromes? Eur J Neurol. 2006;13(12):1370–3.

    Article  CAS  PubMed  Google Scholar 

  12. Cooperation OFE, Staff D, Health at a Glance 2013: OECD Indicators. 2013: OECD. (cited 24th April 2016) https://www.oecd.org/els/health-systems/Health-at-a-Glance-2013.pdf.

  13. Martin D. Deadly shortage of cancer scanners that shames UK: Britain has fewer MRI machines than almost any other Western country. 2014. (cited 24th April 2016). http://www.dailymail.co.uk/news/article-2672902/Deadly-shortage-cancer-scanners-shames-UK-Britain-fewer-MRI-machines-Western-country.html.

  14. Morris Z, Whitely WN, Longtreth WT, Weber F, Lee YC, Tsushima Y, et al. Incidental findings on brain magnetic resonance imaging: systematic review and meta-analysis. BMJ. 2009;339:b3016.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Wiebers DO, Whisant JP, Huston J, Meissiner I, Brown RD, Piepgras DG, et al. Unruptured intracranial aneurysms: natural history, clinical outcome, and risks of surgical and endovascular treatment. Lancet. 2003;362(9378):103–10.

    Article  PubMed  Google Scholar 

  16. Lanterna LA, Tredici G, Dimitrov BD, Biroli F. Treatment of unruptured cerebral aneurysms by embolization with Guglielmi detachable coils: case-fatality, morbidity, and effectiveness in preventing bleeding—a systematic review of the literature. Neurosurgery. 2004;55(4):767–78.

    Article  PubMed  Google Scholar 

  17. Wedderburn CJ, van Beijnum J, Bhattacharya JJ, Counsell CE, Papanastassiou V, Ritchie V, et al. Outcome after interventional or conservative management of unruptured brain arteriovenous malformations: a prospective, population-based cohort study. Lancet Neurol. 2008;7(3):223–30.

    Article  PubMed  Google Scholar 

  18. Cavaliere R, Lopes MBS, Schiff D. Low-grade gliomas: an update on pathology and therapy. Lancet Neurol. 2005;4(11):760–70.

    Article  PubMed  Google Scholar 

  19. Piatt JH. Unexpected findings on brain and spine imaging in children. Pediatr Clin North Am. 2004;51(2):507–27.

    Article  PubMed  Google Scholar 

  20. Howard L, Wessely S, Leese M, Page L, McCrone P, Husain K, et al. Are investigations anxiolytic or anxiogenic? A randomised controlled trial of neuroimaging to provide reassurance in chronic daily headache. J Neurol Neurosurg Psychiatry. 2005;76(11):1558–64.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  21. Kernick D, Williams S. Should GPs have direct access to neuroradiological investigation when adults present with headache? Br J Gen Pract. 2011;61(587):409.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Wade D. Ethics audit and research: all shades of grey. BMJ. 2005;330:468–71.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

None.

Funding

This project did not receive any specific funding.

Availability of data and materials

The datasets analysed during the current study are not publicly available due to confidentiality.

Authors’ contributions

All authors contributed substantially to the conception and design, acquisition of data, analysis or interpretation of data, were involved in drafting the manuscript and revising it critically for important intellectual content, and gave final approval of the version to be published, and participated sufficiently in the work to take public responsibility for appropriate portions of the content and has agreed to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved.

Competing interests

The authors declare that they have no competing interest.

Consent for publication

Not applicable.

Ethics approval and consent to participate

This retrospective study, based entirely on existing patient records and imaging acquired during routine clinical care, was considered to constitute audit and not to require ethical approval [22]. According to the policy activities that constitute research at the Royal Preston Hospital this work met criteria for operational improvement activities exempt from ethical review.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Hasan Raza Mohammad.

Additional file

Additional file 1:

Appendix. Raw data calculations. (DOCX 31 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Mohammad, H.R., Boardman, J., Howell, L. et al. Urgent referral for suspected CNS cancer: which clinical features are associated with a positive predictive value of 3 % or more?. BMC Neurol 16, 152 (2016). https://doi.org/10.1186/s12883-016-0677-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12883-016-0677-1

Keywords