- Research article
- Open Access
Urgent referral for suspected CNS cancer: which clinical features are associated with a positive predictive value of 3 % or more?
BMC Neurology volume 16, Article number: 152 (2016)
Urgent referral for suspected central nervous system (CNS) cancer is recommended, but little analysis of the referral criteria diagnostic performance has been conducted. New 2015 NICE guidance recommends direct brain imaging for patients with symptoms with positive predictive values (PPV) of 3 %, but further guidance is needed.
A 12-month retrospective evaluation of 393 patients referred under previous 2005 NICE 2-week rule criteria was conducted. Analysis was based on the three groups of symptoms forming the referral criteria, (1) CNS symptoms, (2) recent onset headaches, (3) rapidly progressive subacute focal deficit/cognitive/behavioural/personality change. Comparison was made with neuroimaging findings.
Twelve (3.1 %) of 383 patients who attended clinic had CNS cancer suggesting the combination of clinical judgement and application of 2005 criteria matched the 2015 guideline’s PPV threshold. PPVs for the three groups of symptoms were (1) 4.1 % (95 % CIs 2.0 to 7.4 %), (2) 1.2 % (0.1 to 4.3 %) and (3) 3.7 % (0.1 to 19.0 %). Sensitivities were (1) 83.3 % (95 % CIs 51.6 to 97.9 %), (2) 16.7 % (2.1 to 48.4 %), and (3) 8.3 % (0.2 to 38.5 %); specificities were (1) 37.2 % (32.3 to 42.3 %), (2) 55.5 % (50.3 to 60.7 %) and (3) 93.0 % (89.9 to 95.4 %). Of 288 patients who underwent neuroimaging, 59 (20.5 %) had incidental findings, most commonly cerebrovascular disease.
The 2015 guidance is less prescriptive than previous criteria making clinical judgement more important. CNS symptoms had greatest sensitivity, while PPVs for CNS symptoms and rapidly progressive subacute deficit/cognitive/behavioural/personality change were closest to 3 %. Recent onset headaches had the lowest sensitivity and PPV.
The 1990s saw rising waiting times in the United Kingdom (UK) for patients undergoing investigation of suspected cancer, including suspected central nervous system (CNS) cancer. This prompted the Department of Health to introduce guidelines in 2000 for referral, with structured pathways and a waiting time target of 2 weeks [1, 2]. The referral guidelines for suspected cancer were revised in 2005  and completely overhauled in 2015  because of concerns that cancer survival in the UK is lower than in other developed countries. The latest guidelines for adults with suspected CNS cancer (Table 1), which advocate direct referral for brain imaging to be performed within 2 weeks, represent a substantial shift from the 2005 guidelines (Table 2) which comprised clinical criteria based on groups of symptoms for urgent outpatient referral (typically to neurology) to be seen within 2 weeks, or for referral to be considered.
Currently, the extent of implementation of the 2015 guidelines for suspected CNS cancer is somewhat variable, with gradual transition being expected from the 2005 to the 2015 guidelines while the implications for clinical practice, including referral pathways and impact on imaging and reporting capacity etc., are understood.
The 2015 guidelines advise that adults with clinical features that are associated with a positive predictive value (PPV) of 3 % or more for CNS cancer should be referred urgently for investigation . The new guidelines are much less prescriptive in their wording, particularly, in respect of which clinical features might be the most relevant. Relatively little is known about the diagnostic performance of the 2005 referral criteria, or diagnosis rate of CNS cancer among patients referred using those criteria . The likely effects of the 2015 guidelines upon referral behaviour and the implications for direct access imaging requests is, to all intents and purposes, unknown. An improved understanding of the diagnostic performance of the 2005 criteria and which clinical features are relevant in determining whether there is a 3 % or greater likelihood of CNS cancer will surely be helpful. In addition, relatively little is known about the implications for patients and clinical pathways upon the identification of incidental findings when imaging is being requested directly from primary care .
We have undertaken a retrospective study of patients referred under the ‘2 week rule’ for suspected CNS cancer according to the 2005 guidelines over a 12 month period. We have analysed (1) the diagnostic performance of the 2005 criteria, with a clinical and radiological diagnosis of CNS cancer as the primary outcome, (2) the symptom frequencies amongst all referred patients and those with CNS cancer, and (3) incidental findings.
Data extraction and validation
Routine clinical data were extracted from referral letters, clinic letters and imaging reports for all patients referred under the ‘2 week rule’ for suspected CNS cancer to the regional neurology service based at the Royal Preston Hospital (serving a population of approximately 1.6 million) between 1st June 2012 and 31st May 2013. Data were extracted by one junior doctor (HM, who was an undergraduate at the time of data collection), and were independently validated by a second junior doctor (JB) working in neurology. One year after data collection, all patients’ records were reviewed to determine whether any other visits/imaging had occurred.
Classification of 2005 referral criteria and analysis
Referral criteria (2005 criteria) were grouped as follows: group 1 – symptoms related to the CNS (all new-onset or recent-onset seizures were included in this group), group 2 – headaches of recent onset accompanied by features suggestive of raised intracranial pressure (ICP), and group 3 – rapidly progressive subacute focal deficit/cognitive/behavioural or personality change. Presenting symptoms were classified into one of these three groups. The primary outcome was the presence/absence of CNS cancer on the basis of clinical assessment and, where applicable, neuroimaging findings (CT brain/MRI brain). Sensitivity, specificity, positive and negative predictive values were calculated for each symptom group.
Statistical analysis was performed using Stata (StataCorp. 2013. Stata Statistical Software: Release 13. College Station, TX: StataCorp LP) and StatsDirect (StatsDirect Ltd. StatsDirect statistical software. http://www.statsdirect.com. England: StatsDirect Ltd. 2013).
Presenting symptoms were reported for all referrals and by CNS cancer diagnosis using frequencies and percentages. Comparisons of presenting symptoms by CNS cancer diagnosis were performed using the Fisher’s exact test. To avoid multiple testing, comparisons were made only for the overall presenting symptom groups: symptoms related to CNS cancer, headaches of recent onset accompanied by features suggestive of raised intracranial pressure and consider urgent referral. The significance threshold was set at p ≤ 0.05. Measures of diagnostic performance, sensitivity, specificity, positive predictive value and negative predictive value were reported for each of the symptom groups based on participants who were referred and attended clinic. Diagnosis of CNS cancer was based on clinical decision and radiological findings. Please see Additional file 1: Appendix for raw data calculations.
Between 1st June 2012 and 31st May 2013, 393 adult patients were referred under the ‘2 week rule’ for suspected CNS cancer. Ten patients did not attend their appointment or were seen at another hospital. Three hundred and eighty-three patients attended clinic, of whom 95 did not undergo neuroimaging (and did not undergo imaging by July 2014) on account of the neurologist considering there to be no clinical suspicion of CNS cancer and no other indication for scanning. Two hundred and eighty eight patients underwent neuroimaging (Fig. 1).
CNS cancer diagnoses
Twelve patients were found to have CNS cancer. This constitutes 3.1 % of the total number of referred patients who attended their appointment and 4.2 % of patients who underwent imaging. Histopathological diagnoses were grade IV glioblastoma in 4 cases, lung cancer metastases in 2 cases, and anaplastic oligoastrocytoma in 1 case. No biopsies were available in the remaining 5 cases. Radiological and clinical diagnoses of these 5 cases were: cystic glioma, metastases from unknown source in parasagittal region, lung metastases in posterior corpus callosum, non-small cell carcinoma metastases in right parietal tissue and C2 vertebral body metastases without frank spinal cord compression.
Diagnostic performance of 2005 referral criteria
The frequency of presenting symptoms and symptom groups are shown in Table 3. Two hundred and forty-three patients were referred with group 1 symptoms, 167 with group 2 symptoms, and 27 with group 3 symptoms. For group 1 (symptoms related to the CNS), the sensitivity was 83.3 % (95 % CI 51.6 to 97.9 %), specificity 37.2 % (95 % CI 32.3 to 42.3 %), PPV 4.1 % (95 % CI 2.0 to 7.4 %) and negative predictive value (NPV) 98.6 % (95 % CI 94.9 to 99.8 %). For group 2 (headaches of recent onset accompanied by features suggestive of raised intracranial pressure), the sensitivity was 16.7 % (95 % CI 2.1 to 48.4 %), specificity 55.5 % (95 % CI 50.3 to 60.7 %), PPV 1.2 % (95 % CI 0.1 to 4.3 %) and NPV 95.4 % (95 % CI 91.7 to 97.8 %). For group 3 (rapidly progressive subacute focal deficit/cognitive/behavioural or personality change), the sensitivity was 8.3 % (95 % CI 0.2 to 38.5 %), specificity 93.0 % (95 % CI 89.9 to 95.4 %), PPV 3.7 % (95 % CI 0.1 to 19.0 %) and NPV 96.9 % (95 % CI 94.5 to 98.4 %).
Of 288 patients who underwent neuroimaging, 59 (20.5 %) were found to have incidental findings (Table 4). Cerebrovascular disease (11.1 %), degenerative spine disease (3.5 %) and sinus disease (3.1 %) were the most frequent incidental findings.
This study, to our knowledge, is the first to consider the implications of the recently revised NICE guidelines for suspected CNS cancer, and specifically which clinical features are associated with a PPV of 3 % or more by analysing the diagnostic performance of previous referral criteria .
Anecdotally, there can appear to be excessive ‘2 week rule’ referrals for suspected CNS cancer to neurology clinics. With the 2015 guidelines advocating direct referral for imaging, fewer patients with suspected CNS cancer might be expected to attend neurology clinics, although the identification of incidental findings will inevitably also have implications for clinical care. In the present study, ‘2 week rule’ referrals constituted approximately 3 % of the total number of new outpatient referrals to the regional neurology service (ca. 12,000). The overall CNS cancer diagnosis rate among the ‘2 week rule’ referral population was 3.1 % (i.e. 12 CNS cancer diagnoses among 383 patients who were referred by this route and who attended clinic). This finding would appear to suggest that intriguingly, through clinical judgement and the application of the 2005 referral criteria, there was a pattern of referral behaviour for suspected CNS cancer matching the PPV threshold of 3 % at which patients should be urgently referred, according to the 2015 guidelines .
Now that the referral criteria are much less prescriptive, referrers will, more than ever, have to employ clinical judgement when considering referral. But which clinical features would suggest a PPV of 3 % or more? Headache often tends to prompt concerns in the patient and the referrer about the possibility of CNS cancer but performs very poorly as a predictor . Probably undue emphasis is placed on headache per se, and the findings in the present study support the usual view that as a single symptom it does tend to be a poor discriminator with respect to the presence/absence of CNS cancer. Nonetheless, headache accounts for 4.4 % of primary care consultations and up to 30 % of outpatient neurology referrals in the UK [8, 9]. However, the current analysis highlights focal deficits (subacute or progressive), new-onset seizures, or cognitive/behavioural/personality changes, as being more strongly predictive of CNS cancer in the appropriate clinical context. New-onset seizures in particular, whether focal or secondary generalised, can be an important early manifestation of a brain tumour. In a previous study of clinical features and the risk of primary brain tumours, in which new-onset epilepsy had an overall risk of 1.2 %, rising to 2.3 % if the patient was >60 years of age, in marked contrast to the risk with headache, which was associated with a risk of less than 1 in 1000 .
It should be noted that diagnostic performance of all three symptom groups in this study was poor by comparison with usual expectations for a good diagnostic test which would have both a high sensitivity and specificity (both around 90.0 %) . Headaches of recent onset accompanied by features suggestive of raised ICP were actually less frequent among patients found to have CNS cancer than among the total referral population. Potentially this suggests difficulties in clinical recognition of features of raised ICP. Uncertainty among referrers over headache diagnosis has certainly been reported previously .
Bypassing a neurology clinical opinion en route to brain imaging may raise some issues in patient management, particularly with respect to relative lack of a detailed neurological assessment which, at least anecdotally, can be helpful for contextualising incidental findings. Impact of the NICE guidance with respect to imaging and reporting capacity is uncertain. An international report published by the Organisation for Economic Cooperation and Development (OECD) found that the UK had fewer magnetic resonance imaging (MRI) scanners than almost any other Western country including developing countries such as Turkey and Slovakia . Out of 32 countries in the OECD the UK stands 26th. For computerised tomography (CT) scanning, the UK is 30th of 32 .
Brain scans are preferably reported by a neuroradiologist, which creates issues of hospital’s reporting capacity.
Implementation of the 2015 NICE criteria also needs to take into account the frequent identification of incidental findings. A systematic review and meta-analysis reported incidental findings of 2.7 % from 19,559 participants . The study suggested that at the very least clinicians should counsel patients about the chance of incidental findings prior to requesting a scan and that a mechanism for their management would need to be implemented . There is considerable uncertainty surrounding the management of some incidental findings on brain imaging, including balancing risk/benefit of intervention for intracranial aneurysms [15, 16], unruptured arteriovenous malformations , low grade glioma  and arachnoid cysts . There is little evidence to guide the management of incidental radiological cerebrovascular disease. This lack of certainty can create significant patient anxiety, lead to additional referrals/investigations, sometimes with significant implications for the patient [19–21]. It seems wise for pre-imaging counselling to make reference not only to the possibility of incidental findings but also uncertainty in their management.
By necessity, given the study design, the calculation of PPVs and NPVs is based on the referral population. This does limit the extent to which these values are directly applicable to the total population (i.e. including an unknown number of unreferred patients with relevant symptoms). Clearly, the balance of positive and negative imaging findings among unreferred patients is also unknown.
The new 2015 guidance is less prescriptive than previous CNS cancer referral criteria making clinical judgement even more important. Symptoms related to the CNS had the greatest sensitivity, while PPVs for symptoms related to the CNS and rapidly progressive subacute deficit/cognitive/behavioural/personality change were closest to the NICE referral figure of 3 %. Headaches of recent onset had the lowest sensitivity and PPV; diagnostic performance with respect to sensitivity and specificity was poor for all three symptom groups. The frequent occurrence of incidental findings also needs to be taken into account when requesting imaging and planning services.
Central nervous system
Magnetic resonance imaging
Negative predictive value
National health service
Organisation for Economic Cooperation and Development
Positive predictive value
Department of Health. The NHS Cancer Plan A plan for investment, a plan for reform. (cited 24th April 2016). https://www.thh.nhs.uk/documents/_Departments/Cancer/NHSCancerPlan.pdf, 2000; Available from: HMSO.
NHS Executive. Referral guidelines for suspected cancer. DOH 2000. (cited 24th April 2015). http://webarchive.nationalarchives.gov.uk/20130107105354/http://www.dh.gov.uk/prod_consum_dh/groups/dh_digitalassets/@dh/@en/documents/digitalasset/dh_4012253.pdf.
NICE. Referral guidlines for suspected cancer. NICE, 2005: p. 21. (cited 24th April 2016). http://www.rcpch.ac.uk/sites/default/files/asset_library/Research/Clinical%20Effectiveness/Endorsed%20guidelines/Cancer,%20Referral%20for%20Suspected%20(NICE)/Referral%20for%20suspected%20cancer.quick%20reference%20guide.pdf.
NICE. Suspected cancer: recognition and referral. NCC-C, 2015 p. 244–253. (Cited 24th April 2016). https://www.nice.org.uk/guidance/ng12.
Hamdan A, Mitchell P. The two-week wait guideline for suspected CNS tumours: a decade analysis. Br J Neurosurg. 2013;27(5):642–5.
Salman RA-S, Whiteley WN, Warlow C. Screening using whole-body magnetic resonance imaging scanning: who wants an incidentaloma? J Med Screen. 2007;14(1):2–4.
Scottish Intercollegiate Guidelines Network. Diagnosis and management of headache in adults. Edinburgh: NHS Quality Improvement Scotland; 2008. (cited 24th April 2016), http://www.sign.ac.uk/pdf/sign107.pdf.
Latinovic R, Gulliford M, Ridsdale L. Headache and migraine in primary care: consultation, prescription, and referral rates in a large population. J Neurol Neurosurg Psychiatry. 2006;77(3):385–7.
Larner A. Guidelines for primary headache disorders in primary care: an ‘intervention’ study. Headache Care. 2006;3(1):1–2.
Hamilton W, Kernick D. Clinical features of primary brain tumours: a case-control study using electronic primary care records. Br J Gen Pract. 2007;57(542):695–9.
Bekkelund S, Salvesen R. Is uncertain diagnosis a more frequent reason for referring migraine patients to neurologist than other headache syndromes? Eur J Neurol. 2006;13(12):1370–3.
Cooperation OFE, Staff D, Health at a Glance 2013: OECD Indicators. 2013: OECD. (cited 24th April 2016) https://www.oecd.org/els/health-systems/Health-at-a-Glance-2013.pdf.
Martin D. Deadly shortage of cancer scanners that shames UK: Britain has fewer MRI machines than almost any other Western country. 2014. (cited 24th April 2016). http://www.dailymail.co.uk/news/article-2672902/Deadly-shortage-cancer-scanners-shames-UK-Britain-fewer-MRI-machines-Western-country.html.
Morris Z, Whitely WN, Longtreth WT, Weber F, Lee YC, Tsushima Y, et al. Incidental findings on brain magnetic resonance imaging: systematic review and meta-analysis. BMJ. 2009;339:b3016.
Wiebers DO, Whisant JP, Huston J, Meissiner I, Brown RD, Piepgras DG, et al. Unruptured intracranial aneurysms: natural history, clinical outcome, and risks of surgical and endovascular treatment. Lancet. 2003;362(9378):103–10.
Lanterna LA, Tredici G, Dimitrov BD, Biroli F. Treatment of unruptured cerebral aneurysms by embolization with Guglielmi detachable coils: case-fatality, morbidity, and effectiveness in preventing bleeding—a systematic review of the literature. Neurosurgery. 2004;55(4):767–78.
Wedderburn CJ, van Beijnum J, Bhattacharya JJ, Counsell CE, Papanastassiou V, Ritchie V, et al. Outcome after interventional or conservative management of unruptured brain arteriovenous malformations: a prospective, population-based cohort study. Lancet Neurol. 2008;7(3):223–30.
Cavaliere R, Lopes MBS, Schiff D. Low-grade gliomas: an update on pathology and therapy. Lancet Neurol. 2005;4(11):760–70.
Piatt JH. Unexpected findings on brain and spine imaging in children. Pediatr Clin North Am. 2004;51(2):507–27.
Howard L, Wessely S, Leese M, Page L, McCrone P, Husain K, et al. Are investigations anxiolytic or anxiogenic? A randomised controlled trial of neuroimaging to provide reassurance in chronic daily headache. J Neurol Neurosurg Psychiatry. 2005;76(11):1558–64.
Kernick D, Williams S. Should GPs have direct access to neuroradiological investigation when adults present with headache? Br J Gen Pract. 2011;61(587):409.
Wade D. Ethics audit and research: all shades of grey. BMJ. 2005;330:468–71.
This project did not receive any specific funding.
Availability of data and materials
The datasets analysed during the current study are not publicly available due to confidentiality.
All authors contributed substantially to the conception and design, acquisition of data, analysis or interpretation of data, were involved in drafting the manuscript and revising it critically for important intellectual content, and gave final approval of the version to be published, and participated sufficiently in the work to take public responsibility for appropriate portions of the content and has agreed to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved.
The authors declare that they have no competing interest.
Consent for publication
Ethics approval and consent to participate
This retrospective study, based entirely on existing patient records and imaging acquired during routine clinical care, was considered to constitute audit and not to require ethical approval . According to the policy activities that constitute research at the Royal Preston Hospital this work met criteria for operational improvement activities exempt from ethical review.
About this article
Cite this article
Mohammad, H.R., Boardman, J., Howell, L. et al. Urgent referral for suspected CNS cancer: which clinical features are associated with a positive predictive value of 3 % or more?. BMC Neurol 16, 152 (2016). https://doi.org/10.1186/s12883-016-0677-1
- CNS cancer
- Retrospective study
- Two-week referral
- Positive predictive value
- NICE guidance