Diagnostic accuracy of the vegetative and minimally conscious state: Clinical consensus versus standardized neurobehavioral assessment
© Schnakers et al; licensee BioMed Central Ltd. 2009
Received: 10 February 2009
Accepted: 21 July 2009
Published: 21 July 2009
Previously published studies have reported that up to 43% of patients with disorders of consciousness are erroneously assigned a diagnosis of vegetative state (VS). However, no recent studies have investigated the accuracy of this grave clinical diagnosis. In this study, we compared consensus-based diagnoses of VS and MCS to those based on a well-established standardized neurobehavioral rating scale, the JFK Coma Recovery Scale-Revised (CRS-R).
We prospectively followed 103 patients (55 ± 19 years) with mixed etiologies and compared the clinical consensus diagnosis provided by the physician on the basis of the medical staff's daily observations to diagnoses derived from CRS-R assessments performed by research staff. All patients were assigned a diagnosis of 'VS', 'MCS' or 'uncertain diagnosis.'
Of the 44 patients diagnosed with VS based on the clinical consensus of the medical team, 18 (41%) were found to be in MCS following standardized assessment with the CRS-R. In the 41 patients with a consensus diagnosis of MCS, 4 (10%) had emerged from MCS, according to the CRS-R. We also found that the majority of patients assigned an uncertain diagnosis by clinical consensus (89%) were in MCS based on CRS-R findings.
Despite the importance of diagnostic accuracy, the rate of misdiagnosis of VS has not substantially changed in the past 15 years. Standardized neurobehavioral assessment is a more sensitive means of establishing differential diagnosis in patients with disorders of consciousness when compared to diagnoses determined by clinical consensus.
Differentiating the vegetative (VS) from minimally conscious state (MCS) is often one of the most challenging tasks facing clinicians involved in the care of patients with disorders of consciousness (DOC). Whereas VS is characterized by the return of arousal without signs of awareness , MCS is defined by the presence of inconsistent but reproducible goal-directed behaviors (e.g. response to command, verbalizations, visual pursuit, etc.) . Behavioral assessment remains the "gold standard" for detecting signs of consciousness and, hence, for determining diagnosis . However, behavioral assessment is complicated by the presence of motor impairment, tracheotomy, fluctuating arousal level or ambiguous and rapidly habituating responses . Previous studies have shown that 37 to 43% of patients diagnosed with VS demonstrated signs of awareness [5, 6]. Misdiagnosis can lead to grave consequences, especially in end-of-life decision-making . Contrary to patients in VS, those in MCS retain some capacity for cognitive processing and activate similar brain networks relatives to controls following painful stimulation; suggesting that they can experience pain [8, 9]. Moreover, the prognosis of patients in MCS is significantly more favorable relative to those in VS . End-of-life decisions, therefore, are likely to be influenced by whether one is diagnosed with MCS or VS. In 2002, criteria were proposed to characterize MCS and identify behaviors that signal emergence from this state . In view of the availability of the MCS criteria, the incidence of misdiagnosis of VS should be lower than the rates reported before these criteria were established . However, no recent studies have investigated the accuracy of this grave clinical diagnosis. Over the last 15 years, specialized neurobehavioral rating scales have been developed to provide a reliable and valid means of detecting signs of consciousness. There are significant differences among these scales, however, with respect to diagnostic sensitivity . The Coma Recovery Scale-Revised (CRS-R) was developed specifically to differentiate MCS from VS . We recently showed that the proportion of patients diagnosed with MCS by the CRS-R was significantly higher as compared to other neurobehavioral scales such as the Glasgow Coma Scale , the Full Outline of UnResponsiveness  and the Wessex Head Injury Matrix . These results suggest that the type of assessment tool used is crucial to accurate diagnosis [16, 17]. In this study, we compared consensus-based diagnoses of VS and MCS to those based on the CRS-R, a well-established standardized neurobehavioral rating scale.
Participating centers were intensive care and neurology units as well as neurorehabilitation centers, part of the Belgian federal network for care of patients in VS and MCS. All the patients included in this study were recruited according to pre-arranged inclusion/exclusion criteria. Inclusion criteria were a) severe acquired brain injury causing disturbance in consciousness, b) no neuromuscular function blockers and no sedation within the prior 24 hours and c) periods of eye opening (indicating preserved sleep-wake cycles and emergence from coma). Exclusion criteria were a) documented history of prior brain injury, b) premorbid history of developmental, psychiatric or neurologic illness resulting in documented functional disabilities up to time of the injury and c) acute illness. Additionally, the following clinical information was collected from the medical file of each patient: age, gender, past medical history, medication, time since onset and etiology.
CRS-R's diagnostic criteria for vegetative (VS) and minimally conscious (MCS) states and emergence from MCS
Auditory ≤ 2 AND Visual ≤ 1 AND Motor ≤ 2 AND Oromotor/Verbal ≤ 2 AND Communication = 0 AND Arousal ≤ 2
Auditory = 3–4 OR Visual = 2–5 OR Motor = 3–5 OR Oromotor/Verbal = 3 OR Communication = 1
Emergence from MCS
Motor = 6 OR Communication = 2
The data were collected between October 2005 and January 2007. We enrolled 103 patients in this study (74 in acute care and neurology units and 29 in neurorehabilitation centers). There were 71 males (69%) and mean age was 55 ± 19 years. Forty-six patients (45%) were in the acute recovery period (mean 12 ± 7 days) and 57 were in the chronic stage (55%) (mean 22 ± 52 months) . The following etiologies were included : traumatic head injury (n = 39), postanoxic-ischemic encephalopathy (n = 31), ischemic or hemorrhagic stroke (n = 16), aneurysmal subarachnoid hemorrhage (n = 6), metabolic encephalopathy (n = 5) and miscellaneous acute neurological conditions (n = 6).
Behavioral signs of consciousness found in patients misdiagnosed with VS and MCS or with uncertain clinical consensus diagnosis.
Unsure of diagnosis
1 – response to verbal order
2 – purposeful eye movements
3 – automatic motor response
4 – pain localization
5 – several criteria for MCS
6 – communication
7 – functional object use
8 – several criteria for EMCS
In this geographically-diverse sample drawn from a Belgian federal network of brain injury treatment centers, the rate of misdiagnosis of VS (41%) is roughly equivalent to rates reported in the U.S. and U.K. before the criteria for MCS were published [5, 6]. Misdiagnosis occurred most often as the result of failure to detect purposeful eye movements (i.e., visual fixation and pursuit), in line with previous studies . Moreover, our study suggests that the majority of cases with an uncertain diagnosis are in MCS (89%), not in VS. Finally, a false negative diagnosis of MCS was noted in 10% of cases that had emerged from this condition.
One could argue that the false negative consensus-based MCS diagnoses actually represent false positive CRS-R diagnoses of MCS. This possibility cannot be excluded but is also not easily resolved. As false positive errors increase, specificity decreases. However, in the context of a weak gold standard, false positives may not actually reflect diagnostic errors. If we consider the clinical consensus diagnosis as the gold standard, then false positive errors on the comparison measure (i.e., diagnosis of MCS) will result in lower specificity. Such false positive errors may, however, be due to the superior capacity of the comparison measure to detect the behavior of interest. In this case, the CRS-R, a standardized measure, captured more behavioral signs of consciousness relative to the collective impression of the medical team. One could also argue that there was a bias in favor of the research team's diagnostic accuracy as the researchers were not blind to the consensus diagnosis. The research team's knowledge of the clinical consensus diagnosis may hence have overestimated the sensitivity of CRS-R to detect signs of consciousness. However, the CRS-R requires replication of behavioral responses before scoring them as present (e.g., a response to verbal order is considered scoreable if the appropriate behavior is observed on 3 out of 4 trials) and, as such, decreases the risk of a false positive diagnosis. Future studies including blind assessment could be performed in order to comfort our results.
Spontaneous recovery is unlikely to explain our results as the clinical consensus diagnosis included behaviors observed by the medical staff within the prior 24 hours and was provided just before the CRS-R assessment. It is more likely that the examiners' reliance on unstructured bedside observations contributed to the high rate of misdiagnosis of VS patients. Indeed, it has been suggested that misdiagnosis is influenced by the use of a standardized behavioral tool . In this study, we compared the accuracy of diagnoses based on standardized behavioral assessment using the CRS-R with consensus-based diagnoses established by the medical team following qualitative observations. Unlike traditional bedside assessment, the CRS-R guards against misdiagnosis by incorporating items that directly reflect the existing diagnostic criteria for MCS, and by operationalizing scoring criteria for the identification of behaviors associated with consciousness. Standardized assessment approaches may hence mitigate the tendency to miss signs of consciousness that may arise when the diagnosis is based solely on routine bedside examination. In cases with ambiguous behavioral findings, the failure to employ a standardized behavioral tool may increase the likelihood of misdiagnosis. Reliance on qualitative (versus standardized) assessment could also explain the higher rate of misdiagnosis observed for VS and MCS patients in both chronic and acute care settings. There is evidence to support this premise. Data regarding the use of a standardized behavioural scale were collected for each centre involved in this study. The behavioural scales' scores were not reported to the research team but were taken in account for the clinical consensus diagnosis. All 46 patients in the acute setting were evaluated with the Glasgow Coma Scale, a standardized assessment tool, and only 4 of these cases (10%) were misdiagnosed. In contrast, of the 57 chronic patients, 30 were not assessed using a standardized measure and 9 cases (30%) were misdiagnosed.
Finally, for uncertain diagnoses, we did not collect information on who disagreed and how frequently. While it would be helpful to know if uncertain diagnoses were due to the ambiguity of patient's responses or to the observational skills of the examiner, the aim of this study was to assess the misdiagnosis rate rather than explain the causes of misdiagnosis.
Despite the importance of diagnostic accuracy and advances in the past 15 years, the rate of misdiagnosis among patients with disorders of consciousness has not substantially changed. Although early detection of signs of consciousness is crucial not only for daily management (particularly, pain treatment), end-of-life decisions  and prognosis (i.e., patients in MCS have significantly more favorable outcomes as compared to those in VS ), clinicians should recognize that diagnoses established during the acute stage tend to be transitional and may change over time as the injury sequelae resolve. The results of this study suggest that the systematic use of a sensitive standardized neurobehavioral assessment scale may help decrease diagnostic error and limit diagnostic uncertainty. Future studies should investigate other factors influencing diagnostic accuracy.
List of abbreviations used
- The list of abbreviations used is the following:
CRS-R: (Coma Recovery Scale-Revised)
(Minimally Conscious State).
This research was supported by funds from the Belgian Federal Public Service for Public Health, Belgian "Fonds National de la Recherche Scientifique" (FNRS), "Centre Hospitalier" of the University of Liège, French Speaking Community of Belgium Concerted Research Action, the J.S. McDonnell Foundation, the European Commission, Mind Science Foundation, TX. SL, SM, and MB are, respectively, Senior Research Associate, Research Associate and Research Fellow at the FNRS. CS is funded by the "Fonds Léon Fredericq" (University of Liège) and the FNRS.
- The Multi-Society Task Force on PVS: Medical aspects of the persistent vegetative state (1). N Engl J Med. 1994, 330 (21): 1499-1508.View ArticleGoogle Scholar
- Giacino J, Ashwal S, Childs N, Cranford R, Jennett B, Katz DI, Kelly JP, Rosenberg JH, Whyte J, Zafonte RD, et al: The minimally conscious state: Definition and diagnostic criteria. Neurology. 2002, 58 (3): 349-353.View ArticlePubMedGoogle Scholar
- Majerus S, Gill-Thwaites H, Andrews K, Laureys S: Behavioral evaluation of consciousness in severe brain damage. Prog Brain Res. 2005, 150: 397-413.View ArticlePubMedGoogle Scholar
- Gill-Thwaites H: Lotteries, loopholes and luck: misdiagnosis in the vegetative state patient. Brain Inj. 2006, 20 (13–14): 1321-1328.View ArticlePubMedGoogle Scholar
- Childs NL, Mercer WN, Childs HW: Accuracy of diagnosis of persistent vegetative state. Neurology. 1993, 43 (8): 1465-1467.View ArticlePubMedGoogle Scholar
- Andrews K, Murphy L, Munday R, Littlewood C: Misdiagnosis of the vegetative state: retrospective study in a rehabilitation unit. BMJ. 1996, 313 (7048): 13-16.View ArticlePubMedPubMed CentralGoogle Scholar
- Andrews K: Medical decision making in the vegetative state: withdrawal of nutrition and hydration. Neuro Rehabilitation. 2004, 19 (4): 299-304.PubMedGoogle Scholar
- Laureys S, Faymonville ME, Peigneux P, Damas P, Lambermont B, Del Fiore G, Degueldre C, Aerts J, Luxen A, Franck G, et al: Cortical processing of noxious somatosensory stimuli in the persistent vegetative state. Neuroimage. 2002, 17 (2): 732-741.View ArticlePubMedGoogle Scholar
- Boly M, Faymonville ME, Schnakers C, Peigneux P, Lambermont B, Phillips C, Lancellotti P, Luxen A, Lamy M, Moonen G, et al: Perception of pain in the minimally conscious state with PET activation: an observational study. Lancet Neurol. 2008, 7: 1013-1020.View ArticlePubMedGoogle Scholar
- Giacino JT: The vegetative and minimally conscious states: consensus-based criteria for establishing diagnosis and prognosis. Neuro Rehabilitation. 2004, 19 (4): 293-298.PubMedGoogle Scholar
- Jennett B: 30 years of the vegetative state: clinical, ethical and legal problems. The boundaries of consciousness: neurobiology and neuropathology. Edited by: Laureys S. 2005, Amsterdam: Elsevier, 150: 541-548.Google Scholar
- Giacino J, Kalmar K, Whyte J: The JFK Coma Recovery Scale-Revised: measurement characteristics and diagnostic utility. Arch Phys Med Rehabil. 2004, 85 (12): 2020-2029.View ArticlePubMedGoogle Scholar
- Teasdale G, Jennett B: Assessment of coma and impaired consciousness. A practical scale. Lancet. 1974, 2 (7872): 81-84.View ArticlePubMedGoogle Scholar
- Wijdicks EF, Bamlet WR, Maramattom BV, Manno EM, McClelland RL: Validation of a new coma scale: The FOUR score. Ann Neurol. 2005, 58 (4): 585-593.View ArticlePubMedGoogle Scholar
- Shiel A, Horn SA, Wilson BA, Watson MJ, Campbell MJ, McLellan DL: The Wessex Head Injury Matrix (WHIM) main scale: a preliminary report on a scale to assess and monitor patient recovery after severe head injury. Clin Rehabil. 2000, 14 (4): 408-416.View ArticlePubMedGoogle Scholar
- Schnakers C, Giacino J, Kalmar K, Piret S, Lopez E, Boly M, Malone R, Laureys S: Does the FOUR score correctly diagnose the vegetative and minimally conscious states?. Ann Neurol. 2006, 60 (6): 744-745. author reply 745View ArticlePubMedGoogle Scholar
- Schnakers C, Majerus S, Giacino J, Vanhaudenhuyse A, Bruno M, Boly M, Moonen G, Damas P, Lambermont B, Lamy M, et al: A French validation study of the Coma Recovery Scale-Revised (CRS-R). Brain Injury. 2008, 22 (10): 786-792.View ArticlePubMedGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2377/9/35/prepub