Validity of Simpson-Angus Scale (SAS) in a naturalistic schizophrenia population
© Janno et al; licensee BioMed Central Ltd. 2005
Received: 01 November 2004
Accepted: 17 March 2005
Published: 17 March 2005
Simpson-Angus Scale (SAS) is an established instrument for neuroleptic-induced parkinsonism (NIP), but its statistical properties have been studied insufficiently. Some shortcomings concerning its content have been suggested as well. According to a recent report, the widely used SAS mean score cut-off value 0.3 of for NIP detection may be too low. Our aim was to evaluate SAS against DSM-IV diagnostic criteria for NIP and objective motor assessment (actometry).
Ninety-nine chronic institutionalised schizophrenia patients were evaluated during the same interview by standardised actometric recording and SAS. The diagnosis of NIP was based on DSM-IV criteria. Internal consistency measured by Cronbach's α, convergence to actometry and the capacity for NIP case detection were assessed.
Cronbach's α for the scale was 0.79. SAS discriminated between DSM-IV NIP and non-NIP patients. The actometric findings did not correlate with SAS. ROC-analysis yielded a good case detection power for SAS mean score. The optimal threshold value of SAS mean score was between 0.65 and 0.95, i.e. clearly higher than previously suggested threshold value.
We conclude that SAS seems a reliable and valid instrument. The previously commonly used cut-off mean score of 0.3 has been too low resulting in low specificity, and we suggest a new cut-off value of 0.65, whereby specificity could be doubled without loosing sensitivity.
Reported prevalences for neuroleptic-induced parkinsonism (NIP) in schizophrenia patients are usually in the range 19% to 36% [1–5]. As NIP can severely impair activities of daily life, and it can be treated or at least alleviated, its diagnosis and assessment are an important focus in clinical practice. A reliable diagnosis of NIP is a demanding task . NIP may be missed due to overlap with negative and depressive symptoms in treated schizophrenia patients . Diagnostic and Statistical Manual, fourth edition, (DSM-IV)  criteria for NIP consist of parkinsonian tremor, muscular rigidity or akinesia, developing within a few weeks of starting or raising the dose of a neuroleptic medication (or after reducing a medication used to treat extrapyramidal symptoms). Like other motor adverse effects of antipsychotic drugs, the NIP is usually assessed by clinical observation or by rating scales, which are based on clinician's judgement. Movement disorders such as NIP, however, can be measured objectively by recording motor activity [9–12].
Simpson-Angus Scale (SAS) is a 10-item rating scale that has been used widely for assessment of NIP in both clinical practice and research settings . It consists of one item measuring gait (hypokinesia), six items measuring rigidity and three items measuring glabella tap, tremor and salivation, respectively. It is an established rating scale, but some shortcomings have been suggested: the rigidity items may be given too much emphasis, the statistical properties have been studied insufficiently, and the instructions as well as the definitions are somewhat unclear . Several items of the scale have failed to show appropriate interrater reliability or insufficient variability across elderly patients , and a modified version has been used to determine the prevalence of spontaneous parkinsonism and the incidence of NIP in this population .
According to our recent study  there was a discrepancy between SAS and DSM-IV based NIP prevalence estimates. We suggested that the commonly used cut-off point of 0.3 mean SAS score was too low in a naturalistic clinical population .
Accelerometric methods have been developed to identify and monitor motor NIP symptoms, such as tremor [18, 19] and hypokinesia . A standardized actometric method has been developed for the assessment of neuroleptic-induced akathisia (NIA) . This method discriminated pure NIA patients from healthy controls and from themselves in remission phase with no overlap . In the current clinical population (including patients with NIP and tardive dyskinesia in addition to NIA), however, the method evidenced less diagnostic power . NIP symptoms may have confounded these actometric findings.
The discrepancy between SAS and DSM-IV based NIP prevalence estimates as well as other above mentioned shortcomings suggest that SAS needs an evaluation as a method to assess NIP severity and to find reliably NIP cases.
Our aims were to check the internal consistency of SAS, improve the convergence between DSM IV and SAS based NIP case finding, and to evaluate how well the scale measures objective motor symptoms verified by actometry.
We recruited 99 chronic schizophrenic institutionalized adult patients from a state nursing home in central Estonia . Inclusion criteria were DSM-IV diagnosis of schizophrenia or schizoaffective disorder, stable antipsychotic medication (for at least one month), and age of 18–65 years. Diagnosis was made using a semi-structured interview according to DSM-IV criteria for schizophrenia by a psychiatrist (SJ) and medical records. Patients with severe somatic illness or neurological illness were excluded. Written informed consent was obtained from the subjects and the study was approved by the Ethics Review Committee on Human Research of the University of Tartu. Data were collected from 29.10.2001 to 27.03.2002.
An experienced clinician (SJ) assessed all the subjects to identify NIP cases in accordance with DSM-IV. The DSM-IV diagnostic criteria for other neuroleptic-induced movement disorders (NIMD) were also checked because of frequent comorbidity and common aetiology. Clinical NIP symptoms were assessed by SAS and the motor activity during rest was measured by actometry. Each item of the 10-item SAS is rated on a 5-point scale (0–4), and the mean score is obtained by adding the items and dividing by 10 . Neuroleptic-induced akathisia and tardive dyskinesia were rated by Barnes Akathisia Rating Scale (BARS)  and Abnormal Involuntary Movement Scale (AIMS) .
The actometric recording was performed during sitting in a standardized clinical interview for 30 minutes, a method described previously as measuring "controlled rest activity" [19, 21]. Controlled rest activity is a parameter of motor activity in a situation where sitting still is adequate and expected, but not instructed or required. The actometers (PAM3, Individual Monitoring Systems, Baltimore, USA) were attached to the ankles of the subjects to measure lower limb motor activity. Actometers are wireless, computerized movement detectors of match-box-size, which do not influence normal moving of the patient.
Cronbach's α was assessed to evaluate the internal consistency of the scale. The correlations between the lower limb activity (the mean of right and left ankle movement indices) and individual item scores and mean SAS scores were analysed. Differences between the NIP and non-NIP, as well as the NIMD and the non-NIMD groups in the SAS mean score and lower limb activity were analysed. The performance of SAS mean score and individual item scores in case identification was evaluated by receiver operating characteristics (ROC) analyses against DSM-IV NIP diagnosis. Validity coefficients (specificity, sensitivity, positive and negative predictive value [PPV and NPV, respectively]) for different mean SAS score thresholds were calculated. To explore the discriminatory power of each single SAS item we performed ROC analyses for each item separately. We also explored the effect on the validity coefficients of merging the six rigidity items of SAS into one single item, to de-emphasise the influence of rigidity on the mean SAS score. The Spearman test was used to correlation analysis and the Mann-Whitney 2-tailed U-test for the comparison between two groups because of the non-normal distribution of the data. The software used in analyses was SPSS 11.0. .
Of the 99 participants, 45 (45.5%) were male and 54 (54.5%) female. The mean age was 49.7 (SD 9.5) years. The mean continuous treatment in hospital or in nursing home was 13.6 (SD 9.0) years. Seventy-nine (79.8%) patients used conventional antipsychotics (70 on low-dose, and 9 on high-dose neuroleptics) and 20 (20.2%) used clozapine (one was receiving clozapine combined with sulpiride). Low-dose antipsychotics in this study were haloperidol, cyclopentixol, perphenazine and fluphenazine; high dose antipsychotics were chlorpromazine, thioridazine, levomepromazine, chlorprotixen and sulpiride. Sixteen (16.2%) patients were receiving combinations of typical antipsychotics (either predominantly low-dose [N = 10] or predominantly high-dose [N = 6] neuroleptic regimens), and 63 (63.6%) were receiving monotherapy (haloperidol: N = 29; zuclopenthixol: N = 28; perphenazine, chlorpromazine, or thioridazine: N = 6). No new atypical antipsychotics were used. The mean daily chlorpromazine equivalent conditions. The prevalence of any NIMD according to DSM-IV was 61.6% in the whole sample. Cronbach's α for SAS was 0.79. dose  was 328 (SD 221) mg. The prevalence of NIP according to DSM-IV criteria was 23.2%. Fourteen patients, all from non-NIP subgroup, used an anticholinergic drug (trihexyphenidyl). Only 10 of the 23 patients with NIP presented as pure NIP without comorbidity of other motor disorders. Among patients with NIP, 10 had comorbid akathisia and 6 tardive dyskinesia; three of them had all three The SAS mean score correlated significantly with age in our population (r = 0.203, p = 0.044).
Convergence of SAS and actometry to DSM-IV NIP diagnosis
Mean scores of Simpson-Angus Scale (SAS) items in Neuroleptic-Induced Parkinsonism (NIP) group and non-NIP group.
Mean of SAS items
Actometric data was missing for one male patient due to non-co-operation. The median lower limb activity for NIP patients was not significantly higher than that of non-NIP patients (U = -0.46, p = 0.643). The median lower limb activity for NIMD patients was significantly higher from that of non-NIMD patients (U=-2.66, p = 0.008).
Convergence of SAS to actometry
The SAS mean score did not correlate significantly with actometric lower limb activity either in the whole population (r = 0.04, p = 0.717), in the NIP group (r = -0.29, p = 0.192), or in the pure NIP subgroup (r = -0.21, p = 0.587). Even after a post-hoc analysis of co-variance in the whole population, where the effect of akathisia (BARS global score) and tardive dyskinesia (AIMS severity score) were controlled for, no significant correlation between SAS mean score and the lower limb activity could be found (r = 0.07, p = 0.494).
The tremor item of the SAS correlated significantly with the lower limb activity in the whole population (r = 0.25, p = 0.013) but not in the NIP population (r = 0.26, p = 0.248) or in the pure NIP subgroup (r = 0.51, p = 0.160). No correlation was evidenced between the hypokinesia item of the SAS and lower limb activity in the whole population (r = -0.07, p = 0.513) either in NIP population (r = -0.24, p = 0.290) or in pure NIP subgroup (r = -0.37, p = 0.797).
No correlation was evidenced between the mean of rigidity items of the SAS and lower limb activity in the whole population (r = -0.12, p = 0.256) either in NIP population (r = -0.37, p = 0.090) or in pure NIP subgroup (r = -0.30, p = 0.426).
NIP case finding by SAS
Validity coefficients of the Simpson-Angus Scale (SAS) mean score at different cutoff values. The optimal cut-off point range is presented in bold text.
SAS mean cut-off
Positive Predictive Value
Negative Predictive Value
ROC-curve for screening performance of SAS mean with single averaged rigidity item was clearly inferior to the original SAS mean curve with AUC of 0.80 (CI = 0.70–0.89).
Area under the ROC curve of Simpson-Angus Scale (SAS) parameters against DSM-IV diagnosis of Neuroleptic-Induced Parkinsonism.
Area under the ROC curve
Mean of rigidity items
Mean of mean rigidity items and other SAS items
Mean of SAS items
As SAS elbow rigidity item had case finding power similar to SAS mean score, we calculated optimal cut-off for this item. Cut-off threshold of 1.5, with sensitivity of 0.826 and specificity of 0.974, was superior to cut-off threshold of 0.5 with sensitivity of 0.957 and specificity 0.553.
Our study aimed to evaluate some of the characteristics of the SAS and its utility for identifying and measuring NIP in a naturalistic schizophrenia sample. The internal consistency of SAS was satisfactory, which suggests sufficient reliability for the scale. We compared the SAS with the DSM-IV to assess its discriminant validity and evaluate it in detecting NIP cases. The comparison with objective movement assessment aimed to estimate the concurrent validity of SAS in NIP severity measurement.
As expected, the SAS had discriminant validity for a clinical diagnosis of NIMD. SAS mean score discriminated NIMD patients well from those without NIMD, and more specifically, also NIP patients from other patients. Actometry discriminated NIMD patients from non-NIMD patients, but did not identify DSM-IV NIP patients.
According to ROC analysis the SAS had good case finding properties converging with the DSM IV NIP diagnosis. In our population the commonly used threshold 0.3 was inappropriate: according to our results the optimal cut-off point should be between 0.65 – 0.95 depending on the emphasis in the trade-off between sensitivity and specificity. We suggest that the new cut-off value for screening NIP could be 0.65, whereby specificity could be doubled without loosing any sensitivity. To be useful for diagnostic purposes a combination of high specificity and high positive predictive value (PPV) is reached at cut-off – 0.75 . To answer to criticism about the overrepresentation of rigidity items, we averaged the six items into one item. This procedure worsened the NIP case detection capacity of the SAS.
Using the single elbow rigidity item for case detection had the same (or slightly better) case detection capacity as the SAS mean score. This finding supports the use of elbow rigidity testing when assessing parkinsonism in clinical settings, as cut-off value 0.5 has good sensitivity and specificity for DSM-IV NIP.
We found that SAS mean score did not correlate with actometric lower limb activity, and hypokinesia observed during gait item of SAS did not correlate with actometric motor activity during the 30-minute recording. There are a few explanations for that:
First, actometry measures only the productive motor dimension of the parkinsonian symptoms while SAS takes into account also rigidity, gait, salivation and glabella tap, with a clear emphasis on rigidity. Lack of correlation with actometric findings in NIP subgroup indicates that tremor may not be the core feature of NIP. This is also supported by the small AUC for the tremor item of SAS.
Secondly, we used lower-limb actometry while the clinical assessment by SAS and DSM-IV considered predominantly upper limbs. Parkinsonism may be more symptomatic in upper limbs, and the upper limb disturbances may have influenced our SAS and DSM IV assessments more than lower limb disturbances. Our findings indicate that lower limb actometry is not suitable for diagnosing NIP.
Thirdly, diurnal naturalistic actometry may have more power in detecting hypokinesia.
This study was limited to a few aspects of utility/validity of the SAS: internal consistency, convergence to DSM-IV NIP diagnosis and convergence to objectively measured motor activity. Many aspects of the scale's reliability (e.g. test-retest and inter-rater reliability) and validity (e.g. construct) were not evaluated.
DSM-IV was used as a standard in this study, but there is not much data available on the validity of NIP criteria of the DSM-IV. A better golden standard in this study would probably have been an expert-consensus diagnosis. Furthermore, as there was only one rater for the scales, a cross-scale contamination issue might have occurred.
It is known that with age the prevalence of spontaneous NIMD rises. Our material did not allow a thorough examination of the issue, but age correlated with SAS mean score in our sample.
The measurement of motor activity here was purely quantitative; we did not assess the patterns of the disordered movements.
As a conclusion, SAS seems be a reliable and a valid instrument. It performs well and similarly to DSM-IV in NIP case detection. The optimal SAS mean score cut-off value in a naturalistic population of neuroleptic-treated schizophrenia patients is higher than the commonly used 0.3. We suggest that the new cut-off value for screening NIP could be 0.65, whereby specificity could be doubled without loosing sensitivity. Combining SAS rigidity items does not seem to improve the performance of the scale.
The study was supported by a grant from Finska Läkaresällskapet (Finnish Medical Society) (KW) and the Eli Lilly (Suisse) S.A. Estonian Affiliate (SJ).
- Van Harten PN, Matroos GE, Hoek HW, Kahn RS: The prevalence of tardive dystonia, tardive dyskinesia, parkinsonism and akathisia: the Curacao Extrapyramidal Syndromes Study. I Schizophr Res. 1996, 19: 195-203. 10.1016/0920-9964(95)00096-8.View ArticlePubMedGoogle Scholar
- McCreadie RG: The Nithsdale Schizophrenia Survey: II: abnormal movements. Br J Psychiatry. 1982, 140: 587-590.View ArticlePubMedGoogle Scholar
- McCreadie RG, Robertson LJ, Wiles DH: The Nithsdale Schizophrenia Surveys. IX: akathisia, parkinsonism, tardive dyskinesia and plasma neuroleptic levels. Br J Psychiatry. 1992, 160: 793-799.View ArticlePubMedGoogle Scholar
- Modestin J, Stephan PL, Erni T, Umari T: Prevalence of extrapyramidal syndromes in psychiatric inpatients and the relationship of clozapine treatment to tardive dyskinesia. Schizophr Res. 2000, 42: 223-230. 10.1016/S0920-9964(99)00133-4.View ArticlePubMedGoogle Scholar
- Muscettola G, Barbato G, Pampallona S, Cashello M, Bollini P: Extrapyramidal syndromes in neuroleptic-treated patients: prevalence, risk factors, and association with tardive dyskinesia. J Clin Psychopharmacol. 1999, 19: 203-208. 10.1097/00004714-199906000-00002.View ArticlePubMedGoogle Scholar
- Chouinard G: New nomenclature for drug-induced movement disorders including tardive dyskinesia. J Clin Psychiatry. 2004, 65 (Suppl 9): 9-15.PubMedGoogle Scholar
- Prosser ES, Csernansky JG, Kaplan J, Thiemann S, Becker TJ, Hollister LE: Depression, Parkinsonian symptoms, and negative symptoms in schizophrenics treated with neuroleptics. J Nerv Ment Dis. 1987, 175 (2): 100-105.View ArticlePubMedGoogle Scholar
- American Psychiatric Association: Diagnostic and Statistical Manual of Mental Disorders. 2000, Washington DC: American Psychiatric Press, 4Google Scholar
- May PRA, Lee MA, Bacon RC: Quantitative assessment of neuroleptic-induced extrapyramidal symptoms: Clinical and nonclinical approaches. Clin Neuropharmacol. 1983, 6 (S1): S35-S51.View ArticlePubMedGoogle Scholar
- Teicher MH: Actigraphy and motion analysis: new tools for psychiatry. Harv Rev Psychiatry. 1995, 3 (1): 18-35.View ArticlePubMedGoogle Scholar
- Hoff JI, van Hilten BJ, Roos RA: A review of the assessment of dyskinesias. Mov Disord. 1999, 14 (5): 737-43. 10.1002/1531-8257(199909)14:5<737::AID-MDS1005>3.0.CO;2-A.View ArticlePubMedGoogle Scholar
- Tuisku K: Motor activity measured by actometry in neuropsychiatric disorders. Academic dissertation. 2002, Helsinki: Helsinki University PressGoogle Scholar
- Simpson GM, Angus JWS: A rating scale for extrapyramidal side effects. Acta Psychiatr Scand. 1970, 11-19. Suppl 212
- Loonen AJM, Doorschot CH, Hemert DA, Oostelbos MCJM, Sijben AES, MASEAS Team: The scedule for the assessment of drug-induced movement disorders (SADIMoD): test-retest reliability and concurrent validity. Int J Neuropsychopharmacol. 2000, 3: 285-296. 10.1017/S1461145700002066.View ArticlePubMedGoogle Scholar
- Sweet RA, DeSensi , Zubenko GS: Reliability and applicability of movement disorder rating scales in the elderly. J Neuropsychiatry Clin Neurosci. 1993, 5: 56-60.View ArticlePubMedGoogle Scholar
- Caligiuri MP, Lacro JP, Jeste DV: Incidence and predictors of drug-induced parkinsonism in older psychiatric patients treated with very low doses of neuroleptics. J Clin Psychopharmacol. 1999, 19 (4): 322-328. 10.1097/00004714-199908000-00007.View ArticlePubMedGoogle Scholar
- Janno S, Holi MM, Tuisku K, Wahlbeck K: Prevalence of neuroleptic-induced movement disorders in chronic schizophrenia patients. Am J Psychiatry. 2004, 161: 160-163. 10.1176/appi.ajp.161.1.160.View ArticlePubMedGoogle Scholar
- Jankovic J, Frost JD: Quantitative assessment of parkinsonian and essential tremor: clinical application of triaxial actometry. Neurology. 1981, 31: 1235-40.View ArticlePubMedGoogle Scholar
- van Someren EJ, Vonk BF, Thijssen WA, Speelman JD, Schuurman PR, Mirmiran M, Swaab DF: A new actigraph for long-term registration of the duration and intensity of tremor and movement. IEEE Trans Biomed Eng. 1998, 45 (3): 386-95. 10.1109/10.661163.View ArticlePubMedGoogle Scholar
- Fujikane M, Katayama S, Hirata K, Yokota N: Objective measurement of motor activity in Parkinson's disease by actigraphy (english abstract). Nippon Rinsho – Japanese J Clin Medicine. 1997, 55 (1): 153-7.Google Scholar
- Tuisku K, Lauerma H, Holi MM, Markkula J, Rimon R: Measuring neuroleptic-induced akathisia by three-channel actometry. Schiz Res. 1999, 40: 105-110. 10.1016/S0920-9964(99)00045-6.View ArticleGoogle Scholar
- Janno S, Holi MM, Tuisku K, Wahlbeck K: Comparison of actometry and Barnes Akathisia Rating Scale (BARS) in neuroleptic-induced akathisia. Eur Neuropsychopharmacol. 2005, 15 (1): 39-41. 10.1016/j.euroneuro.2004.05.003.View ArticlePubMedGoogle Scholar
- Barnes TRE: A rating scale for drug-induced akathisia. Br J Psychiatry. 1989, 154: 672-676.View ArticlePubMedGoogle Scholar
- Munetz M, Benjamin S: How to examine patients using the Abnormal Involuntary Movement Scale. Hosp Community Psychiatry. 1988, 39: 1172-1177.PubMedGoogle Scholar
- SPSS Inc: Chicago, Illinois, USA. 1989Google Scholar
- Bazire S: Psychotropic drug directory. 2000, Dinton: Quay BooksGoogle Scholar
- Naarding P, Leentjens AFG, van Kooten F, Verhey FRJ: Disease-specific properties of the Hamilton rating scale for depression in patients with stroke, Alzheimer's dementia, and Parkinson disease. J Neuropsychiatry Clin Neurosci. 2002, 14: 329-334.View ArticlePubMedGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2377/5/5/prepub