- Research article
- Open Access
- Open Peer Review
The Turkish validation of the Brief International Cognitive Assessment for Multiple Sclerosis (BICAMS) battery
BMC Neurologyvolume 17, Article number: 208 (2017)
Cognitive impairment may be seen in as many as 43–70% of patients with multiple sclerosis (MS) and may be observed in all MS subtypes. The Brief International Cognitive Assessment in Multiple Sclerosis (BICAMS) battery may be used to evaluate cognition status. The purpose of the current study is to validate the BICAMS battery in Turkish.
Patients with MS attending our clinic between September 2014 and April 2015 were invited to participate. Healthy control participants were matched in terms of age, gender and years of education.
One hundred seventy-three MS patients and 153 healthy control participants were enrolled in the study. MS patients performed significantly worse in all trials than the members of the healthy control group. In addition, cognitive dysfunction was identified in 78 of the 173 (45.1%) patients. In the MS with cognitive impairment group, 64 out of 151 (42.4%) subjects were RRMS patients, 12 out of 18 (66.7%) were secondary progressive MS patients, and 2 out of 4 (50%) were primer progressive MS patients.
The BICAMS has been proposed for assessing cognitive impairment in MS patients. This study shows that the battery is suitable for use in Turkey.
Cognitive impairment is common in multiple sclerosis (MS), and approximately half of patients with MS present with cognitive impairment that adversely impacts on aspects of both patients’ and caregivers’ everyday lives [1, 2]. It is demonstrable in all disease stages and subtypes, in up to 40% of newly diagnosed individuals with clinically isolated syndrome and relapsing remitting MS (RRMS)  and in up to 60% of those with secondary progressive MS (SPMS) . It can have a significant impact on quality of life and can influence employment status, physical independence, communications, treatment adherence and even rehabilitation benefit . The assessment of MS-related cognitive decline has received increasing attention in recent decades. Many different neuropsychological batteries have been proposed. However, the Brief Repeatable Battery of Neuropsychological tests (BRB-N)  and the Minimal Assessment of Cognitive Function in MS (MACFIMS) [4, 6] are the most popular tools. While both batteries are known to be highly specific for the evaluation of cognitive impairment in MS patients, their implementation in everyday clinical practice remains limited due to their high time demands (at least 45 min are required for BRB-N and 90 min for MACFIMS) and the need for surveillance and interpretation by specialist neuropsychologists [4,5,6,7]. Various neuropsychological batteries have been proposed for the assessment of cognitive impairment in MS as the interest in this area has increased over recent years. The Brief International Cognitive Assessment in Multiple Sclerosis (BICAMS) was proposed by an expert panel as a tool for brief cognitive monitoring of MS patients in clinical settings in 2012 . It can be administered by healthcare professionals without any formal neuropsychological training to identify early or subtle cognitive impairment. The BICAMS battery is a fast, reliable, sensitive and specific tool that has been validated and applied in many countries [9,10,11,12,13,14]. The primary objective of our study was the cross-cultural validation of the BICAMS battery to Turkish. The secondary objective was to measure the impact of cognitive impairment on patients’ quality of life and the effect of fatigue on patients’ cognitive state by assessing correlations between BICAMS performance and the Modified Fatigue Impact Scale (MFIS) and the Multiple Sclerosis International Quality of Life (MUSIQoL) questionnaire.
Patients with a diagnosis of MS according to the 2010 revised McDonald criteria  attending our clinic between September, 2014, and April, 2015, were invited to participate. Patients were recruited cross-sectionally, and no pre-selection was applied for cognitive impairment. The inclusion criteria were age over 18 years, the ability to give informed consent, neurological stability with no evidence of relapse, being steroid and/or plasmapheresis-free for at least 4 weeks preceding enrollment, and proficiency in the Turkish language. Patients were excluded if they had a current or previous neurological disorder other than MS, a current psychiatric disorder unrelated to that diagnosis, a coexistent medical condition that might influence cognition, a previous history of developmental disorder unrelated to MS, a history of learning disability, any vision or hearing problems that might influence performance on the tests, or a current or past history of alcohol or drug abuse. Control participants were recruited from unaffected relatives or friends of MS patients or from other individuals attending the neurology outpatient clinic for other reasons, such as migraine or vertigo. All relatives were matched in terms of age, gender and years of education. All patients and all healthy control subjects provided verbal informed consent to participation in the study. Approval for the research project was granted by the Ethics Committee of Dokuz Eylul University of Izmir.
Study instruments and procedures
The methodology employed followed the recommendations for BICAMS national validation (step 1; standardization and translation of test stimuli, step 2; standardization and translation of test instructions, step 3; normalization, step 4; test-retest reliability, step 5; criterion-related validity) . Age, sex, handedness, years of education, occupation and employment status were recorded for all participants. In the MS group, disease subtype, expanded disability status scale (EDSS)  and disease duration from onset of symptoms were also noted. Depression was assessed using the Beck Depression Inventory (BID) , and the (MFIS)  was used to measure fatigue.
All participants were administered the BICAMS, and test re-test reliability was confirmed for all patients and controls. The BICAMS is composed of the Symbol Digit Modalities Test (SDMT), California Verbal Learning Test (CVLT-II) and Brief Visuospatial Memory Test Revised (BVMTR) . The SDMT measures the working memory and information processing speed. It consists of nine symbols, each representing a number from 1 to 9. These pairs are visible in a key at the top of an A4-size page. Below are a number of rows of the same symbols arranged in random order. After a short practice session, subjects are asked to match as many of the symbols with the digits as they can in 90 s. The answers can be written or orally. We used the oral version, and number of correct answers recorded within 90 s .
The CVLT-II is composed of a list of 16 words in 4 semantic categories. The examiner reads out the list of words at a steady pace of in approximately 20 s. The patient listens to the complete list and is then asked to repeat as many of the words as possible, in any order, which the examiner records on a piece of paper. Five trials in total are performed, and the final score is composed of the total number of words recorded across these trials. On each occasion the patient is asked to remember the answers given in the preceding trial. The BVMT-R consists of 6 abstract symbols on an A4-size page. Patients are given 10 s to look at the page, which is then removed from view. They are then asked to draw as many symbols as they can remember in the order given on a blank page. These symbols are then scored from 0 to 2, depending on accuracy and location. This is performed 3 times, and the total score consists of the sum of scores from all 3 trials.
Quality of life (QoL) was assessed using the MUSIQoL questionnaire . This consists of 31 questions in 9 dimensions (subscales): activities of daily living (8 items), psychological well-being (4), symptoms (4), relationships with friends (3), relationships with family (3), sentimental and sexual life (2), coping (2), rejection (2), and relationships with the healthcare system (3). The index score is computed as the mean of these subscale scores. We used only the index score, which was linearly transformed and standardized on a 0 to 100 scale, where 0 indicates the worst possible level of QoL and 100 indicates the best possible level. The MFIS battery consists of 40 questions (3 subscales; social functions, physical functions and cognitive functions). Each question is scored from 0 (minimal problems) to 4 (severe) .
Comparisons between groups were performed using paired-sample t-tests and the Mann–Whitney U test for continuous variables where appropriate. The chi square test was used for categorical variables. Normal distribution of data was verified using the Shapiro-Wilk test. Multinomial logistic regression was performed to evaluate associations among the individual neuropsychological tests, and depression, education status, disability level, duration of the disease, and the relapse rate. Correlation of BICAMS test-retest scores was evaluated using Pearson correlation coefficient r. Statistical analysis was performed on SPSS 15.0 software. Statistical significance was set at p < 0.05.
One hundred seventy-three MS patients and 153 healthy controls were recruited to the study. Baseline characteristics are outlined in Table 1. Of the MS patient group, 151 (87.3%) were classified as having RRMS, 18 (10.4%) with SPMS and 4 (2.3%) with primary progressive MS (PPMS). Mean EDSS scores were 2.1 (SD: 1.1), 4.6 (SD: 1.5) and 5.3 (SD: 1.6), respectively, with disease durations of 7.1 (SD: 5.6), 14.9 (SD: 9.1) and 11.5 (SD: 8.4) years. Table 2 shows the group data and the differences between the patient and healthy groups’raw scores in all 3 trials and during the retests. The MS patients performed significantly worse in all trials than the members of the healthy group. As no validated threshold of cognitive impairment for BICAMS was available, we identified the 5th percentile on each performance of the healthy group in order to evaluate how many MS patients were impaired on each of the three components of BICAMS. Based on the proposed criterion of one or more test performances being below the 5th percentile of the healthy controls’ performance, we identified cognitive dysfunction in 78 of the 173 (45.1%) patients. Of the MS with cognitive impairment group, 64 out of 151 (42.4%) subjects were RRMS patients, 12 out of 18 (66.7%) were SPMS patients, and 2 out of 4 (50%) were PPMS patients. When the MS group was further subdivided into RRMS and progressive MS (SPMS and PPMS) groups, statistically significant differences were observed between the groups in each of the individual tests (p˂0.05). Using the cut-off of one or more impaired tests, 41.7% of the RRMS and 77.3% of the progressive MS patients met the criterion for cognitive impairment. Table 3 summarizes the results and the estimation of impaired MS patients on one, two, and three tests.
When the patient group was subdivided in terms of disease duration, 36.6% of those diagnosed < 10 years previously (45 out 14 of 123) and 64% diagnosed ≥10 years (32 out of 50) previously also met the criterion for cognitive impairment (data not shown). Significant negative correlations were determined between SDMT scores and EDSS (r = −0.46, p = 0.003), and between CVLT II 17 scores and EDSS (r = −0.4, p = 0.024). No significant correlation was determined with BVMT-R (r = −0.24, p > 0.05). As expected, higher rates of unemployment were seen amongst the patient population compared to the control participants. We also determined higher rates of unemployment or inability to work due to MS in patients with cognitive impairment (34 vs 11 patients, respectively, p0.05). The test-retest interval was calculated as a median value of 15 days, with a mean value of 14.2 ± 4 days (10–21 days). We evaluated the difference between the patient and the healthy group test-retest scores (Table 4). Table 4 shows that the r values in the patient group were higher than those of the healthy controls (r = 0,814 vs r = 0,714).
In order assess the impact of fatigue on patients’ cognitive status, we examined the correlations between their scores during the BICAMS battery and the MFIS battery scores. We determined significant negative correlations between the patients’ overall subjective fatigue scores and their cognitive performance in all parts of the BICAMS (Table 5). The decline in cognitive functions measured by the BICAMS correlated best with the cognitive dimension subscale of the MFIS, followed by the physical subscale. We only determined meaningful correlation between the SDMT and the social subscale of the MFIS. As shown in Table 6, cognitive impairment correlated significantly with all MUSIQoL subscales. The most prominent correlations were with “activities of daily living”, “psychological well-being” and “sentimental and sexual life”.
The assessment of cognitive status and characterization of damaged domains are useful for all MS patients in terms of appropriate rehabilitation, vocational counseling, and quantification of disability, beginning from the initial stages of the disease. It is now recognized that assessments and follow-ups should be as much as a priority as the evaluation of physical disability. Many diagnostic batteries have been used for these purposes. The most commonly used batteries of neuropsychological tests in MS are the BRB-N and MACFIMS, which are accurate, but may be time-consuming to administer. These batteries are not, therefore, suitable for everyday clinical practice, especially in centers without a resident neuropsychologist.
There is a need for a brief cognitive assessment tool with adequate reliability, validity, specificity and sensitivity, capable of provide comprehensive and accurate cognitive evaluations. The BICAMS has been proposed for assessing cognitive impairment in MS patients [8, 16]. The BICAMS battery can be used in small MS centers without a resident neuropsychologist . Translation and validation studies of the BICAMS battery are currently being performed in several countries.
In our study, we assessed the cognitive status of MS patients using the Turkish translation of the BICAMS and measured the impact of cognitive impairment on the demographic and clinical characteristics. In our validation process, we observed significant differences in all tests between the MS group and the healthy group. The most significant difference was determined in the SDMT. We also determined strong correlations (p < 0.001) when assessing the test-retest reliability in both the patient and HC groups. Correlations were stronger in the patient group (r > 0.8) than in the HC group (r between 0.7 and 0.8).
In agreement with many other studies [3, 23], level of disability and duration of disease were associated with severity of cognitive impairment in the present research. However, some studies have also reported that duration of disease was not correlated with cognitive impairment . Unemployment or inability to work due to MS was also correlated with cognitive impairment. Although patients often report that fatigue impairs their cognitive abilities , the majority of studies have failed to identify any correlation between fatigue and cognitive involvement [25,26,27,28,29]. But, fatigue has been reported to be capable of an adverse impact on patients’ cognition [12, 30]. We observed significant negative correlations between patients’ overall subjective fatigue scores and their cognitive performance in all parts of the BICAMS. Sandi et al. reported that all FIS scores exhibited meaningful negative correlations with patients’ BICAMS performances. The strongest correlation was determined in SDMT . In terms of the FIS subscales, they observed that the physical subscale exhibited the strongest correlation with cognitive status, while the cognitive subscale exhibited meaningful correlation both the SDMT and the CVLT-II tests. In our study, however, the decline in cognitive functions measured using BICAMS correlated best with the cognitive dimension subscale of the FIS, followed by the physical subscale. The SDMT was only significantly correlated with the FIS social subscale.
Several studies have reported that a decline in cognitive status is associated with poorer QoL [12, 31, 32]. Our study yielded similar results. All MUSIQoL subscales exhibited significant correlation with scores on the BICAMS battery. The most prominent correlations were with “activities of daily living”, “psychological well-being” and “sentimental and sexual life”. Sexual life is the subscalemost commonly correlated with cognitive status in ours and previous studies [12, 31,32,33,34].
The BICAMS is useful as a monitoring test for identifying MS patients with cognitive impairment. The Turkish version of the BICAMS is a short, easily administered, and specific tool for the clinical evaluation of cognitive impairment in MS patients, and is as reliable as the original English version. However, there are a number of limitations to our study. Some of the healthy control group being relatives of MS patients may be one such limitation, because there is a known greater incidence of MS in the relatives of MS patients. However, no significant difference was determined between this control subgroup and the other healthy control group in any tests. Moreover, alternative forms were used for the BVMT-R and SDMT testretest applications in order to avoid the practice effect. However, since there is only one CVLTII form, that single form was used. This may have led to a practice effect for CVLTII, and may constitute a limitation.
The present study contained the highest number of patients and healthy subjects to date. We want to emphasize that fatigue can have a negative effect on patients’ cognitive status, while cognitive impairment can impact on employment status among patients with MS.
Brief International Cognitive Assessment In Multiple Sclerosis
Beck depression ınventory
Brief repeatable battery of neuropsychological test
Brief visuospatial memory test revised
California verbal learning test
Expanded disability status scale
Minimal assessment of cognitive function in multiple sclserosis
Modified fatigue ımpact scale
Multiple sclerosis ınternational quality of life
Primary progressive multiple sclerosis
Relapsing remitting multiple sclerosis
Symbol digit modalities test
Secondary progressive multiple sclerosis
Chiaravalloti ND, DeLuca J. Cognitive impairment in multiple sclerosis. Lancet Neurol. 2008;7:11391151.
Langdon DW. Cognition in multiple sclerosis. Curr Opin Neurol. 2011 Jun;24(3):244–9.
Amato MP, Portaccio E, Goretti B, Zipoli V, Iudice A, Della Pina D, Malentacchi G, Sabatini S, Annunziata P, Falcini M, Mazzoni M, Mortilla M, Fonda C, De Stefano N, TuSCIMS Study Group. Relevance of cognitive deterioration in early relapsing-remitting MS: a3-year follow-up study. MultScler. 2010;16:1474–82.
Benedict RH, Cookfair D, Gavett R, Gunther M, Munschauer F, Garg N, Weinstock-Guttman B. Validity of the minimal assessment of cognitive function in multiple sclerosis (MACFIMS). J Int Neuropsychol Soc. 2006;12(4):549–58.
Rao SM. A manual for the brief repeatable battery of neuropsychological tests in multiple sclerosis. Milwaukee: Medical College of Wisconsin; 1990.
Benedict RH, Fischer JS, Archibald CJ, Arnett PA, Beatty WW, Bobholz J, Chelune GJ, Fisk JD, Langdon DW, Caruso L, Foley F, LaRocca NG, Vowels L, Weinstein A, DeLuca J, Rao SM, Munschauer F. Minimal neuropsychological assessment of MS patients: a consensus approach. Clin Neuropsychol. 2002;16(3):381–97.
Takeda A. Neuropsychological tests in multiple sclerosis. Nihon Rinsho. 2014;72(11):1989–94.
Langdon DW, Amato MP, Boringa J, Brochet B, Foley F, Fredrikson S, Hämäläinen P, Hartung HP, Krupp L, Penner IK, Reder AT, Benedict RH. Recommendations for a brief international cognitive assessment for multiple sclerosis (BICAMS). Mult Scler. 2012;18:891–8.
Walker LA, Osman L, Berard JA, Rees LM, Freedman MS, MacLean H, Cousineau D. Brief international cognitive assessment for multiple sclerosis (BICAMS): Canadian contribution to the international validation project. J Neurol Sci. 2016;362:147–52.
Giedraitienė N, Kizlaitienė R, Kaubrys G. The BICAMS battery for assessment of LithuanianSpeaking multiple sclerosis patients: relationship with age, education, disease disability, and duration. Med Sci Monit. 2015;21:3853–9.
O'Connell K, Langdon D, Tubridy N, Hutchinson M, McGuigan C. A preliminary validation of the brief international cognitive assessment for multiple sclerosis (BICAMS) tool in an Irish population 40 with multiple sclerosis (MS). Mult Scler Relat Disord. 2015;4(6):521–5.
Sandi D, Rudisch T, Füvesi J, Fricska-Nagy Z, Huszka H, Biernacki T, Langdon DW, Langane É, Vécsei L, Bencsik K. The Hungarian validation of the brief international cognitive assessment for multiple sclerosis (BICAMS) battery and the correlation of cognitive impairment with fatigue and quality of life. Mult Scler Relat Disord. 2015;4(6):499–504.
Spedo CT, Frndak SE, Marques VD, Foss MP, Pereira DA, Carvalho Lde F, Guerreiro CT, Conde RM, Fusco T, Pereira AJ, Gaino SB, Garcia RB, Benedict RH, Barreira AA. Cross-cultural adaptation, reliability, and validity of the BICAMS in Brazil. Clin Neuropsychol. 2015;29(6):836–46.
Dusankova JB, Kalincik T, Havrdova E, Benedict RH. Cross cultural validation of the minimal of cognitive function in multiple sclerosis (MACFIMS) and the brief international cognitive assessment for multiple sclerosis (BICAMS). Clin Neuropsychol. 2012;26(7):1186–200.
Polman CH, Reingold SC, Banwell B, Clanet M, Cohen JA, Filippi M, Fujihara K, Havrdova E, Hutchinson M, Kappos L, Lublin FD, Montalban X, O'Connor P, Sandberg-Wollheim M, Thompson AJ, Waubant E, Weinshenker B, Wolinsky JS. Diagnostic criteria for multiple sclerosis: 2010 revisions to the McDonald criteria. Ann Neurol. 2011;69(2):292–302.
Benedict RH, Amato MP, Boringa J, Brochet B, Foley F, Fredrikson S, Hamalainen P, Hartung H, Krupp L, Penner I, Reder AT, Langdon D. Brief international cognitive assessment for MS (BICAMS): international standards for validation. BMC Neurol. 2012;12:55.
Kurtzke JF. Disability rating scales in multiple sclerosis. Ann N Y Acad Sci. 1984;436:347–60.
Beck AT, Steer RA, Brown GK. Beck depression inventory-second edition manual. San Antonio: The Psychological Corporation S; 1996.
Schwid SR, Covington MMSB, Segal BM, Goodman AD. Fatigue in multiple sclerosis: current understanding and future directions. J Rehabil Res Dev. 2002;39(2):211–24.
Smith A. Symbol digit modalities test manual. Los Angeles: Western Psychological Services; 1982.
Simeoni M, Auquier P, Fernandez O, Flachenecker P, Stecchi S, Constantinescu C, Idiman E, Boyko A, Beiske A, Vollmer T, Triantafyllou N, O'Connor P, Barak Y, Biermann L, Cristiano E, Atweh S, Patrick D, Robitail S, Ammoury N, Beresniak A, Pelletier J, MusiQol study group. Validation of the multiple sclerosis international quality of life questionnaire. Mult Scler. 2008;14:219–30.
Goverover Y, Chiaravalloti N, DeLuca J. Brief international cognitive assessment for multiple sclerosis (BICAMS) and performance of everyday life tasks: actual reality, multiple 17. Sclerosis Journal. 2015;
Smestad C, Sandvik L, Landrø NI, Celius EG. Cognitive impairment after three decades of multiple sclerosis. Eur J Neurol. 2010;17(3):499–505.
Krupp LB, Alvarez LA, LaRocca NG, Scheinberg LC. Fatigue in multiple sclerosis. Arch Neurol. 1988;45(4):435–7.
Johnson SK, Lange G, DeLuca J, Korn LR, Natelson B. The effects of fatigue on neuropsychological performance in patients with chronic fatigue syndrome, multiple sclerosis, and depression. ApplNeuropsychol. 1997;4(3):145–53.
Paul RH, Beatty WW, Schneider R, Blanco CR, Hames KA. Cognitive and physical fatigue in multiple sclerosis: relations between self-report and objective performance. Appl Neuropsychol. 1998;5(3):143–8.
Bailey A, Channon S, Beaumont JG. The relationship between subjective fatigue and cognitive fatigue in advanced multiple sclerosis. Mult Scler. 2007;13(1):73–80.
Bol Y, Duits AA, Hupperts RM, Verlinden I, Verhey FR. The impact of fatigue on cognitive functioning in patients with multiple sclerosis. Clin Rehabil. 2010;24(9):854–62.
Morrow SA, Drake A, Zivadinov R, Munschauer F, Weinstock-Guttman B, Benedict RH. Predicting loss of employment over three years in multiple sclerosis: clinically meaningful cognitive decline. Clin Neuropsychol. 2010;24(7):1131–45.
Andreasen AK, Spliid PE, Andersen H, Jakobsen J. Fatigue and processing speed are related in multiple sclerosis. Eur J Neurol. 2010;17(2):212–8.
Mitchell AJ, Benito-León J, González JM, Rivera-Navarro J. Quality of life and its assessment in multiple sclerosis: integrating physical and psychological components of well-being. Lancet Neurol. 2005;4(9):556–66.
Glanz BI, Holland CM, Gauthier SA, Amunwa EL, Liptak Z, Houtchens MK, Sperling RA, Khoury SJ, Guttmann CR, Weiner HL. Cognitive dysfunction in patients with clinically isolated syndromes or newly diagnosed multiple sclerosis. Mult Scler. 2007;13(8):1004–10.
Benito-León J, Morales JM, Rivera-Navarro J. Health-related quality of life and its relationship to cognitive and emotional functioning in multiple sclerosis patients. Eur J Neurol. 2002;9(5):497–502.
Turpin KV, Carroll LJ, Cassidy JD, Hader WJ. Deterioration in the health-related quality of life of persons with multiple sclerosis: the possible warning signs. Mult Scler. 2007;13(8):1038–45.
This study was sponsored by the Multiple Sclerosis Research Society, to whom we are most grateful. We would also like to thank all the patients and members of the healthy control group for their co-operation in the validation process.
The authors declared that no grants were involved in supporting this work.
Availability of data and materials
The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.
Ethics approval and consent to participate
All patients and all healthy control subjects provided verbal informed consent to participation in the study. Approval for the research project was granted by the Ethics Committee of Dokuz Eylul University of Izmir.
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.