- Research article
- Open Access
- Open Peer Review
The brief international cognitive assessment for multiple sclerosis (BICAMS): normative values with gender, age and education corrections in the Italian population
BMC Neurology volume 14, Article number: 171 (2014)
BICAMS (Brief International Cognitive Assessment for Multiple Sclerosis) has been recently developed as brief, practical and universal assessment tool for cognitive impairment in MS subjects. It includes the Symbol Digit Modalities Test (SDMT), the California Verbal Learning Test-2 (CVLT2) and the Brief Visuospatial Memory Test-Revised (BVMT-R) . In this study we aimed at gathering regression based normative data for the BICAMS battery in the Italian population.
Healthy subjects were consecutively recruited among patient friends and relatives. Corrections for demographics were calculated using multivariable linear regression models. Test-retest reliability was assessed using the Pearson correlation coefficient.
The BICAMS battery was administered to 273 healthy subjects (180 women, mean age 38.9 ± 13.0 years, mean education 14.9 ± 3.0 years). Test-retest reliability was good for all the tests.
The study provided normative data of the BICAMS for the Italian population confirming good test-retest reliability which can facilitate the use of the battery in clinical practice, also for longitudinal patient assessments.
Cognitive impairment (CI) affects up to 65% of multiple sclerosis (MS) subjects, involves all the disease subtypes and can be documented from the very beginning of the disease ,. Moreover, once established, it tends to progress over time, sometimes independently of the accumulation of physical disability . Beyond the effects of physical disability, CI has an important negative impact on patient performance in everyday activities and is the main factor leading to reduced employment or unemployment  in this population of young adults. CI also affects social activity, general independence, coping, rehabilitation progress, treatment adherence and mental health of MS patients . The neuropsychological profile typically involves impaired complex attention and information processing speed, episodic memory and executive functions, whereas language and general intelligence are usually spared .
For this purpose, over the last decades, assessment of MS-related CI has received growing attention and different neuropsychological batteries have been proposed. The most commonly utilized batteries are the Brief Repeatable Battery of Neuropsychological tests (BRB-N)  and the Minimal Assessment of Cognitive Function in MS (MACFIMS) . These batteries were recognized as highly accurate in MS patients, however, their implementation in clinical practice is limited by their time-consuming nature (respectively 45 and 90 minutes) and the need of supervision and interpretation by experienced neuropsychologists. Therefore, there has been considerable effort over the past decade to streamline the neuropsychological assessment in MS, by developing brief assessment tools that can be incorporated in everyday patient assessment. In particular, recently, a Brief International Cognitive Assessment for MS (BICAMS) , is recommended as an international, validated and standardized brief cognitive test. This battery takes about 15 minutes for administration and can be used in everyday clinical practice, even in small MS centers with few staff members who may not have neuropsychological training ,. It could also be integrated into more detailed cognitive assessments and used as a brief assessment tool to identify patients who require a more comprehensive evaluation by specialized personnel. The objective of the this Italian multicentric collaborative study was to provide BICAMS norms in the Italian population, with corrections for gender, age and educational level, as well as to assess test-retest reliability in our population, following recommended international standards for validation .
A total of 273 healthy subjects (180 women; 93 men) were recruited from the community in ten Italian sites representative of the whole national territory (Bari, Barletta, Cagliari, Catania, Chieti, Florence, Lanciano, Milan, Naples and Rome). Exclusion criteria were neurological and major psychiatric illness, history of learning disability, serious head trauma (causing coma and/or neuropsychological dysfunctions), alcohol or drug abuse as well as major medical illness. All subjects had adequate vision and hearing to undergo the tests. Two hundred and forty-three healthy controls agreed to undergo a second assessment using the same version of the test, three weeks apart. All the participants in the study provided their informed consent and the study was approved by the ethic committee of the University of Florence.
Neuropsychological test procedures
In each site, the subjects were examined by the same neuropsychologist who had participated in a common training session, in order to ensure uniform administration, data recording and scoring procedures.
Tests were administered in a standardized manner, during daytime, in a quiet room, and in a fixed order: SDMT , CVLT2 first five trials  and BVMT-R first three recall trials . Administration of the whole battery took 13.7 ± 3.3 minutes (median value 15 minutes).
SDMT presented a series of nine symbols, each paired with a single digit in a key at the top of an 8.5 -1-inch sheet. The remainder of the page presented a pseudo-randomized sequence of symbols. Participants responded by voicing the digit associated with each symbol as quickly as possible. The SDMT required both rapid information processing and visual scanning, and to a lesser extent, working memory. The dependent variable was the total number of correct responses in 90 seconds.
CVLT-II is a measure of verbal learning and memory. The ability to learn a 16-word list (List A) was first examined over the course of five trials. Examiner read 16 words and asked participants to repeat as many words as possible. The entire List A was repeated each time. The dependent variable we considered was the total number of words recalled over five learning trials (Total Learning, TL).
BVMT-R is a measure of visuospatial learning and memory. These were tested by exposing of the participants to a matrix of six simple abstract designs for 10 seconds followed by an unaided recall. Participants were asked to reproduce the designs using paper and pencil, taking as much time as needed for reproduction. Each design received a score 0, 1, or 2 based on accuracy and location scoring criteria. The dependent variable was total recall score across the three trials.
This is the first implementation of the BICAMS in Italy; therefore the battery was translated and culturally adapted for the Italian population. In particular, for visual stimuli, the presence of any semantic associations to stimuli in Italian culture and language was screened. Moreover, the CVLT-II was forward translated from English into Italian by a professional native-speaking Italian translator, matching new words on word frequency and appropriate similarity of meaning.
Group comparisons were assessed through the Student's t -test for unpaired samples, the Mann-Whitney test and the χ2 test, when appropriate. Regression-based norms were calculated following the previously described procedure applied for the MACFIMS . In particular, the control group's raw scores on each neuropsychological measure were converted to scaled scores (M = 10, SD = 3) using the cumulative frequency distribution of each measure. We then regressed the resulting scaled scores on age, age-squared, gender (male = 1; female = 2), and education, entered en bloc. The inclusion of a term of age-squared allowed us to consider the nonlinear relationship between age and cognition. The assumptions of regression analysis were tested by conducting a Kolmogorov-Smirnov test to evaluate the normality of the residuals. The Kolmogorov-Smirnov test should not be significant. Moreover, significant demographic predictors of scaled scores were assessed through backward stepwise multivariable regression models.
The normative data can be established as it follows: the participants' raw test scores must be converted to scaled scores using the raw-to-scale-score conversions derived from the healthy controls. Next, the multiple regression equations derived from the healthy controls must be applied to compute demographically predicted scores for each participant. These predicted scores must be then subtracted from each participant's actual scores and the differences divided by the standard deviation of the controls group's raw residuals for each measure. Finally, the resulting values can be converted to T scores and performance on each neuropsychological measure classified as either intact ( T > 35) or impaired ( T ≤ 35).
Test-retest reliability was assessed using the Pearson correlation coefficient. We used alpha = 0.05 as a significance level for including the regression coefficient in the formula. All analyses were performed using the SPSS 20 running on Windows (SPSS, Chicago, IL, USA).
Tables 1 and 2 show the main characteristics of the subjects who completed the test battery at baseline and re-test assessments. Distribution of different classes of ages and education is reported in Table 2. Classes of age were evenly distributed; more educated subjects were predominantly represented (54.6%). Table 1 lists mean baseline and re-test scores of the BICAMS components. In the 243 healthy subjects who were re-assessed after three weeks, using the same versions of the tests, mean scores were significantly higher on all the cognitive measures (p < 0.0001).
Table 3 reports the raw to scaled scores (M = 10, SD = 3) conversion using the cumulative frequency distribution of each measure of the BICAMS. Table 4 shows the normal control regression models for the BICAMS. All models include age, age-squared, sex (male = 1; female = 2), and education. The Kolmogorov-Smirnov test on the distribution of the residuals was negative for all the three tests (p > 0.06).
These models can be used to convert MS raw scores to regression-based T scores. For example, consider a 38-year-old female MS patients with 18 years of education. Her predicted scaled score on the CVLT-II is 11.435 [4.989 + 38(0.118) + 382(-0.002) + 2(0.823) + 18(0.178)]. Her actual CVLT-II score of 53 corresponds to a scaled score of 9, according to Table 3. We then divide the difference between her actual and predicted scaled score (9-11.435 = -2.453) by the standard deviation of the residual reported in Table 5 (2.842), obtaining a z score of -0.86, which equals a T score of 41.4.
In the backward stepwise multivariable regression models, higher age was associated with a worse performance on the three tests (SDMT: age-squared B = -0.001, p < 0.001; CVLT-II: age-squared B = -0.001, p = 0.001; BVMRT: age-squared B = -0.001, p < 0.001). The CVLT-II was also influenced by education (B = 0.181, p = 0.002), with higher education associated with better performance, and by gender (B = 0.847, p = 0.022), with women performing better than men.
Finally, test-retest reliability for raw scores on each test was good for all the three tests (Table 6).
The BICAMS  is a well-validated, rapid and reliable instrument, which is optimized also for small MS centres and international use. This brief cognitive tool should not replace more comprehensive evaluation of the cognitive function, such as MACFIMS  or BRB-N ; instead, it will increase accessibility for cognitive assessment in non-specialized centres and it can also be integrated into more detailed cognitive assessments and used as a brief assessment tool in all MS centres. Translation and validation of the BICAMS is ongoing in several countries. In a recent study, BICAMS has been validated in the Czech population. This study showed that BICAMS accuracy and reliability are similar to those of the MACFIMS, so that it can be recommended for further clinical use . These BICAMS psychometric characteristics have been confirmed in an Iranian sample .
In the present study, we obtained normative values for the BICAMS tests in a large Italian population representative of the whole national territory, providing corrections for demographics. Our raw scores, compared with results in the Czech sample, showed lower means for the SDMT and CVLT-II, whereas the scores of BVMT-R were almost overlapping. The Czech sample was younger than the currently described Italian sample (mean age 34.0 years versus 38.9 years, respectively). However, scores on these tests were also higher for an American sample with a similar age range, which highlights the need for appropriately validated national samples to take account of translation, cultural and educational differences . These results highlight the subtle linguistic and cultural differences that occur when tests are translated and the importance of national validation data.
Comparing our current data for the SDMT with Italian normative data for the BRB  we found that mean scores of SDMT in the present study were higher (56.3 vs 50.9). This may be due to younger age of the subjects included in the present study (p < 0.05).
It is noteworthy that our study confirmed good test-retest reliability of the BICAMS tests which is an essential requirement in longitudinal assessments of the patients. In this respect, test-retest reliability was higher (r = 0.815) for the SDMT, which is in line with previous reports . It has to be noted that high reliability would be likely due to practice effects with the same form tested. This finding should be confirmed using alternate forms of the tests. .
Our sample tended to include mostly young and middle-aged subjects with higher educational levels. Therefore, the demographic corrections may be not be precise for older subjects with less education; however this group tend to be less represented in an MS clinical population.
In conclusion, our results provide BICAMS norms for use with an Italian population and provide evidence for the robust psychometric properties of the BICAMS scales in a fourth national population. The battery was completed with a median time of 15 minutes, confirming that it is a brief tool appropriate for a broad range of clinical and research uses. We have also reported the largest test-retest sample data for BICAMS, which affirms its suitability for longitudinal assessment. The next step in the validation process will be the comparison of results obtained in our healthy population with those of an Italian MS sample, in order to evaluate the criterion-related validity of the BICAMS.
Brief International Cognitive Assessment for Multiple Sclerosis
Symbol Digit Modalities Test
California Verbal Learning Test - II
Brief Visuo-spatial Memory Test - Revised
Brief Repeatable Battery of Neuropsychological tests
Minimal Assessment of Cognitive Function in Multiple Sclerosis
Amato MP, Zipoli V, Portaccio E: Cognitive changes in multiple sclerosis. Expert Rev Neurother. 2008, 8: 1585-1596. 10.1586/14737220.127.116.115.
Zipoli V, Goretti B, Hakiki B, Siracusa G, Sorbi S, Portaccio E, Amato MP: Cognitive impairment predicts conversion to multiple sclerosis in clinically isolated syndromes. Mult Scler. 2010, 16: 62-67. 10.1177/1352458509350311.
Langdon DW, Amato MP, Boringa J, Brochet B, Foley F, Fredrikson S, Hämäläinen P, Hartung HP, Krupp L, Penner IK, Reder AT, Benedict RH: Recommendations for a Brief International Cognitive Assessment for Multiple Sclerosis (BICAMS). Mult Scler. 2012, 18: 891-898. 10.1177/1352458511431076.
Rao S: A Manual for the Brief Repeatable Battery of Neuropsychological Tests in Multiple Sclerosis. 1990, Medical College of Wisconsin, Milwaukee, WI, USA
Benedict RH, Cookfair D, Gavett R, Gunther M, Munschauer F, Garg N, Weinstock-Guttman B: Validity of the minimal assessment of cognitive function in multiple sclerosis (MACFIMS). J Int Neuropsychol Soc. 2006, 12: 549-558. 10.1017/S1355617706060723.
Benedict RH, Amato MP, Boringa J, Brochet B, Foley F, Fredrikson S, Hamalainen P, Hartung H, Krupp L, Penner I, Reder AT, Langdon D: Brief International Cognitive Assessment for MS (BICAMS): international standards for validation. BMC Neurol. 2012, 16: 12-55.
Delis DC, Kramer JH, Kaplan E, Ober BA: California Verbal Learning Test, second edition (CVLT-II). 2000, Psychological Corporation, San Antonio, TX
Benedict RHB: The Brief Visuospatial Memory Test Revised (BVMT-R). 1997, Psychosocial Assessment Resources Inc, Lutz, FL
Parmenter BA, Testa SM, Schretlen DJ, Weinstock-Guttman B, Benedict RH: The utility of regression-based norms in interpreting the minimal assessment of cognitive function in multiple sclerosis (MACFIMS). J Int Neuropsychol Soc. 2010, 16 (1): 6-16. 10.1017/S1355617709990750.
Dusankova JB, Kalincik T, Havrdova E: Cross cultural validation of the Minimal Assessment of Cognitive Function in Multiple Sclerosis (MACFIMS) and the Brief International Cognitive Assessment for Multiple Sclerosis (BICAMS). Clin Neuropsychol. 2012, 26: 1186-1200. 10.1080/13854046.2012.725101.
Eshaghi A, Riyahi-Alam S, Roostaei T, Haeri G, Aghsaei A, Aidi MR, Pouretemad HR, Zarei M, Farhang S, Saeedi R, Nazeri A, Ganjgahi H, Etesam F, Azimi AR, Benedict RH, Sahraian MA: Validity and reliability of a Persian translation of the Minimal Assessment of Cognitive Function in Multiple Sclerosis (MACFIMS). Clin Neuropsychol. 2012, 26: 975-984. 10.1080/13854046.2012.694912.
Amato MP, Portaccio E, Goretti B, Zipoli V, Ricchiuti L, De Caro MF, Patti F, Vecchio R, Sorbi S, Trojano M: The Rao's Brief Repeatable Battery and Stroop Test: normative values with age, education and gender corrections in an Italian population. Mult Scler. 2006, 12: 787-793. 10.1177/1352458506070933.
Benedict RH: Integrating cognitive function screening and assessment into the routine care of multiple sclerosis patients. CNS Spectr. 2005, 10: 384-391.
Benedict RH: Effects of using same-versus alternate-form memory tests during short-interval repeated assessments in multiple sclerosis. J Int Neuropsychol Soc. 2005, 11: 727-736. 10.1017/S1355617705050782.
MPA received personal compensation from Merck Serono, Biogen, Bayer Schering, Genzyme, Teva and Novartis for serving on scientific advisory board and for speaking, received financial support for research activites from Merck Serono, Biogen Idec, Bayer Schering, Genzyme, Novartis, Genzyme and Teva. BG serves on a scientific advisory board for Biogen, received honoraria for speaking from Biogen-Idec and Teva. RGV serves on a scientific advisory board for Biogen. E Po serves on a scientific advisory board for Biogen, Merck Serono and Bayer, received honoraria for speaking from Biogen-Idec and Teva, and receives research support from Merck Serono. MT has received honoraria for consultancy or speaking from Biogen, Sanofi-Aventis, Merck Serono and Bayer-Schering and research grants from Merck Serono, Biogen and Novartis. VM has received speaker honoraria or funding for travel expenses from Biogen-Dompé SG, Merck Serono, Bayer Schering Pharma, Novartis, Teva Pharmaceutical Industries and Sanofi-Aventis. UN has served as consultant for Biogen Idec, Sanofi Aventis, Teva Pharmaceuticals, Novartis Pharma, Boehringer-Ingelheim and has received travel and research grants by Merck Serono, Novartis Pharma and Biogen Idec. GF has received honoraria for consultancy or speaking from Merck Serono, Novartis and Teva. EC has received honoraria for consultancy or speaking from Biogen, TEVA, Novartis, Sanofi-Aventis, Merck Serono and Bayer. MGM has received honoraria for consultancy or speaking and research grants from Biogen, Sanofi-Aventis, TEVA, Novartis, Merck Serono and Bayer. E Pi has received travel grants from Bayer Schering, Biogen Idec, Merck Serono, Novartis, Sanofi-Aventis and TEVA and has also received travel and research grants from the Fondazione Italiana Sclerosi Multipla. AL is a Bayer, Biogen Idec, Merck Serono and Genzyme Advisory Board Member. She received travel grants and honoraria from Bayer, Biogen Idec, Merck Serono, Novartis, Sanofi and Teva and research grants from Bayer, Biogen Idec, Merck Serono, Novartis, Sanofi and Teva. Prof Lugaresi has also received travel and research grants from the Associazione Italiana Sclerosi Multipla and was a Consultant of "Fondazione Cesare Serono'. DL wishes to disclose that Royal Holloway, University of London has received a research grant from Bayer Healthcare, educational grants from Bayer Healthcare, consultancy and/or lecture fees from Bayer Healthcare, Merck-Serono, Roche, Serono Symposia, Novartis and TEVA Germany. She has received travel expenses in connection with the above and also for presenting at scientific meetings. CN, BH, MF, EM, CI, M Mu, EG, FIA, M Ma, MC, NAL and GBZ have no competing interests.
BG and CN drafted/revised the manuscript, participated in study concept or design and carried out acquisition of data. BH drafted/revised the manuscript, participated in study concept or design, carried out acquisition of data and statistical analysis. AS, MF, EM, VM, CI, UN, M Mu, GF, EC, MGM, EG, FIA, M Ma, MC, RGV, MT, NAL, GBZ, E Pi, AL participated in study concept or design and acquisition of data. DL drafted/revised the manuscript, participated in study concept or design and carried out study supervision. E Po and MPA drafted/revised the manuscript, participated in study concept or design, analysis or interpretation of data and carried out study supervision. All authors read and approved the final manuscript.