- Research article
- Open Access
A systematic review of the responsiveness of lower limb physical performance measures in inpatient care after stroke
BMC Neurology volume 13, Article number: 4 (2013)
Responsiveness refers to a measurement tool’s ability to detect change in performance over time. The aim of the review was to summarise studies of responsiveness of lower limb physical performance measures during inpatient care after stroke.
A systematic literature review was conducted. Prospective studies that included participants with a diagnosis of stroke, were commenced in the acute or subacute phase of inpatient care and included a measure of a lower limb physical performance were included in this review.
Twenty-one studies met these inclusion criteria. A variety of measures were investigated including the Berg Balance Scale, various timed walking tests and the Rivermead Mobility Index. Ten of the included studies had small sample sizes (50 participants or less), 2 studies used a convenience sample rather than consecutive recruitment and 5 studies excluded potential participants with poor physical abilities at baseline. Responsiveness varied between and within studies but was generally large, Effect Size (ES) or Standardised Response Mean (SRM) > 0.8. Measures displaying large responsiveness included the twelve-minute walk test (SRM 1.90) and the Modified Rivermead Mobility Index (SRM 1.31) when re-measured at four weeks after stroke, and the Berg Balance Scale (ES 1.11) and Postural Assessment Scale for Stroke Patients (ES 1.12) when re-measured at approximately six months after stroke.
Studies conducted to date have generally found physical performance measures after stroke to have large responsiveness i.e., to be able to detect changes. Further investigation of the responsiveness of measurement tools after stroke in larger prospective cohort studies is required.
Rehabilitation after stroke aims to optimise stroke survivors’ physical functioning including mobility. Physical performance measures involve measurement of mobility and other functional activities. These measures are often used to monitor progress in clinical settings and used in research studies to evaluate the effectiveness of rehabilitation programs. Many different measurement tools are available to evaluate physical performance in stroke survivors . Clinicians and researchers need to decide on the best measurement tools to use after stroke. In order to make this decision each measurement tool’s reliability, validity and responsiveness must be considered [2, 3].
Responsiveness is a measurement tool’s ability to detect change in performance over time . If responsiveness of a measurement tool is low then even though a person’s physical performance may be improving the tool may not be sensitive enough to detect this change e.g. his/her score on a particular scale may not change. Different measurement tools may be more sensitive to change in different settings over different timeframes.
To date, responsiveness has not received the same attention in the literature as reliability and validity . Despite this there has been a recent increase in research about the responsiveness of measures in stroke rehabilitation. This interest has lead to a number of papers being published summarising the responsiveness of one or more measurement tools. The aim of this systematic review was to summarise the current evidence about the responsiveness of lower limb physical performance measures during inpatient care after stroke. The purpose of this review is to provide clinicians and researchers access to a summary of the many measurement tools available and to assist their selection of the most relevant measurement tool.
The specific research question of this review was: how responsive are measurement tools that measure any aspect of lower limb physical performance in stroke survivors when the use of the measure commences in inpatient care, that is early after stroke?.
When designing and conducting this systematic review we followed the PRISMA guidelines for systematic reviews .
A literature search was completed of Medline (via OvidSP, 1950 to April 2012), CINAHL (1981 to April 2012) and EMBASE (1980 to April 2012) databases for relevant articles. The search terms were stroke (or cerebrovascular accident or hemiplegia) and responsiveness and terms related to lower limb activities or physical therapy (including sitting or standing or standing up or sit to stand or balance or walking or gait or mobility or physiotherapy or physical therapy or rehabilitation). The first author reviewed titles and/or abstracts of displayed articles and determined relevance to the review. Full text copies of relevant articles were obtained. Reference lists were screened for identification of other relevant articles. Two known systematic reviews of measurement in neurological populations were screened for relevant articles [5, 7]. Only articles written in English were included in this review. Any year of publication was included as restricted by each database’s availability.
Studies were included in the review if they: included only participants with a diagnosis of stroke; used a prospective design which involved initial measurement in inpatient care (acute hospital or subacute rehabilitation setting); involved a physical performance measure that related to a lower limb activity including seated reach, standing up, standing, balancing and walking.
A physical performance measure was defined as any measure that required the stroke survivor to actively move or participate. Each measure included use of the legs e.g. sitting, seated reach, moving from sitting to standing, balancing in standing and walking. If the first author was unfamiliar with a scale, a full copy of the scale was reviewed to check for inclusion of lower limb activities. Where upper limb activities were combined in the scales total score the scale was excluded from the review.
Information about the study design, setting, participants and results were extracted by the first author and checked by the third author. Authors were contacted where there was information missing. When extracting data we looked for an Effect Size I (ESI) (also known as Cohen’s Effect Size, the difference between the mean baseline and follow-up scores divided by the standard deviation of baseline scores) or a Standardised Response Mean (SRM) (also known as Effect Size II, the ratio of observed change and its standard deviation, which therefore reflects the variability of change). However if an ESI or SRM was not calculated then, where possible, we calculated one from available data. We considered Effect Size/SRMs of 0.20 to 0.50 be small, 0.50 to 0.80 to be moderate and > 0.8 to indicate be large . A recent consensus statement indicated that any statistical measure of change, including looking at the difference between before and after measures could be used to measure responsiveness . Consequently if any statistical measure of change was used the article was included in this review.
Assessing risk of bias
The risk of bias was evaluated for each study using the recent consensus statement regarding design of responsiveness studies as a guideline . In particular we examined each studies sample size and the method used to select participants.
Flow of studies through the review
The electronic search identified 189 articles. After screening all titles and abstracts, 26 articles were identified but after reviewing the full text, five of these were excluded from the review. The main reasons for exclusion was that the measurement tool involved an upper limb component or the population sample included people with a diagnosis other than stroke. A systematic review of the Berg Balance Scale was identified in the search and its reference list was also screened, identifying one extra article that had not been found in the electronic search [9, 10]. When the reference lists of the two previously identified systematic reviews were screened, one additional article was identified and included in the review .
Upon reviewing the reference lists and abstracts of potentially relevant papers, from the 21 articles identified by this search, no extra articles were found to be relevant.
Characteristics of included studies
The 21 included studies involved 1,101 participants (some of the included studies reported data for the same participants, where this was the case the participant was counted only once). A variety of measurement tools captured a number of lower limb skills ranging from seated reach to standing balance and walking. A summary of the studies is presented in Table 1. Additional information was obtained from the author of one study . An Effect Size was calculated in one study where data was available but an Effect Size was not included in the original article .
Most of the included studies were prospective cohort studies. Limitations of studies include ten out of the 21 studies having small sample sizes, 16 to 50 participants [10, 13, 14, 16, 21–23, 26, 27, 29], use of a sample of convenience not consecutive stroke survivors [15, 23] and having significant exclusion criteria e.g. excluding stroke survivors based on their physical abilities on admission [11, 14, 16, 22, 30]. Six studies in the review investigated the responsiveness of different measures in the same cohort of stroke survivors; in this case data were collected as part of a larger prospective study [17, 19, 20, 27, 30, 31].
Time after stroke
The time post stroke varied across the studies from 7 days to 2 months. Some studies included participants on admission to inpatient rehabilitation. In many of the studies occurring in subacute rehabilitation, the exact time post stroke onset was not indicated [11, 16, 22, 26, 28].
Timeframe of follow up
The time between initial measurement and follow up varied greatly, from one to two weeks to 360 days after the initial measurement. A number of studies followed participants from admission until discharge from hospital [11–13, 26, 29]; consequently the exact timing between measures was unknown.
All participants’ measurements commenced early in an inpatient hospital admission. Eleven of the studies specified they were conducted in inpatient rehabilitation. Three were conducted on acute hospital wards. The remaining seven studies indicated that they were conducted in an inpatient hospital setting but further details were not provided.
The measurement tools investigated varied. The Berg Balance Scale (BBS) was most investigated, with five studies included in this review investigating the full scale and two investigating a shortened version. For further details of measures investigated refer to Table 1.
Responsiveness of measures of lower limb physical performance
The Modified Functional Reach Test towards the paretic side showed good responsiveness (ES 0.80) . This reach direction was more responsive than the reach forward or towards the non-paretic side (ES 0.60 and 0.57 respectively).
The Berg Balance Scale demonstrated varied responsiveness depending on the study and time of measure post stroke (ES 0.40 – 1.11, ES > 1 in 3/9 measures and SRM 0.67 – 1.29, SRM > 1 in 2/4 measures) [11, 16–19]. A three item short form of the BBS was shown to have similar results (SRM 0.70 and 1.11) .
The two-minute walk test, 2MWT (SRM 1.34) , six-minute walk test, 6MWT (SRM 1.52)  and twelve-minute walk test, 12MWT (SRM 1.90)  were highly responsive to change. However, they were investigated in a small study of only 18 participants. The 5 m (ES 0.66-0.81 and SRM 1.00-1.22 > 1 in 2/2 measures) [11, 16] and 10 m (ES 0.55-1.17, ES > 1 in 1/3 measures and SRM 0.83-0.92) [16, 22] walk tests demonstrated variable responsiveness.
A number of studies investigated tools that rated subjects based on their ability to complete a number of activities from sitting to walking. Highly responsive measures included the Rivermead Mobility Index (ES 0.89-1.28, ES > 1 in 1/2 measures and SRM 0.24-1.14, SRM > 1 in 1/3 measures) [13, 27, 28], the Modified Rivermead Mobility Index (ES 1.15 and SRM 0.20-1.31, SRM > 1 in 1/3 measures) [27, 29, 32] and the Modified Emory Functional Ambulation Profile (SRM 1.1) . The lower limb items of the Motor Assessment Scale (MAS) varied in their responsiveness (ES 0.61-1.03, ES > 1 in 2/5 items) . The most responsive items were item 1; supine to side lying (ES 1.03) and item 5; walking (ES 1.02) . The Postural Assessment Scale for Stroke patients (PASS) demonstrated variable responsiveness (ES 0.31-1.12, ES > 1 in 2/6 measures and SRM 0.84-1.02, SRM > 1 in 1/3 measures) [17, 19, 21, 33]. It was most responsive when measured at later time periods after stroke e.g. comparing measures taken at 90 and 180 days post stroke (SRM 1.02)  and comparing measures taken at 14 and 180 days post stroke (ES 1.12) . Full details of the responsiveness of each measurement tool, can be seen in Table 1.
Discussion and conclusion
This systematic review summarised current studies relating to responsiveness of lower limb physical performance measures after stroke. This review demonstrated the variability in the responsiveness of these measures. Within the first four weeks after stroke the measures achieving an ES or SRM of greater than one were the Berg Balance Scale , 5-metre walk test , 2, 6 and 12 min walking tests , the Functional Ambulation Category  and the modified Rivermead Mobility Index . When the follow up period was longer, for example more than three months after stroke, the measures achieving an ES or SRM of greater than one were the Berg Balance Scale [17, 18] (including modified versions [17, 19]) and the Postural Assessment Scale for Stroke [17, 19] (including a modified version ).
This review confirms that responsiveness is specific to the population being investigated and the timeframe of measurement . For example, the Effect Size for the ten-metre walk test (10mWT) varied from moderate (ES = 0.55 to 0.74) in one study conducted in an acute hospital with a measurement period of four weeks, to large (ES = 1.17) in another study conducted in rehabilitation with a measurement period of eight weeks. This makes identification of responsive measurement tools more challenging, as it is often not appropriate to compare results across studies.
The review was designed to assist clinicians and researchers to select the most appropriate measurement tool for use in their setting or trial. When making this decision a number of factors need to be considered. Firstly, they need to identify studies with a similar setting to their own in Table 1 of the review. For example will the measurement tool be used in an acute ward or rehabilitation unit? Secondly, when after stroke will they first measure the stroke survivors’ performance? Table 1 includes the timeframe when studies reported the initial measurement. Thirdly, they need to consider when they plan to re-measure the stroke survivors’ performance and find studies in Table 1 of the review that have assessed responsiveness with similar re-measurement periods. It is important to recognise that the responsiveness of the same measure can vary greatly if measured two weeks or six months later.
To our knowledge this is the first systematic review to focus on responsiveness of measurement tools in the stroke population. There have been several other reviews of mobility measurement tools in general neurological populations. These reviews found responsiveness to be rarely investigated [5, 7]. The mobility measures found to be responsive for use in general neurological populations were the 5 m and 10 m walking tests, the 6MWT, the BBS and the Rivermead Mobility Index [5, 7]. These measures were also included in our review and shown to be responsive in a stroke specific population.
The results of our systematic review need to be interpreted with caution due to the limitations of the included studies. For example, the two, six and 12-min walk tests demonstrate large Effect Sizes, however were investigated in a small study of just 18 participants . Perhaps if they were investigated in a larger cohort the results would be different. In the review there were nine other studies with sample sizes containing less than 50 participants [10, 13, 14, 16, 21–23, 26, 27, 29].
Moreover, a number of studies included in the review included data from the same cohort of stroke survivors [17, 19, 20, 27, 30, 31]. As described above, responsiveness is specific to the sample being investigated. Consequently, it may appear in this review that more samples of stroke survivors have been assessed than is actually the case. Two studies in the review used a sample of convenience and not consecutive stroke survivors [15, 23]. This study design may contain significant bias as subjects may be chosen as they are determined to be likely to respond to treatment.
In conclusion, this review has demonstrated the responsiveness of lower limb physical performance measures. The responsiveness of these measures was generally large. However, further systematic investigation of the responsiveness of measures in larger prospective cohort studies is required.
Kwakkel G: Extended editorial: towards integrative neurorehabilitation science. Physiother Res Int. 2009, 14 (3): 137-146. 10.1002/pri.446.
Kane RL, Radosevich DM: Conducting Health Outcomes Research. 2011, Sudbury, Massachusetts: Jones & Bartlett Learning
Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, Bouter LM, de Vet HCW: International consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported ouctomes: results of the COSMIN study. J Clin Epidemiol. 2010, 63: 737-745. 10.1016/j.jclinepi.2010.02.006.
Husted JA, Cook RJ, Farewell VT, Gladman DD: Methods for assessing responsiveness: a critical review and recommendations. J Clin Epidemiol. 2000, 53 (5): 459-468. 10.1016/S0895-4356(99)00206-1.
Tyson S, Connell L: The psychometric properties and clinical utility of measures of walking and mobility in neurological conditions: a systematic review. Clin Rehabil. 2009, 23 (11): 1018-1033. 10.1177/0269215509339004.
Moher D, Liberati A, Tetzlaff J, Altman DG: Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009, 6 (7): e1000097-10.1371/journal.pmed.1000097.
Salter K, Jutai JW, Teasell R, Foley NC, Bitensky J, Bayley M: Issues for selection of outcome measures in stroke rehabilitation: ICF activity. Disabil Rehabil. 2005, 27 (6): 315-340. 10.1080/09638280400008545.
Mokkink L, Terwee C, Patrick D, Alonso J, Stratford P, Knol D, Bouter L, de Vet H: The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Qual Life Res. 2010, 19 (4): 539-549. 10.1007/s11136-010-9606-8.
Blum L, Korner-Bitensky N: Usefulness of the Berg Balance Scale in stroke rehabilitation: a systematic review. Phys Ther. 2008, 88 (5): 559-566. 10.2522/ptj.20070205.
Stevenson TJ: Detecting change in patients with stroke using the Berg Balance Scale. Aust J Physiother. 2001, 47: 29-38.
English CK, Hillier SL, Stiller K, Warden-Flood A: The sensitivity of three commonly used outcome measures to detect change amongst patients receiving inpatient rehabilitation following stroke. Clin Rehabil. 2006, 20: 52-55. 10.1191/0269215506cr877oa.
Kurtais Y, Kucukdeveci A, Elhan A, Yilmaz A, Kalli T, Tur BS, Tennant A: Psychometric properties of the rivermead motor assessment: its utility in stroke. J Rehabil Med. 2009, 41: 1055-1061. 10.2340/16501977-0463.
Hsieh CL, Hsueh IP, Mao HF: Validity and responsiveness of the rivermead mobility index in stroke patients. Scand J Rehabil Med. 2000, 32 (3): 140-142. 10.1080/003655000750045497.
Katz-Leurer M, Fisher I, Neeb M, Schwartz I, Carmeli E: Reliability and validity of the modified functional reach test at the sub-acute stage post-stroke. Disabil Rehabil. 2009, 31 (3): 243-248. 10.1080/09638280801927830.
Pyoria O, Talvitie U, Villberg J: The reliability, distribution, and responsiveness of the postural control and balance for stroke test. Arch Phys Med Rehabil. 2005, 86: 296-302. 10.1016/j.apmr.2004.01.024.
Salbach NM, Mayo NE, Higgins J, Ahmed S, Finch LE, Richards CL: Responsiveness and predictability of gait speed and other disability measures in acute stroke. Arch Phys Med Rehabil. 2001, 82 (9): 1204-1212. 10.1053/apmr.2001.24907.
Mao HF, Hsueh IP, Tang PF, Sheu CF, Hsieh CL: Analysis and comparison of the psychometric properties of three balance measures for stroke patients. Stroke. 2002, 33: 1022-1027. 10.1161/01.STR.0000012516.63191.C5.
Wood-Dauphinee S, Berg K, Bravo G, Williams JI: The Balance Scale: responsiveness to clinically meaningful changes. Can J Rehabil. 1996, 10 (1): 35-50.
Wang CH, Hsueh IP, Sheu CF, Yeo G, Hsieh CL: Psychometric properties of 2 simplified 3-level balance scales used for patients with stroke. Phys Ther. 2004, 84 (5): 430-438.
Chou CY, Chien CW, Hsueh IP, Sheu CF, Wang CH, Hsieh CL: Developing a short form of the berg balance scale for people with stroke. Phys Ther. 2006, 86: 195-204.
Chien CW, Hu MH, Tang PF, Sheu CF, Hsieh CL: A comparison of psychometric properties of the smart balance master system and the postural assessment scale for stroke in people who have had mild stroke. Arch Phys Med Rehabil. 2007, 88: 374-380. 10.1016/j.apmr.2006.11.019.
Goldie PA, Matyas TA, Evans OM: Deficit and change in gait velocity during rehabilitation after stroke. Arch Phys Med Rehabil. 1996, 77 (10): 1074-1082. 10.1016/S0003-9993(96)90072-6.
Kosak M, Smith T: Comparison of the 2-, 6-, and 12-min walk tests in patients with stroke. J Rehabil Res Dev. 2005, 42 (1): 103-108.
Kollen B, van de Port I, Lindeman E, Twisk J, Kwakkel G: Predicting improvement in gait after stroke: a longitudinal prospective study. Stroke. 2005, 36: 2676-2680. 10.1161/01.STR.0000190839.29234.50.
Mehrholz J, Wagner K, Rutte K, Meissner D, Pohl M: Predictive validity and responsiveness of the functional ambulation category in hemiparetic patients after stroke. Arch Phys Med Rehabil. 2007, 88 (10): 1314-1319. 10.1016/j.apmr.2007.06.764.
Liaw LJ, Hsieh CL, Lo SK, Lee S, Lin JH: Psychometric properties of the modified Emory functional ambulation profile in stroke patients. Clin Rehabil. 2006, 20: 429-437. 10.1191/0269215506cr950oa.
Hsueh IP, Wang CH, Sheu CF, Hsieh CL: Comparison of psychometric properties of three mobility measures for patients with stroke. Stroke. 2003, 34 (7): 1741-1745. 10.1161/01.STR.0000075295.45185.D4.
Franchignoni F, Tesio L, Benevolo E, Ottonello M: Psychometric properties of the rivermead mobility index in Italian stroke rehabilitation inpatients. Clin Rehabil. 2003, 17: 273-282. 10.1191/0269215503cr608oa.
Lennon S, Johnson L: The modified rivermead mobility index: validity and reliability. Disabil Rehabil. 2000, 22 (18): 833-839. 10.1080/09638280050207884.
Chien CW, Lin JH, Wang CH, Sheu CF, Hsieh CL: Developing a short form of the postural assessment scale for people with stroke. Neurorehabil Neural Repair. 2007, 21: 81-90. 10.1177/1545968306289297.
Wang CH, Hsueh IP, Sheu CF, Hsieh CL: Discriminative, predictive, and evaluative properties of a trunk control measure in patients with stroke. Phys Ther. 2005, 85 (9): 887-894.
Hsueh IP, Lin JH, Jeng JS, Hsieh CL: Comparison of the psychometric characteristics of the functional independence measure, 5 item Barthel index, and 10 item Barthel index in patients with stroke. J Neurol Neurosurg Psychiatry. 2002, 73 (2): 188-190. 10.1136/jnnp.73.2.188.
Hsieh YW, Hsueh IP, Chou YT, Sheu CF, Hsieh CL, Kwakkel G: Development and validation of a short form of the Fugl-Meyer motor scale in patients with stroke. Stroke. 2007, 38: 3052-3054. 10.1161/STROKEAHA.107.490730.
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2377/13/4/prepub
The authors declare no competing interests.
KScr participated in the study design, carried out the electronic search, extracted data from trials for the review and drafted the manuscript. CS initiated the study design and participated in manuscript editing and writing. KSch participated in the study design, extracted data from trials for the review and participated in manuscript editing and writing. All authors read and approved the final manuscript.
About this article
Cite this article
Scrivener, K., Sherrington, C. & Schurr, K. A systematic review of the responsiveness of lower limb physical performance measures in inpatient care after stroke. BMC Neurol 13, 4 (2013). https://doi.org/10.1186/1471-2377-13-4