Skip to main content
  • Research article
  • Open access
  • Published:

Reliability of timed walking tests and temporo-spatial gait parameters in youths with neurological gait disorders

Abstract

Background

The 10-Meter Walk Tests (10MWT) and the 6-Minute Walk Test (6MinWT) are applied to assess gait capacity in paediatric patients. To better objectify changes in qualitative aspects of gait, temporo-spatial parameters like stride length or step symmetry could be simultaneously assessed with a GAITRite system. Reliability has not yet been evaluated in a heterogeneous sample of children with various neurological gait disorders such as is representative for paediatric neuro-rehabilitation. The aim of this study was to assess test-retest reliability of the 10MWT, the 6MinWT and simultaneously recorded gait parameters captured with the GAITRite system in children with neurological gait disorders.

Methods

This is a cross-sectional study with two measurement time-points. Thirty participants (9 females; mean (standard deviation) age 13.0 (3.6) years, 10 with cerebral palsy, 6 after stroke, among other diagnoses) performed the 10MWT at preferred (10MWTpref) and maximum speed (10MWTmax) and the 6MinWT on two occasions (mean time interval: 7.0 (1.9) days). Relative reliability was quantified with an intra-class correlation coefficient (ICC); the measurement error reflecting absolute reliability was quantified with the standard error of measurement and the smallest real difference.

Results

ICCs of timed walking tests (time measured with a stopwatch, step count for the 10MWT and walking distance for the 6MinWT) ranged from 0.89–0.97. ICCs of temporo-spatial gait parameters ranged from 0.81–0.95 (10MWTpref), from 0.61–0.90 (10MWTmax) and from 0.88–0.97 (6MinWT). In general, absolute reliability was greatest in the 6MinWT.

Conclusion

Timed walking tests and temporo-spatial gait parameters obtained from the GAITRite system appear reliable in children with neurological gait disorders. However, especially in children with poorer walking ability, the reliability of temporo-spatial parameters might have been positively influenced, as unclear steps had to be removed using the GAITRite software. As absolute reliability is rather low, the responsiveness of these measures needs to be further evaluated.

Peer Review reports

Background

Worldwide the prevalence of Cerebral Palsy (CP) varies between 1.5 to 2.5 per 1000 births [1] and has increased over the years [2]. While CP is the most common physical disability among children [3], traumatic brain injury is also a leading cause of long-term disability among children and young adults [4]. Also, children with stroke, myelomeningocele, spinal cord injury, genetic disorders or various developmental disorders are frequently undergoing paediatric neurorehabilitation; therefore, the population in this field is very heterogeneous.

Many children with neurological disorders such as CP, traumatic brain injury, or stroke and their parents prioritise walking above any other activities to be improved during rehabilitation [5]. Therefore, to evaluate the effectiveness of the rehabilitation program, a careful evaluation of walking ability is required. The international classification of functioning, disability and health (ICF) declares walking as an item on the activity and participation domain (WHO, 2001). Therefore, at least part of its assessment should also occur in this domain.

The 10-Meter Walk Test (10MWT) and the 6-Minute Walk Test (6MinWT) have often been used to assess gait capacity in paediatric patients [68]. Commonly, the time required to walk 10 m is recorded while the covered distance is measured for the 6MinWT.

Interestingly, while psychometric studies evaluating the reliability of the 10MWT performed at a comfortable speed in children with neurological disorders do not seem to exist, test-retest reliability of the 10MWT performed at fast speed proved to be acceptable [6]. Also, the 6MinWT proved reliable when tested in healthy children [9], in children with myelomeningocele [7] and CP [6, 8]. The test-retest reliability of the 6MinWT was evaluated in a group of 31 children with CP with a retest interval of 1 to 4 weeks [6] and in a sample of 41 children with CP, who performed the test twice on the same day [8]. Bartels et al. examined psychometric properties of the 6MinWT administered in children with chronic paediatric conditions [10]. In their recently published review, they stated that there is little evidence available for responsiveness and measurement error (i.e. absolute reliability).

Combining these tests simultaneously with the GAITRite, which has to our knowledge not been done before, provides additional information on temporo-spatial gait parameters. These parameters allow an objective evaluation of parameters reflecting the quality of gait since, for example, step length or step time symmetry can be computed. Wondra et al. [11] stated that these parameters are often used for the assessment of treatment effects and to expose irregularities in the gait pattern of children with motor disabilities. Several studies showed that most temporo-spatial gait parameters, including e.g. symmetry of steps, were validly and reliably assessed by the GAITRite system in healthy adults [1214]. In children with developmental coordination disorder, reliability differed considerably between gait parameters [15]. Reliability was found to be satisfying in children with motor disabilities (mostly CP) who walked barefoot or while wearing shoes and orthoses [11] and in 18 children with a mild CP (Gross Motor Function Classification System (GMFCS) level I and II) [16].

Wondra et al. let their participants practice the walk test and measured 6 to 10 trials [11]. This procedure might lead to better reliability since the walks are practiced before the test. Same-day reliability testing is mentioned to be crucial to determine therapeutical interventions with immediate effects, such as when applying an orthosis [11]. In our case, to determine the outcome of a longer intervention period, it makes sense to assess test-retest reliability with an interval that is long enough to allow a certain independence of the measurements, but short enough to ensure that the patient’s performance remains stable.

To obtain reliable pre- and post-measurements it is recommended to have the same person administering both tests. Nevertheless, in the clinic it is often difficult having the same tester performing both pre- and post-assessments. Therefore, determining the reliability between different testers at different time points might reflect better daily routines. In the studies by Wondra et al. [11] and Sohrsdahl et al. [16] there is no information about whether the same person did the tests or whether there was more than one tester.

Even though reliability results obtained in very homogeneous patient groups might make sense for research purposes, their generalizability to the clinics is very limited. The aim of this study was to evaluate the test-retest reliability of the 10MWT performed at preferred speed (10MWTpref), at maximum speed (10MWTmax) and the 6MinWT, including temporo-spatial gait parameters that were simultaneously collected in youths with neurological diagnoses. The first and second test session were performed by different therapists to reflect the normal daily scenario. According to the results presented by Sorsdahl et al. [16] and Wondra et al. [11] and based on our heterogeneous sample that we aimed to include, we hypothesized that most of the parameters would reveal good relative reliability (intra-class correlation coefficients (ICCs) > 0.8). According to our experience with children, we hypothesized that most parameters would show poor absolute reliability, i.e. considerable measurement errors due to high within-subject variance.

Methods

Study design

In this cross-sectional study, two different assessors (physiotherapists or movement scientists who had all received the same training) performed two measurements within 14 days maximum (targeted was a between-test interval of 7 days). Since we had to plan the time-points within the regular ongoing rehabilitation program, we choose this pragmatic time range. The rehabilitation program consisted of physiotherapy, occupational therapy, speech and language therapy, school, sports, and/or robot-assisted training, according to the patients’ individual goals.

Participants

For our convenience sample, we recruited inpatients of the Rehabilitation Centre for Children and Adolescents of the University Children’s Hospital Zurich in Affoltern am Albis, Switzerland. We included youths between the age of 5 and 20 years with gait disorders of neurological origin. Participants had to be able to understand and follow the instructions of the timed walking tests. Excluded were children who were not able to walk without the physical assistance of a person. Walking aids such as walkers as well as orthoses of any kind were allowed. A sample size of 25–30 participants was minimally required since such a sample size was suggested to calculate an accurate estimate of the random error [17].

The Ethics Committee of the Canton of Zurich approved this study. Children below 15 years provided verbal informed consent. Legal representatives and adolescents aged 15 years and older signed a written informed consent.

Instrumentation

The GAITRite Electronic Walkway Platinum (CIR Systems Inc., Peekskill, N.Y., USA) has an active area of 61 cm × 488 cm containing 18’432 sensors (distance between sensors 1.27 cm). The system captures the geometry and relative arrangement of each footfall as a function of time at a sampling frequency of 120 Hz.

The walkway was placed in a long corridor in a calm environment.

Procedures

For all timed walk tests, participants wore their regular shoes and orthoses. Participants completed the three timed walking tests in a calm corridor in the order presented below.

10 Meter Walk Test at preferred speed

The time to walk across the 10 middle meters of a 14 m long walkway was recorded (tape on the floor marked the distances) to account for acceleration and deceleration effects [16]. The GAITRite mat was placed at the start of the 10 m walkway.

Participants were instructed the following: “Walk in your normal, comfortable speed up to the last line.” This test was repeated twice, with a short break in between. We recorded the time in seconds and counted the number of steps. The average value of the two measurements was included in the analysis.

10 Meter Walk Test at maximum speed

The 10MWTmax was conducted similarly as the 10MWTpref. Participants were instructed as follows: “Walk as fast as you can to the last line, but so that you are still feeling safe and without running.” The test was also repeated twice, with a short break in between. Only data from the fastest trial were included in the analysis, as this test should indicate the participant’s maximal capacity.

6 Minute Walk Test

After a break of 5 to 10 min, participants performed the 6MinWT according to guidelines published by the American Thoracic Society [18]. The participants walked up and down 30 m. The GAITRite walkway was positioned 18 m after the start of the track (Fig. 1). Participants repeatedly walked over it.

Fig. 1
figure 1

Setup of the (a) 10-Meter Walk Test and (b) 6-Minute Walk Test. Shown is the position of the GAITRite walkway in relation to the start of the timed walk tests. For the 6-Minute Walk Test, participants walked repetitively over the GAITRite (walking up and down the corridor)

At each end of the 30 m track, they circumvented a pylon. Instructions and encouragement were standardized throughout the test. “The aim of this test is to walk as far as possible within 6 min. You walk up and down the hallway; every time you reach the end of the hallway you circumvent the pylon and walk back. If you are tired or exhausted, you are allowed to walk slower, to stop or take a break, but try to keep on walking as soon as possible. Remember, the aim is to walk as far as possible.” During the test, verbal encouragement was given every minute, e.g. after one minute: “You are doing well; you have five more minutes to walk,” after two minutes: “Go on like this; you have four more minutes to go,” etc. The child was instructed to lean against the wall when it needed a break and was informed to continue walking when being able to. Participants were informed 15 s before the end of the tests to stand still soon. The maximal distance covered during 6 min was determined and rounded to the next meter.

A trained physiotherapist performed manual muscle testing of the hip extensor and flexor muscles, the ab- and adductors, the internal and external rotators, the knee extensors and –flexors, and the plantar and dorsiflexors of the ankle joint. Testing occurred after the timed walking tests had been performed. The scores were evaluated according to Durfee and Iaizzo [19].

Data processing

Simultaneously to the timed walk tests and the recording of step count, and time needed to cover 10 meter (10MWT) or distance walked during 6 minutes (6MinWT), the GAITRite system captured the footfalls. These were then processed into various temporo-spatial gait parameters with the accompanying software. Incomplete footfalls, scrub marks and marks produced by walking aids were deleted. Included were only walks with at least 4 footfalls. Data were then exported to Microsoft Excel. For the 10MWTpref, the two trials were averaged, while for the 10MWTmax, data from the fastest trial (measured with a stopwatch) were selected. For the 6MinWT, the average of all the walks crossing the GAITRite was calculated.

We selected the following GAITRite parameters for analysis: velocity, cadence, double support as a percentage of the gait cycle and step length, as the reliability of these parameters was also previously investigated [11, 16]. The parameters normalized velocity (ratio of velocity and leg length), step-extremity-ratio (ratio of leg- and step-length) and step time were chosen since we considered them important for describing a gait pattern. Double support, step length, step-extremity-ratio and step time were determined for the left and right leg and the more and the less affected leg. The more affected leg was defined as the leg with the smaller sum-score of muscle strength scores [20] (Table 1). If the sum-score was the same on both legs, the left leg was classified as more affected. Furthermore, we calculated an absolute symmetry index (ASI) for the step time- and step length-symmetry according to the following formula:

Table 1 Participant characteristics

ASI = ABS[(2 × (X L  − X R )/(X L  + X R )) × 100] [21, 22].

Where XL refers to the according parameter of the left leg and XR to the same parameter of the right leg and ABS to the absolute value.

An absolute symmetry index value of 0 % refers to perfect symmetry [22] while <10 % is considered normal [23]. We considered symmetry important, as it reflected a qualitative aspect of the gait pattern.

Data analysis

The statistical analyses were conducted with SPSS (IBM SPSS Statistics V. 19.0). To test for systematic differences between session 1 and session 2 for all parameters (e.g. an improvement due to familiarization) we applied a Wilcoxon signed rank test. To assess relative reliability a two-way random model ICC (2,1) based on absolute agreement was applied. The 95 % confidence interval was calculated to specify the precision of the estimates. The ICCs were evaluated according the Munro’s classification for correlation coefficients: 0.00 to 0.25: little if any correlation; 0.26 to 0.49: low correlation; 0.50 to 0.69: moderate correlation; 0.70 to 0.89: high correlation; 0.90 to 1.00: very high correlation [24]. Nunnally and Bernstein [25] state that a reliability coefficient of 0.70 is sufficient in early stages of research, but recommended are values of 0.80 or higher [26].

For absolute reliability the standard error of measurement (SEM) and the smallest real difference (SRD) were calculated according to the following formulas [27]:

$$ SEM=\sqrt{\Big({\sigma}_t^2}+{\sigma}_e^2\Big) $$
$$ SRD=1.96\times \sqrt{2}\times SEM $$

Here, \( {\sigma}_t^2 \) refers to the variance of the trial and \( {\sigma}_e^2 \) to the variance of the residual error. The units of SEM and SRD are those of the particular parameter. To be able to compare the absolute reliability measures between various parameters or various tests, the SEM% and SRD% were calculated as \( SEM\%=\left(SEM\div \overline{X}\right)\times 100 \), and \( SRD\%=\left(SRD\div \overline{X}\right)\times 100 \) respectively where is the grand mean of the correspondent parameter of session 1 and 2 [28].

Data were presented as means and standard deviations (SD), despite that most data were not normally distributed. Mean and SD values should enable future studies to use these data for, for example, sample size calculations. To determine differences in relative and absolute reliability between the 10MWTpref, 10MWTmax and the 6MinWT, the ICC and the SEM% values of the temporo-spatial gait parameters were compared among the three timed walking tests with a Friedman’s test and consecutive Wilcoxon tests. For the Wilcoxon tests, a Bonferroni correction was applied and α was set at 0.025, as each dataset was included twice.

Results

Recruited were 35 participants. Due to technical difficulties, data of two participants could not be used, and three participants were incompliant. Demographical and clinical characteristics of the remaining 30 participants are shown in Table 1. Mean time interval (SD) between test and retest was 7.0 (1.8) days (range: 4–12 days).

All participants had complete 10MWTpref and 10MWTmax datasets. Three 6MinWT datasets were excluded: one participant became incompliant during testing while technical problems with the GAITRite resulted in the loss of two datasets and a reduction of 61 cm in active measurement area in 7 datasets (which reduced the number of recorded footfalls by one or two).

Means, SDs, and results of the Wilcoxon signed rank tests between session 1 and 2 of all the parameters (conventional parameters: stopwatch time, step count, and walking distance and the GAITRite parameters) are displayed in Table 2. Measurement results are also displayed in Fig. 2.

Table 2 Means of all the parameters and results of the Wilcoxon signed rank test between session 1 and 2
Fig. 2
figure 2

Scatter-plots showing the results of the first and second assessment of the time needed to cover 10 m at (a) preferred or (c) maximum speed, or (e) the distance covered during 6 min. Shown are also the repeated assessments of the absolute symmetry index calculated for the step length for the (b) 10-min walking test performed at preferred speed (10MWTpref), (d) 10-min walking test performed at maximum speed (10MWTmax) and (f) 6-min walking test (6MinWT)

Relative reliability varied considerably between the parameters (0.61 < ICC < 0.97) (see also Table 3). ICCs of the 10MWTpref and the 6MinWT met or exceeded the minimum acceptable value of 0.80. 10MWTmax ICC values varied from moderate to very high while 4/23 parameters did not achieve the level of 0.70.

Table 3 Relative and absolute reliability measures of all the parameters and walk tests

The median ICC value calculated from all 21 GAITRite parameter ICC values (Table 3) was 0.93 for the 6MinWT, 0.87 for the 10MWTpref and 0.74 for the 10MWTmax. The ICC values differed between the three tests (p <0.001) and were higher for the 6MinWT compared to 10MWTpref and 10MWTmax (for both: p < 0.001) and also higher for the 10MWTpref compared to the 10MWTmax (p = 0.002). Therefore, the relative reliability of the GAITRite parameters of the three walking tests can be ordered from better to worse as 6MinWT > 10MWTpref > 10MWTmax.

Absolute reliability values of the conventional parameters, expressed as SEM%, of the time needed to cover 10 m were twice as high (10MWTpref: 28.3 %; 10MWTmax: 23.7 %) compared to the walking distance of the 6MinWT (14.1 %, see Table 3). For the GAITRite parameters, SEM% values varied between 4.36 % (extremity-step ratio right leg recorded during the 6MinWT) and 80.71 % (step length symmetry calculated for the 10MWTmax) of the grand mean of the first and second measurement. The median SEM% values calculated from all 21 GAITRite parameter SEM% values (Table 3) were 11.04 for the 6MinWT, 18.88 for the 10MWTpref and 14.59 for the 10MWTmax. In line with the ICC results, SEM% values differed significantly between the tests (Friedman’s test: p < 0.001) and were smallest for the 6MinWT compared to 10MWTpref (p = 0.001) and 10MWTmax (p = 0.001). No significant difference could be found between the 10MWTpref compared to the 10MWTmax (p = 0.498). Therefore, absolute reliability of the GAITRite parameters was better for the 6MinWT compared to the two other tests.

Discussion

The aim of this study was to establish test-retest reliability of the conventional and the GAITRite parameters of the 10MWTpref, the 10MWTmax, and the 6MinWT. Results showed high to very high relative reliability in conventional gait parameters like the time needed to cover 10 m or the distance covered during 6 min. GAITRite parameters recorded during the 6MinWT showed the highest relative and absolute reliability. Second best was the 10MWTpref.

We could not completely confirm our first hypothesis that all the three tests would show good relative reliability. Although the lowest ICC values were still moderate, this is considered not sufficient for tests used to reveal improvement in gait. For the 10MWTmax, only 10 out of 23 parameters showed high or very high relative reliability (ICC ≥ 0.80), while all the parameters of the 10MWTpref and the 6MinWT exceeded this threshold. Concerning our second hypothesis, some parameters showed a low absolute reliability (i.e. considerable measurement errors) between the two sessions. The rather low relative and absolute reliability of the 10MWTmax might be partially explained by its accomplishment. Since we evaluated only the fastest trial, we did not average two or more walks as for the other tests. Averaging several trials reduces variability, which could have increased the reliability. This approach is supported by the observation that the 6MinWT shows the greatest relative and absolute reliability, as there was a mean of 12.67 (SD 4.86, Range 1–22) walks used for analysis in session 1, and a mean of 12.56 (SD 5.64, Range 1–27) walks in session 2.

The results of the reliability of conventional gait parameters are partially consistent with the findings of other studies. Compared to results obtained in children with CP by Thompson et al. [6] the present study revealed higher ICCs and smaller SEM and SRD for the parameter time during the 10MWTmax. In the study of Thompson et al., a period of up to 4 weeks lay between the time-points of measurement [6], which could have led to a more variable performance of the participants between the sessions. Despite that the participants performed the 10MWTmax 1.5 s faster at the second time point (3.1 s faster in a subgroup with GMFCS level III), this change was not significantly different [6]. For the walking distance (6MinWT), however, relative and especially absolute reliability was reported to be considerably better than the results found in our study [6, 8]. In the study by Maher et al., the time between the two 6MinWT measurements lasted only 30 min [8]. Retesting within such a short interval might increase reliability due to the dependence of the measurements. Also in the population of children with myelomeningocele, walking distance appeared more reliable compared to our findings [7]. These children were retested two weeks later and therewith the protocol was more comparable to our study [7]. An important difference that might have led to better results in the study by Maher et al. is the higher level of standardisation: the same tester administered the tests at the same time of day [7]. On the contrary, in our study, we wanted to resemble the clinical situation and abdicated on purpose on a high level of standardisation. In the population of children with cystic fibrosis comparable results of agreements were observed, as the bias (i.e. the average difference between the first and second measurement) was −15.9 m and the limits of agreement were 100.9 m and −132.9 m (Bland-Altman plot) [29].

The results of the GAITRite parameters of the present study are comparable to the results obtained in the study by Wondra et al. [11], where 80 % of the parameters met the ICC threshold of ≥ 0.80 (single and multiple trials, barefoot and with shoes and orthosis) in children with motor disabilities. Considering heterogeneity between the participants, the samples of their and our study are quite comparable. As ICCs depend on the between-subject variance (i.e. a larger between-subject variance leads to greater ICCs), ICCs are usually high in heterogeneous patient groups. This fact has to be considered when discussing these results. Nevertheless, while Sorsdahl et al. [16] investigated test-retest reliability of gait parameters in a rather homogenous group of children with CP (GMFCS levels I and II), they also found (very) high relative reliability, except for the parameter step width, which was not evaluated in our study. The study by Morrison et al. [15] investigating children with developmental coordination disorder. Here, the authors concluded that the wide range of ICC values they obtained could be explained by the variable and inconsistent gait pattern of these children, which could have resulted in low ICC scores [14].

As previously stated, also our second hypothesis that absolute reliability will show considerable measurement errors could be confirmed. While SEM values for the parameter cadence were comparable to the results obtained by Wondra et al. [11], the SEM values for the parameter velocity were larger in our study. The time window between the testing might explain this. Wondra et al. performed their tests on one day, which reduces e.g. the influence of the participant’s day’s form, and, therefore, might lead to more reliable performance [11].

One important aim of this study was to investigate the reliability of the step time- and step length-symmetry, as possible parameters to quantify the quality of gait. While the average symmetry values were quite comparable between the three tests (table 2), the ICC values appeared only excellent for the 10MWTpref and 6MinWT. Sorsdahl et al. [15] also determined the relative reliability of the asymmetry of the step length and found an ICC of 0.82. Their and our test procedures were different: the participants walked barefoot and without their orthosis at self-selected, slow and fast speed, a total of eight walks over a 5.88 m GAITRite walkway. Start and end were 1.5 m before and after the walkway. In the current study, ICC values were better for the 6MinWT and 10MWTpref, but poorer for the 10MWTmax. Symmetry indices were also evaluated in adult patients with stroke [30]. In that study, a step length asymmetry ratio was calculated. Despite differences in calculation, they reported similar ICC values for step length symmetry (ICC 0.81 for one walk, 0.92 for six walks) [30].

Nevertheless, absolute reliability values proved to be utterly poor. SRD% of step length symmetry exceeded 100 % in all three tests, for step time symmetry in the 10MWTmax. We conclude, therefore, that these symmetry parameters appeared promising when considering the quantification of gait quality but, unfortunately, they do not appear reliable enough for longitudinal evaluation.

Methodological considerations

The heterogeneity of children included in this study reflects the population of children with gait impairments in paediatric neuro-rehabilitation, which is important to determine the generalizability of our results. If these assessments are used for research purposes the examination of reliability in specific populations is needed, [31] since reliability is described as a varying feature and depends on the tested population [24].

Interestingly, the participants walked on average substantially faster during the 6MinWT compared to the 10MWTpref. We hypothesise that this observation is caused by the test instructions. While, for the 10MWTpref, the children were instructed to walk at a self-selected comfortable speed, they had to cover as much distance as possible during the 6MinWT. Apparently, the children were able to walk at such a higher-than-comfortable speed for 6 min.

We assume that the quality of gait of the most severely affected youths was overestimated by the GAITRite, as, for those with poor walking ability, data of the walk required considerable editing with the GAITRite software. By deleting unclear steps, the quality of the walk improved. Editing might also have introduced a higher susceptibility to a bias of the investigator due to unclear decisions on when and how to edit data. Despite that different people edited the walks, they all performed this according to internally formulated guidelines. However, as each walking pattern has its specific characteristics that cannot be described in such guidelines, editing remains to a certain extent subjective. This might have impacted our results (but also those of other GAITRite studies).

Younger children and those with reduced cognitive abilities, although able to follow test instructions, showed quite large differences between the first and second session. This bias might be largely due to a lack of motivation. Motivational aspects have to be kept in mind since they might strongly affect the reliability of any assessment.

ICCs are largely influenced by between-subject variability, i.e. a high ICC does not necessarily also reflect a high absolute reliability. See for example Fig. 2b and f where heterogeneous distributions of absolute step length symmetry indices of 10MWTpref and 6MinWT result in excellent ICC values despite poor absolute reliability values. In clinical and research practice, it is very difficult to make judgements on improvements in individual patients when you have only information about relative reliability. Therefore, we deemed it necessary to investigate also the absolute reliability, i.e. measurement errors. An SRD value informs you what change a patient should achieve before this could be considered a true change, i.e. above chance. Compared to other studies (for example Wondra et al. [11]), we chose a relatively conservative way of calculating the SEM and SRD values, because we included systematic bias, which is not always done.

Limitations of the study

There are limitations that have to be mentioned. The sample size of our study was rather small, and the sample was very heterogeneous due to the different diagnoses, severity levels and walking abilities. A heterogeneous sample involves large between-subject variance, which results in high relative reliability. Nevertheless, as we wanted to picture reliability of a clinical setting, we decided to keep the sample as heterogeneous as it was. One advantage of a heterogeneous sample is that results can be generalised to a broader population.

The participants were wearing the same orthosis and used the same walking aids for both measurements. Furthermore, we also tried to schedule the measurement time-points at the same time of the day. Since our study was conducted parallel to the rehabilitation programme, this was not always possible. Other factors such as medication, daily activity, and others that we did not control for, might have influenced reliability to a certain extent.

Clinical implications

A few practical issues have to be mentioned when using the GAITRite walkway system. Firstly, small children might not be heavy enough for the walkway [12]. In our experience, GAITRite measurements are difficult with children with a bodyweight of less than 15 kg since there is not enough pressure on the sensors and the GAITRite does not recognize that there is still a walk in progress. The recording of the walk will stop before it is finished. Secondly, editing difficult walks should be standardised by formulating standardised guidelines, so all walks are edited the same way. Thirdly, automatic and manual editing errors occur. Some are obvious (e.g. calculations are done with 7 steps instead of 8 that are shown in the walk); however, the number of non-recognizable errors is difficult to estimate.

To get a reliable result, several repetitions are recommended, and this can be applied to any test. Nevertheless, the motivational factor and the compliance of the person doing the test must be considered. Compliance decreases with the increasing number of trials, especially in the paediatric field. This might influence reliability to a large extent.

Finally, for clinical purposes, we do not recommend the repeated use of the GAITRite walkway during the 6MinWT because due to a large number of walks, the time required for editing and analysing is considerable.

Conclusions

The timed walking tests and the simultaneously measured temporo-spatial gait parameters showed moderate to very high relative reliability in all the three timed walking tests. In general, absolute reliability was rather low. Parameters recorded during the 10MWTmax showed lowest relative reliability. Symmetry indices are difficult to use for evaluation purposes, because of poor absolute reliability. The use of the GAITRite system in a paediatric neurorehabilitation setting has its advantages but also disadvantages, as that gait quality of smaller children and those with more severely affected walking ability is likely to become overestimated because unclear steps have to be removed from the analysis.

Abbreviations

10MWTmax:

10-meter walk test at maximum speed

10MWTpref:

10-meter walk test at preferred speed

6MinWT:

6-minute walk test

95 % CI:

95 % confidence interval

CNS:

central nervous system

CP:

cerebral palsy

GC:

gait cycle

GMFCS:

gross motor function classification system

ICC:

intraclass correlation coefficient

ICF:

International Classification of Functioning, Disability and Health

L:

left (leg)

LA:

less affected

MA:

more affected

MD:

median of differences

MMT:

manual muscle test

NA:

not applicable

R:

right (leg)

SD:

standard deviation

SEM:

standard error of measurement

SEM%:

percentage of standard error of measurement of the grand mean

SRD:

smallest real difference

SRD%:

percentage of smallest real difference of the grand mean

WHO:

World Health Organisation

References

  1. Paneth N, Hong T, Korzeniewski S. The Descriptive Epidemiology of Cerebral Palsy. Clin Perinatol. 2006;33:251–67.

    Article  PubMed  Google Scholar 

  2. Odding E, Roebroeck ME, Stam HJ. The epidemiology of cerebral palsy: Incidence, impairments and risk factors. Disabil Rehabil. 2006;28:183–91.

    Article  PubMed  Google Scholar 

  3. Reddihough DS, Collins KJ. The epidemiology and causes of cerebral palsy. Aust J Physiother. 2003;49:7–12.

    Article  PubMed  Google Scholar 

  4. Roehr B. Traumatic brain injury is more widespread than previously estimated. BMJ. 2012;345, e8098.

    Article  PubMed  Google Scholar 

  5. Brütsch K, Schuler T, Koenig A, Zimmerli L, Koeneke SM, Lünenburger L, et al. Influence of virtual reality soccer game on walking performance in robotic assisted gait training for children. J Neuroeng Rehabil. 2010;7:15.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Thompson P, Kin H, Jacobson G, Mscpt B. Test – retest reliability of the 10-metre fast walk test and 6-minute walk test in ambulatory with cerebral palsy. Dev Med Child Neurol. 2008;50:370–6.

    Article  PubMed  Google Scholar 

  7. de Groot JF, Takken T, Gooskens RHJM, Schoenmakers MAGC, Wubbels M, Vanhees L, et al. Reproducibility of maximal and submaximal exercise testing in ‘normal ambulatory’ and ‘community ambulatory’ children and adolescents with spina bifida: which is best for the evaluation and application of exercise training? Phys Ther. 2011;91:267–76.

    Article  PubMed  Google Scholar 

  8. Maher CA, Williams MT, Olds TS. The six-minute walk test for children with cerebral palsy. Int J Rehabil Res. 2008;31:185–8.

    Article  PubMed  Google Scholar 

  9. Li AM, Yin J, Yu CCW, Tsang T, So HK, Wong E, et al. The six-minute walk test in healthy children: reliability and validity. Eur Respir J. 2005;25:1057–60.

    Article  CAS  PubMed  Google Scholar 

  10. Bartels B, de Groot JF, Terwee CB. The six-minute walk test in chronic pediatric conditions: a systematic review of measurement properties. Phys Ther. 2013;93:529–41.

    Article  PubMed  Google Scholar 

  11. Wondra VC, Pitetti KH, Beets MW. Gait Parameters in Children with Motor Disabilities Using an Electronic Walkway System: Assessment of Reliability. Pediatr Phys Ther. 2007;19:326–31.

    Article  PubMed  Google Scholar 

  12. Mcdonough AL, Batavia M, Chen FC, Kwon S, Ziai J, Al AM, et al. The validity and reliability of the GAITRite system's measurements: A preliminary evaluation. Arch Phys Med Rehabil. 2001;82:419–25.

    Article  CAS  PubMed  Google Scholar 

  13. Menz HB, Latt MD, Tiedemann A, Mun San Kwan M, Lord SR. Reliability of the GAITRite walkway system for the quantification of temporo-spatial parameters of gait in young and older people. Gait Posture. 2004;20:20–5.

    Article  PubMed  Google Scholar 

  14. van Uden CJT, Besser MP. Test-retest reliability of temporal and spatial gait characteristics measured with an instrumented walkway system (GAITRite). BMC Musculoskelet Disord. 2004;5:13.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Morrison SC, Ferrari J, Smillie S. Are spatiotemporal gait characteristics reliable outcome measures in children with developmental coordination disorder? Pediatr Phys Ther. 2012;24:46–50.

    Article  PubMed  Google Scholar 

  16. Sorsdahl AB, Moe-Nilssen R, Strand LI. Test-retest reliability of spatial and temporal gait parameters in children with cerebral palsy as measured by an electronic walkway. Gait Posture. 2008;27:43–50.

    Article  PubMed  Google Scholar 

  17. Springate SD. The effect of sample size and bias on the reliability of estimates of error: a comparative study of Dahlberg’s formula. Eur J Orthod. 2012;34:158–63.

    Article  CAS  PubMed  Google Scholar 

  18. ATS. ATS statement: guidelines for the six-minute walk test. Am J Respir Crit Care Med. 2002;166:111–7.

    Article  Google Scholar 

  19. Durfee WK, Iaizzo PA. Rehabilitation and muscle testing. Encycl Med Devices. 2006;6:62–71.

    Google Scholar 

  20. Balzer J, Marsico P, Mitteregger E, van der Linden ML, Mercer TH, van Hedel HJA. Construct validity and reliability of the Selective Control Assessment of the Lower Extremity in children with cerebral palsy. Dev Med Child Neurol. 2015.

  21. Patterson KK, Gage WH, Brooks D, Black SE, McIlroy WE. Evaluation of gait symmetry after stroke: a comparison of current methods and recommendations for standardization. Gait Posture. 2010;31:241–6.

    Article  PubMed  Google Scholar 

  22. Bosch K, Rosenbaum D. Gait symmetry improves in childhood--a 4-year follow-up of foot loading data. Gait Posture. 2010;32:464–8.

    Article  PubMed  Google Scholar 

  23. Giakas G, Baltzopoulos V. Time and frequency domain analysis of ground reaction forces during walking: an investigation of variability and symmetry. Gait Posture. 1997;5:189–97.

    Article  Google Scholar 

  24. Carter R, Lubinsky J, Domholdt E. Rehabilitation Research: Principles and Applications. 4th ed. St. Louis: Elsevier Saunders; 2005.

    Google Scholar 

  25. Nunnally JC, Bernstein IH. Psychometric theory (3rd ed.) New York: McGraw-Hill; 1994.

    Google Scholar 

  26. Shrout PE, Fleiss JL. Intraclass Correlations: Uses in Assessing Rater Reliability. Psychol Bull. 1979;2:420–428.

    Article  Google Scholar 

  27. De Vet HCW, Terwee CB, Knol DL, Bouter LM. When to use agreement versus reliability measures. J Clin Epidemiol. 2006;59:1033–9.

    Article  PubMed  Google Scholar 

  28. Nair PM, Hornby TG, Behrman AL. Minimal detectable change for spatial and temporal measurements of gait after incomplete spinal cord injury. Top Spinal Cord Inj Rehabil. 2012;18:273–81.

    Article  PubMed  Google Scholar 

  29. Cunha MT, Rozov T, de Oliveira RC, Jardim JR. Six-minute walk test in children and adolescents with cystic fibrosis. Pediatr Pulmonol. 2006;41:618–22.

    Article  PubMed  Google Scholar 

  30. Hodt-Billington C, Helbostad JL, Moe-Nilssen R. Should trunk movement or footfall parameters quantify gait asymmetry in chronic stroke patients? Gait Posture. 2008;27:552–8.

    Article  PubMed  Google Scholar 

  31. Rossier P, Wade DT. Validity and Reliability Comparison of 4 Mobility Measures in Patients Presenting With Neurologic Impairment. Arch Phys Med Rehabil. 2001;82:9–13.

    Article  CAS  PubMed  Google Scholar 

Download references

Acknowledgements

Special thanks go to all the participants of this study and their parents and furthermore to all the therapists who conducted the walk tests. This study was funded by the Mäxi-Foundation (Zurich, Switzerland).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Hubertus J. A. van Hedel.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

JVG took over the study from CL, collected more data, performed all final analyses and wrote the manuscript. CL participated in designing the study, collected data, performed first data analyses and provided comments on the final version. HvH initiated and designed the study, provided statistical support and critically revised the manuscript. Complete access to the study data was available to Mrs. Graser and Dr. van Hedel. All authors read and approved the final manuscript.

Authors’ information

JVG is a physiotherapist with clinical experience in paediatrics since 2004. She finished an additional Masters in Physiotherapy in 2013 and started a PhD in 2014. She holds a clinical and research appointment in the Rehabilitation Center for Children and Adolescents of the University Children’s Hospital Zurich in Affoltern am Albis, Switzerland since 2011.

CL was a Master student of the Human Movement Sciences and Sports department of the ETH Zurich, who performed her master thesis in our group.

HvH was trained as a physiotherapist, received in 2004 a PhD in biomedical health sciences (major in movement sciences), and in 2009 a senior lecturer title in the field of Neurorehabilitation. He is head of Research and Therapies in the Rehabilitation Center for Children and Adolescents of the University Children’s Hospital Zurich in Affoltern am Albis, Switzerland.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Graser, J.V., Letsch, C. & van Hedel, H.J.A. Reliability of timed walking tests and temporo-spatial gait parameters in youths with neurological gait disorders. BMC Neurol 16, 15 (2016). https://doi.org/10.1186/s12883-016-0538-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12883-016-0538-y

Keywords