Skip to main content
  • Research article
  • Open access
  • Published:

An economic evaluation of an augmented cognitive behavioural intervention vs. computerized cognitive training for post-stroke depressive symptoms



Stroke survivors encounter emotional problems in the chronic phase after stroke. Post-stroke depressive symptoms have major impact on health-related quality of life (HRQol) and lead to increased hospitalization and therefore substantial healthcare costs. We present a cost-effectiveness and cost-utility evaluation of a cognitive behavioural therapy augmented with occupational and movement therapy to support patients with a stroke with depressive symptoms in goal-setting and goal attainment (augmented CBT) in comparison with a computerized cognitive training program (CogniPlus) as a control intervention.


A trial-based economic evaluation was conducted from a societal perspective with a time horizon of 12 months. Stroke patients (aged 18+ years) with signs of depression (Hospital Anxiety and Depression Scale (HADS) – subscale depression > 7) were eligible to participate. Primary outcomes were the HADS and Quality Adjusted Life Years (QALYs) based on the three-level five-dimensional EuroQol (EQ-5D-3 L). Missing data were handled through mean imputation (costs) and multiple imputation (HADS and EuroQol), and costs were bootstrapped. Sensitivity analyses were performed to test robustness of baseline assumptions.


Sixty-one patients were included. The average total societal costs were not significantly different between the control group (€9,998.3) and the augmented CBT group (€8,063.7), with a 95 % confidence interval (−5,284, 1,796). The augmented CBT intervention was less costly and less effective from a societal perspective on the HADS, and less costly and slightly more effective in QALYs, in comparison with the control treatment. The cost-effectiveness and cost-utility analyses provided greater effects and fewer costs for the augmented CBT group, and fewer effects and costs for the HADS. Based on a willingness to pay (WTP) level of €40,000 per QALY, the augmented CBT intervention had a 76 % chance of being cost-effective. Sensitivity analyses showed robustness of results.


The stroke-specific augmented CBT intervention did not show convincing cost-effectiveness results. In addition to other literature, this study provided new insights into the potential cost-effectiveness of an adjusted cognitive behavioural therapy intervention. However, as our study showed a 76 % chance of being cost-effective for one outcome measure (QALY) and did not provide convincing cost-effectiveness results on the HADS we recommend further research in a larger population.

Peer Review reports


Stroke is a leading cause of death and a source of persistent disability around the world [1]. Annually, 6.7 million people die from stroke, representing 12 % of all global deaths [2]. As a disease of aging, the prevalence of stroke is expected to increase significantly around the world in the years ahead as the global population older than 65 years of age continues to increase by approximately nine million people per year [3]. Stroke survivors often encounter severe cognitive and emotional consequences [4]. Post-stroke depressive symptoms occur frequently in the chronic phase after stroke [59]. Recent data from the National Stroke Association (United Kingdom) show that approximately one-third of stroke survivors is affected by varying degrees of post-stroke depression amongst other symptoms [10]. In addition, these symptoms often coincide with increased feelings of anxiety [11]. Besides the major impact on health-related quality of life (HRQol) [12], post-stroke depressive symptoms are associated with increased hospitalization and therefore substantial healthcare costs [13].

Stroke puts a high burden of disease on patients and their caregivers, as well as a considerable financial burden on society. Currently, approximately 3–4 % of total healthcare expenditures in Western countries are spent on stroke [14]. Even greater healthcare expenditures are likely in the near future, with expected increases in the elderly population and the availability of new and better treatments for stroke patients. As healthcare resources are limited and choices have to be made, interest in the economic aspect of stroke and cost-effective stroke-specific interventions has increased in the past few years [15].

Previous research has been used to evaluate different interventions focusing on the treatment of post-stroke depressive symptoms, such as pharmacological interventions [16, 17], yet evidence for the effectiveness of stroke-specific psychological interventions is limited [18]. This is mainly related due to possible lack of efficacy of the interventions under investigation, but also caused by poor study design [19]. There are, however, indications that the use of cognitive behavioural therapy (CBT) might be both effective and cost-effective, based on the treatment of other chronic conditions [2025]. Psychological interventions, such as CBT, seem promising in terms of effectiveness because they result in fewer side effects than medication and have a stronger effect on preventing relapse of symptoms than pharmacotherapy [20, 2629]. With respect to psychological interventions, fewer side effects and reduction in relapse are potentially strong indicators for cost-effectiveness. Furthermore, the characteristics of CBT seem to suggest it ought to be an especially good fit to meet the needs of people who suffer from post-stroke depression [17]. Depressed stroke survivors endorse significantly more negative conditions than non-depressed stroke survivors [30, 31] In addition, there is good evidence that remaining active, expressing emotion and finding positive meaning ensures good psychological adjustment in other chronic illnesses [32].

The current study describes the cost-effectiveness and cost-utility of a cognitive behavioural therapy augmented with occupational and movement therapy to support stroke patients with depressive symptoms in goal setting and goal attainment (augmented CBT) for stroke patients suffering from post-stroke depressive symptoms, in comparison with a computerized cognitive training program (CogniPlus) as a control intervention. Our aim was to determine the cost-effectiveness of both interventions from a societal perspective.



The current study and economic evaluation were performed according to the Consolidated Health Economic Evaluation Reporting Guidelines (CHEERS) [33]. The study design and methods were approved by the medical ethical committee of Nijmegen (The Netherlands) and by the executive boards of all participating rehabilitation institutions. The indented time points of assessment were post hoc approved by the same medical ethical committee.


The current study describes an economic evaluation which was linked to the Restore4stroke CBT study: a multi-centre randomized controlled trial (RCT) conducted in five rehabilitation centres and in the rehabilitation department of one general hospital in the Netherlands. The Medical Ethics Committee of the Radboud University Medical Centre and the executive boards of the participating institutes approved the study. The inclusion of participants took place between February 2012 and October 2013. All patients provided written informed consent. The RCT was registered in the Dutch Trial Register as NTR2999. Detailed information on the methods of this RCT and the current study can be found elsewhere [15, 34].

Eligibility criteria

Patients where included if they: (1) suffered any type of stroke in the last 3 months and complaints in mood (indicating possible symptoms of anxiety or depression) occurred post stroke, (2) were 18 years or older, (3) scored >7 on the HADS depression subscale (HADS-D) [35], (4) mastered the Dutch language, and (5) had sufficient communication skills based on the Mini-Mental State Examinate [36] > 27 and had normal score (>0) on communication items of the National Institutes of Health Stroke Scale items [37]. Patients were excluded if they: (1) scored < 19/20 on the Barthel Index [5] indicating premorbid disabilities, (2) were staying in an in-patient setting, (3) suffered from co-morbidity that might affect outcomes (e.g. cancer or major psychiatric illnesses for which psychological treatment was being given at the moment of inclusion), (4) were diagnosed with a major depression requiring medication, or (5) were diagnosed with a pre-morbid depression or had received psychiatric care for depression.


The augmented CBT intervention was individually administered and tailored according to specific subjects-own activity-related goals. These goals could capture domains as e.g. self-care, leisure, household, work, and improvement of mobility-related goals such as movement and walking. The CBT treatment program consisted of 10–12 sessions with a certified healthcare psychologist, experienced in the treatment of depression and stroke rehabilitation. The augmentation part of the intervention was specifically aimed at supporting patients in goal setting and goal attainment. This part consisted of three sessions of occupational therapy (OT) or movement therapy (MT) provided by an occupational or movement therapist. Each of these sessions was comprised of 20–25 min blocks divided by a 10–15 min break. If a patient’s score on the HADS subscale anxiety (HADS-A) was > 7, the protocol was expanded with an additional (fourth) OT/MT session [38]. All treatments were provided at the closest participating centre and the complete program was executed within 4 months.

The control group was provided with an individual, patient-tailored computerized cognitive training program (CogniPlus) [39]. In specific self-determined cognitive domains (e.g. attention, memory, executive functioning, and visual attention) patients executed computer tasks on their own performance level. This impairment-oriented intervention consisted of 13–16 sessions provided at participating centres under the supervision of a research assistant or psychological assistant, for a period of 4 months. We chose to compare the augmented CBT intervention to an ‘active’ intervention (and not usual care) to control for Hawthorne effects. Evidence from Spikman et al. [40] showed that a similar control group did not improve in executive functioning, and that generalisation of what was assessed in the control intervention to daily life did not occur. Further information on the justification of both interventions can be found elsewhere [15, 34].


Treating physicians and healthcare psychologists of the participating institutes were informed about the inclusion and exclusion criteria of the study. Accordingly, they recruited eligible patients at participating centres. Potential participants were contacted by the primary researcher (JK) and informed about the intervention. In case of a positive reply, an individual appointment was made to confirm the inclusion and exclusion criteria, to obtain written consent, and to conduct the baseline assessment. Patients were randomly allocated to either the augmented CBT group or control group. Stratified block randomization (block size four) was conducted, in which level of anxiety was a minimization factor (HADS-A > 7 vs ≤ 7). Follow-up assessments took place at the nearest participating centre for each patient and were conducted by a research assistant who was blinded to the type of intervention provided to the patient. Prior to each assessment, the assessor explicitly asked patients not to talk about the content of their intervention. The success of assessor blinding was ensured with a short self-constructed questionnaire at the end of each assessment.

Time horizon

Patients were randomly allocated to one of the interventions after the baseline assessment (T0). Assessments took place post treatment (T1), at 8 months follow-up (T2) and at 12 months follow-up (T3).

Sample size

Based on a minimal detectable effect size of 0.6 the standard deviation (SD) on the HADS (α = 0.05; β = 0.80), a minimum of 45 participants per group was required. With an expected dropout of 15 %, 106 participants needed to be recruited. However, due to recruitment difficulties we were not able to include the minimum amount of participants necessary. Reconsidering the proposed analysis of the Restore4stroke CBT study, it was decided to add the T1 measurement next to T2 to estimate the effect of treatment outcomes. These repeated measures at T1 and T2 would reduce variance, double the power and reduce the required sample size. Therefore, a new power (n = 53; α = 0.05; β = 0.80) allowed us to continue with fewer participants than originally planned. The Medical Ethics Committee approved an amendment containing these changes.

Outcome measures

The main outcome for the cost-effectiveness analysis (CEA) was depression and anxiety, assessed by the HADS (total score). The HADS is a 14-item questionnaire (seven questions concerning ‘depression’ and seven questions concerning ‘anxiety’) on a 4-point scale. Higher scores on the HADS indicate greater levels of depression and/or anxiety. The validity and reliability of the HADS has been determined in previous research [41].

The main outcome for the cost-utility analysis (CUA) was health-related quality of life (further referred to as QoL), as measured by with the five-dimensional three-level EuroQol (EQ-5D-3 L) [42]. The five EuroQol dimensions are mobility, self-care, usual activities, pain/discomfort and anxiety/depression. To estimate the utility of health states described by patients, we used the Dutch tariff [43]. Quality adjusted life years (QALYs) were calculated by means of the area under the curve method. Higher QALYs indicate more improvement in QoL.

Resource use and costs

A 19-item self-report cost-questionnaire was constructed to collect cost data from a societal perspective, based on the steps described by Thorn [44]. The validity and feasibility of generic self-report questionnaires has been investigated elsewhere [45]. As a societal perspective is a broad perspective in which all relevant costs for the whole population are incorporated [46], we included four main cost categories in this study: intervention, healthcare, patient- and family-related, and productivity costs. A bottom-up approach was used to determine intervention costs (e.g. intervention materials, consultation hours with a psychologist). Healthcare costs covered care provider utilization (e.g. general practitioner and medical specialist consultations), complementary medicine, home care and medication. As a guideline for calculating healthcare costs we used the Dutch Manual for Costing [47].

Medical and personal aids were based on costs per user within the aid category provided by the Dutch care institute [] and the costs of prescription medicines were valued by the price per dosage for drug costs in the Netherlands [48, 49]. Travel costs and costs of informal care were included as patient- and family costs. Travel costs were calculated by multiplying the average distance with standard price weights provided by The Dutch Manual for Costing [47], corrected for the costs of public transport and parking costs. Shadow prices were used to determine the costs of informal care, which were equal to the hourly wage rates of professional caregivers (i.e. housekeepers). Productivity costs were valued according to the human capital approach. This approach states that productivity costs are calculated by multiplying the number of sick days by the costs of labour, corrected for different age categories. The human capital approach is the international standard in calculating productivity costs, whereas its counterpart, the friction cost method, is subject to variability in the national economic cycles [50, 51]. Furthermore, due to changes in Dutch legislations, it is unlikely for employees that they are being replaced, making it imperative to include long-term absenteeism as well.

Currency, price date and conversion

All costs reported in this study were expressed in Euro’s (€). Consumer price indices were used to adjust all costs to the index year 2012 [52]. Discounting was not necessary since the follow-up period of the current study did not exceed 1 year.

Analytic methods

Intention-to-treat was used to analyse data. Missing values for resource use were handled by individual mean imputation, the recommended imputation methods on dealing with intermittent data in economic evaluation studies [53]. Missing data on the main outcomes were handled by multiple imputation (MI). MI is a technique often used to analyse data sets with missing values; it is the process of replacing each missing data point with a set of plausible values to generate complete data sets [54]. Since baseline utility measurements are included when calculating QALYs we consider any baseline difference in utility scores as a potential bias, regardless of whether or not this difference is significant or not. Therefore, we used a regression based correction method to correct for baseline differences in utility scores [55].

An incremental cost-effectiveness ratio (ICER) was calculated by dividing the incremental costs by the incremental effects, and an incremental cost-utility ratio was calculated by dividing the incremental costs by the differences in QALY. We used non-parametric bootstrapping (5000 replications) to estimate the uncertainty surrounding the ICER, due to the highly skewed cost distribution. Bootstrapped cost-effectiveness and cost-utility pairs were presented in cost-effectiveness planes (CE-planes). Statistically significant differences in costs were determined by means of a 95 % confidence interval (further referred to as CI). If the CI entailed a ‘0’ value, no statistical differences in costs were found.

Furthermore, a cost-effectiveness acceptability curve (CEAC) was made to express the probability of the augmented CBT intervention being a cost-effective alternative in comparison with the control intervention. A CEAC shows the probability of an intervention to be a cost-effective alternative for a certain threshold; the amount of money society is willing to pay (WTP) to gain one unit of effect (e.g. a one-point improvement on the HADS or one QALY). For the HADS, the WTP threshold is an unknown quantity. A previous study on manual psychological therapy for dementia patients used a WTP level of €500 per one-point improvement on the HADS [56]. The minimal important difference of the HADS has not been established, but in patients with chronic obstructive pulmonary disease (COPD) a minimal important difference of 1.6 was found [57]. The WTP threshold for a QALY differs per country or even within countries. In the Netherlands, the Dutch Council of Public Health and Care published a report in 2006 regarding the burden of disease in the Netherlands, estimating a QALY threshold for stroke at €40,000 Euros [58]. All statistical analyses were performed using the Statistical Package for the Social Sciences (SPSS) version 21 or Microsoft Excel (bootstrapping).

Sensitivity analyses

To test the robustness of assumption made in the base case analyses, we conducted four one-way sensitivity analyses. First, the price for a rehabilitation day treatment was decreased to €117, equal to a regular rehabilitation consultation. Second, the friction cost method was used to calculate productivity costs instead of the human capital approach [47]. Third, we compared our base case societal perspective for calculating costs with a healthcare perspective. Finally, as different sets of tariffs exist to calculate utilities, we analysed the impact of the use of Dutch tariffs versus United Kingdom (UK) tariffs [59].



One hundred sixty-three patients were assessed regarding their eligibility for participation in this study (Fig. 1). Eighty-three patients were found ineligible based on their HADS-D score (≤7) and 15 patients did not meet other inclusion criteria. After baseline measurement, four patients dropped out due to various reasons. Thus, a total of 61 patients were included in this study (Table 1). Thirty-one patients (52 %) were allocated to the augmented CBT group and 30 patients (48 %) to the control group. As presented in Fig. 1, the percentage of missing data at T1 was 15 % (n = 9), at T2 was 21 % (n = 13) and at T3 was 28 % (n = 17).

Fig. 1
figure 1

Inclusion of patients

Table 1 Baseline patients’ characteristics (n = 61)

Cost analysis

The average total societal costs were greater for the control group (€9,998) in comparison with the augmented CBT group (€8,064), but this difference between the two groups was not significant (CI: −5284, 1,796). Healthcare costs were also greater for the control group (€5,055 compared to €3,771), but this difference was not significant either (CI: −3,039, 465). Specialist visits was the only cost category within healthcare costs that showed significantly greater costs for the control group (€993) in comparison with the augmented CBT group (€539) (CI: −868, −38). The non-healthcare costs were also in favour of the intervention group (€4,926 in comparison with €4,333 in the control group), however, no significant difference was found (CI: −2,778, 1,551). Both the productivity costs (CI: −3,065, −93) and the productivity costs of the caregiver (CI: −1,354, −27) were significantly greater for the control group. As expected, intervention costs were greater for the augmented CBT group (€1,130 in comparison with €592). Further details are presented in Table 2.

Table 2 Average resource use and costs per category over 12 months (bootstrapped)

Cost-effectiveness and cost-utility

The CEA for the HADS showed that the augmented CBT group induced fewer costs (−€1,913) but also fewer effects (−0.8), resulting in an ICER of €2,395 (Table 3). The majority of bootstrapped ICERs (58 %) were located in the southwest (SW) quadrant of the CE-plane (Fig. 2) indicating fewer costs and fewer effects for the augmented CBT intervention, and 29 % of the bootstrapped ICERs were located in the dominant southeast (SE) quadrant indicating greater effects and fewer costs for the augmented CBT intervention.

Table 3 Mean cost and effect differences between the Augmented CBT group and CogniPlus group, incremental cost-effectiveness ratios and cost-effectiveness plane distributions
Fig. 2
figure 2

Cost-effectiveness plane HADS and cost-effectiveness acceptability curve HADS

Patients in the augmented CBT group gained slightly more QALYs (mean: 0.01) compared to control group patients. More QALYs gained combined with fewer societal costs (−€1,913) induced by the augmented CBT group resulted in a dominant ICER. As presented in Fig. 3, 31 % of the bootstrapped ICERs were located in the SW quadrant (fewer costs and effects) of the CE-plane and 55 % of the bootstrapped ICERs were located in the dominant SE quadrant (fewer costs and greater effects).

Fig. 3
figure 3

Cost-effectiveness plane QALY and cost-effectiveness acceptability curve QALY

The cost-effectiveness acceptability curves (CEACs) of the HADS and QALY are also presented in Figs. 2 and 3. The slope of the HADS CEAC indicates that with a WTP threshold of €2,500, the probability of the augmented CBT intervention being cost-effective was 49 %. Furthermore, greater WTP levels showed an increasing decline in the probability of the augmented CBT intervention being cost-effective. In the Netherlands, there is no fixed WTP threshold for a QALY, but the threshold is dependent on the burden of disease [58]. Based on the burden of stroke, a WTP level of €40,000 was considered acceptable [58]. Using this threshold, the QALY CEAC indicates that there is a 76 % chance that the augmented CBT intervention will be cost-effective.

Sensitivity analysis

A sensitivity analysis was performed to estimate the impact of reducing the price of a rehabilitation treatment day, on the cost-effectiveness results (Table 4). The analysis proved robustness of the base case assumption for this parameter for both the HADS and QALY, as it resulted in a slightly lower ICER and no major changes in distributions on the CE-plane (7. 4). Calculating productivity costs by means of the friction cost method resulted in a much lower ICER for both the HADS and QALY and major shifts in distributions on the CE-plane to both ‘west’ quadrants (indicating fewer costs for the augmented CBT group). Estimating total costs from a healthcare perspective resulted in lower ICERs for both outcome measures; this was due to fewer cost categories being included. A major shift on the CE-plane of the QALY is noticeable towards the northeast (NE) quadrant (greater costs and greater effects). Finally, UK tariffs were used to calculate QALYs resulting in a decrease in ICER, and again, a shift on the CE-plane towards the SE quadrant.

Table 4 Sensitivity analysis


To our knowledge, this is the first cost-effectiveness analysis performed on a prospective randomized comparison of an augmented CBT intervention versus computerized cognitive training (CogniPlus) for post-stroke depressive symptoms.

The results of this study provides evidence that, using the HADS as an outcome, the augmented CBT intervention for stroke patients was less costly and less effective from a societal perspective and less costly and slightly more effective in terms of QALYs, compared to the control treatment. Cost differences between the two groups could be explained by costs of admission to a hospital, specialist consultations and home adjustments, but the larger part of the difference in total costs was due to productivity costs of both the patient and the caregiver which were both significantly less in the augmented CBT group. The fact that, at baseline, 43.3 % of the control group had paid work, in comparison with only 29 % of the augmented CBT group, and that patients in the control group worked more than twice the number of hours per week might explain this difference.

The results of the cost-effectiveness analysis showed that the probability of the augmented CBT intervention being cost effective was 49 % for a WTP of €2,500. No fixed WTP threshold for the HADS exists, but previous research used a WTP of €500 per point improvement on the HADS based on expert opinion [56]. A dominant ICER for the QALY was found, indicating greater effects and fewer costs for the augmented CBT group. Combined with a high probability of the augmented CBT intervention being cost-effective, the results from the cost-utility analysis were in favour of the augmented CBT intervention. However, due to the minimal difference in effects (mean: 0.1), these results should be interpreted with caution.

In general, the sensitivity analyses showed robustness of results. For the HADS, a distinct shift in the distribution of bootstrapped ICERs was noticeable when calculating productivity costs with the friction method. This might be expected, since the friction cost method accounts for a shorter period of productivity losses resulting in fewer costs, and a lower ICER with the same difference in HADS score and a slightly greater probability of the augmented CBT intervention being cost-effective. This was also observed for the friction method, employed as a sensitivity analysis with regard to QALYs. A major shift was noticeable when conducting the cost-utility analysis from a healthcare perspective instead of the societal perspective. It appeared that the augmented CBT group induced both greater costs and greater effects leading to a shift on the CE plane towards the NE quadrant. This, and the fact that the difference in effect was minimal, indicated that the majority of total costs for the control group were accounted for by non-healthcare costs.

To our knowledge, this current study provides new but preliminary evidence on the cost-effectiveness of a stroke-specific augmented cognitive behavioural therapy. Four previous studies investigating a comparable intervention in different populations showed similar results [2224, 27]. More precisely, recent research on the effectiveness of an online CBT intervention for depressive patients found greater costs for CBT group and a cost per QALY gained of €23.857, which is below the acceptable UK threshold of €27.784 per QALY [21]. Although this study was conducted from a National Health Services (NHS) perspective and the CBT intervention was compared with care as usual, the conclusions drawn from this study where in line with the current study results, indicating the potential cost-effectiveness of CBT. Another study evaluating the effectiveness of CBT for depressive patients in a non-stroke population reported greater costs and greater effects in terms of QALYs, resulting in a base case ICER of €20.714 [25]. Two other studies on the cost-effectiveness of CBT for patients with low-back pain and for people with schizophrenia-spectrum disorder also showed the possible cost-effectiveness of cognitive behavioural therapy [22, 24]. It is important to note that these previous studies chose ‘care as usual’ as comparator, whereas the current study chose a computerized training (CogniPlus). The choice of comparator is a critical design parameter in economic evaluation research and may influence study results [60].

Strengths and limitations

To our knowledge, there has been no previous economic evaluation research on a stroke-specific cognitive behavioural therapy. Furthermore, the cost-effectiveness and cost-utility analyses in this study were conducted from a societal perspective, which is also considered to be a strength because it provides extensive evidence on a broad range of costs. Finally, both the outcome assessors and research assistants were blinded for the randomised treatment.

The current study was also subject to several limitations. First, due to recruitment difficulties we were not able to include the desired amount of participants, which was the reason for performing a new power calculation. Still, the current study results must be interpreted with caution due to the small sample size. Next, we had to deal with a considerable number (n = 17; 28 %) of missing values on T3 measurement concerning the HADS and EQ-5D-3 L. A multiple imputation (MI) method was used to handle these missing values [54]. There are alternative methods for imputation, such as linear mixed models, but since cost-effectiveness analysis requires individual patient data we believe that MI was the best method for the analyses performed in the current study. Also, productivity costs of the caregivers were estimated with a mean hourly wage and a mean age, since information with respect to the employment of caregivers was limited. Finally, we found and measured differences between interventions within the time horizon chosen for this study. However, with progressing insight, we would argue that it would be interesting to expand the time horizon, by adding extra follow-up measurement moments or using modelling techniques in further research in order to identify the long-term effects of both interventions in comparison to each other.

Concluding remarks

Taking into account the limitations of the current study, we conclude that the preliminary results of the cost-effectiveness of the stroke-specific augmented CBT intervention under investigation were not convincing. As our study showed a 76 % chance of being cost-effective for one outcome measure (QALY) and did not provide convincing cost-effectiveness results on the HADS. However, other studies showed the potential for the augmented CBT intervention to be cost-effective in treating depression. Although we have argued why we have chosen an ‘active’ control intervention, it would be very interesting to investigate the effect of including a care as usual group as third study arm in future research. Also, in addition to other literature, this study provided new insights into the potential cost-effectiveness of an adjusted cognitive behavioural therapy intervention. Therefore, for further research we would recommend recruitment of a larger stroke population, i.e. in multiple sites.



Health-related quality of life


Cognitive behavioural therapy


Hospital anxiety and depression subscale


Quality-adjusted life year

EQ-5D-3 L:

Three-level five-dimensional EuroQol


United Kingdom


Incremental cost-effectiveness ratio


Willingness to pay


Consolidated health economic evaluation reporting standards


Randomized controlled trial


Mini-mental state examinate


National Institute of Health Stroke Scale


Occupational therapy


Movement therapy


Standard deviation


Joyce Kootker


Cost-effectiveness analysis


Cost-utility analysis


General practitioner


Multiple imputation


Cost-effectiveness plane


Confidence interval


Cost-effectiveness acceptability curve


Statistical Package for the Social Sciences










National Health Services


  1. Jaracz K, Grabowska-Fudala B, Kozubski W. Caregiver burden after stroke: towards a structural model. Neurol Neurochir Pol. 2012;46(3):224–32.

    PubMed  Google Scholar 

  2. World Health Organization []

  3. WHO. World Health Report: Changing History. Geneva, Switzerland: World Health Organization; 2004.

  4. Rasquin SM, Van De Sande P, Praamstra AJ, Van Heugten CM. Cognitive-behavioural intervention for depression after stroke: five single case studies on effects and feasibility. Neuropsychol Rehabil. 2009;19(2):208–22.

    Article  CAS  PubMed  Google Scholar 

  5. Aben I, Verhey F, Strik J, Lousberg R, Lodder J, Honig A. A comparative study into the 1 year cumulative incidence of depression after stroke and myocardial infarction. J Neurol Neurosurg Psychiatry. 2003;74(5):581–5.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  6. De Wit L, Putman K, Baert I, Lincoln NB, Angst F, Beyens H, et al. Anxiety and depression in the first 6 months after stroke. A longitudinal multicentre study. Disabil Rehabil. 2008;30(24):1858–66.

    Article  PubMed  Google Scholar 

  7. Gainotti G, Azzoni A, Lanzillotta M, Marra C, Razzano C. Some preliminary findings concerning a new scale for the assessment of depression and related symptoms in stroke patients. Ital J Neurol Sci. 1995;16(7):439–51.

    Article  CAS  PubMed  Google Scholar 

  8. van Mierlo ML, van Heugten CM, Post MWM, Lindeman E, de Kort PLM, Visser-Meily JMA. A longitudinal cohort study on quality of life in stroke patients and their partners: Restore4Stroke Cohort. Int J Stroke. 2014;9(1):148–54.

    Article  PubMed  Google Scholar 

  9. Wilkinson PR, Wolfe CD, Warburton FG, Rudd AG, Howard RS, Ross-Russell RW, et al. A long-term follow-up of stroke patients. Stroke. 1997;28(3):507–12.

    Article  CAS  PubMed  Google Scholar 

  10. Post-Stroke Depression []

  11. Lincoln NB, Brinkmann N, Cunningham S, Dejaeger E, De Weerdt W, Jenni W, et al. Anxiety and depression after stroke: a 5 year follow-up. Disabil Rehabil. 2013;35(2):140–5.

    Article  CAS  PubMed  Google Scholar 

  12. Rastenyte D, Kranciukaite D. Poststroke depression and its impact on quality of life. Medicina (Kaunas). 2007;43(1):1–9.

    Google Scholar 

  13. Husaini B, Levine R, Sharp L, Cain V, Novotny M, Hull P, et al. Depression increases stroke hospitalization cost: an analysis of 17,010 stroke patients in 2008 by race and gender. Stroke Res Treat. 2013;2013:846732.

    PubMed  PubMed Central  Google Scholar 

  14. Struijs JN, van Genugten ML, Evers SM, Ament AJ, Baan CA, van den Bos GA. Future costs of stroke in the Netherlands: the impact of stroke services. Int J Technol Assess Health Care. 2006;22(4):518–24.

    Article  PubMed  Google Scholar 

  15. van Eeden M, van Heugten CM, Evers SM. The economic impact of stroke in The Netherlands: the euro-Restore4Stroke study. BMC Public Health. 2012;12:122.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Hackett ML, Anderson CS. Predictors of depression after stroke: a systematic review of observational studies. Stroke. 2005;36(10):2296–301.

    Article  PubMed  Google Scholar 

  17. Hackett ML, Anderson CS, House A, Halteh C. Interventions for preventing depression after stroke. Cochrane Database Syst Rev. 2008;3:CD003689.

    PubMed  Google Scholar 

  18. Broomfield NM, Laidlaw K, Hickabottom E, Murray MF, Pendrey R, Whittick JE, et al. Post-stroke depression: the case for augmented, individually tailored cognitive behavioural therapy. Clin Psychol Psychother. 2011;18(3):202–17.

    Article  PubMed  Google Scholar 

  19. Hackett ML, Anderson CS, House A, Halteh C. Interventions for preventing depression after stroke. Cochrane Database Syst Rev. 2008;3:CD003689.

    PubMed  Google Scholar 

  20. Cuijpers P, Smit F, Bohlmeijer E, Hollon SD, Andersson G. Efficacy of cognitive-behavioural therapy and other psychological treatments for adult depression: meta-analytic study of publication bias. Br J Psychiatry. 2010;196(3):173–8.

    Article  PubMed  Google Scholar 

  21. Hollinghurst S, Peters TJ, Kaur S, Wiles N, Lewis G, Kessler D. Cost-effectiveness of therapist-delivered online cognitive-behavioural therapy for depression: randomised controlled trial. Br J Psychiatry. 2010;197(4):297–304.

    Article  PubMed  Google Scholar 

  22. Lamb SE, Hansen Z, Lall R, Castelnuovo E, Withers EJ, Nichols V, et al. Group cognitive behavioural treatment for low-back pain in primary care: a randomised controlled trial and cost-effectiveness analysis. Lancet. 2010;375(9718):916–23.

    Article  PubMed  Google Scholar 

  23. McCrone P, Ridsdale L, Darbishire L, Seed P. Cost-effectiveness of cognitive behavioural therapy, graded exercise and usual care for patients with chronic fatigue in primary care. Psychol Med. 2004;34(6):991–9.

    Article  CAS  PubMed  Google Scholar 

  24. van der Gaag M, Stant AD, Wolters KJ, Buskens E, Wiersma D. Cognitive-behavioural therapy for persistent and recurrent psychosis in people with schizophrenia-spectrum disorder: cost-effectiveness analysis. Br J Psychiatry. 2011;198(1):59–65. sup 51.

    Article  PubMed  Google Scholar 

  25. Wiles N, Thomas L, Abel A, Barnes M, Carroll F, Ridgway N, et al. Clinical effectiveness and cost-effectiveness of cognitive behavioural therapy as an adjunct to pharmacotherapy for treatment-resistant depression in primary care: the CoBalT randomised controlled trial. Health Technol Assess. 2014;18(31):1–167. vii-viii.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Anson K, Ponsford J. Coping and emotional adjustment following traumatic brain injury. J Head Trauma Rehabil. 2006;21(3):248–59.

    Article  PubMed  Google Scholar 

  27. Anson K, Ponsford J. Evaluation of a coping skills group following traumatic brain injury. Brain Inj. 2006;20(2):167–78.

    Article  PubMed  Google Scholar 

  28. Bedard M, Felteau M, Mazmanian D, Fedyk K, Klein R, Richardson J, et al. Pilot evaluation of a mindfulness-based intervention to improve quality of life among individuals who sustained traumatic brain injuries. Disabil Rehabil. 2003;25(13):722–31.

    Article  PubMed  Google Scholar 

  29. Lincoln NB, Flannaghan T, Sutcliffe L, Rother L. Evaluation of cognitive behavioural treatment for depression after stroke: a pilot study. Clin Rehabil. 1997;11(2):114–22.

    Article  CAS  PubMed  Google Scholar 

  30. Nicholl CR, Lincoln NB, Muncaster K, Thomas S. Cognitions and post-stroke depression. Br J Clin Psychol. 2002;41(Pt 3):221–31.

    Article  PubMed  Google Scholar 

  31. Vickery CD, Sepehri A, Evans CC. Self-esteem in an acute stroke rehabilitation sample: a control group comparison. Clin Rehabil. 2008;22(2):179–87.

    Article  PubMed  Google Scholar 

  32. de Ridder D, Geenen R, Kuijer R, van Middendorp H. Psychological adjustment to chronic disease. Lancet. 2008;372(9634):246–55.

    Article  PubMed  Google Scholar 

  33. Husereau D, Drummond M, Petrou S, Carswell C, Moher D, Greenberg D, et al. Consolidated Health Economic Evaluation Reporting Standards (CHEERS)--explanation and elaboration: a report of the ISPOR Health Economic Evaluation Publication Guidelines Good Reporting Practices Task Force. Value Health. 2013;16(2):231–50.

    Article  PubMed  Google Scholar 

  34. Kootker J, Fasotti L, Rasquin S, van Heugten C, Geurts A. The effectiveness of an augmented cognitive behavioural intervention for post-stroke depression with or without anxiety (PSDA): the Restore4Stroke-PSDA trial. BMC Neurol. 2012;12(1):51.

    Article  PubMed  PubMed Central  Google Scholar 

  35. Zigmond AS, Snaith RP. The hospital anxiety and depression scale. Acta Psychiatr Scand. 1983;67(6):361–70.

    Article  CAS  PubMed  Google Scholar 

  36. O’Bryant SE, Humphreys JD, Smith GE, Ivnik RJ, Graff-Radford NR, Petersen RC, et al. Detecting dementia with the mini-mental state examination in highly educated individuals. Arch Neurol. 2008;65(7):963–7.

    PubMed  PubMed Central  Google Scholar 

  37. Meyer BC, Hemmen TM, Jackson CM, Lyden PD. Modified National Institutes of Health Stroke Scale for use in stroke clinical trials: prospective reliability and validity. Stroke. 2002;33(5):1261–6.

    Article  PubMed  Google Scholar 

  38. van Erp J. Relaxation exercises (ontspanningsoefeningen; bodyscan, aandacht voor uw lichaam), De Hart&Vaat groep. 2010.

    Google Scholar 

  39. CogniPlus [].

  40. Spikman JM, Boelen DH, Lamberts KF, Brouwer WH, Fasotti L. Effects of a multifaceted treatment program for executive dysfunction after acquired brain injury on indications of executive functioning in daily life. J Int Neuropsychol Soc. 2010;16(1):118–29.

    Article  PubMed  Google Scholar 

  41. Spinhoven P, Ormel J, Sloekers PP, Kempen GI, Speckens AE, Van Hemert AM. A validation study of the Hospital Anxiety and Depression Scale (HADS) in different groups of Dutch subjects. Psychol Med. 1997;27(2):363–70.

    Article  CAS  PubMed  Google Scholar 

  42. Golicki D, Niewada M, Buczek J, Karlinska A, Kobayashi A, Janssen MF, et al. Validity of EQ-5D-5L in stroke. Qual Life Res. 2015;24(4):845–50.

    Article  PubMed  Google Scholar 

  43. Lamers LM, McDonnell J, Stalmeier PFM, Krabbe PFM, Busschbach JJV. The Dutch tariff: results and arguments for an effective design for national EQ-5D valuation studies. Health Econ. 2006;15(10):1121–32.

    Article  CAS  PubMed  Google Scholar 

  44. Thorn JC, Coast J, Cohen D, Hollingworth W, Knapp M, Noble SM, et al. Resource-use measurement based on patient recall: issues and challenges for economic evaluation. Appl Health Econ Health Policy. 2013;11(3):155–61.

    Article  PubMed  Google Scholar 

  45. Noben CY, Evers SM, Nijhuis FJ, de Rijk AE. Quality appraisal of generic self-reported instruments measuring health-related productivity changes: a systematic review. BMC Public Health. 2014;14:115.

    Article  PubMed  PubMed Central  Google Scholar 

  46. Jonsson B. Ten arguments for a societal perspective in the economic evaluation of medical innovations. Eur J Health Econ. 2009;10(4):357–9.

    Article  PubMed  Google Scholar 

  47. Oostenbrink JB, Koopmanschap M.A, Rutten F.F.H. Handleiding voor Kostenonderzoek. In. Edited by Adang EMM: Institute for Medical Technology Assessment; 2010: 126.

  48. Farmacotherapeutisch Kompas: Medisch farmaceutische voorlichting [].

  49. Drug costs in the Netherlands [].

  50. Hutubessy RC, van Tulder MW, Vondeling H, Bouter LM. Indirect costs of back pain in the Netherlands: a comparison of the human capital method with the friction cost method. Pain. 1999;80(1–2):201–7.

    Article  CAS  PubMed  Google Scholar 

  51. Johannesson M, Karlsson G. The friction cost method: a comment. J Health Econ. 1997;16(2):249–55. discussion 257–249.

    Article  CAS  PubMed  Google Scholar 

  52. (CBS) CBvdS. Indexcijfers. 2012.

    Google Scholar 

  53. Hendriks MRC, Al MJ, Bleijlevens MHC, van Haastregt JCM, Crebolder HFJM, van Eijk JTM, et al. Continuous versus Intermittent Data Collection of Health Care Utilization, Medical Decision Making. 2013.

    Google Scholar 

  54. Sinharay S, Stern HS, Russell D. The use of multiple imputation for the analysis of missing data. Psychol Methods. 2001;6(4):317–29.

    Article  CAS  PubMed  Google Scholar 

  55. van Mastrigt GAPG. Outcome assessment and economic evaluation of short-stay intensive care for coronary artery bypass patients. Maastricht: Maastricht University; 2009.

    Google Scholar 

  56. Knapp M, Thorgrimsen L, Patel A, Spector A, Hallam A, Woods B, et al. Cognitive stimulation therapy for people with dementia: cost-effectiveness analysis. Br J Psychiatry. 2006;188:574–80.

    Article  PubMed  Google Scholar 

  57. Puhan M, Frey M, Buchi S, Schunemann H. The minimal important difference of the hospital anxiety and depression scale in patients with chronic obstructive pulmonary disease. Health Qual Life Outcomes. 2008;6(1):46.

    Article  PubMed  PubMed Central  Google Scholar 

  58. Raad voor Volksgezondheid en Samenleving (RVS). Zinnige en duurzame zorg. In. Zoetermeer; 2006.

  59. Kind P, Hardman G, Macran S. UK Population Norms for the EQ-5D. Centre for Health Economics: The University of York; 1999.

    Google Scholar 

  60. Wagner M, Melnyk P, Rindress D. Systematic review of guideline recommendations on comparator selection in health economic evaluations. Montreal, Quebec, Canada: BioMedCom Consultants Inc; 2012.

    Google Scholar 

Download references


The authors appreciate Barbara Greenberg’s language review of this. This study is embedded in the Restore4Stroke research program. Restore4Stroke is coordinated by ZonMw (Dutch Organization for Health Research and Development) and financially supported by VSBfonds (#89000004).

Source of funding

Restore4Stroke is funded through the VSBfonds (the Dutch organization for supporting Dutch society with money, knowledge and networks).

Author information

Authors and Affiliations


Corresponding author

Correspondence to M. van Eeden.

Additional information

Competing interests

All authors declare no conflict of interest.

Authors’ contributions

MvE carried out the main study, conducted all analyses and wrote the article. GvM assisted in carrying out all analyses and supervised the writing process. SE and CvH participated in the design of the article and coordinated and helped to draft the manuscript. SG and JK helped providing data to perform the analyses and checked the final version of the article. Additionally, all authors read and approved the final manuscript.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (, which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver ( applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

van Eeden, M., Kootker, J.A., Evers, S.M.A.A. et al. An economic evaluation of an augmented cognitive behavioural intervention vs. computerized cognitive training for post-stroke depressive symptoms. BMC Neurol 15, 266 (2015).

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: