Skip to main content

Acceptability of a digital health application to empower persons with multiple sclerosis with moderate to severe disability: single-arm prospective pilot study

Abstract

Background

Many persons with multiple sclerosis (pwMS) desire to learn how health behaviour changes (e.g., dietary adjustments, physical activity, improvements in stress management) might help them manage their disease. Previous research has shown that certain health behaviour changes can improve quality of life (QoL), fatigue and other MS outcomes. Digital health applications may be well suited to deliver relevant health behavioural interventions because of their accessibility and flexibility. The digital health application “levidex” was designed to facilitate health behaviour change by offering evidence-based patient information and cognitive-behavioural therapy techniques to pwMS. By doing so, levidex aims to improve QoL and MS symptoms such as fatigue and mental health.

Objectives

A previous study reported on the development of levidex; this non-randomised pilot study examined the feasibility (practicability and acceptability) of levidex in pwMS with moderate to severe disability. Furthermore, the intervention’s impact on empowerment, stress management, and relevant health behaviours (e.g., dietary behaviour, physical activity) was explored.

Methods

levidex was originally developed for newly diagnosed pwMS in the first year after diagnosis and eventually modified to offer access to pwMS with moderate to severe disability. Participants (n = 43) with an Expanded Disability Status Scale between 3.5 and 7.5 and a disease duration of more than one year were eligible to participate. The intervention was used over a period of six months with measurement time points at baseline, month 3 and month 6.

Results

Out of 38 participants who completed the six-month intervention period, 18 (47.4%) completed all 16 modules and 9 (23.7%) reached modules 13–16, the long-term maintenance part of levidex. Participants rated levidex positively in terms of practicability and acceptability and had only few points of criticism such as to include more physical exercise routine suggestions suitable for participants with severe impairment. Data on secondary endpoints showed no significant changes.

Conclusion

This pilot study provided evidence for the practicability and acceptability of levidex, a digital health application designed to facilitate health behaviour change in pwMS with moderate to severe disability. Adequately powered randomised controlled studies with longer follow-up periods are needed to clarify the benefit of levidex in pwMS with moderate to severe disability.

Trial registration

German Clinical Trials Register (DRKS) DRKS00032667 (14/09/2023); Retrospectively registered.

Peer Review reports

Introduction

Multiple sclerosis (MS) is a neurodegenerative disease that affects the central nervous system. About 85% of persons with MS (pwMS) are diagnosed with relapsing-remitting MS (RRMS), whereas the remaining 10–15% are diagnosed with a primary-progressive form (PPMS) [1]. Of those initially diagnosed with RRMS, about 80% develop a secondary progressive form (SPMS) characterised by a slowly worsening disease course in the absence of relapses [2].

While there has been substantial progress in the medical treatment of RRMS, the situation for SPMS and PPMS is not satisfactory [3]. Interventions facilitating health behaviour change to target modifiable risk factors in MS have received increasing research attention [4]. Emerging evidence suggests that exercise training can alleviate symptoms and might even restore functions [5]. While psychological factors are established risk factors for disease manifestation and relapse activity, early evidence indicates that psychological interventions can also lower inflammatory disease activity and reduce symptom burden [6,7,8]. Among nutritional factors, Vitamin D deficiency is a proven risk factor for MS [9]. An MS-specific diet has not yet been identified [10]. However, a balanced diet based on whole foods seems advisable [11]. This aligns with the evidence that obesity and cardiovascular comorbidities increase the risk for MS progression, which suggests the relevance of dietary treatment approaches, perhaps similar to those targeting the metabolic syndrome [1214]. A large variety of more or less demanding dietary regimens, most with little empirical support, have been advocated for pwMS, which creates potential for confusion and non-evidence-based decision-making [15].

PwMS have a high affinity to web-based information and use of eHealth technologies [16]. Over the disease course, internet searching behaviour often changes from a broad interest in all aspects of the disease at diagnosis to a more focused approach in later stages of the disease [17]. However, information provided on the internet is often neither evidence-based nor guideline-oriented [18, 19]. In addition, time is limited in most existing care structures, making it challenging for health professionals to provide detailed information on these complex topics. This is compounded by the fact that pwMS often demand extensive information on lifestyle adjustment options [20, 21].

Digital behaviour change interventions provided via the internet could help fill the gap between high patient demand and limited clinician resources [22]. Until now, studies using digital behaviour change interventions have mostly focused on the management of specific symptoms, such as fatigue, depression or insomnia [2326]. Some early work has also been performed to stimulate physical activity [27]. While there are some digital educational interventions available providing evidence-based information on relevant health behaviours in MS [28, 29], we are not aware of programmatic digital health applications combining evidence-based patient information (EBPI) with cognitive behavioural therapy (CBT) and behaviour change techniques (BCTs) for all major health behaviour areas such as physical activity, psychological stress, sleep, and diet in MS. Against this background, a comprehensive internet-based health behaviour change intervention termed “levidex” was developed and is currently being evaluated in two randomised controlled trials (RCTs) [30, 31]. Nevertheless, more evidence is needed to examine the effectiveness of levidex for pwMS. In particular, there appears to be a pressing need for evidence-based health behaviour change interventions in advanced MS stages, especially after experiencing failure of disease-modifying therapies (DMTs). PwMS who participated in the development of levidex encouraged us to conduct a pilot study for pwMS with moderate to severe disability who were diagnosed with MS more than one year ago, which is why this pilot cohort study was initiated. The main goal of this study was to examine the feasibility of levidex in pwMS with moderate to severe disability to enable future studies addressing the full spectrum of MS.

Methods

Study design

This single-arm prospective pilot study tested feasibility criteria which included the practicability (e.g., navigation, login data) and the acceptability (e.g., perceived benefit, module completion) of levidex, a complex digital health application that promotes health behaviour change in pwMS with moderate to severe disability.

Participant inclusion and exclusion criteria

For eligibility, participants had to be aged between 18 and 65 years and diagnosed with a clinically definite MS for more than one year. As we did not want to exclude persons with RRMS with moderate to severe disability, we did not limit inclusion criteria to SPMS and PPMS. In addition, participants had to have an Expanded Disability Status Scale (EDSS) score between 3.5 and 7.5, indicating moderate to severe disability ranging from gait impairment to a loss of ability to walk [32]. Despite present gait impairment, the ability to use arm ergometry was mandatory. Moreover, participants were required to have internet access. PwMS with severely impaired vision, severe cognitive deficits or psychiatric disorders as well as a lack of ability to provide informed consent were excluded.

Intervention

levidex is a complex behavioural digital health application tailored for pwMS. It is based on a similar programme, termed ‘optimune’, which aims to support health-promoting behaviour change among breast cancer survivors and has been evaluated in an RCT [33]. Both programmes were developed by GAIA (www.gaia-group.com), a small-to-medium enterprise that focuses on research and development of digital health applications. The underlying software used for the development is ‘Broca’, a proprietary software developed by GAIA. It utilizes rule-based algorithms to create “simulated dialogues” in which patients interact with the programme by choosing from predefined response options, which are then used to custom-tailor subsequent content. Broca-based digital health applications for a range of psychiatric and somatic conditions have been shown to be effective in more than 15 RCTs [3436]. To facilitate behaviour change, these interventions employ techniques gleaned from CBT and BCTs described in health psychology and behavioural medicine [37]. These interventions typically also include mental imagery and mindfulness/acceptance exercises, both as audio recordings and in text form. levidex consists of 16 modules that convey information on four main topics: General education and information provision, psychological techniques to improve emotional well-being, dietary approaches to optimise immune system health and MS management and behavioural approaches to optimise physical activity. levidex can be divided into three parts: [1] introduction modules and basic information on all topics to build important foundations (modules 1–6); [2] advanced information and exercises to integrate what was learned from phase one into the daily routine (modules 7–12); and [3] recapitulation of essential content from previous modules and focus on long-term maintenance of achieved health behaviour change (modules 13–16). For further information, please refer to the development paper of levidex [38].

For this study, minor adjustments were made to improve the suitability of levidex for more experienced pwMS with moderate to severe disability (EDSS 3.5–7.5). This includes, for example, a change in the tone of the first module, shifting it away from a more cautious and sensitive tone designed for newly diagnosed pwMS to a more seasoned or experienced tone for pwMS with a longer disease duration. Information regarding immunotherapy decision-making was removed, as in later stages of the disease, immunotherapy may be less relevant. Furthermore, the physical activity part was slightly modified to provide more options for participants with physical impairments.

Access to new modules is only provided after a predetermined waiting period to allow participants to reflect on provided content as well as to complete different exercises (e.g., removing unhealthy foods from the household) before starting a new module. The frequency of newly available content starts with two to three weekly modules and is reduced to biweekly modules and eventually to one module per month in the maintenance phase (last four modules), which results in approximately six months required to comfortably complete all 16 levidex modules.

Recruitment

Participants were recruited from the registry database of the MS day clinic at the University Medical Centre Hamburg-Eppendorf (UKE). Participants were selected based on their EDSS score from their last consultation. PwMS who fulfilled inclusion criteria and had indicated a general interest in study participation were contacted by mail. After expressing their willingness to participate, they were additionally screened for eligibility by telephone. Eligible participants then signed informed consent and were provided with login details for levidex. Access to levidex was provided for six months. Due to the beginning of the COVID-19 pandemic, in-person meetings could not take place. Therefore, disability was self-reported by the participants at the beginning of the study using the Patient Determined Disease Steps (PDDS) [39].

Outcomes

Data was collected over a period of six months. All outcome measures as well as their measurement timepoints are provided in Table 1.

Table 1 Assessments and measurement time points

Primary outcome

The primary outcome was the feasibility of levidex, measured as its practicability and acceptability, to determine whether participants found the intervention helpful and were able to apply the suggestions and techniques into their daily lives. This was measured by usage data and a self-developed feasibility questionnaire (see Additional file 1). Usage data was monitored biweekly through number of logins (regardless of time spent during that visit) and programme progress (assessed as the number of completed modules). This data was extracted from the backend of the levidex system manually and analysed afterwards. To our knowledge, there is no standardised questionnaire suitable to evaluate feasibility criteria relating to the practicability and acceptability of digital health applications. Therefore, we used a self-developed questionnaire consisting of questions on the navigation, comprehensibility, ease of use and perceived benefit (self-reported stages of health behaviour change and self-reported health behaviour change) of the intervention in both numeric and verbal Likert-scale format. We chose a mix of numeric 11-point Likert-scale format questions and verbal 4-point Likert-scale questions to assess the extent to which participants agree or disagree on questions relating to the practicability and acceptability of levidex. The 11-point Likert-scale format was applied in questions where we wanted to obtain a more differentiated answer and allow respondents to express themselves, while the 4-point Likert-scale format was chosen in domains where we tried to foster participants taking a position not allowing tendency to the mean [40]. The questionnaire also featured a free-text answer section to assess barriers for the health behaviour change process. The statements were analysed thematically according to Braun and Clarke [41] and Adobe Illustrator was used to create a mind map (see Fig. 1).

Fig. 1
figure 1

Barriers to health behaviour change. Statements of participants on perceived barriers to health behaviour change that were taken at month 6 were thematically evaluated. Statements that were mentioned more than once are marked with a number indicating the total number of pwMS. Font size represents the frequencies as well. The different forms and line types are used to emphasise the four main topics

Secondary outcomes

The intervention was expected to influence patient empowerment, quality of life (QoL), depressive and anxiety symptoms, dietary behaviour, and physical activity.

Patient empowerment was measured with the Patient Activation Measure (PAM) questionnaire [42]. The raw score can be transformed into a scale from 0 to 100, which is subdivided into 4 different activation levels: 1 (≤ 47.0) not believing activation to be important, 2 (47.1–55.1) a lack of knowledge and confidence to take action, 3 (55.2–67.0) beginning to take action and 4 (≥ 67.1) taking action [43]. The Hamburg Quality of Life in MS (HAQUAMS) questionnaire was used to measure health-rated QoL [44]. Depressive and anxiety symptoms were captured using the Hospital Anxiety and Depression Scale (HADS) [45].

Physical activity was measured via the Godin Leisure-Time Exercise Questionnaire (GLTEQ) [46]. We used the health contribution score based on only strenuous and moderate activities [47], as it allows for a classification of participants in three categories of activity: “Active” (≥ 24), “Moderately active” (14–23) and “Insufficiently active” (≤ 13).

Dietary behaviour was measured with three inventories. A validated healthy diet screener assessing intake of 11 key food groups that are thought to be preventive for common chronic diseases was used to describe dietary habits and to capture changes in general dietary behaviour [48, 49]. The summary score of the validated screener ranges from 0 to 10. Moreover, nutrient intake data was assessed using the validated, web-based 24-hour dietary recall tool myfood24-Germany [50]. Participants received a link via e-mail on three different days to capture two weekdays and one weekend day. The link guided participants to a website with an underlying database, where they entered the foods eaten the day before. A food item search engine and additional features (e.g., portion size options, images) guided the user through the self-administered recall. Nutrient intake data is displayed as nutrient intake in g or mg per 1000 kcal. With the help of a nutrition expert, 23 parameters out of a list of 137 parameters provided in myfood24 were selected to assess putative beneficial changes in macro- and micronutrient intake. We consider these parameters to be related to increased adherence to a Mediterranean dietary pattern. In addition to that, we compared baseline and follow-up number of portions eaten of every food category captured with the validated diet screener to explore if changes in number of portions of a certain food category would correlate with the corresponding micronutrient intake. Finally, we asked if participants were supplementing Vitamin D.

Data collection methods

Except for myfood24, all questionnaires were paper-based and sent to the participants by regular mail in pseudonymised form. The myfood24 tool is a secure online platform that is accessed through links sent to participants by e-mail by members of the study team. It is managed by the Dietary Assessment Ltd (a Spin-Out-company of the University of Leeds). Data is stored on a server in the Netherlands with a backup in England. The institution acts in accordance with the General Data Protection Regulation of the European Union and uses data in pseudonymised form.

Strategies to improve adherence

The levidex application contacts participants automatically through optional regular e-mail and short text message reminders to improve adherence to the intervention. In addition, the research team monitored participants’ usage through biweekly usage reports and contacted participants via e-mail or telephone in case of non-usage. During the first three months of study participation, corresponding to completion of modules 8–12, non-usage was defined as not logging into levidex for more than two weeks. Towards the end of study participation, no login for longer than one month was considered as non-usage. Regarding the completion of questionnaires, participants were asked to fill out the forms within one month. In case of missing data, participants were contacted by a study centre member by e-mail or telephone.

Sample size & statistical analyses

As there are no clear guidelines on how large the sample size of a feasibility study should be [51], we considered a convenience sample of around 40 participants as adequate to derive conclusions on the feasibility of levidex in pwMS with moderate to severe disability. For the validated questionnaires that examined secondary outcomes, we applied exploratory significance testing to generate an early impression of possible effects. We computed a mixed linear regression with random intercept in SPSS and differences were considered significant at p < 0.05. Concerning the primary outcomes and any further evaluation of secondary outcomes, descriptive statistics were used. Incomplete outcome data were imputed using the last observation carried forward method unless a substantial part (10–20%, depending on the questionnaire), was missing.

Results

Participant flow and clinical characteristics

From February to August 2020, 59 pwMS from the MS day clinic of the UKE were recruited. Forty-three pwMS completed baseline data and registered for levidex. Baseline data collection started in April 2020. From May 2020 to March 2021, 43 participants used the intervention. Out of these, 38 participants completed the six months intervention period and the final assessment. The myfood24 dietary recall was not completed by two participants who perceived it as too time-consuming. Four participants insufficiently completed the diet screener requiring exclusion of these participants from analysis. A visualisation of the participant flow is provided in Fig. 2.

Fig. 2
figure 2

Participant flow

Overall, the sample had a mean age of 52 years and 60.5% were female. Participants were moderately to severely impaired as 81.4% of participants experienced gait disability or needed an ambulatory device. In terms of MS forms, 69.8% were diagnosed with progressive forms of MS while 25.6% were diagnosed with RRMS. In total, 44.2% were on immunotherapy regimes and 93% used the internet at least two times per week. All baseline demographics and clinical characteristics are provided in Table 2.

Table 2 Baseline demographics and clinical characteristics

User activity

At month 3 of study participation, the median login number of all study participants was 13. This increased to a median of 20 logins at month 6. There were some users who logged on significantly more often with login numbers of up to 180 times.

After six months, 27 (71.1%) participants reached the long-term maintenance part of levidex and therefore had access to most content. Out of these 27 participants, 18 (47.4%) participants finished module 16 and hence completed levidex. Three (7.9%) participants did not advance beyond module 6 (introduction and important foundations), and eight (21.1%) participants did not advance beyond module 12 (advanced information and integration into daily routines). With more than half of the participants having logged on enough times to finish all 16 levidex modules and around half of the participants having finished all modules, both ways of measuring usage complemented each other.

Thirty-three (86.8%) participants were reminded by the study team once or not at all during the intervention period (excluding contacts made in order to ensure data collection and organisational matters). In five (13.2%) cases, there were up to three contacts. This occurred when participants indicated having experienced stressful life events and wished for an additional reminder to keep up usage of levidex.

Practicability and perceived benefit of levidex at month 6

Participants were asked to rate the practicability of levidex as well as the perceived benefit in form of self-reported stages of health behaviour change and self-reported health behaviour changes. The corresponding data is provided in Fig. 3; Table 3 due to differences in the Likert-scale format.

Fig. 3
figure 3

Practicability and self-reported stages of health behaviour change (perceived benefit) at month 6 (4-point Likert ratings)

Between 65 and 75% of participants agreed or partly agreed to either have set goals to change their health behaviour, to have made concrete plans to change their health behaviour, to have changed their health behaviour or to want to maintain health behaviour changes.

Eleven participants stated that they did not change their health behaviour at all, and out of these, nine disagreed or partly disagreed to have set goals. Out of the 27 participants who stated to have changed at least a part of their health behaviour, the mean score on the 11-point Likert-scale ranged from 4.2 for sleeping behaviour to 7.3 for physical activity.

Three (8.1%) participants perceived the messages sent via levidex as stressful or pressuring and seven (18.4%) participants perceived the work with levidex as burdensome. With a mean of 8.2 and 8.7, participants agreed that the navigation was easy and information was understandable.

Table 3 Practicability and self-reported health behaviour change (perceived benefit) at month 6 (11-point Likert ratings)

Barriers to health behaviour change

Four main categories emerged as barriers to health behaviour change: The intervention itself, individual problems, systemic issues and the COVID-19 pandemic. Most frequently mentioned barriers were lack of motivation and discipline, the COVID-19 pandemic and MS-associated health issues. The results are visualised in Fig. 1.

Empowerment, quality of life, depression and anxiety and physical activity assessment

The corresponding data is provided in Table 4. The average GLTEQ health contribution score remained largely stable over the course of the study. When looking at the number of participants in each pre-defined category, 12 participants managed to improve their level of physical activity, while 24 stayed in the same category and two had a decreased level of physical activity (see Fig. 4). The raw data show that the eight participants with the highest scores (ranging from 98 to 47) at baseline, all reduced their physical activity level (except for one participant) while staying in the active category. Seven of these participants had a decrease of 25% or more. At the same time, 14 of the 17 participants who improved their scores showed lower baseline scores of around 0 to 20. We contacted five of those with the highest decrease in physical activity. In total, three participants were reached and were able to remember and explain the decrease in physical activity. One participant stopped to cycle to work twice a day due to switching to home office work, another participant suffered from a longer COVID-19 infection during the observation time, and the third participant had important private and health issues that stopped him from keeping up his routine.

Fig. 4
figure 4

Number of participants in each GLTEQ health contribution score category over the course of the study

In terms of empowerment, the PAM showed no change over the course of the study. The average score of 72.4 at baseline puts the participants in the highest of the four activation categories at the beginning of the study. QoL as measured by the HAQUAMS as well as anxiety and depression as measured by the HADS showed no change over the course of the study.

Dietary assessment

The evaluation of the summary diet score indicated a trend towards improvement after 3 and 6 months (see Table 4). Changes in micronutrient intake and intake of certain food categories indicated a tendency towards increased adherence to a Mediterranean dietary pattern (see Tables 14, Additional File 2).

Participants reported to consume more plant-based foods such as legumes, vegetables, fruits, and whole grain products, which corresponds to a higher intake of Vitamin C, potassium, magnesium and fibre at follow-up. Increased consumption of seafood and fatty fish is consistent with a slight increase in docosahexaenoic acid, eicosapentaenoic acid and total omega-3 fatty acid intake. A higher weekly consumption of vegetable oils is in line with slightly elevated intakes of oleic acid, monounsaturated acids, polyunsaturated acids and Vitamin E. Participants reported lower overall meat consumption, which could possibly explain lower Vitamin A and lower saturated fatty acids intake. However, the observed reduction in sugar-sweetened beverage consumption did not match the saccharose intake, which remained the same. The corresponding tables with detailed information can be found in the appendix.

Vitamin D supplementation stayed the same over the course of the study. Twenty-five participants supplemented Vitamin D at baseline, 23 at month 3 and 24 at month 6.

Table 4 Questionnaire results

Discussion

Prior to this study, we initiated an RCT to evaluate levidex in newly diagnosed pwMS. As the growing need for health behaviour change advice in all stages of MS became apparent, we conducted this feasibility study upon request of pwMS and their representatives. To our knowledge, this is the first study of its kind to assess the effects of a digital health behaviour change application in pwMS with moderate to severe disability. We found that levidex was well-accepted, used intensively, and had a low drop-out rate among pwMS with moderate to severe disability. Overall, we deemed this pilot study as a success justifying future large-scale trials.

The dropout rate of only 11% is very encouraging. A systematic review investigating 11 RCT’s on personalised telehealth in pwMS showed similar drop-out rates between 0 and 21% [52]. In addition, the programme completion rate of 47% indicates an acceptable adherence to the intervention. Bevens et al. (2022) declared a feasibility threshold of 40% programme completion for their web-based educational lifestyle programme for pwMS, which we successfully surpassed [28]. While we did not prespecify a certain percentage of programme completion as necessary for success, we consider a programme completion of 40% as a reasonable benchmark. However, participants’ usage was surveyed in our study and they were reminded to keep up use of the intervention in case of non-use for an extended period. Without these personal reminders, the programme completion rate might have been lower. At the same time, the month-long waiting period in between the last four modules possibly made it harder for participants to complete levidex within six months. Some participants used levidex far more frequently than others, with up to 180 logins. Reasons for these high login numbers might have been reusable media such as audio recordings or the use of the embedded self-monitoring questionnaires. Possible participant characteristics associated with higher usage of mHealth applications are being of younger age or having a university degree [16].

Concerning the practicability of levidex, some participants perceived the reminders sent by the programme to be stressful and annoying, which then led to two dropouts. This problem has been described in the literature but is most likely outweighed by the positive effect of e-mail or short text message reminders [53].

The frequent mentioning of discipline and motivational issues by participants demonstrates how difficult behaviour change is, even when attempted in the context of an interactive CBT-based programme. A qualitative study on multimodal health behaviour changes in pwMS reported similar barriers such as lack of motivation and support, MS-health related issues and lack of time due to competing demands [54]. They also found tailoring activities to the individual’s ability and preference to be enabling which is in line with our findings that an insufficiently adapted physical activity programme can be inhibiting to health behaviour change. Researchers found that among motivational drivers to participate in an online health behaviour change course, “wanting to help others” was one of the prime motivations while “doing what I can to help myself” was uncommonly reported [55]. It is imaginable that these findings would be even more prominent in pwMS with longer disease experience as they might feel the urge to help newly affected individuals. To actually achieve, for example, long-term physical activity, participants seem to need to possess high levels of autonomous motivation, perceived self-efficacy and goal setting abilities [56].

MS-associated health issues can be problematic as they complicate daily activities (e.g., using transportation to go shopping or to the gym) and social participation due to negative attitudes from others [57]. Furthermore, living with disabilities requires special strategies to find ways to still participate in everyday activities [58]. This complicates behaviour change as mastering daily life already consumes many resources. PwMS with moderate to severe disability have usually lived with their disease for many years. Implementing behaviour change may become harder the longer one gets accustomed to certain behavioural patterns such as coping by “suppression of competing activities” to better deal with disease-associated problems [59]. A review on the effectiveness of interventions targeting physical activity suggested that there seems to be a lack of studies exploring differences between disability levels so this topic should be considered in future studies [60]. Beyond MS, a recent analysis of approved digital health interventions in Germany indicated that a minimum of personal advice substantially increases usage and possibly also behaviour change [61]. This might be especially true in people with substantial persisting disabilities.

Another valuable insight of our study is that both the food category and micronutrient intake profile that is associated with a Mediterranean dietary pattern mostly changed in a coherent way. Further studies could use similar approaches to objectify dietary changes.

It is possible that the pandemic setting supported improvement in dietary behaviour with the reasons for this effect remaining unclear [62]. In contrast, a study on the impact of Australian bushfires and the COVID-19 pandemic on pwMS’ health behaviours found an increase in unhealthy eating due to stress and boredom [63]. There is some evidence that pwMS tended to engage in self-isolating behaviours during the pandemic [64]. On the one hand, this would mean more time at home to cook healthy meals. On the other hand, it is possible that due to self-isolating behaviour, less shopping for fresh and healthy foods took place. However, one study concluded that pwMS might have left their homes less for work but still continued to go shopping [65].

Even though there was no improvement in the average physical activity score, 12 participants managed to successfully increase their physical activity level in pre-defined categories. Several reasons might explain these results. First, the COVID-19 pandemic may have interfered with physical activity as it has been observed that especially activities with moderate and high intensity decreased in comparison to pre-pandemic levels [66]. Moreover, staying at home might increase lower limb spasticity, which then could have further limited pwMS’ ability to be physically active [67].

There was a substantial decrease of physical activity among participants who already had much higher-than-average levels of physical activity in our study, which might be a result of the COVID-19 pandemic and the closing of public sports facilities. It must also be noted that studies revolving around health behaviour change topics might be more prone to selection bias. To conclude, future studies could screen for lower baseline empowerment levels to deliver a better estimate for beneficial effects of the intervention.

As mentioned earlier, some participants criticised that the physical activity part was not sufficiently adapted to the needs of participants with more severe impairments. It was noted that levidex included only few exercises that can be performed while sitting and which do not require balance or complex motion sequences. Some participants indicated that being confronted with unfeasible exercises led to disappointment.

The lack of change in depression and anxiety, empowerment and QoL outcomes might be caused by insufficient sample size. As this was a feasibility study, no power calculations were performed and therefore all statistical findings could be hampered by a lack of power. Nevertheless, in light of possibly elevated psychological stress associated with the COVID-19 pandemic, levidex might have helped to maintain the status quo or prevent deterioration of mental health [68].

This study has limitations that need to be considered. First of all, as this study was designed as a pragmatic pilot study, only patient-reported outcome measures were used. Further, personal reminders were implemented which might not be feasible in a real-world setting due to limited resources in standard care. However, levidex itself already incorporates pre-programmed reminders to enhance adherence which could be further improved in the future. Baseline values for patient empowerment were already high, as there were no exclusion criteria concerning participants’ activation level and general health behaviour. Therefore, the sample was presumably biased to more active pwMS lowering the chance to show behaviour change.

The strength of this study was its use of a programmatic digital health application combining EBPI with CBT and BCTs for all major health behaviour areas. Moreover, it showed good adherence to the intervention despite it being originally designed for newly diagnosed pwMS and only slightly adapted to fit pwMS with moderate to severe disability.

Conclusions

The intervention was well accepted and used frequently by the participants. Further studies with larger sample sizes and longer follow-up periods need to be conducted to solidify the evidence on the use of digital health applications such as levidex.

Data Availability

All relevant data are within the manuscript and its supplemental material. Qualitative data generated and analysed during the current study are not publicly available due to privacy issues. Quantitative data are available from the corresponding author on reasonable request.

Abbreviations

BMI:

Body mass index

CBT:

Cognitive behavioural therapy

DMTs:

Disease-modifying therapies

EDSS:

Expanded Disability Status Scale

GLTEQ:

Godin Leisure-Time Exercise Questionnaire

HADS:

Hospital Anxiety and Depression Scale

HAQUAMS:

Hamburg Quality of Life in Multiple Sclerosis

MS:

Multiple sclerosis

PAM:

Patient Activation Measure

PDDS:

Patient Determined Disease Steps

PPMS:

Primary progressive MS

pwMS:

Persons with MS

QoL:

Quality of life

RCT:

Randomised controlled trial

RRMS:

Relapsing-remitting MS

SD:

Standard deviation

SPMS:

Secondary progressive MS

References

  1. Reich DS, Lucchinetti CF, Calabresi PA. Multiple sclerosis. N Engl J Med. 2018;378(2):169–80.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  2. The Lancet N. Setting new standards in multiple sclerosis care and research. Lancet Neurol. 2012;11(10):835.

    Article  Google Scholar 

  3. Correale J, Gaitán MI, Ysrraelit MC, Fiol MP. Progressive multiple sclerosis: from pathogenic mechanisms to treatment. Brain. 2017;140(3):527–46.

    PubMed  Google Scholar 

  4. Hempel S, Graham GD, Fu N, Estrada E, Chen AY, Miake-Lye I, et al. A systematic review of modifiable risk factors in the progression of multiple sclerosis. Multiple Scler J. 2017;23(4):525–33.

    Article  Google Scholar 

  5. Motl RW, Sandroff BM, Kwakkel G, Dalgas U, Feinstein A, Heesen C, et al. Exercise in patients with multiple sclerosis. Lancet Neurol. 2017;16(10):848–56.

    Article  PubMed  Google Scholar 

  6. Mohr DC, Goodkin DE, Islar J, Hauser SL, Genain CP. Treatment of Depression is Associated with suppression of nonspecific and Antigen-Specific TH1 responses in multiple sclerosis. Arch Neurol. 2001;58(7):1081–6.

    Article  CAS  PubMed  Google Scholar 

  7. Mohr DC, Lovera J, Brown T, Cohen B, Neylan T, Henry R, et al. A randomized trial of stress management for the prevention of new brain lesions in MS. Neurology. 2012;79(5):412–9.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Grossman P, Kappos L, Gensicke H, D’Souza M, Mohr DC, Penner IK, et al. MS quality of life, depression, and fatigue improve after mindfulness training: a randomized trial. Neurology. 2010;75(13):1141–9.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  9. Munger KL, Zhang SM, O’Reilly E, Hernán MA, Olek MJ, Willett WC, et al. Vitamin D intake and incidence of multiple sclerosis. Neurology. 2004;62(1):60–5.

    Article  CAS  PubMed  Google Scholar 

  10. Parks NE, Jackson-Tarlton CS, Vacchi L, Merdad R, Johnston BC. Dietary interventions for multiple sclerosis-related outcomes. Cochrane Database Syst Rev. 2020;5(5):CD004192–CD.

    PubMed  Google Scholar 

  11. Holton KF, Kirkland AE. Moving past antioxidant supplementation for the dietary treatment of multiple sclerosis. Multiple Scler J. 2019;26(9):1012–23.

    Article  Google Scholar 

  12. Tettey P, Simpson S, Taylor B, Ponsonby A-L, Lucas RM, Dwyer T, et al. An adverse lipid profile and increased levels of adiposity significantly predict clinical course after a first demyelinating event. Journal of Neurology, Neurosurgery & Psychiatry. 2017;88(5):395.

  13. Lutfullin I, Eveslage M, Bittner S, Antony G, Flaskamp M, Luessi F, et al. Association of obesity with disease outcome in multiple sclerosis. J Neurol Neurosurg & Psychiatry. 2023;94(1):57.

  14. Marrie RA, Rudick R, Horwitz R, Cutter G, Tyry T, Campagnolo D, et al. Vascular comorbidity is associated with more rapid disability progression in multiple sclerosis. Neurology. 2010;74(13):1041–7.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  15. Tredinnick AR, Probst YC. Evaluating the effects of Dietary interventions on Disease progression and symptoms of adults with multiple sclerosis: an Umbrella Review. Adv Nutr. 2020;11(6):1603–15.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Marrie RA, Leung S, Tyry T, Cutter GR, Fox R, Salter A. Use of eHealth and mHealth technology by persons with multiple sclerosis. Multiple Scler Relat Disorders. 2019;27:13–9.

    Article  Google Scholar 

  17. Colombo C, Mosconi P, Confalonieri P, Baroni I, Traversa S, Hill SJ, et al. Web search behavior and information needs of people with multiple sclerosis: focus group study and analysis of online postings. Interact J Med Res. 2014;3(3):e12–e.

    Article  PubMed  PubMed Central  Google Scholar 

  18. Beckett JM, Bird M-L, Pittaway JK, Ahuja KD. Diet and multiple sclerosis: scoping review of web-based recommendations. Interact J Med Res. 2019;8(1):e10050–e.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Sadeghi-Bahmani D, Silveira SL, Baird JF, Motl RW. Do internet resources align with exercise training and physical activity guidelines for people with multiple sclerosis? Mult Scler J Exp Transl Clin. 2021;7(3):20552173211038035.

    PubMed  PubMed Central  Google Scholar 

  20. Elkhalii-Wilhelm S, Sippel A, Riemann-Lorenz K, Kofahl C, Scheiderbauer J, Arnade S, et al. Experiences of persons with multiple sclerosis with lifestyle adjustment–A qualitative interview study. PLoS ONE. 2022;17(5):e0268988.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  21. Learmonth YC, Adamson BC, Balto JM, Chiu CY, Molina-Guzman I, Finlayson M, et al. Multiple sclerosis patients need and want information on exercise promotion from healthcare providers: a qualitative study. Health Expect. 2017;20(4):574–83.

    Article  PubMed  Google Scholar 

  22. Matthews PM, Block VJ, Leocani L. E-health and multiple sclerosis. Curr Opin Neurol. 2020;33(3):271–6.

    Article  PubMed  Google Scholar 

  23. van Kessel K, Wouldes T, Moss-Morris R. A New Zealand pilot randomized controlled trial of a web-based interactive self-management programme (MSInvigor8) with and without email support for the treatment of multiple sclerosis fatigue. (1477 – 0873 (Electronic)).

  24. Pöttgen J, Moss-Morris R, Wendebourg JM, Feddersen L, Lau S, Köpke S, et al. Randomised controlled trial of a self-guided online fatigue intervention in multiple sclerosis. J Neurol Neurosurg Psychiatry. 2018;89(9):970–6.

    Article  PubMed  Google Scholar 

  25. Fischer A, Schröder J, Vettorazzi E, Wolf OT, Pöttgen J, Lau S, et al. An online programme to reduce depression in patients with multiple sclerosis: a randomised controlled trial. Lancet Psychiatry. 2015;2(3):217–23.

    Article  PubMed  Google Scholar 

  26. Siengsukon CF, Beck ES Jr., Drerup M. Feasibility and treatment effect of a web-based cognitive behavioral therapy for Insomnia Program in individuals with multiple sclerosis: a pilot randomized controlled trial. Int J MS Care. 2021;23(3):107–13.

    PubMed  Google Scholar 

  27. Motl RW, Hubbard EA, Bollaert RE, Adamson BC, Kinnett-Hopkins D, Balto JM, et al. Randomized controlled trial of an e-learning designed behavioral intervention for increasing physical activity behavior in multiple sclerosis. Mult Scler J Exp Transl Clin. 2017;3(4):2055217317734886.

    PubMed  PubMed Central  Google Scholar 

  28. Bevens W, Weiland TJ, Gray K, Neate SL, Nag N, Simpson-Yap S, et al. The feasibility of a web-based Educational Lifestyle Program for people with multiple sclerosis: a Randomized Controlled Trial. Front Public Health. 2022;10:852214.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Claflin SB, Campbell JA, Doherty K, Farrow M, Bessing B, Taylor BV. Evaluating course completion, appropriateness, and Burden in the understanding multiple sclerosis massive Open Online Course: Cohort Study. J Med Internet Res. 2021;23(12):e21681.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Krause N, Riemann-Lorenz K, Steffen T, Rahn AC, Pöttgen J, Stellmann J-P, et al. Study protocol for a randomised controlled trial of a web-based behavioural lifestyle programme for emPOWERment in early multiple sclerosis (POWER@MS1). BMJ Open. 2021;11(2):e041720–e.

    Article  PubMed  PubMed Central  Google Scholar 

  31. German Clinical Trials Register. Identifier: DRKS00023023. Randomized-controlled trial investigating the effectiveness of a digital life-style intervention to improve quality of life in people with multiple sclerosis. 2020 Sep 3 [cited 2023 April 13]. Available from: https://drks.de/search/en/trial/DRKS00023023

  32. Kurtzke JF. Rating neurologic impairment in multiple sclerosis. Neurology. 1983;33(11):1444.

    Article  CAS  PubMed  Google Scholar 

  33. Holtdirk F, Mehnert A, Weiss M, Meyer B, Watzl C. Protocol for the Optimune trial: a randomized controlled trial evaluating a novel internet intervention for Breast cancer survivors. Trials. 2020;21(1):117.

    Article  PubMed  PubMed Central  Google Scholar 

  34. Zill JM, Christalle E, Meyer B, Härter M, Dirmaier J. The effectiveness of an internet intervention aimed at reducing alcohol consumption in adults. Dtsch Arztebl Int. 2019;116(8):127–33.

    PubMed  PubMed Central  Google Scholar 

  35. Meyer B, Weiss M, Holtkamp M, Arnold S, Brückner K, Schröder J, et al. Effects of an epilepsy-specific internet intervention (Emyna) on depression: results of the ENCODE randomized controlled trial. Epilepsia. 2019;60(4):656–68.

    Article  PubMed  Google Scholar 

  36. Twomey C, O’Reilly G, Bültmann O, Meyer B. Effectiveness of a tailored, integrative internet intervention (deprexis) for depression: updated meta-analysis. PLoS ONE. 2020;15(1):e0228100.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  37. Michie S, Wood CE, Johnston M, Abraham C, Francis JJ, Hardeman W. Behaviour change techniques: the development and evaluation of a taxonomic method for reporting and describing behaviour change interventions (a suite of five studies involving consensus methods, randomised controlled trials and analysis of qualitative data). Health Technol Assess. 2015;19(99):1–188.

    Article  PubMed  PubMed Central  Google Scholar 

  38. Krause N, Riemann-Lorenz K, Rahn AC, Pöttgen J, Köpke S, Meyer B, et al. That would have been the perfect thing after diagnosis’: development of a digital lifestyle management application in multiple sclerosis. Ther Adv Neurol Disord. 2022;15:17562864221118729.

    Article  PubMed  PubMed Central  Google Scholar 

  39. Learmonth YC, Motl RW, Sandroff BM, Pula JH, Cadavid D. Validation of patient determined Disease steps (PDDS) scale scores in persons with multiple sclerosis. BMC Neurol. 2013;13:37.

    Article  PubMed  PubMed Central  Google Scholar 

  40. Lewis J, Erdinc O. User experience rating scales with 7, 11, or 101 points: does it Matter? J Usability Stud. 2017;12:73–91.

    Google Scholar 

  41. Braun V, Clarke V. Using thematic analysis in psychology. Qualitative Res Psychol. 2006;3(2):77–101.

    Article  Google Scholar 

  42. Hibbard JH, Stockard J, Mahoney ER, Tusler M. Development of the patient activation measure (PAM): conceptualizing and measuring activation in patients and consumers. Health Serv Res. 2004;39(4 Pt 1):1005–26.

    Article  PubMed  PubMed Central  Google Scholar 

  43. Moljord IEO, Lara-Cabrera ML, Perestelo-Pérez L, Rivero-Santana A, Eriksen L, Linaker OM. Psychometric properties of the patient activation Measure-13 among out-patients waiting for mental health treatment: a validation study in Norway. Patient Educ Couns. 2015;98(11):1410–7.

    Article  PubMed  Google Scholar 

  44. Gold SM, Heesen C, Schulz H, Guder U, Mönch A, Gbadamosi J, et al. Disease specific quality of life instruments in multiple sclerosis: validation of the Hamburg Quality of Life Questionnaire in multiple sclerosis (HAQUAMS). Multiple Scler J. 2001;7(2):119–30.

    Article  CAS  Google Scholar 

  45. Zigmond AS, Snaith RP. The Hospital anxiety and Depression Scale. Acta Psychiatrica Scandinavica. 1983;67(6):361–70.

    Article  CAS  PubMed  Google Scholar 

  46. Godin G. The Godin-Shephard leisure-time physical activity questionnaire. The Health & Fitness Journal of Canada. 2011;4(1):18–22.

    Google Scholar 

  47. Taul-Madsen L, Connolly L, Dennett R, Freeman J, Dalgas U, Hvid LG. Is aerobic or resistance training the most effective Exercise modality for improving lower extremity physical function and perceived fatigue in people with multiple sclerosis? A systematic review and Meta-analysis. Arch Phys Med Rehabil. 2021;102(10):2032–48.

    Article  PubMed  Google Scholar 

  48. Jannasch F, Nickel DV, Bergmann MM, Schulze MB. A New evidence-based Diet score to capture associations of Food Consumption and Chronic Disease Risk. Nutrients. 2022;14(11).

  49. Estruch R, Ros E, Salas-Salvadó J, Covas M-I, Corella D, Arós F, et al. Primary Prevention of Cardiovascular Disease with a Mediterranean Diet supplemented with Extra-virgin Olive oil or nuts. N Engl J Med. 2018;378(25):e34.

    Article  CAS  PubMed  Google Scholar 

  50. Koch SAJ, Conrad J, Cade JE, Weinhold L, Alexy U, Nöthlings U. Validation of the web-based self-administered 24-h dietary recall myfood24-Germany: comparison with a weighed dietary record and biomarkers. Eur J Nutr. 2021;60(7):4069–82.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  51. Beets MW, von Klinggraeff L, Weaver RG, Armstrong B, Burkart S. Small studies, big decisions: the role of pilot/feasibility studies in incremental science and premature scale-up of behavioral interventions. Pilot Feasibility Stud. 2021;7(1):173.

    Article  PubMed  PubMed Central  Google Scholar 

  52. Khan F, Amatya B, Kesselring J, Galea M. Telerehabilitation for persons with multiple sclerosis. Cochrane Database Syst Rev. 2015;2015(4):Cd010508.

    PubMed  PubMed Central  Google Scholar 

  53. Schwebel FJ, Larimer ME. Using text message reminders in health care services: a narrative literature review. Internet Interv. 2018;13:82–104.

    Article  PubMed  PubMed Central  Google Scholar 

  54. Barnard E, Brown CR, Weiland TJ, Jelinek GA, Marck CH. Understanding barriers, enablers, and long-term adherence to a health behavior intervention in people with multiple sclerosis. Disabil Rehabil. 2020;42(6):822–32.

    Article  PubMed  Google Scholar 

  55. Neate SL, Bevens W, Jelinek PL, Gray KM, Weiland TJ, Nag N, et al. A multiple sclerosis lifestyle behavior online course: qualitative analysis of participants’ motivations, expectations and experiences. Front Public Health. 2022;10:1022185.

    Article  PubMed  PubMed Central  Google Scholar 

  56. Riemann-Lorenz K, Motl RW, Casey B, Coote S, Daubmann A, Heesen C. Possible determinants of long-term adherence to physical activity in multiple sclerosis-theory-based development of a comprehensive questionnaire and results from a German survey study. Disabil Rehabil. 2021;43(22):3175–88.

    Article  PubMed  Google Scholar 

  57. Ståhl D, Bjereld Y, Dunér A. Disabled in Society - A Scoping Review on persons living with multiple sclerosis and disability. J Multidiscip Healthc. 2022;15:375–90.

    Article  PubMed  PubMed Central  Google Scholar 

  58. Audulv Ã, Ghahari S, Kephart G, Warner G, Packer TL. The taxonomy of Everyday Self-management strategies (TEDSS): a framework derived from the literature and refined using empirical data. Patient Educ Couns. 2019;102(2):367–75.

    Article  PubMed  Google Scholar 

  59. Holland DP, Schlüter DK, Young CA, Mills RJ, Rog DJ, Ford HL, et al. Use of coping strategies in multiple sclerosis: Association with demographic and disease-related characteristics(). Mult Scler Relat Disord. 2019;27:214–22.

    Article  CAS  PubMed  Google Scholar 

  60. Coulter EH, Bond S, Dalgas U, Paul L. The effectiveness of interventions targeting physical activity and/or sedentary behaviour in people with multiple sclerosis: a systematic review. Disabil Rehabil. 2020;42(5):594–612.

    Article  PubMed  Google Scholar 

  61. Uncovska M, Freitag B, Meister S, Fehring L. Rating analysis and BERTopic modeling of consumer versus regulated mHealth app reviews in Germany. Npj Digit Med. 2023;6(1):115.

    Article  PubMed  PubMed Central  Google Scholar 

  62. Della Valle PG, Mosconi G, Nucci D, Vigezzi GP, Gentile L, Gianfredi V, et al. Adherence to the Mediterranean Diet during the COVID-19 national lockdowns: a systematic review of observational studies. Acta Biomed. 2021;92(S6):e2021440.

    PubMed  PubMed Central  Google Scholar 

  63. Marck CH, Hunter A, Heritage B, Gibbs L, Kermode AG, Walker DI, et al. The effect of the Australian bushfires and the COVID-19 pandemic on health behaviours in people with multiple sclerosis. Mult Scler Relat Disord. 2021;53:103042.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  64. Beesley R, Cauchi M, Davies L, Upcott M, Norton E, Loveless S, et al. Multiple sclerosis and COVID-19: assessing risk perception, patient behaviors and access to disease-modifying therapies. Mult Scler Relat Disord. 2022;68:104121.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  65. Landi D, Ponzano M, Nicoletti CG, Cecchi G, Cola G, Mataluni G, et al. Adherence to social distancing and use of personal protective equipment and the risk of SARS-CoV-2 Infection in a cohort of patients with multiple sclerosis. Mult Scler Relat Disord. 2020;45:102359.

    Article  PubMed  PubMed Central  Google Scholar 

  66. Moumdjian L, Smedal T, Arntzen EC, van der Linden ML, Learmonth Y, Pedullà L et al. Impact of the COVID-19 pandemic on physical activity and Associated Technology use in persons with multiple sclerosis: an International RIMS-SIG mobility Survey Study. Arch Phys Med Rehabil. 2022.

  67. Andreu-Caravaca L, Ramos-Campo DJ, Chung LH, Manonelles P, Abellán-Aynés O, Rubio-Arias J. Impact of Lockdown during COVID-19 pandemic on Central Activation, muscle activity, contractile function, and spasticity in people with multiple sclerosis. Biomed Res Int. 2021;2021:2624860.

    Article  PubMed  PubMed Central  Google Scholar 

  68. Altieri M, Capuano R, Bisecco A, d’Ambrosio A, Buonanno D, Tedeschi G, et al. The psychological impact of Covid-19 pandemic on people with multiple sclerosis: a meta-analysis. Mult Scler Relat Disord. 2022;61:103774.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

The authors want to thank all participating persons with MS for their involvement and support in this pilot study.

Funding

This study did not receive funding.

Open Access funding enabled and organized by Projekt DEAL.

Author information

Authors and Affiliations

Authors

Contributions

CH is the principal investigator and led the planning and conduction of the study with support from NK and MK. The levidex programme was adapted by BM. MK curated and analysed the data and wrote the first draft of the paper. NK, KRL, BM and CH commented on the manuscript, providing scientific content. All authors read and approved the final manuscript.

Corresponding authors

Correspondence to Max Kutzinski or Nicole Krause.

Ethics declarations

Ethics approval and consent to participate

The study has been approved by the Ethics Committee of the Hamburg Chamber of Physicians (PV6015) and informed consent was obtained from all study participants. All methods were carried out in accordance with relevant guidelines and regulations.

Consent for publication

Not applicable.

Competing interests

CH has received research grants, speaker honoraria and travel grants from Biogen, Celgene, Genzyme, Merck and Roche, all outside of this work. BM is employed by GAIA, the company that developed, owns and operates levidex. NK, KRL and MK have nothing to declare.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary Material 1

Supplementary Material 2

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kutzinski, M., Krause, N., Riemann-Lorenz, K. et al. Acceptability of a digital health application to empower persons with multiple sclerosis with moderate to severe disability: single-arm prospective pilot study. BMC Neurol 23, 382 (2023). https://doi.org/10.1186/s12883-023-03434-w

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12883-023-03434-w

Keywords