Skip to main content
  • Research article
  • Open access
  • Published:

Development of a patient-reported outcome measure for patients who have recovered from a subarachnoid hemorrhage: the “questionnaire for the screening of symptoms in aneurysmal subarachnoid hemorrhage” (SOS-SAH)

Abstract

Background

Patients who have been successfully treated for an aneurysmal subarachnoid hemorrhage (aSAH) often retain multiple health complaints, including mood disorders, cognitive complaints, fatigue, and problems with social participation. These problems are not always fully addressed during hospital visits or in current outcome measures, such as the modified Rankin score and the Glasgow Outcome Scale. Here, we present the development of the “Questionnaire for the Screening of Symptoms in aneurysmal Subarachnoid Hemorrhage” (SOS-SAH), which screens for the self-reported symptoms of patients with mild disabilities.

Methods

During the development of the SOS-SAH we adhered to the PROM-cycle framework for the selection and implementation of patient-reported outcome measures (PROMs). The SOS-SAH was developed in an iterative process informed by a literature study. Patients and healthcare professionals were involved in the development process through participating in a working group, interviews, and a cognitive validation study.

Results and conclusions

Relevant patient-reported outcomes (PROs) were identified for patients with aSAH. The SOS-SAH was developed primarily using domains and items from existing PROMs and, if necessary, by developing new items. The SOS-SAH consists of 40 items and covers 14 domains: cognitive abilities, hypersensitivity to stimuli, anxiety, depression, fatigue, social roles, personality change, language, vision, taste, smell, hearing, headache, and sexual function. It also includes a proxy measurement for use by family members to assess cognitive functioning and personality change.

Peer Review reports

Key points

- Several symptoms often remain undetected after an aneurysmal subarachnoid hemorrhage (aSAH). A disease-specific PROM for aSAH might reveal more non-spontaneously mentioned symptoms.

- The SOS-SAH was developed to cover relevant PROs for patients successfully treated after an aSAH.

- The SOS-SAH consists of 40 items covering 14 domains, and an additional section for a proxy measurement.

Background

An aneurysmal subarachnoid hemorrhage (aSAH) is the result of a rupture of an intracranial aneurysm resulting in an accumulation of blood in the subarachnoid space. The incidence rate is 6.1 per 100,000 person-years [1]. Advances in the management of aSAH have led to a mortality rate reduction of 17% over the last 30 years [2,3,4], meaning the daily functioning and quality of life of patients who survived an aSAH is therefore becoming more and more important.

The typical patient suffering an aSAH is relatively young (mean age 50–55 years), meaning this condition has a high impact on society through a loss of productive life years [5, 6]. The estimated costs of an aSAH over a patient’s lifetime are twice as high as the costs of an ischaemic stroke, mainly caused by the younger age of patients with aSAH and the higher mortality rate [7]. Approximately half of patients with a successfully treated aSAH experience problems with memory, mood, or neuropsychological function, and a third have problems in societal participation [8,9,10]. This highlights the need to measure these problems from a patient’s point of view using patient-reported outcomes (PROs). These PROs can be assessed using patient-reported outcome measures (PROMs), which are questionnaires consisting of one or multiple items. Healthcare professionals can use PROMs in clinical practice to focus on a patient’s individual health status and as an aid in the follow-up care of patients. PROMs can also be used across multiple patients for a quality assessment of treatment and for public reporting to promote external transparency [11, 12].

A limited number of validation studies have evaluated PROMs in patients with aSAH [13]. Due to a low level of evidence for the quality of these PROMs, no evaluation of content validity or unclear phrasing of items, none of the cited PROMs were deemed suitable for use in clinical practice. We therefore describe the development process of a new PROM, the “Questionnaire for the Screening of Symptoms in aneurysmal Subarachnoid Hemorrhage” (SOS-SAH), which was conducted in collaboration with patients, healthcare professionals, and specialists in PROM development. Our aim was to develop a PROM for use in individual patients with aSAH to guide their follow-up care, especially for those patients with mild disabilities that have an apparent good outcome but may suffer from symptoms that they often do not actively mention.

Methods

Design and setting

This study was conducted in the Netherlands from May 2018 to April 2020. We adhered to the “PROM-cycle”, a framework with eight steps necessary for the selection and implementation of PROMs in healthcare [14]. The first four steps that focus on the development of a PROM are described: (1) goal setting for the PROM, (2) selection of important PROs, (3) identification of PROMs that cover the selected PROs, and (4) the development and testing of a PROM. Throughout the development process, collaboration with patients and healthcare professionals was assured through iterative interactions. The involvement of the different parties and processes in each step of the PROM-cycle is presented schematically in Fig. 1.

Fig. 1
figure 1

Flowchart of the steps of the PROM-cycle [14] and involved parties and processes in the development of the SOS-SAH. PROs: patient-reported outcomes; PROMs: patient-reported outcome measures

Scope

The goal of the PROM is to screen individual patients with mild disabilities who have been successfully treated for aSAH, since they are prone to undetected symptoms during their follow-up care. “Mild disabilities” was defined as an outcome on the modified Rankin Scale (mRS) of 0, 1, or 2. The mRS is a global disability scale that has an ordinal scale ranging from no residual symptoms (score of 0) to severely disabled (score of 5) [15]. The intention was to construct the PROM using (the domains of) existing PROMs and, if necessary, newly developed items.

Procedures

Working group

The working group included a lead researcher (EN), two researchers experienced with developing PROMs (IA and PW), a patient who has experienced aSAH (AS, a member of the patient organization of patients with an intracranial aneurysm hosted at Radboud university medical center), and a neurosurgeon (JB). The working group made the necessary decisions during the development process of the SOS-SAH.

Interviews with healthcare professionals

A focus group interview was scheduled with healthcare professionals involved in the acute in-hospital care, as well as follow-up and rehabilitation treatment, of patients with an aSAH, which informed step 1 of the PROM-cycle (goal setting), step 2 of the PROM-cycle (selection of PROs), and an exploration of some aspects of step 4 of the PROM-cycle (development and testing of the PROM). Neurologists, neurosurgeons, rehabilitation physicians, and specialized nurses from different regions in the Netherlands were contacted to participate in a focus group interview. Five healthcare professionals (Table 1) participated in the focus group interview, led by an experienced moderator. As a second step, two individual interviews were conducted with a neurologist and with a rehabilitation specialist who could not attend the focus group interview. The following topics were discussed: the goal setting for the PROM, the relevant PROs for patients with an aSAH, the ideal timing for completion of the PROM, and the best strategy for the visual representation of the results of the PROM. Afterwards there were no unresolved issues, and a shared general view of healthcare professionals involved with the care for patients with aSAH in the hospital setting was achieved. The semi-structured interviews were recorded and transcribed verbatim. A thematic analysis was performed on the data using ATLAS.ti version 8.4.20. The interviews were coded based on a topic list, and new topics that emerged during the analysis were added to this list. Coding was performed independently by two researchers (EN and IA), and differences in the codes were discussed by these two researchers until a consensus was reached. A summary of the interviews was returned to the participants for comments or corrections.

Table 1 The characteristics of the interviewees

Literature search

The literature was screened to identify relevant PROs for patients with aSAH that could be related to symptoms, activities, and participation, according to the International Classification of Functioning, Disability, and Health (ICF) model [16]. This is a framework for describing and organizing information on functioning and disability and conceptualizes a person’s level of functioning as an interaction between health conditions, environmental factors, and personal factors.

The validity of the available PROMs for patients after aSAH was evaluated in a recent systematic review [13]. We used this review to select the PROs and PROMs for this study. Additionally, we searched PubMed for qualitative studies about the outcomes in patients after aSAH (using a qualitative research filter (MeSH term) and keywords “subarachnoid hemorrhage” and “outcome”), and performed a search guided by articles and their references previously included in the national guideline.

For all PROs identified in the literature, we searched for PROMs that captured the outcome and assessed its content validity (including face validity) and the length of the questionnaire. Information on structural validity was used to assess the dimensionality of multi-domain PROMs. Only unidimensional domains were considered potentially suitable to be part of the new PROM.

Interviews with patients: round one

Eleven patients from three hospitals in the Netherlands were interviewed (Table 1) by trained interviewers to cover step 2 of the PROM-cycle (selection of PROs), and step 3 of the PROM-cycle (identification and selection of PROMs). These patients were successfully treated for an aSAH less than five years ago, and were selected by their treating physician. They randomly selected patients of different ages, genders, and mRS outcome scores. The topics covered in the interviews were: which PROs are relevant for patients with aSAH, the potential value of using a PROM in their own healthcare following aSAH treatment, the acceptable number of questions for the PROM to keep the questionnaire complete but concise, and the preference of completing a questionnaire on paper or online. The goal of the interview was not to perform an explorative study about all possible PROs experienced by patients successfully treated for aSAH, but more specifically to confirm the relevance of previously detected PROs in the literature and by healthcare professionals, and to discuss any other relevant PROs. The interviewees were asked about the content and comprehensiveness of several existing PROMs, i.e., the domains of the Stroke Specific Quality of Life scale (SS-QoL) [17], the Cognitive and Emotional Consequences of Stroke (CLCE-24) [18], the Hospital Anxiety and Depression Scale (HADS) [19, 20], the Quality of Life after Brain Injury scale (QOLIBRI) [21], the Patient-Reported Outcomes Measurement Information System questionnaire (PROMIS) [22], and the Stroke Impact Scale (SIS) [23]. These PROMs were selected because they have been (partly) validated for use in patients with aSAH (as found in the systematic review [13]) or commonly used in research studying the outcomes of aSAH.

The interviews were recorded, and a verbatim transcript was made. A thematic analysis with a directed approach was performed based on a topic list guided by the interview script. The analysis was performed in ATLAS.ti. Any new themes that emerged during the analysis were added to this topic list.

Interviews with patients: round two

After developing the preliminary PROM, a cognitive validation study was conducted to evaluate whether the questions of the SOS-SAH were interpreted in the way they were intended (step 4 of the PROM-cycle: testing of the PROM). This enabled the evaluation of whether the selected (domains of) existing PROMs were suitable for use in patients with aSAH, and to assess the comprehensibility of any newly formulated items. Patients with a successfully treated aSAH who attended the outpatient clinic were asked to participate. During the interview, the patients completed the SOS-SAH and shared their thoughts about the purpose and phrasing of the questions and about the comprehensiveness of the SOS-SAH [24]. An interview guide was used for all the interviews, which were transcribed verbatim. The analysis was performed based on a topic list and any new issues that emerged during the analysis were added to this topic list. Based on the results, the working group made the final decision about the removal or adaptation of unclear items, leading to the final version of the SOS-SAH.

Results

Goal setting

The main goal of the SOS-SAH is to screen for undetected symptoms in individual patients with mild disabilities following their successful treatment for aSAH. Healthcare professionals stated that complaints and mild disabilities common in patients with aSAH are not always recognized during regular hospital visits, in contrast to the complaints of patients with higher mRS values. Patients with mild disabilities may not actively mention these symptoms during the follow-up consultation, and due to time restraints healthcare professionals also may not inquire about all of them. This prohibits potential treatment or therapy. Healthcare professionals mentioned the following symptoms that might not be recognized: fatigue, problems with cognitive functioning, anxiety, depression, barriers in social participation, and headaches.

According to patients, a PROM might help them to identify and bring up the topics they want to discuss during a consultation, as well as providing insight into which of their complaints might be caused by the aSAH. However, none of the patients thought that the use of a questionnaire in their own care would have had a major impact on the healthcare they received. Despite that, half of the interviewed patients have the feeling they lacked something in their follow-up care, such as support or more timely and regular follow-up appointments.

All interviewed patients and healthcare professionals were in favor of an additional proxy measurement, which is a measurement completed by a person close to the patient. This would facilitate the indirect measurement of certain domains of functioning, which is especially important in patients with a decreased insight into their own performance due to brain damage, as can be the case in patients with aSAH, which was also found to be relevant in patients with an apparently good outcome.

Selection of PROs

In the literature, 17 PROs were identified for patients with aSAH, listed in Table 2 [3, 9, 25,26,27]. The working group decided that if the PROs showed a major overlap, e.g., fatigue and sleep disorders, or post-traumatic stress disorder and anxiety, only one PRO was to be included in the PROM. Healthcare professionals and patients considered cognitive functioning, depression, anxiety, fatigue, social roles, and personality to be the most important PROs for the SOS-SAH.

Table 2 The selection process of relevant PROs for patients with an aSAH

The healthcare professionals recommended the addition of the following to the SOS-SAH: smell, taste, hearing, headache (but not pain in general), and hypersensitivity to especially visual and acoustic stimuli (Table 2). Hypersensitivity to stimuli was also frequently mentioned by the patients. Sexual dysfunction is not frequently mentioned as an important outcome after aSAH [28], but healthcare professionals recommended the active exploration of this outcome, which patients may otherwise be reluctant to present. The working group excluded PROs that represent complaints on the functional level, such as mobility and upper extremity function, since they are not the main focus of this study (i.e., they are usually detected in regular assessments and evaluation).

Identification of PROMs

Only a few validation studies have assessed PROMs specifically for patients with aSAH, and generally these are of low quality [13]. The most suitable PROM currently available for patients with aSAH is the SS-QoL [13]; however, this PROM lacks an assessment of content validity, and the assessment of structural validity resulted in two factors and not the proposed twelve domains that the SS-QoL aims to measure [13]. This makes the validity of the separate domain scores questionable. We identified one disease-specific PROM for patients with aSAH: the Subarachnoid Haemorrhage Outcome tool (SAHOT) [29]. The SAHOT consists of 56 items that patients rate on a three-point scale according to the change they experienced. Since no direction of change (better or worse) is incorporated in the answering options, the working group considered the face validity of this tool to be insufficient. The development and assessment of its measurement properties were of low quality [13]. The interpretation of the SAHOT was developed using a Rasch-based interval analysis (which is based on item response theory and requires time for a digital analysis of the answers using Rasch models), which makes it unfeasible for use in daily practice. The SS-QoL and the SAHOT were therefore considered unsuitable for inclusion in the current PROM.

Since the validated PROMs for patients with aSAH were not suitable, we searched the literature for more generic PROMs to capture the selected PROs. The selected PROMs were the CLCE-24 [18], the HADS [19, 20], QOLIBRI questionnaire [21], the PROMIS questionnaires [22], and the SIS [23]. We selected these PROMs because they are (at least partially) validated for use in patients with aSAH, have previously been used in research into the outcomes of aSAH, or because they are broadly accepted PROMs.

Development and testing of the PROM

Number of questions

Both healthcare professionals and patients found 30–40 items to be the acceptable maximum number in the PROM; despite this, some patients reported that in practice they would complete the PROM in multiple attempts due to a lack of energy and/or concentration. The PROM consists of multiple questions addressing the most important PROs; cognitive functioning, anxiety, depression, fatigue, and social roles. In order to keep the SOS-SAH relatively brief, only one or two questions were used to address the other PROs.

Patients’ preferences

The interviewed patients in general preferred PROMs that adhere to their actual experiences and feelings, and preferred positively formulated items; for example, ‘I feel cheerful’ (HADS) was preferred over ‘I felt worthless’ (PROMIS short form for depression)). Healthcare professionals advised the inclusion of a question about the degree of recovery after the aSAH; however, during pilot testing, several patients interpreted this question as asking whether the aneurysm itself was healed, which was not the aim of the question. Additionally, only one patient could provide an estimated degree of recovery, because the concept of general recovery did not capture the different persisting complaints or because complaints fluctuated daily. The working group therefore decided not to add this item to the PROM.

Preliminary SOS-SAH

After consensus was reached in the working group, the SOS-SAH was composed of the HADS, the PROMIS short form for fatigue, the PROMIS short form for social roles, a customized PROMIS short form for cognitive abilities, and 10 questions to cover the other nine PROs (Table 3). The HADS is a questionnaire that measures anxiety and depression, with seven questions per domain [19]. PROMIS HealthMeasures develops item banks for frequently assessed PROs that are validated for use in the general population and for persons with chronic diseases. Ideally, these databases are used as computer adaptive tests (CATs); however, since CATs are not yet feasible for widespread use in Dutch clinical practice and because patients with aSAH preferred to complete the PROM in paper form, we opted to use the short forms that were created based on the item banks [22].

Table 3 Used PROMs to cover the identified PROs

In the original PROMIS short form for cognitive abilities, the phrase ‘as usual’ was often used in an item (e.g., ‘my memory has been as good as usual’). Due to the changes due to the aSAH itself, the reference point ‘as usual’ can be ambiguous; therefore, the working group decided to use a previously developed and translated customized Dutch form, which did not include ‘as usual’. Finally, we added 10 questions to the SOS-SAH to cover the nine remaining PROs. The working group rephrased an item of the QOLIBRI questionnaire, which was developed for patients with brain injury, for each of these PROs (the QOLIBRI item: ‘How bothered are you by problems with seeing or hearing?’).

Proxy measurements in the SOS-SAH

The working group considered proxy measurements relevant to assess cognitive abilities and changes in personality, as for these topics it was deemed most essential to gain an additional perspective. The PROMIS short form for cognitive abilities was adapted to fit a proxy perspective, with permission from PROMIS HealthMeasures.

Measurement protocol of the SOS-SAH

With regard to the timing of the use of the screening instrument, healthcare professionals suggested that the SOS-SAH screening should take place approximately six weeks after the aSAH treatment, since an early intervention in the case of persistent complaints might be of benefit to the patient. Some patients experienced deficits later in their recovery or did not request help at an early stage after their aSAH, however; therefore, both the healthcare professionals and patients recommended that the questionnaire should also be used later in the course of the aSAH recovery, such as six months after treatment.

Cognitive validation

Seven patients were interviewed to validate the SOH-SAH (Table 1). Additionally, we interviewed five family members to evaluate the proxy questionnaire.

Most of the questions from the existing PROMs were understood by the patients as intended, with only a few questions for which one or two patients had a different interpretation of the question. Most notably, patients found it hard to distinguish between ‘focusing’ and ‘concentrating’ (PROMS short form for cognitive abilities), while some patients answered the HADS question ‘I can enjoy a good book or radio or TV program’ (from its depression domain) negatively due to problems with their sight rather than feelings of depression. As a whole, however, the cognitive validation did not reveal any major problems for the content validity of the existing PROMs included in the SOS-SAH.

The 10 newly formulated items were also mostly understood as intended. Only one question about personality change was sometimes interpreted in a broader way, with patients taking changes of activities into account alongside personality change. However, these two may influence each other so this deviation was considered minor and the question was left unchanged.

Visual presentation

Healthcare professionals preferred a visual presentation of the SOS-SAH results that could be easily interpreted at a glance. They considered colored smileys for each PRO to be a good way to do this: a green smiley for a good outcome, orange for moderate, and red for a bad outcome. These categories were defined based on the cut-off values for the HADS [19] and the cut-off values for the PROMIS short forms based on T-scores [30]; the working group decided the cut-off values for the domains with one or two questions.

Final result and recommended use

The SOS-SAH consists of 40 items covering 14 domains, with an additional section for a proxy measurement by family members containing nine items covering the cognitive abilities and personality change domains (Table 4). The result of the SOS-SAH can be summarized with a sum score, presented as a colored smiley for each domain.

Table 4 Definite version of the questions of the SOS-SAH

It was not possible for the majority of the interviewed patients to complete the PROM online without help, due to an inability to use a computer or a lack of energy to focus on a computer screen. The working group therefore recommends that, in practice, the PROM is presented to patients on paper.

The working group advises the following use of the SOS-SAH: the PROM could be employed multiple times during a patient’s follow-up care; for example, at six weeks, six months, and 12 months after the aSAH treatment. We advise healthcare professionals to discuss the results of the SOS-SAH with the patient to clarify whether the patient actually considers their condition to be a problem and to discuss whether there is a need for treatment. We suggest that patients are asked to prioritize the domains they want to discuss with the healthcare professional, in order to enhance patient engagement.

Discussion

We describe the development of the SOS-SAH, a PROM for patients with successfully treated aSAH but with mild disabilities. The SOS-SAH screens for symptoms that often remain undetected because patients often do not actively mention these symptoms in consultations with healthcare professionals. The SOS-SAH was developed using domains and items from existing PROMs, with 10 newly formulated items. The use of existing PROMs offers the advantage of validated measurement properties, which increases the general acceptance of a PROM.

It is important to discuss the results of the PROM with patients. Pre-existing diseases or personal and environmental factors can influence impairments, limit activity, or restrict participation, as described in the ICF model [16]. These contextual personal and environmental factors are not captured in the SOS-SAH; therefore, we advise the healthcare professionals to ask patients for a clarification of their answers and discuss whether they would like to receive treatment.

The SOS-SAH covers cognitive complaints, but is not meant to replace formal cognitive tests. Subjective cognitive complaints are prevalent after subarachnoid hemorrhage [26]; however, cognitive complaints do not necessarily correspond with objective cognitive deficits. Previous research showed that cognitive complaints correlate not only with cognitive deficits, but also with depressive symptoms, anxiety, and coping style [26, 31,32,33]. Additionally, an aSAH can affect a patient’s ability to judge their own cognitive abilities [34]; therefore, patient-reported cognitive complaints may suggest cognitive dysfunctioning, but cannot replace formal neuropsychological tests. From a patient’s perspective, their own experience of cognitive impairments in daily life is what is most important and that is what must be treated. When the SOS-SAH reveals cognitive complaints, cognitive tests are advocated.

Both the anxiety and depression domains are incorporated in the SOS-SAH, although it might not be possible to measure these two as separate constructs. The HADS is a well-known and widely used health measurement instrument for measuring anxiety and depression; however, multiple studies have revealed it has an unclear factor structure [35]. The questions of the HADS are designed to avoid items that might arise due to physical rather than psychological states [36], but our cognitive validation interviews revealed that patients took physical symptoms into account while answering two questions of the HADS. We will evaluate whether this is problematic in future research on the SOS-SAH. Since our proposed use of the SOS-SAH is as a screening instrument in individual patient care, valuable information is gathered from the administration of the HADS.

The PROs that are incorporated in the SOS-SAH overlap with relevant PROs for patients after an ischemic stroke [37]; however, the most frequently occurring problems differ between patients treated for these two conditions. In patients after a stroke, the functional outcome is mainly driven by physical limitations due to focal brain damage, while for patients after an aSAH the main problems are usually cognitive disturbances, problems with societal participation, mood disturbances, and fatigue [37]. As a result of the higher age of patients after a stroke and the physical handicaps, the implications of these deficits in daily life might be less pronounced. It has not yet been investigated whether the clinical outcome of patients after an aSAH is different from the outcome of young stroke patients.

The results of a recently published systematic review show that the currently available PROMs are not sufficiently valid for use with patients successfully treated for aSAH [13], leading us to develop the SOS-SAH. The SOS-SAH differs from existing PROMs because the content validity has been evaluated thoroughly, and because it has been developed as a screening questionnaire and contains a proxy measurement. Furthermore, the SOS-SAH covers more topics than the SS-QoL, most notably anxiety, headache, smell, hearing, taste, and hypersensitivity to stimuli. In comparison with the SAHOT, the SOS-SAH is easier to use because its scores are not based on a Rasch analysis. Additionally, its face validity is better since the answer categories in the SAHOT do not contain the direction of change [13]. We therefore think that the SOS-SAH is more useful as a screening questionnaire in individual patient care.

Strengths

The major strength of the development of the SOS-SAH is our extensive collaboration with patients and different types of healthcare professionals. Furthermore, the methodological adherence to the PROM-cycle and consensus-based standards for the selection of health status measurement instruments (COSMIN) is a strength [14, 38]. Lastly, validated PROMs available in multiple languages were included in the SOS-SAH, making the adaptation of the PROM for use in different countries highly feasible.

In qualitative research, data are gathered until data saturation is reached, and usually a large number of patients are interviewed to collect all important aspects of the outcome measure. In the development of the SOS-SAH, previously published PROs for patients after aSAH were used. These PROs were discussed in interviews with patients and healthcare professionals to decide on their relevance and whether they should be included in the SOS-SAH. This approach offers a scientific but pragmatic method to create a comprehensive overview of relevant PROs for patients. In doing so, we were able to interview a limited number of patients but still adhere to the COSMIN guidelines for PROM development [38].

Limitations

The SOS-SAH does not cover all PROs that are important for patients with an aSAH, such as mobility and upper extremity function. This decision was made consciously in order to focus on undetected complaints and limit the length of the questionnaire. Additionally, we developed the SOS-SAH as a screening instrument for in-hospital care. The potential value of the SOS-SAH for use in other settings such as primary care or in the rehabilitation setting might be interesting for future research.

The optimal way of scoring PROMIS short forms is by the calculation of T-scores based on response pattern scoring instead of the T-scores in table form that we used. In response pattern scoring, the T-scores are calculated based on item parameters, i.e., item difficulty and discrimination of the item. It is only possible to accomplish this with an online scoring service in which all answers must be uploaded, which is less feasible in clinical practice.

Finally, the PROM has not yet been clinically tested, and thus is not yet validated. A validation study was recently begun.

Conclusions

The development of a PROM for implementation in clinical practice for patients after an aSAH is described here. It resulted in the “Questionnaire for the Screening of Symptoms in aneurysmal Subarachnoid Hemorrhage” (SOS-SAH), which screens for self-reported symptoms of patients with mild disabilities. The SOS-SAH contains 14 domains and 40 items, in addition to a proxy measurement of nine items covering two domains.

We started a pilot study to test the feasibility of the SOS-SAH in daily clinical care to gather information about its practical use, to explore whether the information obtained from the SOS-SAH helps physicians and/or patients, and to determine its measurement properties.

Availability of data and materials

The authors are willing to provide non-identifying raw data related to this study upon request.

References

  1. Etminan N, Chang HS, Hackenberg K, de Rooij NK, Vergouwen MDI, Rinkel GJE, et al. Worldwide incidence of aneurysmal subarachnoid hemorrhage according to region, time period, blood pressure, and smoking prevalence in the population: a systematic review and meta-analysis. JAMA Neurol. 2019;76(5):588–97. https://doi.org/10.1001/jamaneurol.2019.0006.

    Article  PubMed  PubMed Central  Google Scholar 

  2. Lovelock CE, Rinkel GJ, Rothwell PM. Time trends in outcome of subarachnoid hemorrhage: population-based study and systematic review. Neurology. 2010;74(19):1494–501. https://doi.org/10.1212/WNL.0b013e3181dd42b3.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  3. Rinkel GJ, Algra A. Long-term outcomes of patients with aneurysmal subarachnoid haemorrhage. Lancet Neurol. 2011;10(4):349–56. https://doi.org/10.1016/s1474-4422(11)70017-5.

    Article  PubMed  Google Scholar 

  4. Nieuwkamp DJ, Setz LE, Algra A, Linn FH, de Rooij NK, Rinkel GJ. Changes in case fatality of aneurysmal subarachnoid haemorrhage over time, according to age, sex, and region: a meta-analysis. The Lancet Neurology. 2009;8(7):635–42. https://doi.org/10.1016/s1474-4422(09)70126-7.

    Article  PubMed  Google Scholar 

  5. de Rooij NK, Linn FH, van der Plas JA, Algra A, Rinkel GJ. Incidence of subarachnoid haemorrhage: a systematic review with emphasis on region, age, gender and time trends. J Neurol Neurosurg Psychiatry. 2007;78(12):1365–72. https://doi.org/10.1136/jnnp.2007.117655.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Shea AM, Reed SD, Curtis LH, Alexander MJ, Villani JJ, Schulman KA. Characteristics of nontraumatic subarachnoid hemorrhage in the United States in 2003. Neurosurgery. 2007;61(6):1131–7; discussion 7-8. https://doi.org/10.1227/01.neu.0000306090.30517.ae.

    Article  PubMed  Google Scholar 

  7. Taylor TN. The medical economics of stroke. Drugs. 1997;54(Suppl 3):51–7; discussion 7-8. https://doi.org/10.2165/00003495-199700543-00008.

    Article  PubMed  Google Scholar 

  8. Hackett ML, Anderson CS. Health outcomes 1 year after subarachnoid hemorrhage: an international population-based study. The Australian cooperative research on subarachnoid hemorrhage study group. Neurology. 2000;55(5):658–62. https://doi.org/10.1212/WNL.55.5.658.

    Article  CAS  PubMed  Google Scholar 

  9. Al-Khindi T, Macdonald RL, Schweizer TA. Cognitive and functional outcome after aneurysmal subarachnoid hemorrhage. Stroke. 2010;41(8):e519–36. https://doi.org/10.1161/strokeaha.110.581975.

    Article  PubMed  Google Scholar 

  10. Kruisheer EM, Huenges Wajer IMC, Visser-Meily JMA, Post MWM. Course of participation after subarachnoid hemorrhage. Journal of stroke and cerebrovascular diseases : the official journal of National Stroke Association. 2017;26(5):1000–6. https://doi.org/10.1016/j.jstrokecerebrovasdis.2016.11.124.

    Article  Google Scholar 

  11. Black N. Patient reported outcome measures could help transform healthcare. BMJ (Clinical research ed). 2013;346:f167. doi:https://doi.org/10.1136/bmj.f167.

  12. Van Der Wees PJ. Nijhuis-Van Der Sanden MW, Ayanian JZ, Black N, Westert GP, Schneider EC. Integrating the use of patient-reported outcomes for both clinical practice and performance measurement: views of experts from 3 countries. The Milbank quarterly. 2014;92(4):754–75. https://doi.org/10.1111/1468-0009.12091.

    Article  Google Scholar 

  13. Nobels-Janssen E, van der Wees PJ, Verhagen WIM, Westert GP, Bartels R, Boogaarts JD. Patient-reported outcome measures in subarachnoid hemorrhage: a systematic review. Neurology. 2019;92(23):1096–112. https://doi.org/10.1212/wnl.0000000000007618.

    Article  PubMed  PubMed Central  Google Scholar 

  14. van der Wees PJ, Verkerk EW, Verbiest MEA, Zuidgeest M, Bakker C, Braspenning J, et al. Development of a framework with tools to support the selection and implementation of patient-reported outcome measures. J Patient Rep Outcomes. 2019;3(1):75. https://doi.org/10.1186/s41687-019-0171-9.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Rankin J. Cerebral vascular accidents in patients over the age of 60. II. Prognosis. Scott Med J. 1957;2(5):200–15. https://doi.org/10.1177/003693305700200504.

    Article  CAS  PubMed  Google Scholar 

  16. WorldHealthOrganization. International classification of functioning, disability and health (ICF) Geneva: World Health Organization. . 2001.

  17. Williams LS, Weinberger M, Harris LE, Clark DO, Biller J. Development of a stroke-specific quality of life scale. Stroke. 1999;30(7):1362–9. https://doi.org/10.1161/01.STR.30.7.1362.

    Article  CAS  PubMed  Google Scholar 

  18. Rasquin SM, van Heugten CM, Winkens L, Beusmans G, Verhey FR. Checklist for the detection of cognitive and emotional consequences after stroke (CLCE-24). Tijdschr Gerontol Geriatr. 2006;37(3):112–6.

    Article  CAS  Google Scholar 

  19. Zigmond AS, Snaith RP. The hospital anxiety and depression scale. Acta Psychiatr Scand. 1983;67(6):361–70. https://doi.org/10.1111/j.1600-0447.1983.tb09716.x.

    Article  CAS  PubMed  Google Scholar 

  20. Spinhoven P, Ormel J, Sloekers PP, Kempen GI, Speckens AE, Van Hemert AM. A validation study of the hospital anxiety and depression scale (HADS) in different groups of Dutch subjects. Psychol Med. 1997;27(2):363–70. https://doi.org/10.1017/s0033291796004382.

    Article  CAS  PubMed  Google Scholar 

  21. von Steinbuchel N, Wilson L, Gibbons H, Hawthorne G, Hofer S, Schmidt S, et al. Quality of life after brain injury (QOLIBRI): scale validity and correlates of quality of life. J Neurotrauma. 2010;27(7):1157–65. https://doi.org/10.1089/neu.2009.1077.

    Article  Google Scholar 

  22. Cella D, Riley W, Stone A, Rothrock N, Reeve B, Yount S, et al. The patient-reported outcomes measurement information system (PROMIS) developed and tested its first wave of adult self-reported health outcome item banks: 2005-2008. J Clin Epidemiol. 2010;63(11):1179–94. https://doi.org/10.1016/j.jclinepi.2010.04.011.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Duncan PW, Wallace D, Lai SM, Johnson D, Embretson S, Laster LJ. The stroke impact scale version 2.0. Evaluation of reliability, validity, and sensitivity to change. Stroke. 1999;30(10):2131–40. https://doi.org/10.1161/01.str.30.10.2131.

    Article  CAS  PubMed  Google Scholar 

  24. Hak T, Van der Veer K, Jansen H. The Three-Step Test-Interview (TSTI): An observation-based method for pretesting self-completion questionnaires. Survey Research Methods. 2008;2:143–50. doi:https://doi.org/10.18148/srm/2008.v2i3.1669.

  25. Hedlund M, Zetterling M, Ronne-Engstrom E, Carlsson M, Ekselius L. Depression and post-traumatic stress disorder after aneurysmal subarachnoid haemorrhage in relation to lifetime psychiatric morbidity. Br J Neurosurg. 2011;25(6):693–700. https://doi.org/10.3109/02688697.2011.578769.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Passier PE, Visser-Meily JM, van Zandvoort MJ, Post MW, Rinkel GJ, van Heugten C. Prevalence and determinants of cognitive complaints after aneurysmal subarachnoid hemorrhage. Cerebrovascular diseases (Basel, Switzerland). 2010;29(6):557–63. doi:https://doi.org/10.1159/000306642.

  27. De Vries J, Menovsky T, Ingels K. Evaluation of olfactory nerve function after aneurysmal subarachnoid hemorrhage and clip occlusion. J Neurosurg. 2007;107(6):1126–9. https://doi.org/10.3171/jns-07/12/1126.

    Article  PubMed  Google Scholar 

  28. Epprecht L, Messerli M, Samuel R, Seule M, Weber J, Fournier JY, et al. Sexual dysfunction after good-grade aneurysmal subarachnoid hemorrhage. World neurosurgery. 2018;111:e449–e53. https://doi.org/10.1016/j.wneu.2017.12.091.

    Article  PubMed  Google Scholar 

  29. Pace A, Mitchell S, Casselden E, Zolnourian A, Glazier J, Foulkes L, et al. A subarachnoid haemorrhage-specific outcome tool. Brain : a journal of neurology. 2018;141(4):1111–21. https://doi.org/10.1093/brain/awy003.

    Article  Google Scholar 

  30. Rothrock NE, Amtmann D, Cook KF. Development and validation of an interpretive guide for PROMIS scores. J Patient Rep Outcomes. 2020;4(1):16. https://doi.org/10.1186/s41687-020-0181-7.

    Article  PubMed  PubMed Central  Google Scholar 

  31. van Rijsbergen MW, Mark RE, Kop WJ, de Kort PL, Sitskoorn MM. The role of objective cognitive dysfunction in subjective cognitive complaints after stroke. Eur J Neurol. 2017;24(3):475–82. https://doi.org/10.1111/ene.13227.

    Article  PubMed  Google Scholar 

  32. Nijsse B, van Heugten CM, van Mierlo ML, Post MW, de Kort PL, Visser-Meily JM. Psychological factors are associated with subjective cognitive complaints 2 months post-stroke. Neuropsychol Rehabil. 2017;27(1):99–115. https://doi.org/10.1080/09602011.2015.1065280.

    Article  PubMed  Google Scholar 

  33. van Rijsbergen MWA, Mark RE, Kop WJ, de Kort PLM, Sitskoorn MM. Psychological factors and subjective cognitive complaints after stroke: beyond depression and anxiety. Neuropsychol Rehabil. 2019;29(10):1671–84. https://doi.org/10.1080/09602011.2018.1441720.

    Article  PubMed  Google Scholar 

  34. Hanninen T, Reinikainen KJ, Helkala EL, Koivisto K, Mykkanen L, Laakso M, et al. Subjective memory complaints and personality traits in normal elderly subjects. J Am Geriatr Soc. 1994;42(1):1–4. https://doi.org/10.1111/j.1532-5415.1994.tb06064.x.

    Article  CAS  PubMed  Google Scholar 

  35. Cosco TD, Doyle F, Ward M, McGee H. Latent structure of the hospital anxiety and depression scale: a 10-year systematic review. J Psychosom Res. 2012;72(3):180–4. https://doi.org/10.1016/j.jpsychores.2011.06.008.

    Article  PubMed  Google Scholar 

  36. Johnston M, Pollard B, Hennessey P. Construct validation of the hospital anxiety and depression scale with clinical populations. J Psychosom Res. 2000;48(6):579–84. https://doi.org/10.1016/s0022-3999(00)00102-1.

    Article  CAS  PubMed  Google Scholar 

  37. Kelly-Hayes M, Beiser A, Kase CS, Scaramucci A, D'Agostino RB, Wolf PA. The influence of gender and age on disability following ischemic stroke: the Framingham study. J Stroke Cerebrovasc Dis. 2003;12(3):119–26. https://doi.org/10.1016/s1052-3057(03)00042-9.

    Article  PubMed  Google Scholar 

  38. Mokkink LB, de Vet HCW, Prinsen CAC, Patrick DL, Alonso J, Bouter LM, et al. COSMIN risk of Bias checklist for systematic reviews of patient-reported outcome measures. Qual Life Res. 2018;27(5):1171–9. https://doi.org/10.1007/s11136-017-1765-4.

    Article  CAS  Google Scholar 

Download references

Acknowledgments

The authors thank A. Smulders, a patient who experienced a subarachnoid hemorrhage, for her constructive contribution to the development process.

Funding

The development of this PROM was funded by the Quality Foundation of Dutch Medical Specialists (SKMS; grant no. 53046391). The SKMS played no role in the design of the PROM, nor in writing of the manuscript.

Author information

Authors and Affiliations

Authors

Contributions

EN, IA, PW, and JB designed the study. EN and IA performed the interviews. PW and EN were the moderators of the focus group. EN and IA analyzed and interpreted the qualitative data and composed the SOS-SAH in cooperation with PW and JB. PW and JB equally contributed to this manuscript. EN drafted the manuscript and all authors (EN, IA, WV, RB, PW, and JB) were involved in critically revising the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Edith Nobels-Janssen.

Ethics declarations

Ethics approval and consent to participate

This study was performed in line with the principles of the Declaration of Helsinki. The project was approved by the Human Research Ethics committee of Radboud university medical center (reference number 2018–4937). Written informed consent was obtained from all participating patients. All participants have been deemed capable of ethically and medically consenting to their participation in the research presented in this manuscript by their treating physician.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Nobels-Janssen, E., Abma, I.L., Verhagen, W.I.M. et al. Development of a patient-reported outcome measure for patients who have recovered from a subarachnoid hemorrhage: the “questionnaire for the screening of symptoms in aneurysmal subarachnoid hemorrhage” (SOS-SAH). BMC Neurol 21, 162 (2021). https://doi.org/10.1186/s12883-021-02184-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12883-021-02184-x