- Study protocol
- Open Access
The Comprehensive Post-Acute Stroke Services (COMPASS) study: design and methods for a cluster-randomized pragmatic trial
BMC Neurology volume 17, Article number: 133 (2017)
Patients discharged home after stroke face significant challenges managing residual neurological deficits, secondary prevention, and pre-existing chronic conditions. Post-discharge care is often fragmented leading to increased healthcare costs, readmissions, and sub-optimal utilization of rehabilitation and community services. The COMprehensive Post-Acute Stroke Services (COMPASS) Study is an ongoing cluster-randomized pragmatic trial to assess the effectiveness of a comprehensive, evidence-based, post-acute care model on patient-centered outcomes.
Forty-one hospitals in North Carolina were randomized (as 40 units) to either implement the COMPASS care model or continue their usual care. The recruitment goal is 6000 patients (3000 per arm). Hospital staff ascertain and enroll patients discharged home with a clinical diagnosis of stroke or transient ischemic attack. Patients discharged from intervention hospitals receive 2-day telephone follow-up; a comprehensive clinic visit within 2 weeks that includes a neurological evaluation, assessments of social and functional determinants of health, and an individualized COMPASS Care Plan™ integrated with a community-specific resource database; and additional follow-up calls at 30 and 60 days post-stroke discharge. This model is consistent with the Centers for Medicare and Medicaid Services transitional care management services provided by physicians or advanced practice providers with support from a nurse to conduct patient assessments and coordinate follow-up services. Patients discharged from usual care hospitals represent the control group and receive the standard of care in place at that hospital. Patient-centered outcomes are collected from telephone surveys administered at 90 days. The primary endpoint is patient-reported functional status as measured by the Stroke Impact Scale 16. Secondary outcomes are: caregiver strain, all-cause readmissions, mortality, healthcare utilization, and medication adherence. The study engages patients, caregivers, and other stakeholders (including policymakers, advocacy groups, payers, and local community coalitions) to advise and support the design, implementation, and sustainability of the COMPASS care model.
Given the high societal and economic burden of stroke, identifying a care model to improve recovery, independence, and quality of life is critical for stroke survivors and their caregivers. The pragmatic trial design provides a real-world assessment of the COMPASS care model effectiveness and will facilitate rapid implementation into clinical practice if successful.
Clinicaltrials.gov: NCT02588664; October 23, 2015.
Stroke is a major cause of long-term disability and mortality in the United States, exemplifying a complex chronic disease with high co-morbidity, associated healthcare costs, and readmission rates [1,2,3,4,5,6]. An estimated 6.6 million Americans aged 20 years and older have had a stroke, and each year approximately 795,000 people experience a new or recurrent stroke . North Carolina (NC) has a particularly high stroke burden and is in the geographic region of the country known as the ‘Stroke Belt’. Stroke mortality in Eastern NC is 40% higher than the national average and hospital admission rates are the highest in the state . African Americans comprise over 20% of the NC population and are more likely to be affected by stroke than their white counterparts, such as having higher post-stroke hospital readmission rates [5, 7, 8].
Stroke survivors experience significant physical, mental and social challenges. Roughly half are discharged directly home from the hospital, where they often realize disabilities not identified during hospitalization and are at risk for complications such as falls, physical deconditioning, aspiration pneumonia, infections, social isolation and depression as well as recurrent stroke [4, 9,10,11,12,13,14,15,16]. Patients with mild post-stroke disability often have undetected physical and cognitive deficits that interfere with function and management of risk factors and medication [17, 18]. Individuals discharged with a clinical diagnosis of transient ischemic attack (TIA) may also have residual deficits and are at increased risk for future stroke [19,20,21].
Family members who care for stroke survivors often face significant burden [22,23,24]. Approximately 70% of stroke survivors require assistance with activities of daily living . This assistance is usually provided by family members who are often unprepared and ill-equipped to assume caregiving responsibilities such as providing direct care (e.g., bathing, toileting, mobility assistance, transfers), managing medications, assisting with instrumental activities of daily living, managing stroke survivor emotions and behaviors, communicating with providers, and identifying and accessing community resources. These new responsibilities often lead to overwhelming physical and emotional strain, depressive symptoms, decline in physical and mental health, reduced quality of life, and isolation in the family caregiver [23, 25].
An effective, post-acute care model is needed given the significant impact of stroke on public health, the high risk and complexity of these patients early after discharge, and the strain on caregivers [26, 27]. Currently the U.S. lacks a standard to require hospitals to coordinate community-based follow-up visits with primary or specialty care . The variation in availability, access, referrals, and effectiveness of post-acute stroke medical and rehabilitative care leads to significant gaps in the stroke system of care . These gaps can lead to increased likelihood of readmission, and thus higher healthcare costs. Improved transitions of care from the acute phase to the post-discharge environment may help improve functional status and quality of life for stroke survivors and their caregivers and reduce healthcare costs to society . Stroke morbidity and mortality may also be reduced through effective transitional care, secondary prevention, and rehabilitation early post-stroke [29,30,31,32,33].
Early supported discharge (ESD) is the only evidence-based transitional care intervention found to reduce the negative impact of stroke (i.e., decreased length of stay, accelerated functional recovery, improved patient and caregiver satisfaction) and is the standard of care in the United Kingdom and Canada [24, 31, 34,35,36,37]. ESD utilizes a hospital-based, multidisciplinary team of physicians, nurses, therapists, and social workers with stroke expertise to decrease length of stay, anticipate, prevent, and manage stroke complications, improve functional status, and optimize stroke risk factor management, all without increasing caregiver burden . ESD has not been evaluated in the U.S. or non-urban settings and few of its components are in place at 29 stakeholder NC hospitals we surveyed .
Our goal was to develop, implement, and evaluate a comprehensive, evidence-based, post-acute care model in real-world practice. Our care model uses elements of transitional care management and ESD evaluated in our prior work with the TRAnsition Coaching for Stroke (TRACS) model that demonstrated reduced readmissions . The intervention was designed to be consistent with the Centers for Medicare and Medicaid Services (CMS) care and reimbursement models for transitional care management . We engaged a range of stakeholders from patients to policy makers, with the goal of making the intervention patient-centered, useful to providers, and lead to greater uptake of results by the larger medical community.
The COMPASS Study was designed to compare the COMPASS care model versus usual post-discharge care on stroke survivors’ self-reported functional status (Stroke Impact Scale-16) 90 days post-stroke hospital discharge. Secondary aims were to determine if the COMPASS care model reduces: i) caregiver strain 90 days post-stroke discharge; ii) all-cause 30- and 90-day readmissions; iii) mortality, health care use (emergency department visits, all-cause re-hospitalization, admission to skilled nursing facilities, admission to inpatient rehabilitation facilities) up to one year after stroke hospitalization; and iv) medication non-adherence.
Objective & study design
The study objective was to evaluate the effectiveness of the COMPASS care model against usual care in diverse hospital settings and patients under real-world clinical conditions. We utilized a cluster-randomized pragmatic trial design in which the unit of randomization was the hospital. This design was chosen as it provides a real-world assessment of our new care model versus usual care. Our design also facilitates rapid dissemination and uptake of successful care strategies and helps health systems prepare for CMS value-based care models [40,41,42,43].
Hospitals eligible to participate in the COMPASS Study included those that 1) were located in North Carolina; 2) had an emergency department; 3) treated stroke patients; and 4) were able to identify stroke and TIA patients concurrent with care. Recruitment efforts first targeted hospitals in the NC Stroke Care Collaborative (NCSCC) network (N = 51) . The NCSCC is a hospital-based, prospective registry of stroke patients and was part of the Centers for Disease Control and Prevention’s Paul Coverdell National Acute Stroke Registry Program through 2014 . It was designed to measure, track, and improve the quality of acute stroke care. The NCSCC hospital network covers 60% of the counties in NC, 80% of the state’s population, and 82% of stroke discharges annually. Recruitment efforts were next extended to all other eligible hospitals in NC. Hospital recruitment lasted for 1 year by which time a total of 110 hospitals in NC had been identified as potentially eligible and invited to participate. Fifteen hospitals did not meet one or more of the inclusion criteria (Fig. 1) because they transferred all stroke patients from the emergency department to another hospital. In addition, 54 hospitals declined to participate in the study. Limited resources (e.g., finances, staff, time) necessary to establish the COMPASS clinic infrastructure and adopt the intervention care model was the primary reason given for non-participation.
Forty-one hospitals (40 randomized units) agreed to participate in the COMPASS study (Fig. 1). Two hospitals were paired as a single randomization unit because their degree of shared staff would have compromised the integrity of independent randomization. Participating hospitals are distributed across urban and rural regions of the state as well as across the three geographic regions of NC, with the majority located in the central Piedmont region (Table 1; Fig. 2) where much of the state’s population resides. Twenty-three sites were Joint Commission certified as a primary or comprehensive stroke center at the time of randomization and 30% had high annual stroke volumes.
Hospitals were randomized to either receive the COMPASS care model or maintain their usual care. We used a stratified cluster-randomized approach with a block size of two, which maintained balance between treatment groups while also protecting the validity of the randomization process. Only pairs of hospitals were randomized until the end of the study when two hospitals without matches were randomized individually. Hospitals were assigned to one of four strata defined by stroke patient discharge volume and primary stroke center (PSC) certification status (PSC/high-volume; PSC/low-volume; non-PSC/high-volume; non-PSC/low-volume). The study team involved with site selection (RD, SJ) did not have access to the randomization schedule, which was held by a biostatistician (WA) who performed all randomizations and was not involved in site selection. Randomization continued in three waves from April, 2016 through January 2017.
A central IRB was established by Wake Forest University to facilitate oversight of study activities across the 41 participating hospitals. This IRB reviewed and approved the study protocol including the unique aspects of patient consent in this pragmatic trial, discussed later in this paper.
The study period for analysis of the primary and secondary aims (Phase 1) will last until accrual of 6000 participants. At the close of Phase 1, hospitals randomized to usual care will receive the COMPASS care model while hospitals randomized to COMPASS care model in Phase 1 will sustain the model with their own resources (Phase 2). This delayed-start study design allows all enrolled hospitals to eventually receive the intervention .
Participant inclusion & exclusion criteria
The COMPASS Study will enroll 6000 stroke patients discharged home from participating hospitals in Phase 1 (3000 each per randomization arm over ~1 year) and an additional 6000 patients in Phase 2. Patient enrollment began after each hospital was randomized and trained. Eight sites began enrollment in July, 2016, 10 between October–November 2016, and 22 from December 2016–March 2017. Patient eligibility criteria, selected to maximize external validity, are as follows:
Aged 18 years of age or older
English or Spanish speaker
Diagnosed with ischemic stroke, hemorrhagic stroke (excluding subdural or aneurysmal hemorrhage), or TIA; excluding elective carotid endarterectomy procedures
Discharged to home (excludes discharges to prison, nursing home, inpatient rehabilitation facility, hospice and comfort measures only)
Hospital staff use a clinical algorithm with standardized definitions for stroke and TIA diagnosis (Additional file 1). Ischemic stroke requires persistence of symptoms for at least 1 h and at least 1 of the following: MRI confirmation of infarct or ischemia, receipt of tPA with or without confirmation on MRI, or high suspicion of cerebrovascular etiology if MRI was negative. Non-traumatic intra-parenchymal hemorrhage requires persistence of symptoms >1 h and CT/MRI evidence of hemorrhage. TIA is defined as a transient episode of neurological dysfunction caused by focal brain, spinal cord, or retinal ischemia without acute infarction. Specifically, TIA diagnosis requires symptoms >5 min in duration with MRI finding negative for acute infarct and absence of suspected stroke mimics (i.e., syncope, complicated migraine, infection, reactivation of old stroke symptoms, delirium, medication reaction, intoxication, angina, and seizure).
Clinical or administrative nursing staff ascertain presumptive stroke and TIA patients concurrently with care by generating a daily list. They query hospital admissions, neurology consults, emergency department logs, and observation units for stroke-related ICD codes and symptoms. Ascertained patients are followed concurrently with care and eligibility is determined using a brief form and clinical algorithm. Patients discharged on a weekend or holiday may be ascertained on the following business day and enrolled retrospectively. The study team performs periodic case ascertainment audits to compare study enrollment against hospital discharge lists.
Participant enrollment & retention
Designated hospital staff (post-acute coordinator [PAC] at an intervention site or stroke care coordinator at a control site) visit eligible patients prior to discharge. They notify the patient of the hospital’s participation in the COMPASS Study and distribute a study information packet that includes a blood pressure log and site-specific informational brochure describing the hospital’s post-acute care and the COMPASS Study. The brochure also explains the voluntary survey call scheduled for 90 days post-discharge. Hospitals in the COMPASS care model intervention arm also distribute additional information (e.g., individualized risk factor information sheets, refrigerator magnet, business card and contact phone number for the PAC, and an appointment for the COMPASS clinic visit.). Reminder letters are mailed to all participants at 30, 60, and 80 days post-discharge describing the study purpose, available resources for stroke survivor and caregivers, and contact information for study staff. The letter at 30 days includes a COMPASS logo magnet and the 80-day letter includes a copy of the 90-day survey questions to assist with the telephone interview.
Control group: usual care
Hospitals in the control group continue to implement their current standard of care for stroke patients going home during Phase 1. The study does not bar hospitals from implementing changes over the course of the study. In order to assess transitional care practices prior to the start of the study, and to monitor changes over time, all COMPASS participating hospitals completed a baseline survey. The survey was administered using an electronic data capture tool prior to randomization. Information was captured about the practices and structures in place for care transitions, including availability of telephone and neurology follow-up, and utilization of Transitional Care Management Codes (TCM) billing, post-acute quality metrics, and outcome assessments. A second survey will be completed at the close of Phase 1 in order to assess temporal changes in practice that may have occurred in control sites.
Intervention group: COMPASS care model
The COMPASS care model intervention uses a holistic approach and integrates medical and community resources to meet the needs of stroke survivors and caregivers and optimize outcomes. These needs include medical, physical, and social determinants of health, goals of care, and preferences as recommended by the CMS. The COMPASS care model was designed to address these needs by identifying four essential ‘dimensions’ of care to help patients ‘find their way forward after stroke’. These dimensions are depicted as directions on a compass in messaging to patient, caregivers, and practitioners (Fig. 3). The COMPASS care model was developed and refined at the Wake Forest Baptist Transitional Stroke Clinic (the study vanguard site). The model consists of patient follow-up post-discharge and standardized patient and caregiver patient reported assessments. The innovative focal point of the COMPASS care model is real-time generation of an individualized patient electronic care plan (COMPASS-CP™) that also incorporates caregiver support needs and an integrated registry of community resources. The COMPASS-CP was designed to meet CMS requirements for comprehensive care of complex patients and was piloted at the study vanguard site prior to implementation at trial sites . The development of the individualized COMPASS-CP was guided by key patient-centered questions (Table 2) and identifies areas of concern that prohibit maximizing full recovery and provide a solution in the form of education, coaching, and referrals to community-based resources.
The structure and process of the COMPASS care model are key components of training and implementation in the setting of this pragmatic clinical trial. The structural component consists of a team of practitioners (a registered nurse and an Advanced Practice Provider [APP; who is a nurse practitioner , physician assistant , or physician]) identified from existing hospital staff, usually those who were already involved in stroke patient clinical care. Their primary functions are to: 1) establish community resource networks representing clinical providers, home health agencies, outpatient therapies, and community agencies; 2) provide input for a local directory of community resources; 3) utilize TCM codes during clinic visits ; and 4) provide educational materials focused on helping patients, caregivers and providers understand stroke recovery and prevention.
The intervention processes are:
Telephone follow-up within 2 days of hospital discharge
Assessment of new stroke symptoms and receipt of home health or outpatient services
Schedule follow-up appointments with PCP and COMPASS providers
Clinic visit within 14 days of discharge during which the patient/proxy undergoes a series of standardized assessments (Table 3)
COMPASS-CP development based on the patient’s individualized needs
Coordinate and coach patients to incorporate recommended strategies across the 4 COMPASS dimensions of care
Make referrals to primary care, specialty care, rehabilitation services, and community services
Communicate with primary care, pharmacy, home health, and rehabilitation services
Telephone follow-up at 30 and 60 days to evaluate adherence to the COMPASS-CP
The PAC and APP conduct 3 standardized assessments at the clinic visits using an iPad application. Patient responses are entered into a web-based data-entry system with a priori defined skip logic. Patient-reported outcome measures (PROMs) captured as part of these assessments include, among others, functional and social determinants of health, cognitive status, health data (e.g., blood pressure, medication reconciliation), lifestyle management (e.g., alcohol, smoking, physical activity), and knowledge of stroke risk factors (Table 3) [47, 48]. For patients needing caregiver support, we supplemented the PROMs with self-reported assessment of the caregiver’s role in patient self-management and their ability to provide the necessary support. Algorithms evaluate the data captured during these assessments and identify factors that are likely to influence health, recovery and independence of the stroke survivor across each dimension of care (Fig. 4). These are used to generate the COMPASS-CP, entitled ‘Finding My Way Forward for Health, Independence, and Recovery’ , that is then finalized by the APP (Additional file 2). A printed copy of the COMPASS-CP is provided to each patient and is available electronically to the patient and all providers who manage the patient.
Implementation monitoring and evaluation
As part of the pragmatic trial we are monitoring intervention fidelity and have developed a set of post-acute quality measures that reflect the core components of the COMPASS intervention. These include receipt of a follow-up phone call within 2 business days, a clinic visit within 14 calendar days, a printed COMPASS-CP during the clinic visit, and home health or outpatient rehabilitation services within 30 days among those who were referred. We hope the results of this pragmatic trial will provide evidence to create national quality standards for post-acute stroke care delivery, which currently do not exist.
In parallel to the pragmatic trial, and with supplemental funding from the Wake Forest Clinical and Translational Science Institute, we are conducting a comprehensive process evaluation of the COMPASS care model implementation guided by the RE-AIM Framework . This analysis will evaluate the Reach, Adoption, Implementation, and Maintenance of the COMPASS intervention while the pragmatic trial will evaluate Effectiveness. Efforts to change clinical practice and deliver evidence-based patient care must be monitored and evaluated to inform broader dissemination. We seek to advance implementation science by identifying individual, organizational, and community factors affecting implementation of the COMPASS care model. For the process evaluation, we will use a mixed methods design. Data will include quantitative data captured from bi-weekly questionnaires to the hospital-based PAC teams that assess perceived barriers to uptake and real-time data on enrollment and performance measures. We will also use qualitative data obtained from interviews with the implementation team and from transcription and coding of bi-weekly phone calls with PAC teams. These data, collected from intervention sites over 1 year, will allow us to identify patient, staffing, and community-level factors that impact intervention uptake, pose challenges to uptake, and influence a health system’s ability to improve performance on pre-defined performance measures.
All hospital staff were provided training on case ascertainment, enrollment, study design and data quality. Community providers at intervention sites also received comprehensive training of the evidence-based COMPASS care model. Training included site visits for all hospitals and an intensive two-day centralized training “boot camp” for PACs and APPs that equipped them for intervention implementation. Ongoing support is provided with monthly conference calls and distribution of hospital data quality and performance reports that are reviewed with sites monthly to highlight successes and processes that need improvement.
Patient and caregiver outcomes are assessed over a 12-month follow-up period beginning at hospital discharge. The primary outcome is patient functional status 90 days post-stroke discharge that assesses the degree to which stroke-related impairments and disabilities affect the patient’s functional status and quality of life . The SIS-16 is a self-reported questionnaire that can be completed by the patient or a proxy and was selected because it is an outcome that matters to patients, their caregivers, and stroke experts [51, 52]. The Modified Caregiver Strain Index is collected from patient’s caregivers as a secondary outcome . We also assess a variety of secondary patient outcomes using the telephone survey and administrative claims data (Table 4) [53,54,55,56,57,58,59,60,61,62,63,64,65,66]. All surveys are available in English and Spanish.
Trained interviewers assess PROMs through a telephone survey conducted approximately 90 days after hospital discharge. Interviewers are blinded to treatment group and use standardized scripts and interviewing guidelines. We utilize reminder letters, additional phone contacts, mailed surveys, and proxy interviews to increase follow-up rates. Approximately 95 days after patient’s hospital discharge, a self-administered survey is mailed to the individual whom the patient had identified as their primary caregiver. This survey includes the Modified Caregiver Strain Index. If after 3 weeks a completed survey is not received, a reminder telephone call and second mailing are administered. Health care utilization data will be obtained from the CMS Medicare and Medicaid administrative claims and from the North Carolina Blue Cross/Blue Shield Health Insurance and the State Health Care Plan data. These data include claims for hospital visits, emergency department visits, admissions to skilled nursing and inpatient rehabilitation facilities, and hospital use of transitional management billing codes.
Intention-to-treat analyses will be performed at the individual level with adjustment for lack of independence between hospitals. We will use a mixed model to compare the primary endpoint (SIS-16, measured on a continuous scale) between the COMPASS care model and control groups. Although the stratified randomization of hospitals should balance most important hospital-level characteristics between groups, imbalances in patient-level characteristics may exist. Therefore, the proposed mixed model will include both fixed and random effects. The primary analysis model will include two fixed effects, randomization stratum (1 to 4) and intervention (COMPASS care model vs. control), and one random effect (hospital). Sample size and power calculations were based on direct comparisons between the expected changes in outcome means in the two groups, adjusted for the intra-hospital correlation. With a sample size of 6000 recruited from 40 randomization units, we calculate that we will have 83.2% power to detect a 4.17 unit difference in the SIS-16 score for patients in the two groups (assuming a standard deviation of 16.1) . This assumes that 90% of patients will be evaluated at 90 days, an intra-class correlation of 0.036 (based on preliminary data from NCSCC hospitals), and a detectable effect of 0.192 times the within-group standard deviation. The COMPASS Study was also designed to detect differences within subgroups of interest that comprise at least 20% of the overall sample (e.g., stroke subtype, severity, insurance status, geographic area of residence, race, and gender). The intention-to-treat analyses will be complemented with a treatment by protocol analysis, controlling for covariates that differ between those treated per protocol (i.e., who received an individualized care plan) and those who were not.
Because of the barriers to using traditional consent methods in a cluster-randomized pragmatic trial design, [67, 68] we used the broadcasting method. Patients are notified about the study and allowed to ask questions, but there is no option of opting out of participation in the intervention other than seeking care at another hospital . By adopting this method, we minimized patient risk and burden on clinical staff and maximized participation. The COMPASS Study brochure included a way to opt out of the research component (i.e., the 90-day survey). Verbal consent was obtained at the beginning of the telephone survey for the collection of those data.
Stakeholder engagement shaped the study design
Stakeholder engagement shaped our choice for a delayed start design, which provided the best statistical control to assess the intervention’s effects compared with current practice, while also ensuring that all communities would benefit from the trial. Hospital stakeholders (stroke and administrative leadership teams at 29 hospitals) explicitly requested the opportunity to implement the COMPASS care model at some point in the study even if initially randomized to the control group. This design feature supported our hospital recruitment efforts. Patients and caregivers determined the primary outcome, which measures aspects of physical functioning that matter to patients and their families, and is the only widely used measure of stroke outcomes developed from patient and caregiver focus groups [50, 51, 69]. Patients and caregivers also determined the selection of our secondary outcome of caregiver strain. Stakeholders helped develop the informed consent process (i.e., timing and language) and study materials. In addition, we convened site-specific meetings with each intervention hospital and their partners to engage local community stakeholders, patients and caregivers and to orient them to the study purpose, intervention and follow-ups, and available learning modules. The community stakeholders included primary care physicians, pharmacists, home health agencies, outpatient rehab providers, Area Agency on Aging representatives, faith leaders, emergency medicine paramedics, and other community partners. Additional information on our methods for engaging a broad base of stakeholders are described elsewhere .
This study was designed to evaluate whether implementation of a post-acute stroke care model in real-world clinical practice improves functional status of stroke patients discharged home compared with usual care. Stroke is a high-cost, complex chronic disease that requires extensive post-acute management. Comprehensive post-acute services for stroke require bridging hospital-based acute care with expanded care teams for rehabilitation, primary care management, access to community resources, and caregiver support. Early supported discharge and other transitions of care processes may improve functional outcomes, but uncertainty remains as to the best method to manage stroke patients as they transition to home . The CMS is setting new directions and reimbursements for value-based care for chronic conditions. Stroke may soon be targeted for 90-day bundled payments, which link payments for services rendered during an episode of care encompassing the inpatient stay and post-acute services through 90 days. We have developed a multidisciplinary care model that would meet these new standards.
A pragmatic trial addresses questions of effectiveness, the degree of benefit of a given intervention tested in a real-world setting. There is urgency for such information to evaluate recommended transitional care and comprehensive services for stroke that can be readily implemented into practice. The COMPASS Study will also allow us to systematically evaluate the uptake of the intervention in a diverse environment of hospital systems across North Carolina. At the same time, we employed several strategies from a traditional trial design to measure adherence to the intervention, increase participant retention, and standardize the capture of the primary outcome in order to minimize selection bias. In keeping with a pragmatic design, participants are enrolled with few exclusion criteria and we believe this will contribute to the generalizability of our findings to stroke patients outside of North Carolina. We will be assessing potential modifiers (e.g., age, race, sex, insurance status, and stroke severity) and will consider these in drawing inferences to different target populations. Moreover, even though current post-acute care may vary, our pragmatic care model incorporates this variability by tailoring the intervention to each community and individual patient’s needs, connecting patients with local resources. This adaptability further supports generalizability of the COMPASS care model to other clinical settings.
As part of our design, we chose to randomize the hospital and not individual patients within a hospital. This was deemed most appropriate given the system-level nature of the intervention, which made patient-level randomization within a single site not feasible. Group randomization also allowed us to assess feasibility and sustainability of implementing a new care model as the new standard of care for a health system. The cluster-randomized design however, may lead to imbalance in patient characteristics between randomization groups due to the fewer number of randomization assignments.
The primary operational challenge in conducting the study to date was navigating the complexity of rapidly engaging diverse health systems for research. Hospitals and systems were sometimes slow to engage because of the substantial hospital investment of staff and other resources needed to implement an intervention of this scale. The financial support provided by the study is in keeping with its pragmatic nature and is modest compared with compensation offered in many traditional clinical trials. Health systems have many competing priorities and opportunities. The extensive engagement challenges and solutions required to successfully recruit a diverse mix of hospital systems is the topic of a future publication. Initiating all hospitals simultaneously was also a challenge. To address this we randomized and launched sites in waves. This allowed us to direct separate implementation teams in a more focused manner toward subsets of hospitals. This strategy also had the unexpected benefit of allowing us more time to tailor the intervention to each site and to conduct site-specific visits and trainings in addition to the centralized training sessions. Finally, use of a central IRB for streamlining administrative burden was invaluable as was the rigorous organizational structure needed to manage operations.
This trial addresses a critical gap in post-acute stroke care management. If successful, the COMPASS care model, which has been implemented into current clinical practice in North Carolina, could be scaled to other settings, or targeted for other chronic diseases, and would position health systems for CMS value-based care models [40,41,42,43]. This care model could be further expanded to engage primary care and sub-specialty clinics which, in collaboration with hospitals, would facilitate successful patient transitions to health, independence, and recovery.
Advanced Practice Provider
Centers for Medicare and Medicaid Services
Comprehensive Post-Acute Stroke Services
Comprehensive Post-Acute Stroke Services Care Plan
International Classification of Diseases
Magnetic resonance imagine
North Carolina Stroke Care Collaborative
Post-acute Stroke Coordinator
Patient-reported outcome measures
Stroke Impact Scale
Transitional Care Management
Transient ischemic attack
Tissue plasminogen activator
Fonarow GC, Smith EE, Reeves MJ, Pan W, Olson D, Hernandez AF, et al. Hospital-level variation in mortality and rehospitalization for medicare beneficiaries with acute ischemic stroke. Stroke. 2011;42:159–66.
Olson DM, Cox M, Pan W, Sacco RL, Fonarow GC, Zorowitz R, et al. Death and rehospitalization after transient ischemic attack or acute ischemic stroke: one-year outcomes from the adherence evaluation of acute ischemic stroke-longitudinal registry. J Stroke Cerebrovasc Dis. 2013;22:e181–8.
Ovbiagele B, Goldstein LB, Higashida RT, Howard VJ, Johnston SC, Khavjou OA, et al. Forecasting the future of stroke in the United States: a policy statement from the American Heart Association and American Stroke Association. Stroke. 2013;44:2361–75.
Rosamond W, Johnson A, Bennett P, O'Brien E, Mettam L, Jones S, et al. Monitoring and improving acute stroke care: the North Carolina stroke care Collaborative. N C Med J. 2012;73:494–8.
Writing Group M, Mozaffarian D, Benjamin EJ, Go AS, Arnett DK, Blaha MJ, et al. Heart disease and stroke Statistics-2016 update: a report from the American Heart Association. Circulation. 2016;133:e38–360.
Centers for Medicare & Medicaid Services. Chronic Conditions among Medicare Beneficiaries. In: Chronic Conditions Chartbook: 2012 Edition. Baltimore. 2012. https://www.cms.gov/Research-Statistics-Data-and-Systems/Statistics-Trends-and-Reports/Chronic-Conditions/Downloads/2012Chartbook.pdf. Accessed 7 Mar 2017.
Bertoni AG, Ensley D, Goff DC. 30,000 fewer heart attacks and strokes in North Carolina: a challenge to prioritize prevention. N C Med J. 2012;73:449–56.
Kennedy BS. Does race predict stroke readmission? An analysis using the truncated negative binomial model. J Natl Med Assoc. 2005;97:699–713.
Bamford J, Dennis M, Sandercock P, Burn J, Warlow C. The frequency, causes and timing of death within 30 days of a first stroke: the Oxfordshire community stroke project. J Neurol Neurosurg Psychiatry. 1990;53:824–9.
Bernhardt J, Dewey H, Thrift A, Donnan G. Inactive and alone: physical activity within the first 14 days of acute stroke unit care. Stroke. 2004;35:1005–9.
Davenport RJ, Dennis MS, Wellwood I, Warlow CP. Complications after acute stroke. Stroke. 1996;27:415–20.
El Husseini N, Goldstein LB, Peterson ED, Zhao X, Pan W, Olson DM, et al. Depression and antidepressant use after stroke and transient ischemic attack. Stroke. 2012;43:1609–16.
Johnston KC, Li JY, Lyden PD, Hanson SK, Feasby TE, Adams RJ, et al. Medical and neurological complications of ischemic stroke: experience from the RANTTAS trial. RANTTAS investigators. Stroke. 1998;29:447–53.
Kelly J, Rudd A, Lewis RR, Coshall C, Moody A, Hunt BJ. Venous thromboembolism after acute ischemic stroke: a prospective study using magnetic resonance direct thrombus imaging. Stroke. 2004;35:2320–5.
White JH, Attia J, Sturm J, Carter G, Magin P. Predictors of depression and anxiety in community dwelling stroke survivors: a cohort study. Disabil Rehabil. 2014;36:1975–82.
Whitson HE, Pieper CF, Sanders L, Horner RD, Duncan PW, Lyles KW. Adding injury to insult: fracture risk after stroke in veterans. J Am Geriatr Soc. 2006;54:1082–8.
Bushnell CD, Zimmer LO, Pan W, Olson DM, Zhao X, Meteleva T, et al. Persistence with stroke prevention medications 3 months after hospitalization. Arch Neurol. 2010;67:1456–63.
Lai SM, Studenski S, Duncan PW, Perera S. Persisting consequences of stroke measured by the stroke impact scale. Stroke. 2011; doi:10.1016/j.apmr.2010.08.033.
Moreau F, Jeerakathil T, Coutts SB. FRCPC for the ASPIRE investigators. Patients referred for TIA may still have persisting neurological deficits. Can J Neurol Sci. 2012;39:170–3.
Pendlebury ST, Wadling S, Silver LE, Mehta Z, Rothwell PM. Transient cognitive impairment in TIA and minor stroke. Stroke. 2011;42:3116–21.
Winward C, Sackley C, Metha Z, Rothwell PM. A population-based study of the prevalence of fatigue after transient ischemic attack and minor stroke. Stroke. 2009;40:757–61.
McCullagh E, Brigstocke G, Donaldson N, Kalra L. Determinants of caregiving burden and quality of life in caregivers of stroke patients. Stroke. 2005;36:2181–6.
Rigby H, Gubitz G, Phillips S. A systematic review of caregiver burden following stroke. Int J Stroke. 2009;4:285–92.
Prvu Bettger J, Alexander KP, Dolor RJ, Olson DM, Kendrick AS, Wing L, et al. Transitional care after hospitalization for acute stroke or myocardial infarction: a systematic review. Ann Intern Med. 2012;157:407–16.
Rigby H, Gubitz G, Eskes G, Reidy Y, Christian C, Grover V, et al. Caring for stroke survivors: baseline and 1-year determinants of caregiver burden. Int J Stroke. 2009;4:152–8.
Broderick JP, Abir M. Transitions of Care for Stroke Patients: opportunities to improve outcomes. Circ Cardiovasc Qual Outcomes. 2015;8:S190–2.
Kalanithi L, Tai W, Conley J, Platchek T, Zulman D, Milstein A. Better health, less spending: delivery innovation for ischemic cerebrovascular disease. Stroke. 2014;45:3105–11.
Schwamm LH, Pancioli A, Acker JE 3rd, Goldstein LB, Zorowitz RD, Shephard TJ, et al. Recommendations for the establishment of stroke systems of care: recommendations from the American Stroke Association's Task Force on the Development of Stroke Systems. Stroke. 2005;36:690–703.
Fearon P, Langhorne P, Early Supported Discharge Trialists. Services for reducing duration of hospital care for acute stroke patients. Cochrane Database Syst Rev. 2012; doi: 10.1002/14651858.CD000443.pub3.
Kernan WN, Ovbiagele B, Black HR, Bravata DM, Chimowitz MI, Ezekowitz MD, et al. Guidelines for the prevention of stroke in patients with stroke and transient ischemic attack: a guideline for healthcare professionals from the American Heart Association/American Stroke Association. Stroke. 2014;45:2160–236.
Langhorne P, Taylor G, Murray G, Dennis M, Anderson C, Bautz-Holter E, et al. Early supported discharge services for stroke patients: a meta-analysis of individual patients' data. Lancet. 2005;365:501–6.
Teasell R, Foley N, Salter K, Bhogal S, Jutai J, Speechley M. Evidence-based review of stroke rehabilitation: executive summary, 12th edition. Top Stroke Rehabil. 2009;16:463–88.
Legg LA, Quinn TJ, Mahmood F, Weir CJ, Tierney J, Stott DJ, et al. Non-pharmacological interventions for caregivers of stroke survivors. Cochrane Database Syst Rev. 2011; doi:10.1002/14651858.CD008179.pub2.
Olson DM, Bettger JP, Alexander KP, Kendrick AS, Irvine JR, Wing L, et al. Transition of care for acute stroke and myocardial infarction patients: from hospitalization to rehabilitation, recovery, and secondary prevention. Evid Rep Technol Assess (Full Rep). 2011;202:1–197.
Cameron JI, O'Connell C, Foley N, Salter K, Booth R, Boyle R, et al. Canadian stroke best practice recommendations: managing transitions of care following stroke, guidelines update 2016. Int J Stroke. 2016;11:807–22.
Early supported discharge. In: NHS improvement - stroke. NHS Improvement Programme. 2008. http://webarchive.nationalarchives.gov.uk/20130221101407/http://www.improvement.nhs.uk/stroke/ESD/tabid/160/Default.aspx. Accessed 20 Feb 2017.
Chouliara N, Fisher RJ, Kerr M, Walker MF. Implementing evidence-based stroke early supported discharge services: a qualitative study of challenges, facilitators and impact. Clin Rehabil. 2014;28:370–7.
Bettger JP, Jones S, Kucharska-Newton A, Freburger J, Ambrosius W, Sissine M. Transitional care in stroke certified and non-certified hospitals: the COMprehensive Post-Acute Stroke Services Study. Poster presented at: International Stroke Conference; February 22–24, 2017; Houston, Texas. In press.
Condon C, Lycan S, Duncan P, Bushnell C. Reducing readmissions after stroke with a structured nurse practitioner/registered nurse transitional stroke Program. Stroke. 2016;47:1599–604.
Transitional Care Management Services. In: The Medicare learning network. Centers for Medicare & Medicaid Services. 2016. https://www.cms.gov/Outreach-and-Education/Medicare-Learning-Network-MLN/MLNProducts/Downloads/Transitional-Care-Management-Services-Fact-Sheet-ICN908628.pdf. Accessed 27 Jan 2017.
Chronic care management services. In: The Medicare learning network. Centers for Medicare & Medicaid Services. 2016. https://www.cms.gov/Outreach-and-Education/Medicare-Learning-Network-MLN/MLNProducts/Downloads/ChronicCareManagement.pdf. Accessed 27 Jan 2017.
Comprehensive primary care pPlus (CPC+) fact sheet. In: Media release database. Centers for Medicare & Medicaid Services. 2016. https://www.cms.gov/Newsroom/MediaReleaseDatabase/Fact-sheets/2016-Fact-sheets-items/2016-04-11.html. Accessed 7 Mar 2016.
MACRA. In: Value-based programs. Centers for Medicare & Medicaid Services. 2016. https://www.cms.gov/Medicare/Quality-Initiatives-Patient-Assessment-Instruments/Value-Based-Programs/MACRA-MIPS-and-APMs/MACRA-MIPS-and-APMs.html. Accessed 7 March 2016.
D'Agostino RB Sr. The delayed-start study design. N Engl J Med. 2009;361:1304–6.
Nurse Journal. Requirements to Become A Nurse Practitioner. 2017. http://nursejournal.org/nurse-practitioner/what-to-know-to-become-a-nurse-practitioner/. Accessed 05 June 2017.
American Academy of PAs. What is a PA? 2017. https://www.aapa.org/what-is-a-pa/. Accessed 05 June 2017.
Adler NE, Stead WW. Patients in context--EHR capture of social and behavioral determinants of health. N Engl J Med. 2015; doi:10.1056/NEJMp1413945.
Institute of Medicine (U.S.). Board on population health and public health practice: capturing social and behavioral domains and measures in electronic health records: phase 2. Washington, D.C.: The National Academies Press; 2014.
Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. 1999;89:1322–7.
Duncan PW, Lai SM, Bode RK, Perera S, DeRosa J. Stroke impact scale-16: a brief assessment of physical function. Neurology. 2003;60:291–6.
Duncan PW, Lai SM, Tyler D, Perera S, Reker DM, Studenski S. Evaluation of proxy responses to the stroke impact scale. Stroke. 2002;33:2593–9.
Carod-Artal FJ, Ferreira Coral L, Stieven Trizotto D, Menezes MC. Self- and proxy-report agreement on the stroke impact scale. Stroke. 2009;40:3308–14.
Onega LL. Helping those who help others: the modified caregiver strain index. Am J Nurs. 2008;108:62–9.
Craig CL, Marshall AL, Sjostrom M, Bauman AE, Booth ML, Ainsworth BE, et al. International physical activity questionnaire: 12-country reliability and validity. Med Sci Sports Exerc. 2003;35:1381–95.
Foraker RE, Rose KM, Chang PP, McNeill AM, Suchindran CM, Selvin E, et al. Socioeconomic status and the trajectory of self-rated health. Age Ageing. 2011;40:706–11.
Kroenke K, Spitzer RL, Williams JB. The patient health questionnaire-2: validity of a two-item depression screener. Med Care. 2003;41:1284–92.
Cella D, Lai JS, Jensen SE, Christodoulou C, Junghaenel DU, Reeve BB, et al. PROMIS fatigue item Bank had clinical validity across diverse chronic conditions. J Clin Epidemiol. 2016;73:128–34.
Lai JS, Stucky BD, Thissen D, Varni JW, DeWitt EM, Irwin DE, et al. Development and psychometric properties of the PROMIS pediatric fatigue item banks. Qual Life Res. 2013;22:2417–27.
Lai JS, Cella D, Choi S, Junghaenel DU, Christodoulou C, Gershon R, et al. How item banks and their application can influence measurement practice in rehabilitation medicine: a PROMIS fatigue item bank example. Arch Phys Med Rehabil. 2011;92:S20–7.
Morisky DE, Green LW, Levine DM. Concurrent and predictive validity of a self-reported measure of medication adherence. Med Care. 1986;24:67–74.
Nasreddine ZS, Phillips NA, Bedirian V, Charbonneau S, Whitehead V, Collin I, et al. The Montreal cognitive assessment, MoCA: a brief screening tool for mild cognitive impairment. J Am Geriatr Soc. 2005;53:695–9.
Thornton M, Travis SS. Analysis of the reliability of the modified caregiver strain index. J Gerontol B Psychol Sci Soc Sci. 2003;58:S127–32.
van Swieten JC, Koudstaal PJ, Visser MC, Schouten HJ, van Gijn J. Interobserver agreement for the assessment of handicap in stroke patients. Stroke. 1988;19:604–7.
Wong A, Nyenhuis D, Black SE, Law LS, Lo ES, Kwan PW, et al. Montreal cognitive assessment 5-minute protocol is a brief, valid, reliable, and feasible cognitive screen for telephone administration. Stroke. 2015;46:1059–64.
CAHPS Clinician & Group Survey and Instructions. Version 3.0. In: CAHPS: Surveys and tools to advance patient-centered care. Agency for Healthcare Research and Quality. 2015. https://www.cahps.ahrq.gov/surveys-guidance/cg/instructions/index.html. Accessed 27 Jan 2017.
Fatigue: a brief guide to the PROMIS Fatigue instruments. In: Patient Reported Outcomes Measurement Information System (PROMIS). Assessment Center. 2015. https://www.assessmentcenter.net/documents/PROMIS%20Fatigue%20Scoring%20Manual.pdf. Accessed 7 Mar 2016.
Kim SY, Miller FG. Informed consent for pragmatic trials--the integrated consent model. N Engl J Med. 2014; doi:10.1056/NEJMhle1312508.
McKinney RE Jr, Beskow LM, Ford DE, Lantos JD, McCall J, Patrick-Lake B, et al. Use of altered informed consent in pragmatic clinical research. Clin Trials. 2015; doi:10.1177/1740774515597688.
Duncan PW, Wallace D, Lai SM, Johnson D, Embretson S, Laster LJ. The stroke impact scale version 2.0. Evaluation of reliability, validity, and sensitivity to change. Stroke. 1999;30:2131–40.
Gesell SBKK, Halladay J, Bettger JP, Freburger J, Cummings DM, Lutz BJ, et al. Methods guiding stakeholder engagement in planning a pragmatic atudy on changing stroke systems of care. J Clin Transl Sci. In press
We thank the stakeholders for their work shaping the study design and intervention components of the COMPASS Study as well as the COMPASS Study participants for their important contributions. We also thank Andrea Tate Mullins, Lynette Staplefoote-Boynton, and Rica Abbott for their operational support of this trial.
Research reported in this publication was funded through a Patient-Centered Outcomes Research Institute (PCORI) Project Program Award (PCS-1403-14,532; NCT02588664). The statements presented in this publication are solely the responsibility of the authors and do not necessarily represent the views of the Patient-Centered Outcomes Research Institute (PCORI), its Board of Governors or Methodology Committee.
We would like to acknowledge the REDCap support of the Wake Forest Clinical and Translational Science Institute (WF CTSI), which is supported by the National Center for Advancing Translational Sciences (NCATS), National Institutes of Health, through Grant Award Number UL1TR001420. We would like to acknowledge the Implementation Science Pilot Award (PI: Gesell) of the Wake Forest Clinical and Translational Science Institute (WF CTSI), which is supported by the National Center for Advancing Translational Sciences (NCATS), National Institutes of Health, through Grant Award Number UL1TR001420.
Availability of data and materials
The statements presented in this publication are solely the responsibility of the authors and do not necessarily represent the views of the Patient-Centered Outcomes Research Institute (PCORI), its Board of Governors or Methodology Committee.
Ethics approval and consent to participate
This research project was reviewed and approved by the Wake Forest University Health Sciences IRB, which acts as a central IRB for 36 participating hospitals. Local IRB review and approval was granted by Cape Fear Valley Medical Center and New Hanover Regional Medical Center. Novant Health Presbyterian Healthcare IRB provided review and approval for the three participating Novant sites. The University of North Carolina at Chapel Hill IRB reviewed all data management and outcomes related activities.
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Duncan, P.W., Bushnell, C.D., Rosamond, W.D. et al. The Comprehensive Post-Acute Stroke Services (COMPASS) study: design and methods for a cluster-randomized pragmatic trial. BMC Neurol 17, 133 (2017). https://doi.org/10.1186/s12883-017-0907-1
- Transitions of care
- Functional status
- Pragmatic trial
- Patient-centered care