Skip to main content

Cumulative experience improves the procedures of mechanical thrombectomy

Abstract

Background

Mechanical thrombectomy has been widely performed for large vessel occlusion stroke. The present study aimed to determine whether cumulative experience could improve thrombectomy outcomes.

Methods

In this retrospective single-center analysis, patients who underwent mechanical thrombectomy with the Solitaire stent in 3 years from 25 April 2015 were enrolled in the current study. Patients’ characteristics, durations of admission and treatment, recanalization rates, clinical outcomes, and hemorrhage transformation rates were compared among the 3 years. Logistic analysis was used to analyze the independent correlation of the years and procedural outcomes.

Results

A total of 222 patients underwent mechanical thrombectomy in the 3 years: 50 in the first year, 68 in the second year, and 104 in the third year. Door-to-puncture time (P < 0.001) and puncture-to-recanalization time (P = 0.033) decreased significantly among the 3 years, while successful recanalization rates increased (P = 0.001). Logistic regression analysis showed an independent increase in the successful recanalization rates in the second year and third year (P = 0.020, P = 0.001) as compared to that in the first year.

Conclusions

Cumulative experience might improve the procedures of mechanical thrombectomy. The current findings suggested a potential benefit for centralization in the treatment of large vessel occlusion stroke.

Peer Review reports

Background

Since the landmark trials were sequentially published from 2015, mechanical thrombectomy has become the key treatment for acute large vessel occlusion stroke [1, 2]. Previous studies established a correlation between site volume and thrombectomy outcomes. A retrospective analysis on a national database found less mortality rates after thrombectomy in patients transferred to the high-volume hospitals than the low-volume [3]. A multicenter registry of stent-retriever thrombectomy also found that short duration of the procedure and improved outcome were seen in high volume sites [4]. These findings implied an intuitive impact of operators’ and centers’ experience on the effect and safety of mechanical thrombectomy [5]. Based on this evidence, a recent multi-society consensus requires a minimum of 50 procedures annually for centers that perform thrombectomy [6]. Accumulating evidence from randomized trials and recommended guidelines showed an increasing trend of thrombectomy procedures performed worldwide [7]. However, the influence of cumulative practice, especially beyond the recommended minimum annual procedures, on the effect of thrombectomy is not yet clarified. Although a learning curve was widely accepted, the steep or smooth trend is controversial [8, 9]. Thus, we employed a retrospective analysis based on the prospectively collected stroke registry of the Nanjing First Hospital. The first procedure of mechanical thrombectomy was performed in 2015 following the updated guidelines on endovascular treatment [1]. The group consisted of three senior neuroradiologists with prior experience of interventional procedures, such as carotid artery stenting and intra-artery thrombolysis but not mechanical thrombectomy. Herein, we investigated the thrombectomy procedures of three consecutive years from the first case and explored whether there is a continuous improvement trend.

Methods

The first procedure was undertaken on April 25, 2015 and the 3 years lasted up to April 24, 2018. All patients who underwent mechanical thrombectomy with the Solitaire stent for large vessel occlusion stroke in these 3 years were enrolled from our single-center stroke registry. Patients were categorized into three consecutive annual groups according to the procedure date: the first-year group (April 25, 2015 to April 24, 2016), the second-year group (April 25, 2016 to April 24, 2017), and the third-year group (April 25, 2017 to April 24, 2018). Baseline characteristics including medical history, laboratory test results, stroke severity and diagnosis, details of procedure such as recanalization status, and clinical outcomes were collected. The admission stroke severity was accessed using the National Institute of Health Stroke Scale (NIHSS) score. The recanalization status was measured by the modified thrombolysis in cerebral infarction (mTICI) scale and successful recanalization was defined as a score of 2b or 3 [10]. There is a new metric for thrombectomy devices named the first pass effect (FPE). It means achieving complete revascularization of the large vessel occlusion and its downstream territory in single pass or use of the device without rescue therapy [11]. The time points of stroke onset, admission to hospital (door), groin puncture, and first recanalization (or end of the procedure for patients failed to acquire successful recanalization) were recorded. A good outcome was defined as a modified Rankin scale (mRS) score 0–2 at 90 days after the stroke onset. Repeated head CT was performed within 24 h to ascertain the intracranial hemorrhage (ICH) transformation. Symptomatic intracranial hemorrhage (sICH) was diagnosed according to the European Cooperative Acute Stroke Study III criteria [12]. All procedures and medical care were carried out in accordance with current guidelines and regulations [1]. Informed consents were obtained from the participants entering the stroke registry, and this analysis was approved by the Ethics Committee of Nanjing First Hospital.

Statistical analysis

The baseline characteristics, procedure details, and clinical outcomes were compared between the three annual groups. Continuous data were presented as mean ± standard deviation or median (interquartile range) and categorical data as number (percentage). Metric and ordinal variables were analyzed by one-way ANOVA and Kruskal–Wallis test, respectively, while frequencies were compared using the chi-square test based on the linear-by-linear association. Next, we performed a logistic regression analysis to study the potential independent differences of successful recanalization, good outcome, sICH, and mortality over the 3 years. The first-year group was analyzed as a reference. Age, sex, and variables with P < 0.1 in univariate analysis were adjusted in multivariate models. The NIHSS score and puncture-to-recanalization time indicated successful recanalization; atrial fibrillation, creatinine, glucose, NIHSS score, stroke subtypes, puncture-to-recanalization time, additional interventions, and recanalization status were for good outcome; platelet counts, NIHSS score, onset-to-recanalization time, and recanalization status for sICH; creatinine, glucose, baseline systolic blood pressure, NIHSS score, infarct circulation, stroke subtypes, onset-to-recanalization time, number of device passes, and recanalization status indicated mortality. Statistical analyses were performed using Statistical Package for the Social Sciences (SPSS) version 20.0 (SPSS Inc., Chicago, IL, USA), and P < 0.05 indicated statistical significance.

Results

A total of 222 patients were included in the present study; of these, 50 patients received endovascular treatment in the first year, 68 in the second year, and 104 in the third year. The average age of the cohort was 70.9 ± 11.9 years, and 64.9% was male. The median NIHSS score was 14. Of these patients, 81.1% had anterior, while 18.9% had posterior circulation infarction. The baseline characteristics of the patients are listed in Table 1. The discrepancies were detected among groups with respect to the history of stroke (8% vs. 19.1% vs. 24.0%, P = 0.021), serum creatinine [77 (64–102) vs. 77 (63–96) vs. 69 (58–85) μmol/L, P = 0.036], onset-to-door time [91 (38–180) vs. 145 (65–206) vs. 149 (77–283) min, P = 0.009], recruited beyond 6 h (2% vs. 2.9% vs. 7.3%, P = 0.001) and prior intravenous thrombolysis (56.0% vs. 64.7% vs. 40.4%, P = 0.021), while other variables were similar between different years.

Table 1 Baseline characteristics of patients in the three years

Details of endovascular treatment procedures are shown in Table 2. A significant decrease was observed in the door-to-puncture time [152 (123–189) vs. 119 (85–149), P < 0.001] and door-to-recanalization time [240 (185–280) vs. 194 (165–227), P < 0.001] from the first year to the second year. Compared to the patients of the first year, those of the second acquired successful recanalization (62.0% vs. 86.8%, P = 0.002). Furthermore, an increasing trend of good outcomes (mRS 0–2: 34.0% vs. 36.8% vs. 41.3%, P = 0.357) and a descending trend in intracranial hemorrhage (50.0% vs. 44.8% vs. 35.0%, P = 0.062), sICH (12.0% vs. 9.0% vs. 5.8%, P = 0.183), and mortality (24.0% vs. 17.6% vs. 18.3%, P = 0.462) was observed from the first to the third year. Logistic regression analysis showed that successful recanalization rates independently increased in the second year (OR: 3.19, 95% CI: 1.21–8.34, P = 0.020) and third year (OR: 4.62, 95% CI: 1.88–11.35, P = 0.001) as compared to the first year (Table 3 and Fig. 1).

Table 2 Characteristics of thrombectomy procedures and outcomes in the three years
Table 3 Logistic analysis of successful recanalization and clinical outcomes
Fig. 1
figure 1

Adjusted odds ratios (midpoints) and 95% confidence intervals (error bars) derived from Logistic analysis for successful recanalization and clinical outcomes after mechanical thrombectomy categorized by years. Single asterisk (*) above the error bars represents the statistical significance (P < 0.05) between the annual group with the first-year group as reference. mRS indicates modified Rankin scale; and sICH, symptomatic intracranial hemorrhage

Discussion

In this study, significant improvements were detected in the procedural delays and successful recanalization rates with accumulating experience. We also found an increasing trend of good outcomes and a decreasing trend of any intracranial hemorrhage and sICH post-procedures, albeit without statistical significance. After balanced for stroke severity and procedure duration, 3.19- and 4.62-fold of recanalization rates were acquired in the second and third year as compared to the first year.

Several randomized controlled trials have verified the benefits of thrombectomy. Although in our research, the onset to recanalization time was distinctly longer than that in ESCAPE trial [241 (176–359)], which may be related to the latter recruited more patients (72.7%) in the time window for intravenous thrombolysis, the recanalization rate (72.4%) was inferior to ours [13]. In DEFUSE 3 trial, puncture to reperfusion time [38(26–59)] was obviously less than ours and recanalization rate (76%) was slightly lower [14]. Even though revascularization rate in our center was superior to some trials, procedure time still could be shortened which need operators to be more proficient in the skill.

A minimum volume was set for certification of thrombectomy-capable stroke centers as practice makes the procedure perfect [15]. However, the major issue remained what was a reasonable number [16]. An early retrospective survey studied 442 patients treated with endovascular therapy. A shorter admission delay, higher reperfusion rates, and better clinical outcomes were observed at high-volume centers (≥50 procedures annually) than low-volume centers (< 50 procedures annually) [17]. In a national database study, the threshold of high-volume centers was ≥35.2 procedures per year, and the results demonstrated significantly reduced mortality in patients transferred to high-volume centers than directly admitted to the low-volume centers [3]. In the current study, angiographic outcomes improved annually continuously; also, the volume was beyond the criterion of high-volume in the above studies. The current results indicated that cumulative center experience might lead to better outcomes and supported the centralization of mechanical thrombectomy for large vessel occlusion stroke [3, 18].

Only a few studies referred to the cumulative experience on thrombectomy, and hence, the discrepancy was observed. Eesa et al. found that with experience accumulating, CT to recanalization time dramatically reduced owe to the improvement in the time from first stent deployment to recanalization. It implied that the learning curve exists in the efficient use of the Solitaire stent [19]. Weyland et al. affirmed that interventionalist’s experience tremendously affected procedure time and marked difference occurred in all outcome variables between the first 25 cases and the 26th to 50th cases [20]. In our study, we also could see considerable decrease in puncture-to-recanalization time between the first year and the last 2 years, which could be attributed to the operators gradually mastered the device. Sheth et al. analyzed the data of patients in the initial roll-in period and subsequent randomized phases of the Solitaire With the Intention For Thrombectomy (SWIFT) trial; the operators had no prior experience of using these devices. The results of the reperfusion rate (55% vs. 61%), adverse event (13% vs. 9%), and good neurological outcome (63% vs. 58%) were similar between the two periods, thereby suggesting a rapid learning curve for Solitaire stent retriever therapy [8]. The absence of a continuous improvement in thrombectomy might be possibly due to the limited number of procedures. There were only 31 and 58 patients in the first and second periods, respectively, and 50 procedures had been completed in the first year in this study, implying that a minimum volume might be warranted for a cumulative improvement effect. Furthermore, all participating centers in the SWIFT study were required to be familiar with early retriever devices, and our center did not have any prior experience of mechanical thrombectomy, which might also contribute to the difference in the results. The current findings were similar to those of another multicenter study by Kim et al. [9] consisting of 955 patients classified into 5 groups based on the consecutive number at each hospital. The results showed that the cumulative case volume group was positively correlated to the recanalization rate and good outcome and negatively correlated with sICH and mortality. However, patients were enrolled from different hospitals, i.e., from almost every center in the first group, while patients in the last group were only collected from high-volume hospitals. This significant correlation might be partially attributed to the different performances of high-volume and low-volume hospitals but not cumulative experience. In the current study, all procedures were performed by the fixed operators in a single-center, and the differences might be due to the diverse experience accumulation.

Nevertheless, the present study had some limitations. First, as a retrospective analysis of a single-center, selection bias is inevitable, and hence, our findings should be modestly referred by the other centers. Second, Just as Weyland et al. illustrated that interventionalist’s performance improved with operation volume increasing. Different operators’ experience could influence surgery duration and successful recanalization rates. But we could not separate the three interventionalists because our stroke register database lacked specific operator records and most procedures were performed by the three interventionalists together. Third, patients in the last 2 years with a prior stroke had a prolonged duration from onset to admission than the first year in the current study, implying putative differences in the selection of patients and treatment decision-making during the phase. In recent years, advanced imaging including perfusion has been widely used before endovascular treatment [21], especially after the publishment of the DAWN and DEFUSE3 trial results, thus we can see significant difference in the rate of patients recruited beyond 6 h in three groups. These improvements or differences in selection for treatment might also confound the association of experience and effect, which should be taken into consideration while comparing thrombectomy outcomes during different years or between high-volume and low-volume centers. Fourth, the median baseline NIHSS score (14 for the whole 3 years and 15 on the 3rd year) was modestly lower than that in the previous clinical trials, which was 17 in the meta-analysis [22]. Some extremely severe patients might be excluded from thrombectomy in our center, which might influence our results. Nevertheless, the severity of stroke in our study was comparable to that of a national registry [23]; thus, could reflect the real characteristics of patients in clinical practice.

Conclusions

We found that cumulative experience could increase the rate of successful recanalization by years, which in turn, would improve the prognosis in the future studies carried out in multiple centers using a large sample size. The current findings endorsed a clinical benefit of centralization strategies of mechanical thrombectomy.

Availability of data and materials

The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.

Abbreviations

NIHSS:

National Institute of Health Stroke Scale

mTICI:

Modified thrombolysis in cerebral infarction

mRS:

Modified Rankin scale

sICH:

Symptomatic intracranial hemorrhage

SPSS:

Statistical Package for the Social Sciences

SWIFT:

Solitaire With the Intention For Thrombectomy

References

  1. Powers WJ, Derdeyn CP, Biller J, et al. American Heart Association/American Stroke Association Focused Update of the 2013 Guidelines for the Early Management of Patients With Acute Ischemic Stroke Regarding Endovascular Treatment: A Guideline for Healthcare Professionals From the American Heart Association/American Stroke Association. Stroke. 2015;46(10):3020–35.

    Article  CAS  Google Scholar 

  2. Powers WJ, Rabinstein AA, Ackerson T, et al. Guidelines for the Early Management of Patients With Acute Ischemic Stroke: A Guideline for Healthcare Professionals From the American Heart Association/American Stroke Association. Stroke. 2018;49(3):e46–e110.

    Article  Google Scholar 

  3. Rinaldo L, Brinjikji W, Rabinstein AA. Transfer to High-Volume Centers Associated With Reduced Mortality After Endovascular Treatment of Acute Stroke. Stroke. 2017;48(5):1316–21.

    Article  Google Scholar 

  4. Nogueira RG, Haussen DC, Castonguay A, et al. Site Experience and Outcomes in the Trevo Acute Ischemic Stroke (TRACK) Multicenter Registry. Stroke. 2019;50:2455–60.

    Article  Google Scholar 

  5. El Nawar R, Lapergue B, Piotin M, et al. Higher Annual Operator Volume Is Associated With Better Reperfusion Rates in Stroke Patients Treated by Mechanical Thrombectomy: The ETIS Registry. JACC Cardiovasc Interv. 2019;12(4):385–91.

    Article  Google Scholar 

  6. Pierot L, Jayaraman MV, Szikora I, et al. Standards of practice in acute ischemic stroke intervention: international recommendations. J Neurointerv Surg. 2018;10(11):1121–6.

    Article  Google Scholar 

  7. Saber H, Navi BB, Grotta JC, et al. Real-World Treatment Trends in Endovascular Stroke Therapy. Stroke. 2019;50(3):683–9.

    Article  Google Scholar 

  8. Sheth SA, Jahan R, Levy EI, et al. Rapid learning curve for Solitaire FR stent retriever therapy: evidence from roll-in and randomised patients in the SWIFT trial. J Neurointerv Surg. 2016;8(4):347–52.

    Article  Google Scholar 

  9. Kim BM, Baek JH, Heo JH, et al. Effect of Cumulative Case Volume on Procedural and Clinical Outcomes in Endovascular Thrombectomy. Stroke. 2019;50(5):1178–83.

    Article  Google Scholar 

  10. Zaidat OO, Yoo AJ, Khatri P, et al. Recommendations on angiographic revascularization grading standards for acute ischemic stroke: a consensus statement. Stroke. 2013;44(9):2650–63.

    Article  Google Scholar 

  11. Zaidat OO, Castonguay AC, Linfante I, et al. First Pass Effect: A New Measure for Stroke Thrombectomy Devices. Stroke. 2018;49(3):660–6.

    Article  Google Scholar 

  12. Hacke W, Kaste M, Bluhmki E, et al. Thrombolysis with alteplase 3 to 4.5 hours after acute ischemic stroke. N Engl J Med. 2008;359(13):1317–29.

    Article  CAS  Google Scholar 

  13. Goyal M, Demchuk A, Menon B, et al. Randomized assessment of rapid endovascular treatment of ischemic stroke. N Engl J Med. 2015;372(11):1019–30.

    Article  CAS  Google Scholar 

  14. Albers G, Marks M, Kemp S, et al. Thrombectomy for Stroke at 6 to 16 Hours with Selection by Perfusion Imaging. N Engl J Med. 2018;378(8):708–18.

    Article  Google Scholar 

  15. Linfante I, Nogueira RG, Zaidat OO, et al. A joint statement from the Neurointerventional Societies: our position on operator experience and training for stroke thrombectomy. J Neurointerv Surg. 2019;11(6):533–4.

    Article  Google Scholar 

  16. Fargen KM, Fiorella DJ, Mocco J. Practice makes perfect: establishing reasonable minimum thrombectomy volume requirements for stroke centers. J Neurointerv Surg. 2017;9(8):717–9.

    Article  Google Scholar 

  17. Gupta R, Horev A, Nguyen T, et al. Higher volume endovascular stroke centers have faster times to treatment, higher reperfusion rates and higher rates of good clinical outcomes. J Neurointerv Surg. 2013;5(4):294–7.

    Article  Google Scholar 

  18. Adamczyk P, Attenello F, Wen G, et al. Mechanical thrombectomy in acute stroke: utilization variances and impact of procedural volume on inpatient mortality. J Stroke Cerebrovasc Dis. 2013;22(8):1263–9.

    Article  Google Scholar 

  19. Eesa M, Burns P, Almekhlafi M, et al. Mechanical thrombectomy with the Solitaire stent: is there a learning curve in achieving rapid recanalization times? J Neurointerv Surg. 2014;6(9):649–51.

    Article  CAS  Google Scholar 

  20. Weyland C, Hemmerich F, Möhlenbruch M, et al. Radiation exposure and fluoroscopy time in mechanical thrombectomy of anterior circulation ischemic stroke depending on the interventionalist's experience-a retrospective single center experience. Eur Radiol. 2020;30(3):1564–70.

    Article  Google Scholar 

  21. Derdeyn C. The Powerful Benefit of Endovascular Thrombectomy for Acute Ischemic Stroke: Driving Major Changes in Stroke Systems of Care and Imaging Triage. Radiology. 2018;288(2):527–8.

    Article  Google Scholar 

  22. Goyal M, Menon BK, van Zwam WH, et al. Endovascular thrombectomy after large-vessel ischaemic stroke: a meta-analysis of individual patient data from five randomised trials. Lancet (London, England). 2016;387(10029):1723–31.

    Article  Google Scholar 

  23. Alegiani AC, Dorn F, Herzberg M, et al. Systematic evaluation of stroke thrombectomy in clinical practice: The German Stroke Registry Endovascular Treatment. Int J Stroke. 2019;14(4):372–80.

    Article  Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

Nanjing Commission of Health and Family Planning, China (grant number ZDX16002) funded this study.

Author information

Authors and Affiliations

Authors

Contributions

Conception and design: L. C, L. Y, Z. J and Z.W; Analysis and interpretation: L. C, L. Y, L. Z, G. P, X. Z, Z.J, Z.W; Drafting the manuscript: L. C, L. Y, Z. J, Z.W; Statistics: L. Y and G. P. The author(s) read and approved the final manuscript.

Corresponding authors

Correspondence to Junshan Zhou or Weidong Zhang.

Ethics declarations

Ethics approval and consent to participate

Informed consents were obtained from the participants entering the stroke registry, and this analysis was approved by the Ethics Committee of Nanjing First Hospital.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Liu, C., Liu, Y., Li, Z. et al. Cumulative experience improves the procedures of mechanical thrombectomy. BMC Neurol 22, 37 (2022). https://doi.org/10.1186/s12883-022-02562-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12883-022-02562-z

Keywords

  • Experience
  • Mechanical thrombectomy
  • Large vessel occlusion stroke
  • Recanalization
  • Annual