Develop, Implement and Assess Effectiveness of Early Warning Score (EWS) for Moneragala District General Hospital
Study Details
Study Description
Brief Summary
Rationale: Early detection and timely interventions are important determinants of clinical outcome in people with acute illness. Adverse outcomes including unplanned transfer to intensive care (ICU), cardiac arrest and death are usually preceded by acute physiological changes manifesting as alterations in vital signs. Usage of early warning scores (EWS) based on bedside vital sign observations may help early detection, improve outcome of patients and reduce healthcare cost.
EWS which are effective in predicting deteriorating patients developed in high income countries have been shown to lose sensitivity and specificity when applied to a low income setting. It is imperative to explore the usefulness of EWSs in Sri Lanka. If the results are positive, widespread adaptation of these scores can significantly contribute to improved patient outcome, better utilization of ICU services and cost effective healthcare provision.
Objectives: To describe the demographic characteristics of cardiac arrest patients and the availability of physiological variables for calculation various EWSs in DGH, Moneragala To validate an early warning score suitable for patients at DGH, Moneragala To examine the effectiveness of the selected EWS at improving pre-defined patient outcomes
Proposed methodology:
Study I: All clinical variables and patient characteristics of past two years collected retrospectively from BHTs. Vital signs and laboratory measurements 24 and 48 hours before cardio respiratory emergency and at admission to hospital will be extracted. The availability of variables required for the calculation of various EWSs will be noted.
Study II: All consecutive inpatient admissions for three months to all units except intensive care unit at DGH, Moneragala will be included to the study, prospectively. Data will be collected from bed head tickets using pre-defined data sheets by nominated medical/ nursing officers daily. Demographic details and physiological data will be recorded on admission to ward. Physiological data for seven EWS will be collected twice daily by these medical/nursing officers.
Study III: Training will be given for the staff to identify patients getting worse using the newly validated EWS. The outcome of this will be measured with information obtained from Study II.
Ethical clearance obtained from the Ethics review Committee of the Faculty of Medicine, University of Colombo (EC-15-034).
| Condition or Disease | Intervention/Treatment | Phase |
|---|---|---|
|
N/A |
Detailed Description
Introduction: Early detection and timely interventions are important determinants of clinical outcome in people with acute illness. Adverse outcomes including unplanned transfer to intensive care (ICU), cardiac arrest and death are usually preceded by acute physiological changes manifesting as alterations in vital signs. Usage of early warning scores (EWS) based on bedside vital sign observations may help early detection, improve outcome of patients and reduce healthcare cost.
Effectiveness of EWS in predicting deterioration of seriously ill patients has been demonstrated in high income countries (HICs). However, these scores developed in HICs have been shown to lose sensitivity and specificity when applied to a low income setting. It is imperative to explore the usefulness of EWSs in Sri Lanka. If the results are positive, widespread adaptation of these scores can significantly contribute to improved patient outcome, better utilization of ICU services and cost effective healthcare provision.
The study will take place in district general hospital (DGH) Moneragala, in Sri Lanka, a lower middle income country (LMIC). The hospital has nearly 450 beds and over 800 staff members serving over 50000 patients per year and approximately 500 cardiac arrests per year. It has four medical wards, two surgical wards and 5 other wards. A wedge shaped interventional study was designed to investigate whether a "setting tested" early warning system protocol can be implemented in a rural district general hospital of a LMIC using a local TTT model to reduce cardiac arrests and admissions to ICU.
Objectives
-
To describe the characteristics, including EWS, of patients resuscitated at DGH, Moneragala.
-
To validate a suitable EWSs at DGH, Moneragala.
-
To examine the effectiveness of the validated EWS as part of a training and implementation bundle to reduce the incidence of cardiac arrests, ICU admissions and mortality.
Methodology Study component 1- Retrospective study All clinical variables and patient characteristics of past two years (01.04.2013-30.06.2015) collected retrospectively from BHTs of all cardiac arrests (approximately 200) of DGH Moneragala. Vital signs and laboratory measurements 24 and 48 hours before cardio respiratory emergency and at admission to hospital will be extracted. The availability of variables required for the calculation of various EWSs will be noted.
Data collection tool: Pre-defined data sheets. Study process: All clinical variables and patient characteristics will be collected retrospectively from BHTs. Vital signs and laboratory measurements 24 and 48 hours before cardio respiratory emergency and at admission to hospital will be extracted. The availability of variables required for the calculation of various EWSs will be noted.
Statistical analysis: Descriptive statistics will be used to describe the characteristics of the resuscitated patients. Mean and standard deviation will be used for normally distributed continuous variables while median and inter quartile ranges will be used for skewed distributions of continuous variables. Count and percentages will be used for discrete variables. The availability of physiological variables will also be illustrated using counts and percentages.
Study component 2- The component two of the study is aimed at selecting and validating an EWS that is capable of predicting cardiac arrest with high sensitivity and specificity A prospective cohort design, conducted at all units of DGH, Moneragala (except ICU) on all consecutive in-patient admissions for a period of 3 months.
Sample size: This phase will be used to determine the ability of EWSs to predict patient outcome with regards to cardiac arrest, ICU admission and death. Assuming that the best performing EWS will achieve an area under the ROC (AUROC) curve of .80 and an alpha of 0.05 with 80% power, comparison of an EWS that performs "worse" (AUROC curve = 0.80) will require 28 cardiac arrest patients. With a cardiac arrest rate of approximately 1% (cardiac arrests/total admissions), and 56,000 admissions per year. this means that each EWS should be performed on 2800 patients. Under the same assumptions, comparison of an EWS with an AUROC curve = 0.70 will require n=108 patients with cardiac arrest; thus, 10,800 patients should be tested with each EWS. With 56000 admissions per year 3 months of phase 2 will be adequate for this.
Data collection tools: Data will be collected from bed head tickets using pre-defined data sheets. Demographic details and physiological data will be recorded on admission to ward. Physiological data will be collected twice daily by these medical/nursing officers.
National Early Warning Score (NEWS), Modified Early Warning Score (MEWS), Standardized Early Warning Score (SEWS), Patient At Risk Score (PARS), Leeds Early Warning Score (LEWS), The Assessment Score for Sick patient Identification and Step-up in Treatment (ASSIST), Cardiac Arrest Risk Triage (CART) and VitalpacTMEarly Warning Score (ViEWS) will be tested in this phase to select the best performing one, as described below.
Statistical analysis: Data will be analyzed using STATA 13. Selection of the EWS will be based on the discrimination (using area under the receiver operating characteristic curve), calibration (using the Hosmer-Lemeshow Ĉ-statistic) and accuracy (using Brier score).
Study component 3- The purpose of this component is to examine the effectiveness of the selected EWS at improving pre-defined patient outcomes.
This is an experimental step wedge design. Study setting and population: Same as study two Study period: Twelve months Sample size: Currently, early detection of deterioration by means of EWS prior to cardiac arrest is 0%. The current cardiac arrest team only attends to patients when a cardiac arrest is detected. It was anticipate that, with the EWS identified in Part 2 of the study, the early detection of cardiac arrests will increase to 50-75%. To detect a difference of 50% in one ward, with 90% power and an alpha of 0.05, would require a sample size of 15 cardiac arrest patients. The estimated cardiac arrest rate at this study site is <1%. Assuming a cardiac arrest rate of approximately 1%, the selected EWS as part of EWS should be performed on 1,500 patients.
This means the study will be powered to detect this in at least 7 of the 12 wards when investigators implement the EWS over the 12 months it takes to recruit all wards. However addition data collection for three months will enable (power) to detect this in almost all the wards.
Data collection tools and study variables Patient data collected from bed head tickets using pre-defined data sheets. Interviewer administered questionnaires will be used to assess the success of the training for nurses and doctors. Successfulness of course delivery in each section will be measured separately. Data sheets will be used to monitor the implementation of the intervention and outcome measures.
Study variables include the same variables as in study 2. The indicators to monitor the implementation of the intervention will also be gathered. Success of implementation will be evaluated using process and outcome measures. These will include indicators to monitor the implementation of the intervention (completeness of observations, use of EWS, appropriate escalation by the nursing team) and outcome indicators (patients suffering cardiac arrests, detected and missed by EWS, ICU admissions and in-hospital mortality). Data will also be collected to monitor the success of the training programme (retention of knowledge).
Intervention and study process Introduce EWS: An EWS that is appropriate for use in the study setting will be adapted and all participants will be educated on this.
Training of staff: The participating Doctors and Nurses from each ward will be trained on early detection and management of clinically deteriorating patients based on the EWS selected. The training will be implemented in a stepped wedge method with a new ward absorbed in to the program monthly.
As each ward has the EWS introduced, an acute care training (ACT) course will be delivered to its staff. The ACT course will comprise of preparation using dedicated e-learning platform (http://nics-training.com/?page_id=403) followed by a 2-day structured, multi-modal training package focused on acute care skills for ward nurses and doctors, comprising short lectures, problem based learning and practical skills stations The ACT course will be delivered to small groups, fortnightly by a faculty of local trainers (Doctors, nurse tutors and nursing officers) who have received a five day preparatory train the trainer(TTT) course led by experienced doctor and nurse trainers (part of investigators' study team) modeled on previous efforts. As in phase 2, process and outcome data, will be collected by trained data collectors.
Follow up: Formative and summative training assessments will be conducted on training participants to measure the effectiveness of the programs, before and after training. Coaching, support and feedback will be provided to the faculty every two months to ensure maintenance of quality. Any issues faced by the staff during implementation will be identified and appropriate remedial action will be taken.
The end points will be proportion of patients detected (and missed) by the system and the number of unexpected cardiac arrests and ICU admissions.
Comparison of outcomes: The "at risk" population will be calculated as a proportion of those who have actual cardiac arrests, and tested whether this will be at least 50% or 75% whereas the value is now 0% (there is no systematic detection of at-risk patients currently, with cardiac arrest team attending only after a declared cardiac arrest. This will be done for each ward separately as well as to the group as whole. Matched group outcomes for ICU admission rates, mortality and cardiac arrests will be compared. These will be assessed for each ward and for the whole group before and after the EWS/RRS implementation. Wilcoxon signed-rank test and McNemar test will be used to compare non parametric continuous and discrete variables of matched group outcomes measured, respectively
Pre and post training: The impact of the training on the knowledge, skills and confidence of the staff in the management of the deteriorating patient before and after the training will be assessed, as above (appendix C, D and E).
Knowledge retention: Knowledge retention will be measured 3 months and 6 months after the training.
Statistical analysis: Prevalence of unanticipated ICU admissions, cardiac arrests and hospital mortality will be calculated for the hospital overall, as well as by ward (using the total number of admissions as the denominator), before and after implementation of the EWS selected from component 2 of the study. The effectiveness of the EWS system will be assessed by comparison of the proportion of cardiac arrest cases that are identified early before and after use of the EWS. Risk ratios with 95% confidence intervals will be calculated with shared frailty specified for a ward to account for any within ward clustering. The formative and summative assessments will be used to compare, in a paired manner, the effect of the training program on ward staff. The outcome analysis and statistical tests used to compare outcomes before and after implementing the EWS is described in section 3.5 comparison of outcomes
Ethical clearance obtained from the Ethics review Committee of the Faculty of Medicine, University of Colombo (EC-15-034).
Study Design
Arms and Interventions
| Arm | Intervention/Treatment |
|---|---|
| Experimental: Introduce EWS and Training on EWS The group of patients who admitted to a ward where the staff has trained on EWS and EWS has been introduced. |
Behavioral: Training
The staff will be trained on early detection and management of clinically deteriorating patients based on the EWS selected.
Behavioral: Introduce EWS
An EWS that is appropriate for use in the study setting will be selected during the second components of the study. This EWS will then be adapted for this component.
|
| No Intervention: EWS not introduced The group of patients who admitted to a ward where the staff has no special training on EWS and EWS has not been introduced. |
Outcome Measures
Primary Outcome Measures
- Proportion of in-hospital cardiac arrests [Twelve months]
Reduction of proportion of in-hospital cardiac arrests among admitted patients
Secondary Outcome Measures
- Proportion of in-hospital deaths following cardiac arrests [Twelve months]
Reduction of the proportion of in-hospital deaths following cardiac arrests
- Proportion of ICU admissions following cardiac arrests [Twelve months]
Reduction of the proportion of ICU admissions due to cardiac arrests
Eligibility Criteria
Criteria
Inclusion Criteria:
-
Patients who underwent CPR.
-
Attendance of cardiac arrest team at this emergency. (When a cardiac arrest occurs in this hospital a cardiac arrest team attends)
-
Age more than 18 years.
Exclusion Criteria:
-
Patients who were under Do Not Resuscitate (DNR) instructions.
-
Patients admitted to ICU.
Contacts and Locations
Locations
| Site | City | State | Country | Postal Code | |
|---|---|---|---|---|---|
| 1 | DGH, Moneragala | Moneragala | Uva | Sri Lanka |
Sponsors and Collaborators
- Ministry of Health, Sri Lanka
- National Intensive Care Surveillance
Investigators
- Study Chair: Rashan Haniffa, MBBS, FRCA, Mahidol Oxford Research Unit
Study Documents (Full-Text)
None provided.More Information
Publications
- Bleyer AJ, Vidya S, Russell GB, Jones CM, Sujata L, Daeihagh P, Hire D. Longitudinal analysis of one million vital signs in patients in an academic medical center. Resuscitation. 2011 Nov;82(11):1387-92. doi: 10.1016/j.resuscitation.2011.06.033. Epub 2011 Jul 3.
- Cattermole GN, Mak SK, Liow CH, Ho MF, Hung KY, Keung KM, Li HM, Graham CA, Rainer TH. Derivation of a prognostic score for identifying critically ill patients in an emergency department resuscitation room. Resuscitation. 2009 Sep;80(9):1000-5. doi: 10.1016/j.resuscitation.2009.06.012. Epub 2009 Jul 15.
- Cheung, T.F. & Rainer, T.H., 2004. Validation of a Modified Early Warning Score ( MEWS ) in emergency department observation ward patients.
- Churpek MM, Yuen TC, Huber MT, Park SY, Hall JB, Edelson DP. Predicting cardiac arrest on the wards: a nested case-control study. Chest. 2012 May;141(5):1170-1176. doi: 10.1378/chest.11-1301. Epub 2011 Nov 3.
- Commission., A., 1999. Critical to Success: The Place of Efficient and Effective Critical Care Services Within the Acute Hospital, london.
- Cretikos M, Chen J, Hillman K, Bellomo R, Finfer S, Flabouris A; MERIT study investigators. The objective medical emergency team activation criteria: a case-control study. Resuscitation. 2007 Apr;73(1):62-72. Epub 2007 Jan 22.
- Cuthbertson BH, Boroujerdi M, McKie L, Aucott L, Prescott G. Can physiological variables and early warning scoring systems allow early recognition of the deteriorating surgical patient? Crit Care Med. 2007 Feb;35(2):402-9.
- Cuthbertson BH, Boroujerdi M, Prescott G. The use of combined physiological parameters in the early recognition of the deteriorating acute medical patient. J R Coll Physicians Edinb. 2010 Mar;40(1):19-25. doi: 10.4997/JRCPE.2010.105. Erratum in: J R Coll Physicians Edinb. 2010 Jun;40(2):190.
- Fieselmann JF, Hendryx MS, Helms CM, Wakefield DS. Respiratory rate predicts cardiopulmonary arrest for internal medicine inpatients. J Gen Intern Med. 1993 Jul;8(7):354-60.
- Franklin C, Mathew J. Developing strategies to prevent inhospital cardiac arrest: analyzing responses of physicians and nurses in the hours before the event. Crit Care Med. 1994 Feb;22(2):244-7.
- Gardner-Thorpe J, Love N, Wrightson J, Walsh S, Keeling N. The value of Modified Early Warning Score (MEWS) in surgical in-patients: a prospective observational study. Ann R Coll Surg Engl. 2006 Oct;88(6):571-5.
- Goldhill DR, McNarry AF, Mandersloot G, McGinley A. A physiologically-based early warning score for ward patients: the association between score and outcome. Anaesthesia. 2005 Jun;60(6):547-53.
- Goldhill DR, Worthington L, Mulcahy A, Tarling M, Sumner A. The patient-at-risk team: identifying and managing seriously ill ward patients. Anaesthesia. 1999 Sep;54(9):853-60.
- Hillman K, Chen J, Cretikos M, Bellomo R, Brown D, Doig G, Finfer S, Flabouris A; MERIT study investigators. Introduction of the medical emergency team (MET) system: a cluster-randomised controlled trial. Lancet. 2005 Jun 18-24;365(9477):2091-7. Erratum in: Lancet. 2005 Oct 1;366(9492):1164.
- Ho le O, Li H, Shahidah N, Koh ZX, Sultana P, Hock Ong ME. Poor performance of the modified early warning score for predicting mortality in critically ill patients presenting to an emergency department. World J Emerg Med. 2013;4(4):273-8. doi: 10.5847/wjem.j.1920-8642.2013.04.005.
- Inflammatory, S. & Syndrome, R., 2000. Proceedings of the Intensive Care Society and Riverside Group " State of the Art " Meeting Soluble adhesion molecules and endothelin in patients with fulminant hepatic failure : evidence for endothelial activation and injury. , 84(5), pp.659-692.
- Jones M. NEWSDIG: The National Early Warning Score Development and Implementation Group. Clin Med (Lond). 2012 Dec;12(6):501-3.
- Kellett J, Woodworth S, Wang F, Huang W. Changes and their prognostic implications in the abbreviated Vitalpac™ early warning score (ViEWS) after admission to hospital of 18,853 acutely ill medical patients. Resuscitation. 2013 Jan;84(1):13-20. doi: 10.1016/j.resuscitation.2012.08.331. Epub 2012 Sep 4.
- Kyriacos U, Jelsma J, James M, Jordan S. Monitoring vital signs: development of a modified early warning scoring (MEWS) system for general wards in a developing country. PLoS One. 2014 Jan 24;9(1):e87073. doi: 10.1371/journal.pone.0087073. eCollection 2014.
- Lee JR, Choi HR. [Validation of a modified early warning score to predict ICU transfer for patients with severe sepsis or septic shock on general wards]. J Korean Acad Nurs. 2014 Apr;44(2):219-27. doi: 10.4040/jkan.2014.44.2.219. Korean.
- Physician, R.C. of, 2012. National Early Warning Score ( NEWS ). , (July).
- Priestley G, Watson W, Rashidian A, Mozley C, Russell D, Wilson J, Cope J, Hart D, Kay D, Cowley K, Pateraki J. Introducing Critical Care Outreach: a ward-randomised trial of phased introduction in a general hospital. Intensive Care Med. 2004 Jul;30(7):1398-404. Epub 2004 Apr 27.
- Prytherch DR, Smith GB, Schmidt PE, Featherstone PI. ViEWS--Towards a national early warning score for detecting adult inpatient deterioration. Resuscitation. 2010 Aug;81(8):932-7. doi: 10.1016/j.resuscitation.2010.04.014.
- Schein RM, Hazday N, Pena M, Ruben BH, Sprung CL. Clinical antecedents to in-hospital cardiopulmonary arrest. Chest. 1990 Dec;98(6):1388-92.
- Smith AF, Wood J. Can some in-hospital cardio-respiratory arrests be prevented? A prospective survey. Resuscitation. 1998 Jun;37(3):133-7.
- Subbe CP, Davies RG, Williams E, Rutherford P, Gemmell L. Effect of introducing the Modified Early Warning score on clinical outcomes, cardio-pulmonary arrests and intensive care utilisation in acute medical admissions. Anaesthesia. 2003 Aug;58(8):797-802.
- Subbe CP, Kruger M, Rutherford P, Gemmel L. Validation of a modified Early Warning Score in medical admissions. QJM. 2001 Oct;94(10):521-6.
- Subbe CP, Slater A, Menon D, Gemmell L. Validation of physiological scoring systems in the accident and emergency department. Emerg Med J. 2006 Nov;23(11):841-5.
- Yu S, Leung S, Heo M, Soto GJ, Shah RT, Gunda S, Gong MN. Comparison of risk prediction scoring systems for ward patients: a retrospective nested case-control study. Crit Care. 2014 Jun 26;18(3):R132. doi: 10.1186/cc13947.
- EWS