DYNAMIC-RW: Dynamic CDSA to Manage Sick Children in Rwanda
Study Details
Study Description
Brief Summary
This study aims to reduce morbidity and mortality among children and mitigate antimicrobial resistance using a novel clinical decision support algorithm, enhanced with point-of-care technologies to help health workers in primary health care settings in Rwanda. Furthermore, the tool provides opportunities to improve supervision and mentorship of health workers and enhance syndromic disease surveillance and outbreak detection.
| Condition or Disease | Intervention/Treatment | Phase |
|---|---|---|
|
N/A |
Detailed Description
Children are a well-recognized vulnerable population that still suffers from a high rate of acute infectious diseases and preventable deaths. This is especially true in fragile health systems of Sub-Saharan Africa, where under-five mortality is 10 times higher than in high-income countries. The management of sick children at the primary care level in these environments remains of insufficient quality as front-line clinicians lack appropriate diagnostics, supervision to improve their skills, and decision support tools. Clinically validated point-of-care (POC) diagnostic tests are often not available, and practice guidelines are quickly outdated by new evidence and changing epidemiology. When an epidemic arises, these static, generic guidelines can even become deleterious if the event is not detected on time and integrated into the recommendations.
In the absence of reliable guidance, health care workers (HCWs) tend to over-prescribe antibiotics (Hopkins et al. 2017, Fink et al. 2019). Approximately 9 out of 10 children at the primary care level in Tanzania receive an antibiotic, while only 1 in 10 needs one (D'Acremont et al. 2014). Inappropriate antibiotic use disrupts the gut flora, favoring the proliferation of pathogens and weakening a child's immune response (Benoun et al. 2016). It is also a major driver of antibiotic resistance, which is estimated to be responsible for up to 10 million deaths per year by 2050 (Holmes et al. 2016, Fink et al. 2019). Equally important to antibiotic overuse, is its underuse. Missing a child in need of antibiotic treatment or providing a child with an inappropriate type or dosage of antibiotic puts them at risk of preventable morbidity and death. The same occurs with antimalarials that are not always prescribed to the children in need: those with a positive malaria test result.
Misdiagnoses have consequences that reach beyond the patient. They increase re-attendance rates, further congesting primary health facilities and accruing economic losses not only for families but for the entire health system. Systematic errors in patient-level data accumulate, and as they are aggregated to measure population-level indicators, they have the potential to bias the statistics used to prioritize health interventions and, importantly, identify epidemics.
The WHO has identified digital health interventions and predictive tools in primary care as key accelerators in achieving the 2030 Sustainable Development Goal 3 of ensuring good health and well-being for all. New simple and cheap technologies, such as mobile devices, coupled with the advances in computing and data science, could help mitigate several of the aforementioned challenges. The proposed digital intervention is a third-generation clinical decision support algorithm (CDSA) intended to help HCWs at the primary care level manage children with acute illnesses. The first two versions of the algorithm have undergone rigorous evaluations in controlled research conditions as summarized below:
The first-generation algorithm called ALMANACH was tested in Tanzania in 2010-2011, achieving improved clinical cure (from 92% to 97%) and a decrease in antibiotic prescription (from 84% to 15%) as compared to routine care (Shao et al. 2015A). ALMANACH also led to more consistent clinical assessments without taking more time than a conventional consultation and was perceived by clinicians as "a powerful and useful" tool (Shao et al. 2015B).
The second-generation algorithm called ePOCT was trialed in Tanzania in 2014-2016. In addition to symptoms and signs, it made use of several POC tests to help detect children with severe infections requiring hospital-based treatment (oximetry and hemoglobin level) and/or children with serious bacterial infection (CRP). The use of ePOCT resulted in higher clinical cure (98%) as compared to ALMANACH (96%) and routine care (95%). The algorithm also further reduced antibiotic prescription to 11%, as compared to 30% with the use of ALMANACH and 95% in routine care (Keitel et al. 2017).
Electronic algorithms can thus be successfully implemented to improve clinical guidance and provide feedback to clinicians, as well as allow near-real-time analyses of data for M&E of health interventions, disease surveillance and outbreak detection. The goal of this study is to improve clinical diagnosis, decrease morbidity and mortality of children, and mitigate antimicrobial resistance using novel dynamic POC technologies that help front-line HCWs manage sick patients, enhanced by smart disease surveillance and outbreak detection mechanisms.
More specifically, this study seeks to:
Objective 1: Improve the integrated management of children with an acute illness through the provision of an electronic CDSA (ePOCT+) to clinicians working at primary care level;
Objective 2: Improve the accuracy of the clinical algorithm and adapt it to spatiotemporal variations in epidemiology and resources, based on the data generated through the ePOCT+ tool, analyzed using machine learning and checked by clinical experts;
Objective 3: Enhance the health management information system for monitoring and evaluation and conducting supportive supervision (increased number of meaningful indicators that are reviewed and actioned regularly) in HFs using the clinical data generated by the ePOCT+ tool and enhanced by additional data analysis and visualization dashboards;
Objective 4: Create a framework for the development and implementation of dynamic CDSA and disease surveillance tools, for large-scale, sustainable, and clinically responsible use of machine learning and data science.
The primary intervention study will be conducted in two phases.
Phase 1: open-label two-arm parallel-group cluster non-randomized controlled superiority trial implemented in a staggered/sequential manner in a total of 32 health facilities. The intervention consists of ePOCT+ clinical decision support algorithm (CDSA) displayed on tablets (medAL-reader), point-of-care tests and devices that are not part of routine care (pulse oximeter, CRP rapid test, additional hemoglobin cuvettes), complementary training on the tool, regular monitoring and mentorship/supervision visits by the study team and/or the Douncil Health Management Team (DHMT). Mentorship and supervision will be enabled by a complementary dashboard (medAL-monitor), used to visualize and monitor study-related indicators. Due to the pragmatic nature of the study, the design is adaptive, in that changes in the implementation across the three cluster studies may be made based on monitoring data and feedback from the health facilities. These implementation changes (excluding significant adaptations to algorithm content) will be thoroughly documented and accounted for in comparing the effects across the three cluster studies.
Phase 2: scale-up of the intervention to more health facilities and transformation into a dynamic algorithm The ePOCT+ tool will be extended to the health facilities serving as controls in Phase 1, as well as to additional neighboring facilities of the target area, to reach a total of up to 40 facilities in Rwanda. In Phase 2, an adaptive study design will be used to measure the same outcome indicators as in Phase 1. The medical content of the algorithm will not be fixed anymore, but rather modifiable. Each potential modification will first be evaluated by the Tanzanian clinical expert group for its clinical coherence, safety and potential benefit and then applied to the retrospective data. If these analyses confirm both a clinically relevant positive impact and estimate that there will be sufficient future cases during the study period to detect this improvement, the change in the algorithm will be tested in a randomized sub-study using the same study design as in Phase 1, except that randomization will take place at patient level rather than health facility level. If the positive impact is confirmed in the sub-study, the modification will be implemented in all relevant locations/patient sub-groups.
Additional cross-sectional mixed-methods operational research studies will take place throughout the intervention period to study the implementation context, facilitators and barriers to the scale-up of this intervention and its integration into the primary health system of Rwanda.
Study Design
Arms and Interventions
| Arm | Intervention/Treatment |
|---|---|
| Experimental: ePOCT+ Health facilities allocated to the ePOCT+ intervention arm will receive an electronic clinical decision support algorithm (ePOCT+) on a tablet that will guide them through pediatric consultations. Point-of-care tests proposed by ePOCT+ that are not part of routine care will be provided as part of the study (pulse oximeter, CRP rapid test, additional hemoglobin cuvettes, and salbutamol inhalers and spacers). Training on the use of ePOCT+ and associated clinical skills will be provided before the implementation of the study, along with mentorship visits to assist with issues related to the implementation of ePOCT+. |
Device: ePOCT+
ePOCT+ is an electronic clinical decision support algorithm
|
| No Intervention: Routine care In health facilities allocated to the control arm, pediatric consultations will be conducted in a routine manner; however, tests/test results, diagnoses, management and treatments will be recorded in an electronic case report form on a tablet. Equivalent clinical training will be provided before the start of the study. |
Outcome Measures
Primary Outcome Measures
- Percentage of children prescribed an antibiotic at initial consultation in the intervention group (ePOCT+) as compared to the control group (routine care) [by the end of the initial consultation (day 0)]
Prescription of oral or parenteral antibiotic at initial consultation, as reported by the HW.
Secondary Outcome Measures
- Percentage of children cured at day 7 in the intervention group (ePOCT+) as compared to the control group (routine care) [at day 7 (range 6-14) after enrollment]
The child is defined as being cured at day 7 if the caregiver says that the child is cured or has improved since the initial consultation. Non-referred secondary hospitalizations (if caregiver says that child was hospitalized between day 0 and day 7 but the electronic clinical data does not indicate a referral for hospitalization) will however be considered as clinical failures even if the child is already cured at day 7.
- Percentage of children with one or more unscheduled re-attendance visits at any health facility by day 7 [by day 7 (range 6-14) after enrollment]
Telephone or home visit follow-up 7 days (range 6-14 days) after enrollment of the subject. The day of enrollment of the subject is considered as day 0.
- Percentage of children with severe clinical outcome (death or non-referred secondary hospitalization) by day 7 [by day 7 (range 6-14) after enrollment]
Death and non-referred secondary hospitalization will be assessed by telephone or home visit follow-up 7 days (range 6-14 days) after enrollment of the subject. The day of enrollment of the subject is considered as day 0.
- Percentage of children referred to hospital or inpatient ward at a health centre at initial consultation [by the end of the initial consultation (day 0)]
Documented by the HW at the end of the initial consultation in the eCRF (control arm) or in ePOCT+ (intervention arm) when the subject was enrolled (day 0).
- Percentage of febrile children tested for malaria by RDT and/or microscopy at day 0 [by the end of the initial consultation (day 0)]
A febrile child is a child with a history of fever (measured or suspected fever in the past 48 hours) or a high temperature.
- Percentage of malaria positive children prescribed an antimalarial at day 0 [by the end of the initial consultation (day 0)]
Antimalarial prescription is any oral, rectal, intramuscular or intravenous antimalarial prescribed by a HCW during the initial consultation or a re-attendance visit.
- Percentage of malaria negative children prescribed an antimalarial at day 0 [by the end of the initial consultation (day 0)]
Antimalarial prescription is any oral, rectal, intramuscular or intravenous antimalarial prescribed by a HCW during the initial consultation or a re-attendance visit.
- Percentage of children untested for malaria prescribed an antimalarial at day 0 [by the end of the initial consultation (day 0)]
Antimalarial prescription is any oral, rectal, intramuscular or intravenous antimalarial prescribed by a HCW during the initial consultation or a re-attendance visit.
Other Outcome Measures
- Change in the percent of children with basic anthropometrics and clinical signs assessed over time / across three cluster studies [through study completion, thus around 1 year]
Change in the percent of children with anthropometric measurements (weight, height, MUAC) and clinical signs (respiratory rate) assessed and documented by the health worker. This outcome will be assessed month to month and compared across the three cluster studies in the intervention arm only. Dated changes in implementation will be presented for context of temporal changes in outcome.
- Change in the percent of children with antibiotic prescribed over time / across three cluster studies [through study completion, thus around 1 year]
Change in the percent of children with an antibiotic prescribed during initial consultation. This outcome will be compared between intervention and control arms month to month and across the three cluster studies. Dated changes in implementation will be presented for context of temporal changes in outcome.
Eligibility Criteria
Criteria
Inclusion Criteria:
- Presenting for an acute medical or surgical condition
Exclusion Criteria:
-
Presenting for scheduled consultation for a chronic disease (e.g. HIV, TB, NCD, malnutrition)
-
Presenting for routine preventive care (e.g. growth monitoring, vitamin supplementation, deworming, vaccination)
-
Caregiver unavailable, unable or unwilling to provide written informed consent (except for older children who can provide verbal assent with an adult witness during the consenting process)
Contacts and Locations
Locations
| Site | City | State | Country | Postal Code | |
|---|---|---|---|---|---|
| 1 | Gisakura CS | Bushekeri | Nyamasheke | Rwanda | |
| 2 | Bushenge CS | Bushenge | Nyamasheke | Rwanda | |
| 3 | Yove CS | Cyato | Nyamasheke | Rwanda | |
| 4 | Kibingo CS | Gihombo | Nyamasheke | Rwanda | |
| 5 | Nyamasheke CS | Kagano | Nyamasheke | Rwanda | |
| 6 | Kibogora CS | Kanjongo | Nyamasheke | Rwanda | |
| 7 | Ruheru CS | Kanjongo | Nyamasheke | Rwanda | |
| 8 | Cyivugiza CS | Karambi | Nyamasheke | Rwanda | |
| 9 | Karambi CS | Karambi | Nyamasheke | Rwanda | |
| 10 | Ngange CS | Karambi | Nyamasheke | Rwanda | |
| 11 | Mwezi CS | Karengera | Nyamasheke | Rwanda | |
| 12 | Gatare CS | Macuba | Nyamasheke | Rwanda | |
| 13 | Hanika CS | Macuba | Nyamasheke | Rwanda | |
| 14 | Rangiro CS | Rangiro | Nyamasheke | Rwanda | |
| 15 | Mugera CS | Shangi | Nyamasheke | Rwanda | |
| 16 | Islamic CS | Bugarama | Rusizi | Rwanda | |
| 17 | Mibilizi CS | Gashonga | Rusizi | Rwanda | |
| 18 | Giheke CS | Giheke | Rusizi | Rwanda | |
| 19 | Mashesha CS | Gitambi | Rusizi | Rwanda | |
| 20 | Gihundwe CS | Kamembe | Rusizi | Rwanda | |
| 21 | Mont Cyangugu CS | Kamembe | Rusizi | Rwanda | |
| 22 | Rusizi CS | Mururu | Rusizi | Rwanda | |
| 23 | Nkungu CS | Nkungu | Rusizi | Rwanda | |
| 24 | Nyakabuye CS | Nyakabuye | Rusizi | Rwanda | |
| 25 | Nyakarenzo CS | Nyakarenzo | Rusizi | Rwanda | |
| 26 | Rwinzuki CS | Nzahaha | Rusizi | Rwanda | |
| 27 | Mushaka CS | Rwimbogo | Rusizi | Rwanda | |
| 28 | Kamonyi CS | Nyamasheke | Rwanda | ||
| 29 | Karengera CS | Nyamasheke | Rwanda | ||
| 30 | Mukoma CS | Nyamasheke | Rwanda | ||
| 31 | Muyange CS | Nyamasheke | Rwanda | ||
| 32 | Nkanka CS | Rusizi | Rwanda |
Sponsors and Collaborators
- Center for Primary Care and Public Health (Unisante), University of Lausanne, Switzerland
- Swiss Tropical & Public Health Institute
- Ecole Polytechnique Fédérale de Lausanne
- Rwanda Biomedical Centre
Investigators
- Principal Investigator: Valerie D'Acremont, PhD, Centre for Primary Care and Public Health
Study Documents (Full-Text)
More Information
Additional Information:
Publications
- Benoun JM, Labuda JC, McSorley SJ. Collateral Damage: Detrimental Effect of Antibiotics on the Development of Protective Immune Memory. mBio. 2016 Dec 20;7(6). pii: e01520-16. doi: 10.1128/mBio.01520-16. Review.
- D'Acremont V, Kilowoko M, Kyungu E, Philipina S, Sangu W, Kahama-Maro J, Lengeler C, Cherpillod P, Kaiser L, Genton B. Beyond malaria--causes of fever in outpatient Tanzanian children. N Engl J Med. 2014 Feb 27;370(9):809-17. doi: 10.1056/NEJMoa1214482.
- Fink G, D'Acremont V, Leslie HH, Cohen J. Antibiotic exposure among children younger than 5 years in low-income and middle-income countries: a cross-sectional study of nationally representative facility-based and household-based surveys. Lancet Infect Dis. 2020 Feb;20(2):179-187. doi: 10.1016/S1473-3099(19)30572-9. Epub 2019 Dec 13.
- Holmes AH, Moore LS, Sundsfjord A, Steinbakk M, Regmi S, Karkey A, Guerin PJ, Piddock LJ. Understanding the mechanisms and drivers of antimicrobial resistance. Lancet. 2016 Jan 9;387(10014):176-87. doi: 10.1016/S0140-6736(15)00473-0. Epub 2015 Nov 18. Review.
- Hopkins H, Bruxvoort KJ, Cairns ME, Chandler CI, Leurent B, Ansah EK, Baiden F, Baltzell KA, Björkman A, Burchett HE, Clarke SE, DiLiberto DD, Elfving K, Goodman C, Hansen KS, Kachur SP, Lal S, Lalloo DG, Leslie T, Magnussen P, Jefferies LM, Mårtensson A, Mayan I, Mbonye AK, Msellem MI, Onwujekwe OE, Owusu-Agyei S, Reyburn H, Rowland MW, Shakely D, Vestergaard LS, Webster J, Wiseman VL, Yeung S, Schellenberg D, Staedke SG, Whitty CJ. Impact of introduction of rapid diagnostic tests for malaria on antibiotic prescribing: analysis of observational and randomised studies in public and private healthcare settings. BMJ. 2017 Mar 29;356:j1054. doi: 10.1136/bmj.j1054. Erratum in: BMJ. 2017 Jun 29;357:j3168.
- Keitel K, Kagoro F, Samaka J, Masimba J, Said Z, Temba H, Mlaganile T, Sangu W, Rambaud-Althaus C, Gervaix A, Genton B, D'Acremont V. A novel electronic algorithm using host biomarker point-of-care tests for the management of febrile illnesses in Tanzanian children (e-POCT): A randomized, controlled non-inferiority trial. PLoS Med. 2017 Oct 23;14(10):e1002411. doi: 10.1371/journal.pmed.1002411. eCollection 2017 Oct.
- Shao AF, Rambaud-Althaus C, Samaka J, Faustine AF, Perri-Moore S, Swai N, Kahama-Maro J, Mitchell M, Genton B, D'Acremont V. New Algorithm for Managing Childhood Illness Using Mobile Technology (ALMANACH): A Controlled Non-Inferiority Study on Clinical Outcome and Antibiotic Use in Tanzania. PLoS One. 2015 Jul 10;10(7):e0132316. doi: 10.1371/journal.pone.0132316. eCollection 2015.
- Shao AF, Rambaud-Althaus C, Swai N, Kahama-Maro J, Genton B, D'Acremont V, Pfeiffer C. Can smartphones and tablets improve the management of childhood illness in Tanzania? A qualitative study from a primary health care worker's perspective. BMC Health Serv Res. 2015 Apr 2;15:135. doi: 10.1186/s12913-015-0805-4.
- 2020-02799
- No.752/RNEC/2020
- Project_7F-10361.01.01