ACCEPT: Assess the Clinical Effectiveness in Prioritising CT Heads
Study Details
Study Description
Brief Summary
Non-Contrast Computed Tomography (NCCT) of the head is the most common imaging method used to assess patients attending the Emergency Department (ED) with a wide range of significant neurological presentations including trauma, stroke, seizure and reduced consciousness. Rapid review of the images supports clinical decision-making including treatment and onward referral.
Radiologists, those reporting scans, often have significant backlogs and are unable to prioritise abnormal images of patients with time critical abnormalities. Similarly, identification of normal scans would support patient turnover in ED with significant waits and pressure on resources.
To address this problem, Qure.AI has worked to develop the market approved qER algorithm, which is a software program that can analyse CT head to identify presence of abnormalities supporting workflow prioritisation.
This study will trial the software in 4 NHS hospitals across the UK to evaluate the ability of the software to reduce the turnaround time of reporting scans with abnormalities that need to be prioritised.
| Condition or Disease | Intervention/Treatment | Phase |
|---|---|---|
|
Detailed Description
Study background:
Emergency Departments (ED) across the UK are overburdened with increasing patient demand, radiology staff shortages and rising patient wait times. Head injuries are a frequent cause of emergency attendance in the UK with computed tomography(CT) scans usually the first imaging tests to diagnose head injuries and strokes.
A report issued by National Institute of Health and Care Excellence (NICE), confirms that each year 1.4 million people attend emergency departments in England and Wales with head injury. Among the 200,000 patients admitted annually, one-fifth of them suffer from a Traumatic Brain Injury with skull fracture or evidence of brain damage. Head injury is the most common cause of death and disability in people up to the age of 40. Early detection and prompt treatment is vital to save lives and minimise risk of disability, according to the NICE guidelines of Head injury: assessment and early management. Head CT scans are the gold standard for diagnosing these and it is critical that these are performed and reported by Radiologists in line with NICE guidelines.
The potential applications of AI in radiology go well beyond image analysis for diagnostic and prognostic opportunities. It is becoming increasingly clear that AI algorithms have the potential to improve productivity, operational efficiency, and accuracy in diagnostic radiology. AI tools are being developed to aide diagnosis and enhance processes at multiple point in the radiology workflow including:
(a) protocolling the prioritised scan,(b) clinical decision support systems for detection of critical findings, (c) worklist priority adjustment via AI results, and (d) reducing turnaround time through worklist prioritisation and semiautomated structures reporting. The adoption of AI tools is dependent on the demonstration of a tangible effect on patient care and improvement in radiologist workflow.
Thus, in this study, we aim to assess whether real-world implementation of an AI tool which augments (b), (c) and (d) of the imaging life cycle would affect turnaround times.
qER medical device:
qER, a CE Class II approved medical software device, detects, and localizes the presence of six target abnormalities - intracranial haemorrhage, cranial fracture, midline shift, mass effect, atrophy and hypodensities suggestive of infarcts in non-contrast Head-CT scans. A priority status is assigned if any one of the target abnormalities (intracranial haemorrhage, cranial fracture, midline shift or mass effect) is detected by the software, and the user will be able to view a single summary slice listing all the target abnormalities found by qER on the CT scan followed by all slices in scan with the overlay of above abnormalities localization. Alternately, if none of the target abnormalities are detected, the output will indicate that the software has analysed the image and identified no critical findings. qER reports are intended to support certified radiologists and/or licensed medical practitioners for clinical decision making. It is a support tool and, when used with original scans, can assist the clinician to improve efficiency, accuracy, and turnaround time in reading head CTs. It is not to be used to provide medical advice, determine treatment plan, or recommend a course of action to the patient.
Study design:
A multi-centre stepped wedged cluster randomised study will be conducted in 4 NHS hospitals over a 13-month period. Hospitals will be identified and initiated into the qER solution with a 30-day implementation period. The order in which sites will receive the qER intervention will be determined by computer-based randomisation. The stepped wedge design allows delivery of the intervention at an organisational level with evaluation of outcome measures at a patient level. Structuring the implementation through a staged activation in a random order provides important methodological advantages for both qualitative and quantitative elements of the study. The design allows control of adoption bias and adjust for time-based changes in the background patient characteristics at a patient level.
All patients under this pathway would receive an AI reading, and no additional or different tests will be performed as a result of the AI findings. The turnaround time will be the interval between the time the scan was taken to the time when the final scan report becomes available and will be measured in minutes. When qER assistance is used for reporting Head-CT scans and if there is a difference between the output of the qER and the radiologist, the latter will be considered as final for further patient management.
Primary objective:
The primary objective is to assess if qER based reporting and triage significantly reduce turnaround time (TAT) of critical NCCT head reporting for patients attending the emergency department.
Secondary objective(s):
-
To assess utility of qER to support emergency department pathways for patients requiring NCCT head and radiology reporting workflow.
-
To assess the safety of qER at identifying patients with critical findings on NCCT heads.
-
To evaluate the technical performance of qER.
-
To conduct a Heath Economic, cost utility analysis of qER.
Study Design
Arms and Interventions
| Arm | Intervention/Treatment |
|---|---|
| Pre-implementation of qER Baseline data: During the pre-implementation phase, we will be gathering data around the technical requirements for integrating qER into the radiology workflow. A random sample of 500 scans per site will be sent for the ground-truthing process for the purpose of technical evaluation. We will also be collecting data on the baseline status of all the endpoints including TAT. The reporting of NCCT scans will follow the same workflow as the current standard of care (i.e., the images/cases will appear in the RIS chronologically and the radiologist either follows this order or prioritises some cases based on communication from ED). |
|
| Post-implementation of qER Post-implementation (Trial Intervention) In the post-implementation phase, there will be a notification (prioritised flag) in RIS. The order of the cases in RIS will not be altered. When the radiologist clicks a case in RIS, a secondary capture of qER along with the original images will be available in PACS. This secondary capture will have a contour showing the algorithm's attention point for a specific abnormality. The radiologist can then choose to agree with qER findings as it is or modify or ignore it according to their clinical judgement, writing and finally signing off the report. For scans which were not processed by qER the radiologist can prioritise and report as per the standard of care. |
Device: qER (qER EU 2.0)
Qure.ai's emergency room software solution qER (qER EU 2.0) is an AI medical device, developed by training a deep-learning algorithm using over 300,000 scans labelled by expert radiologists. qER has been shown to be accurate in identifying a range of abnormalities in NCCT head scans as well as prioritising them for urgent review and radiologist reporting. It is designated as a clinical support tool and, when used with original scans, can assist the clinician to improve efficiency, accuracy, and turnaround time in reading head CTs.
|
Outcome Measures
Primary Outcome Measures
- Reporting turnaround time with qER prioritisation [1 year]
Time taken to report NCCT head from acquisition for patients with prioritised findings in Emergency Department compared to standard of care. Measured as time in minutes from the scan acquisition to the final radiology report of prioritised scans.
Secondary Outcome Measures
- Reporting turnaround time with qER prioritisation for scans without prioritised findings. [1 year]
Measured as time in minutes from the scan acquisition to the final radiology report of scans without prioritised findings.
- Reporting turnaround time with qER prioritisation for scans with an absence of findings. [1 year]
Measured as time in minutes from the scan acquisition to the final radiology report of scans with an absence of findings.
- Assess utility of qER to support emergency department pathways for patients requiring NCCT head and radiology reporting workflow. [1 year]
Time to diagnosis from NCCT acquisition. Measured as time in hours to the electronic record of diagnosis assigned in the emergency department.
- Assess utility of qER to support the flow of the patients from the emergency department. [1 year]
Time to referral or discharge designation from NCCT acquisition. Measured as time in hours to the electronic record of referral or discharge after diagnosis in the emergency department.
- Assess utility of qER to support the Clinical decision in emergency department. [1 year]
Time to initiation of treatment from NCCT acquisition. Measured as time in hours to the electronic record of the initiation of treatment in the emergency department.
- Assess the safety of qER [1 year]
Mortality within 30 days of Emergency Department discharge. Measured by the number of study participants who upon discharge from the impatient setting are dead within 30 days.
- Evaluate the technical performance of qER for proritised scans. [1 year]
Accuracy of qER in classifying prioritised scans. Rate of accurate classification of prioritised scans compared with the final radiology report.
- Evaluate the technical performance of qER for non-prioritised scans. [1 year]
Accuracy of qER in classifying non-prioritised scans in comparison to a radiologist. Rate of accurate classification of non-prioritised scans compared with the final radiology report.
- Evaluate the technical performance of qER for scans with an absence of findings. [1 year]
Accuracy of qER in classifying scans with an absence of findings. Rate of accurate classification of scans with an absence of findings compared with the final radiology report.
Eligibility Criteria
Criteria
Inclusion Criteria:
-
Individuals undergoing Head CT scan at the ED / A&E (Accident and Emergency Services).
-
Non-contrast axial CT scan series with consistently spaced axial slices.
-
Soft reconstruction kernel covering the complete Brain.
-
Maximum slice thickness of 6mm.
Exclusion Criteria:
There are no explicit exclusion criteria for qER as all scans in inclusion criteria will be processed by qER. Exclusion criteria are implicit within the inclusion criteria listed above.
Contacts and Locations
Locations
| Site | City | State | Country | Postal Code | |
|---|---|---|---|---|---|
| 1 | NHS Greater Glasgow and Clyde | Glasgow | United Kingdom | ||
| 2 | Guy's and St.Thomas Trusts | London | United Kingdom | SE1 7EH | |
| 3 | Northumbria Healthcare NHS Foundation Trust | Northumberland | United Kingdom | NE27 0QJ | |
| 4 | Oxford University Hospitals | Oxford | United Kingdom | OX3 9DU |
Sponsors and Collaborators
- Guy's and St Thomas' NHS Foundation Trust
- Qure.ai
- NHS Greater Glasgow and Clyde
- Northumbria Healthcare NHS Foundation Trust
- Oxford University Hospitals NHS Trust
Investigators
- Study Chair: Haris Shuaib, MSc, Guy's and St.Thomas' Hospitals
Study Documents (Full-Text)
More Information
Publications
None provided.- 313507