Nelli: Clinical Validation of a Video-based Epilepsy Examination Service
Study Details
Study Description
Brief Summary
The main purpose of this study is to validate the ability of the Nelli system (video-based epilepsy examination system) to detect epileptic motor seizure behaviors in patients at rest.
| Condition or Disease | Intervention/Treatment | Phase |
|---|---|---|
|
|
Detailed Description
Proper seizure documentation is an important tool to evaluate treatment outcomes and risks associated with epileptic seizures. Apart from a costly in-hospital video electro-encephalogram (VEEG) monitoring, most patients with epilepsy log and track their seizures with the help of the seizure diaries only. However, the reliability of the diaries is heavily dependent on an accurate recognition and recording of the seizures. There is an obvious need for a more objective and reliable seizure detection method. The investigators propose a low-cost video-based examination system, designed to detect motor seizure behaviors in patients at rest.
The main aim of this study is to clinically validate the ability of the Nelli system (video-based epilepsy examination system) to detect epileptic motor seizure behaviors in patients at rest, using simultaneous VEEG as the ground truth with the reference to all motor seizures and individual motor seizure types.
Study design established as follows:
-
Study population is represented by 90 epilepsy patients with suspected history of motor seizures undergoing a standard VEEG examination for clinical evaluation of epilepsy.
-
Co-registration of standard VEEG with the Nelli video- and audio-based system is performed, duration of the registration is 1-4 days.
-
The inclusion criteria for seizures:
-
Epileptic motor seizures appearing from rest while patients are in supine position in their monitoring bed.
-
The seizures are determined to be epileptic based on electroclinical characteristics by the responsible neurophysiologist / epileptologist.
-
The seizures can be classified into motor seizure types (both focal and generalized) using the 2017 International League Against Epilepsy (ILAE) seizure classification.
-
The registrations are analyzed by the Nelli system blinded to any clinical information.
Nelli system consists of two evaluation components:
-
Algorithmic component (pre-trained machine learning model based on video and audio signals)
-
Supervisory component (performed by experienced VEEG technicians)
-
Reports containing the seizure type classification (time-stamped) are provided by the VEEG laboratory, the performance of the Nelli system is assessed using these reports as the ground truth.
- Specificity and sensitivity of the Nelli system are evaluated with reference to both all motor seizures and individual motor seizure types.
-
The secondary outcome measures are established as follows:
-
To assess the latency from the onset of the seizure detection by the Nelli system in comparison to VEEG registration.
-
To determine an inter-rater agreement for the supervisory component of the Nelli system.
-
To investigate the performance of the algorithmic component of the Nelli system alone.
Study Design
Outcome Measures
Primary Outcome Measures
- FDR (per hour) and TPR [Examination period specific to the patient (1-4 days)]
False detection rate (FDR/hour) as well as true positive rate (TPR) of the Nelli service is to be evaluated. Here FDR stands for detections which do not intersect with the ground truth events, and true positive events match ground truth with the Nelli detections.
Secondary Outcome Measures
- Latency (seconds) [Examination period specific to the patient (1-4 days)]
Latency from the seizure onset (according to the ground truth) and the seizure detection by the Nelli system.
- Inter-rater agreement (Cohen's kappa coefficient) [Examination period specific to the patient (1-4 days)]
Inter-rater agreement for the supervisory component of the Nelli system
- Performance of the algorithmic component [Examination period specific to the patient (1-4 days)]
Performance of the algorithmic component evaluated using the ROC (receiver operating characteristic) curve at different operating points (thresholds).
Eligibility Criteria
Criteria
Inclusion Criteria:
Patients with epilepsy undergoing a standard VEEG examination for clinical evaluation consenting to participate in the present study
Exclusion Criteria:
Patients not consenting to participate in the study
Contacts and Locations
Locations
| Site | City | State | Country | Postal Code | |
|---|---|---|---|---|---|
| 1 | Danish Epilepsy Center, Filadelfia | Dianalund | Denmark |
Sponsors and Collaborators
- Tampere University
- Filadelfia Epilepsy Hospital
- Aarhus University Hospital
- Neuro Event Labs Oy
Investigators
None specified.Study Documents (Full-Text)
None provided.More Information
Publications
None provided.- CS001