Abstract
In this work, we contribute towards the development of video-based epileptic seizure classification by introducing a novel framework (SETR-PKD), which could achieve privacy-preserved early detection of seizures in videos. Specifically, our framework has two significant components - (1) It is built upon optical flow features extracted from the video of a seizure, which encodes the seizure motion semiotics while preserving the privacy of the patient; (2) It utilizes a transformer based progressive knowledge distillation, where the knowledge is gradually distilled from networks trained on a longer portion of video samples to the ones which will operate on shorter portions. Thus, our proposed framework addresses the limitations of the current approaches which compromise the privacy of the patients by directly operating on the RGB video of a seizure as well as impede real-time detection of a seizure by utilizing the full video sample to make a prediction. Our SETR-PKD framework could detect tonic-clonic seizures (TCSs) in a privacy-preserving manner with an accuracy of 83.9% while they are only half-way into their progression. Our data and code is available at https://github.com/DevD1092/seizure-detection.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
We have a data ethics agreement approved for collection of data at hospital.
- 2.
We plan to release the in-house optical flow dataset and corresponding code.
References
Ahmedt-Aristizabal, D., et al.: A hierarchical multimodal system for motion analysis in patients with epilepsy. Epilepsy Behav. 87, 46–58 (2018)
Ahmedt-Aristizabal, D., Nguyen, K., Denman, S., Sridharan, S., Dionisio, S., Fookes, C.: Deep motion analysis for epileptic seizure classification. In: 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp. 3578–3581. IEEE (2018)
Cascino, G.D.: Video-EEG monitoring in adults. Epilepsia 43, 80–93 (2002)
Cunha, J.P.S., et al.: NeuroKinect: a novel low-cost 3Dvideo-EEG system for epileptic seizure motion quantification. PloS one 11(1), e0145669 (2016)
Devinsky, O., Hesdorffer, D.C., Thurman, D.J., Lhatoo, S., Richerson, G.: Sudden unexpected death in epilepsy: epidemiology, mechanisms, and prevention. Lancet Neurol. 15(10), 1075–1088 (2016)
Dosovitskiy, A., et al.: An image is worth 16x16 words: Transformers for image recognition at scale. ar**v preprint ar**v:2010.11929 (2020)
Fan, M., Chou, C.A.: Detecting abnormal pattern of epileptic seizures via temporal synchronization of EEG signals. IEEE Trans. Biomed. Eng. 66(3), 601–608 (2018)
Fisher, R.S., et al.: Operational classification of seizure types by the international league against epilepsy: position paper of the ILAE commission for classification and terminology. Epilepsia 58(4), 522–530 (2017)
Furnari, A., Farinella, G.M.: Rolling-unrolling LSTMs for action anticipation from first-person video. IEEE Trans. Pattern Anal. Mach. Intell. (PAMI) 43, 4021–4036 (2020)
Guan, W., et al.: Egocentric early action prediction via multimodal transformer-based dual action prediction. IEEE Trans. Circ. Syst. Video Technol. 33(9), 4472–4483 (2023)
Horn, B.K., Schunck, B.G.: Determining optical flow. Artif. Intell. 17(1–3), 185–203 (1981)
Hou, J.C., Thonnat, M., Bartolomei, F., McGonigal, A.: Automated video analysis of emotion and dystonia in epileptic seizures. Epilepsy Res. 184, 106953 (2022)
Huberfeld, G., et al.: Glutamatergic pre-ictal discharges emerge at the transition to seizure in human epilepsy. Nat. Neurosci. 14(5), 627–634 (2011)
Kalitzin, S., Petkov, G., Velis, D., Vledder, B., da Silva, F.L.: Automatic segmentation of episodes containing epileptic clonic seizures in video sequences. IEEE Trans. Biomed. Eng. 59(12), 3379–3385 (2012)
Karayiannis, N.B., Tao, G., Frost, J.D., Jr., Wise, M.S., Hrachovy, R.A., Mizrahi, E.M.: Automated detection of videotaped neonatal seizures based on motion segmentation methods. Clin. Neurophys. 117(7), 1585–1594 (2006)
Kusmakar, S., Karmakar, C.K., Yan, B., O’Brien, T.J., Muthuganapathy, R., Palaniswami, M.: Automated detection of convulsive seizures using a wearable accelerometer device. IEEE Trans. Biomed. Eng. 66(2), 421–432 (2018)
Moshé, S.L., Perucca, E., Ryvlin, P., Tomson, T.: Epilepsy: new advances. Lancet 385(9971), 884–898 (2015)
Nashef, L., So, E.L., Ryvlin, P., Tomson, T.: Unifying the definitions of sudden unexpected death in epilepsy. Epilepsia 53(2), 227–233 (2012)
Osman, N., Camporese, G., Coscia, P., Ballan, L.: SlowFast rolling-unrolling LSTMs for action anticipation in egocentric videos. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 3437–3445 (2021)
Pérez, J.S., Meinhardt-Llopis, E., Facciolo, G.: Tv-l1 optical flow estimation. Image Process. On Line 2013, 137–150 (2013)
Pérez-García, F., Scott, C., Sparks, R., Diehl, B., Ourselin, S.: Transfer learning of deep spatiotemporal networks to model arbitrarily long videos of seizures. In: de Bruijne, M., et al. (eds.) MICCAI 2021. LNCS, vol. 12905, pp. 334–344. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-87240-3_32
Rashid, M., Singh, H., Goyal, V.: The use of machine learning and deep learning algorithms in functional magnetic resonance imaging-a systematic review. Expert Syst. 37(6), e12644 (2020)
Shih, J.J., et al.: Indications and methodology for video-electroencephalographic studies in the epilepsy monitoring unit. Epilepsia 59(1), 27–36 (2018)
Siddiqui, M.K., Islam, M.Z., Kabir, M.A.: A novel quick seizure detection and localization through brain data mining on ECoG dataset. Neural Comput. Appl. 31, 5595–5608 (2019)
Sivathamboo, S., et al.: Cardiorespiratory and autonomic function in epileptic seizures: a video-EEG monitoring study. Epilepsy Behav. 111, 107271 (2020)
Vaswani, A., et al.: Attention is all you need. In: Advances in Neural Information Processing Systems. vol. 30 (2017)
Wang, L., et al.: Temporal segment networks for action recognition in videos. IEEE Trans. Pattern Anal. Mach. Intell. 41(11), 2740–2755 (2018)
Wang, X., et al.: OadTR: online action detection with transformers. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 7565–7575 (2021)
Yang, Y., Sarkis, R.A., El Atrache, R., Loddenkemper, T., Meisel, C.: Video-based detection of generalized tonic-clonic seizures using deep learning. IEEE J. Biomed. Health Inf. 25(8), 2997–3008 (2021)
Yuan, Y., Xun, G., Jia, K., Zhang, A.: A multi-context learning approach for EEG epileptic seizure detection. BMC syst. Biol. 12(6), 47–57 (2018)
Zheng, N., Song, X., Su, T., Liu, W., Yan, Y., Nie, L.: Egocentric early action prediction via adversarial knowledge distillation. ACM Trans. Multimedia Comput. Commun. Appl. 19(2), 1–21 (2023)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
1 Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Mehta, D., Sivathamboo, S., Simpson, H., Kwan, P., O’Brien, T., Ge, Z. (2023). Privacy-Preserving Early Detection of Epileptic Seizures in Videos. In: Greenspan, H., et al. Medical Image Computing and Computer Assisted Intervention – MICCAI 2023. MICCAI 2023. Lecture Notes in Computer Science, vol 14224. Springer, Cham. https://doi.org/10.1007/978-3-031-43904-9_21
Download citation
DOI: https://doi.org/10.1007/978-3-031-43904-9_21
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-43903-2
Online ISBN: 978-3-031-43904-9
eBook Packages: Computer ScienceComputer Science (R0)
