Abstract
Brain-computer interfaces (BCIs) are innovative systems that allow individuals to communicate with external devices without physical movements. These systems commonly use Event-Related Potentials (ERPs), particularly P300, as the signal control. However, despite their wide acceptance, there are still issues to be resolved, such as inter- and intra-subject variability. To address this challenge, we propose a novel approach based on post-processing the output of a Recurrent Neural Network using a Post-Recurrent Module (PRM). The PRM processes the temporal information extracted from the recurrent layer to make the final decision. This work shows that simple approaches, such as a reduce-max operation or a logistic regression layer, can improve the balanced accuracy by more than 9\(\%\) compared to state-of-the-art results. Our findings also contribute to the interpretability of RNNs since we have deepened the internal mechanisms of the model through an extensive analysis of the PRM layer. Overall, this study enhances the performance of ERP-based BCIs.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Allison, B.Z., Kübler, A., **, J.: 30+ years of P300 brain-computer interfaces. Psychophysiology 57(7), e13569 (2020)
Altaheri, H., et al.: Deep learning techniques for classification of electroencephalogram (EEG) motor imagery (MI) signals: a review. Neural Comput. Appl. 1–42 (2021)
Amin, H.U., Malik, A.S., Kamel, N., Chooi, W.T., Hussain, M.: P300 correlates with learning & memory abilities and fluid intelligence. J. Neuroeng. Rehabil. 12(1), 1–14 (2015)
Bishop, C.M.: Pattern Recognition and Machine Learning. Springer, New York (2006)
Changoluisa, V., Varona, P., Rodríguez, F.B.: An electrode selection approach in P300-based BCIs to address inter-and intra-subject variability. In: 2018 6th International Conference on Brain-Computer Interface (BCI), pp. 1–4. IEEE (2018)
Changoluisa, V., Varona, P., Rodriguez, F.B.: A fine dry-electrode selection to characterize event-related potentials in the context of BCI. In: Rojas, I., Joya, G., Català, A. (eds.) IWANN 2021. LNCS, vol. 12861, pp. 230–241. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-85030-2_19
Changoluisa, V., Varona, P., Rodríguez, F.B.: A low-cost computational method for characterizing event-related potentials for BCI applications and beyond. IEEE Access 8, 111089–111101 (2020)
van Dinteren, R., Arns, M., Jongsma, M.L., Kessels, R.P.: P300 development across the lifespan: a systematic review and meta-analysis. PLoS ONE 9(2), e87347 (2014)
Dozat, T.: Incorporating nesterov momentum into adam. In: ICLR Workshop (2016)
Elman, J.L.: Finding structure in time. Cogn. Sci. 14(2), 179–211 (1990)
Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9(8), 1735–1780 (1997)
Hoffmann, U., Vesin, J.M., Ebrahimi, T., Diserens, K.: An efficient P300-based brain computer interface for disabled subjects. J. Neurosci. Methods 167, 115–25 (2008)
Hu, L., Zhang, Z.: EEG Signal Processing and Feature. Springer, Singapore (2019). https://doi.org/10.1007/978-981-13-9113-2
Luck, S.J.: An Introduction to the Event-Related Potential Technique, 2nd edn. MIT Press, Cambridge (2014)
Mansoor, A., Usman, M.W., Jamil, N., Naeem, M.A.: Deep learning algorithm for brain-computer interface. Sci. Program. 2020, 1–12 (2020)
Oliva, C., Changoluisa, V., Rodríguez, F.B., Lago-Fernández, L.F.: Detecting P300-ERPs building a post-validation neural ensemble with informative neurons from a recurrent neural network. In: Maglogiannis, I., Iliadis, L., MacIntyre, J., Dominguez, M. (eds.) AIAI 2023, pp. 90–101. Springer, Cham (2023). https://doi.org/10.1007/978-3-031-34111-3_9
Oliva, C., Changoluisa, V., Rodríguez, F.B., Lago-Fernández, L.F.: Precise temporal P300 detection in brain computer interface EEG signals using a long-short term memory. In: Farkaš, I., Masulli, P., Otte, S., Wermter, S. (eds.) ICANN 2021. LNCS, vol. 12894, pp. 457–468. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-86380-7_37
Patel, S.H., Azzam, P.N.: Characterization of N200 and P300: selected studies of the event-related potential. Int. J. Med. Sci. 2(4), 147 (2005)
Pedregosa, F., et al.: Scikit-learn: machine learning in Python. J. Mach. Learn. Res. 12, 2825–2830 (2011)
Zhang, X., Yao, L., Wang, X., Monaghan, J., McAlpine, D., Zhang, Y.: A survey on deep learning-based non-invasive brain signals: recent advances and new frontiers. J. Neural Eng. 18(3), 031002 (2021)
Acknowledgements
This work has been partially funded by Spanish project PID2020-114867RB-I00, (MCIN/AEI and ERDF-“A way of making Europe”), Universidad Politécnica Salesiana 034-02-2022-03-31 and by Predoctoral Research Grants 2015-AR2Q9086 of the Government of Ecuador through SENESCYT.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Oliva, C., Changoluisa, V., Rodríguez, F.B., Lago-Fernández, L.F. (2023). Enhancing P300 Detection in Brain-Computer Interfaces with Interpretable Post-processing of Recurrent Neural Networks. In: Iliadis, L., Papaleonidas, A., Angelov, P., Jayne, C. (eds) Artificial Neural Networks and Machine Learning – ICANN 2023. ICANN 2023. Lecture Notes in Computer Science, vol 14259. Springer, Cham. https://doi.org/10.1007/978-3-031-44223-0_3
Download citation
DOI: https://doi.org/10.1007/978-3-031-44223-0_3
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-44222-3
Online ISBN: 978-3-031-44223-0
eBook Packages: Computer ScienceComputer Science (R0)