Application of brain-computer interface system in communication of people with severe motor deficits
Abstract
Introduction. Maintaining and improving communication skills of people with severe motor deficits are the main goals of speech therapy. Brain-computer interface systems can be used as a means of communication in this group of users, since they allow them to control external devices with the help of brain activity. This assistive technology represents a new communication channel between the human brain and computers, or other devices. These systems translate the user’s intention, reflected in brain signals, into the output used to control an external device, without muscular activity. Objective. The aim of this paper was to describe and list basic types and divisions of the brain-computer interface system, as well as their development for communication in people with severe motor deficits. Methods. A systematic review of the available literature was performed by searching electronic databases available through the service of the Serbian Library Consortium for Coordinated Acquisition – KOBSON, as well as through Google Scholar and Research Gate. Conclusion. Early communication systems, based on the interpretation of brain waves, provided answers to simple ”yes/no” questions. After that, they were also used in spelling methods, whose speed became higher over time. The development of a brain-computer interface system aims to reduce the length of training, as time-consuming training is one of the main obstacles for the users. In addition, research in this area is aimed at improving performance in all parts of the communication system, as well as developing a reliable interface between users and computers.
References
Abdulkader, S. N., Atia, A., & Mostafa, M. S. M. (2015). Brain computer interfacing: Applications and challenges. Egyptian Informatics Journal, 16(2), 213-230. https://doi.org/10.1016/j.eij.2015.06.002
Arsenić, I. (2020, 15 septembar). Primena asistivne tehnologije kod odraslih osoba sa dizartrijom [rezime saopštenja sa skupa]. Druga nacionalna konferencija Asistivne tehnologije i komunikacija (ASTEK), Beograd, Srbija.
Birbaumer, N. (2006). Breaking the silence: Brain-computer interfaces (BCI) for communication and motor control. Psychophysiology, 43(6), 517-532. https://doi.org/10.1111/j.1469-8986.2006.00456.x
Birbaumer, N., Elbert, T., Canavan, A. G., & Rockstroh, B. (1990). Slow potentials of the cerebral cortex and behavior. Physiological Reviews, 70(1), 1-41. https://doi.org/10.1152/physrev.1990.70.1.1
Birbaumer, N., Ghanayim, N., Hinterberger, T., Iversen, I., Kotchoubey, B., Kübler, A., Perelmouter J., Taub, E., & Flor, H. (1999). A spelling device for the paralysed. Nature, 398(6725), 297-298. https://doi.org/10.1038/18581
Blankertz, B., Muller, K. -R., Curio, G., Vaughan, T. M., Schalk, G., Wolpaw, J. R., Schlögl, A., Neuper, C., Pfurtscheller, G., Hinterberger, T., Schroder, M., & Birbaumer, N. (2004). The BCI competition 2003: Progress and perspectives in detection and discrimination of EEG single trials. IEEE Transactions on Biomedical Engineering, 51(6), 1044-1051. https://doi.org/10.1109/TBME.2004.826692
Brumberg, J. S., Kennedy, P. R., & Guenther, F. H. (2009). Artificial speech synthesizer control by brain-computer interface. In 10th Annual Conference of the International Speech Communication Association 2009 (INTERSPEECH 2009) (pp. 636-639). International Speech Communication Association.
Chaudhary, U., Birbaumer, N., & Ramos-Murguialday, A. (2016). Brain-computer interfaces for communication and rehabilitation. Nature Reviews Neurology, 12(9), 513-525. https://doi.org/10.1038/nrneurol.2016.113
Cipresso, P., Carelli, L., Solca, F., Meazzi, D., Meriggi, P., Poletti, B., Lulé, D., Ludolph, A. C., Silani, V., & Riva, G. (2012). The use of P300--based BCIs in amyotrophic lateral sclerosis: From augmentative and alternative communication to cognitive assessment. Brain and Behavior, 2(4), 479-498. https://doi.org/10.1002/brb3.57
Daly, J. J., & Wolpaw, J. R. (2008). Brain-computer interfaces in neurological rehabilitation. The Lancet Neurology, 7(11), 1032-1043. https://doi.org/10.1016/S1474-4422(08)70223-0
Fouad, I. A., & Labib, F. E. Z. M. (2015). Using emotiv EPOC neuroheadset to acquire data in brain-computer interface. International Journal of Advanced Research, 3(11), 1012-1017.
Gilja, V., Pandarinath, C., Blabe, C. H., Nuyujukian, P., Simeral, J. D., Sarma, A. A., Sorice, B. L., Perge, J. A., Jarosiewicz, B., Hochberg, L. R., Shenoy, K. V., & Henderson, J. M. (2015). Clinical translation of a high-performance neural prosthesis. Nature Medicine, 21(10), 1142-1145. https://doi.org/10.1038/nm.3953
Guger, C., Spataro, R., Allison, B. Z., Heilinger, A., Ortner, R., Cho, W., & La Bella, V. (2017). Complete locked-in and locked-in patients: Command following assessment and communication with vibro-tactile P300 and motor imagery brain-computer interface tools. Frontiers in Neuroscience, 11, Article 251. https://doi.org/10.3389/fnins.2017.00251
Hwang, J. -Y., Lee, M. -H., & Lee, S. -W. (2017, 9-11 January). A brain-computer interface speller using peripheral stimulus-based SSVEP and P300. In 5th International Winter Conference on Brain-Computer Interface BCI 2017 (pp. 77-78). IEEE.
Jovanović-Simić, N., Arsenić, I., i Daničić, Z. (2020). Primena metoda augmentativne i alternativne komunikacije kod osoba sa locked-in sindromom. Beogradska defektološka škola, 26(2), 53-73.
Jovanović-Simić, N., Arsenić, I., Daničić, Z., i Ječmenica, N. (2021, 18-21 februar). Primena asistivne tehnologije u komunikaciji osoba sa teškim motoričkim deficitima [rezime saopštenja sa skupa]. Stručno naučna konferencija sa međunarodnim učešćem Dani defektologa Srbije, Zlatibor, Srbija.
Kennedy, P. R., Bakay, R. A. E., Moore, M. M., Adams, K., & Goldwaithe, J. (2000). Direct control of a computer from the human central nervous system. IEEE Transactions on Rehabilitation Engineering, 8(2), 198-202. https://doi.org/10.1109/86.847815
Kübler, A., & Birbaumer, N. (2008). Brain-computer interfaces and communication in paralysis: Extinction of goal directed thinking in completely paralysed patients? Clinical Neurophysiology, 119(11), 2658-2666. https://doi.org/10.1016/j.clinph.2008.06.019
Kübler, A., Kotchoubey, B., Kaiser, J., Wolpaw, J. R., & Birbaumer, N. (2001). Brain-computer communication: Unlocking the locked in. Psychological Bulletin, 127(3), 358-375. https://doi.org/10.1037/0033-2909.127.3.358
Lacmanović, D. (2016). Modeliranje i razvoj računarskog sistema za korišćenje servisa e-uprave za osobe sa invaliditetom [doktorska disertacija, Univerzitet u Novom Sadu]. NaRDuS. https://nardus.mpn.gov.rs/bitstream/handle/123456789/5651/Disertacija3542.pdf?sequence=7
Lazarou, I., Nikolopoulos, S., Petrantonakis, P. C., Kompatsiaris, I., & Tsolaki, M. (2018). EEG-based brain-computer interfaces for communication and rehabilitation of people with motor impairment: A novel approach of the 21st century. Frontiers in Human Neuroscience, 12, Article 14. https://doi.org/10.3389/fnhum.2018.00014
Leuthardt, E. C., Schalk, G., Wolpaw, J. R., Ojemann, J. G., & Moran, D. W. (2004). A brain-computer interface using electrocorticographic signals in humans. Journal of Neural Engineering, 1(2), 140-154. https://doi.org//10.1109/RBME.2011.2172408
Mak, J. N., & Wolpaw, J. R. (2009). Clinical applications of brain-computer interfaces: Current state and future prospects. IEEE Reviews in Biomedical Engineering, 2, 187-199. https://doi.org/10.1109/RBME.2009.2035356
Milekovic, T., Sarma, A. A., Bacher, D., Simeral, J. D., Saab, J., Pandarinath, C., Sorice, B. L., Blabe, C., Oakley, E. M., Tringale, K. R., Eskandar, E., Cash, S. S., Henderson, J. M., Shenoy, K. V., Donoghue, J. P., & Hochberg, L. R. (2018). Stable long-term BCI-enabled communication in ALS and locked-in syndrome using LFP signals. Journal of Neurophysiology, 120(7), 343-360. https://doi.org/10.1152/jn.00493.2017
Miner, L. A., McFarland, D. J., & Wolpaw, J. R. (1998). Answering questions with an electroencephalogram-based brain-computer interface. Archives of Physical Medicine and Rehabilitation, 79(9), 1029-1033. https://doi.org/10.1016/S0003-9993(98)90165-4
Miranda, R. A., Casebeer, W. D., Hein, A. M., Judy, J. W., Krotkov, E. P., Laabs, T. L., Manzo, J. E., Pankratz, K. G., Pratt, G. A., Sanchez, J. C., Weber, D. J., Wheeler, T. L., & Ling, G. S. F. (2015). DARPA-funded efforts in the development of novel brain-computer interface technologies. Journal of Neuroscience Methods, 244, 52-67. https://doi.org/10.1016/j.jneumeth.2014.07.019
Neumann, N., Kübler, A., Kaiser, J., Hinterberger, T., & Birbaumer, N. (2003). Conscious perception of brain states: Mental strategies for brain-computer communication. Neuropsychologia, 41(8), 1028-1036. https://doi.org/10.1016/S0028-3932(02)00298-1
Nijboer, F., & Broermann, U. (2009). Brain-computer interfaces for communication and control in locked-in patients. In B. Graimann, G. Pfurtscheller, B. Allison, (Eds.), Brain-Computer Interfaces (pp. 185-201). Springer.
Oken, B. S., Orhan, U., Roark, B., Erdogmus, D., Fowler, A., Mooney, A., Peters, B., Miller, M., & Fried-Oken, M. B. (2014). Brain-computer interface with language model-electroencephalography fusion for locked-in syndrome. Neurorehabilitation and Neural Repair, 28(4), 387-394. https://doi.org/10.1177/1545968313516867
Rogić, N. (2021). Mozak-računar interfejs i njegova primena u upravljanju dronom. Zbornik radova Fakulteta tehničkih nauka, 36(10), 1835-1838. https://doi.org/10.24867/14RB02Rogic
Ryan, D. B., Frye, G. E., Townsend, G., Berry, D. R., Mesa-G, S., Gates, N. A., & Sellers, E. W. (2010). Predictive spelling with a P300-based brain-computer interface: Increasing the rate of communication. International Journal of Human-Computer Interaction, 27(1), 69-84. https://doi.org/10.1080/10447318.2011.535754
Savić, A. (2014). Elektoencefalografski signali za upravljanje računarskim interfejsom u neurorehabilitaciji [doktorska disertacija, Univerzitet u Beogradu]. NaRDuS. https://nardus.mpn.gov.rs/handle/123456789/8339
Sellers, E. W., Ryan, D. B., & Hauser, C. K. (2014). Noninvasive brain-computer interface enables communication after brainstem stroke. Science Translational Medicine, 6(257), Article 257re7. https://doi.org/10.1126/scitranslmed.3007801
Sutter, E. E. (1992). The brain response interface: Communication through visually-induced electrical brain responses. Journal of Microcomputer Applications, 15(1), 31-45. https://doi.org/10.1016/0745-7138(92)90045-7
Verbaarschot, C., Tump, D., Lutu, A., Borhanazad, M., Thielen, J., van den Broek, P., Farquhar, J., Weikamp, J., Raaphorst, J., Groothuis, J. T., & Desain, P. (2021). A visual brain-computer interface as communication aid for patients with amyotrophic lateral sclerosis. Clinical Neurophysiology, 132(10), 2404-2415. https://doi.org/10.1016/j.clinph.2021.07.012
Vidal, J. J. (1973). Toward direct brain-computer communication. Annual Review of Biophysics and Bioengineering, 2(1), 157-180. https://doi.org/10.1146/annurev.bb.02.060173.001105
Wolpaw, J. R. (2004). Brain-computer interfaces (BCIs) for communication and control: A mini-review. Supplements to Clinical Neurophysiology, 57, 607-613. https://doi.org/10.1016/S1567-424X(09)70400-3
Wolpaw, J. R., Bedlack, R. S., Reda, D. J., Ringer, R. J., Banks, P. G., Vaughan, T. M., Heckman, S. M., McCane, L. M., Carmack, C. S., Winden, S., McFarland, D. J., Sellers, E. W., Shi, H., Paine, T., Higgins, D. S., Lo, A. C., Patwa, H. S., Hill, K. J., Huang, G. D., & Ruff, R. L. (2018). Independent home use of a brain-computer interface by people with amyotrophic lateral sclerosis. Neurology, 91(3), e258-e267. https://doi.org/10.1212/WNL.0000000000005812
Wolpaw, J. R., Birbaumer, N., Heetderks, W. J., McFarland, D. J., Peckham, P. H., Schalk, G., Donchin, E., Quatrano, L. A., Robinson, C. J., & Vaughan, T. M. (2000). Brain-computer interface technology: A review of the first international meeting. IEEE Transactions on Rehabilitation Engineering, 8(2), 164-173. https://doi.org/10.1109/tre.2000.847807
Wolpaw, J. R., Birbaumer, N., McFarland, D. J., Pfurtscheller, G., & Vaughan, T. M. (2002). Brain-computer interfaces for communication and control. Clinical Neurophysiology, 113(6), 767-791. https://doi.org/10.1016/S1388-2457(02)00057-3
Copyright (c) 2022 Specijalna edukacija i rehabilitacija
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.