Skip to main content

Local and remote cooperation with virtual and robotic agents:a P300 BCI study in healthy and people living with spinal cord injury

Tidoni, Emmanuele; Abu-Alqumsan, Mohammad; Leonardis, Daniele; Kapeller, Christoph; Fusco, Gabriele; Guger, Cristoph; Hintermuller, Cristoph; Peer, Angelika; Frisoli, Antonio; Tecchia, Franco; Bergamasco, Massimo; Aglioti, Salvatore Maria

Authors

Mohammad Abu-Alqumsan

Daniele Leonardis

Christoph Kapeller

Gabriele Fusco

Cristoph Guger

Cristoph Hintermuller

Angelika Peer

Antonio Frisoli

Franco Tecchia

Massimo Bergamasco

Salvatore Maria Aglioti



Abstract

The development of technological applications that allow people to control and embody external devices within social interaction settings represents a major goal for current and future brain-computer interface (BCI) systems. Prior research has suggested that embodied systems may ameliorate BCI end-user's experience and accuracy in controlling external devices. Along these lines, we developed an immersive P300-based BCI application with a head-mounted display for virtual-local and robotic-remote social interactions and explored in a group of healthy participants the role of proprioceptive feedback in the control of a virtual surrogate (Study 1). Moreover, we compared the performance of a small group of people with spinal cord injury (SCI) to a control group of healthy subjects during virtual and robotic social interactions (Study 2), where both groups received a proprioceptive stimulation. Our attempt to combine immersive environments, BCI technologies and neuroscience of body ownership suggests that providing realistic multisensory feedback still represents a challenge. Results have shown that healthy and people living with SCI used the BCI within the immersive scenarios with good levels of performance (as indexed by task accuracy, optimizations calls and Information Transfer Rate) and perceived control of the surrogates. Proprioceptive feedback did not contribute to alter performance measures and body ownership sensations. Further studies are necessary to test whether sensorimotor experience represents an opportunity to improve the use of future embodied BCI applications.

Journal Article Type Article
Publication Date 2017-09
Journal IEEE Transactions on Neural Systems and Rehabilitation Engineering
Print ISSN 1534-4320
Electronic ISSN 1558-0210
Publisher Institute of Electrical and Electronics Engineers
Peer Reviewed Peer Reviewed
Volume 25
Issue 9
Pages 1622-1632
APA6 Citation Tidoni, E., Abu-Alqumsan, M., Leonardis, D., Kapeller, C., Fusco, G., Guger, C., …Aglioti, S. M. (2017). Local and remote cooperation with virtual and robotic agents:a P300 BCI study in healthy and people living with spinal cord injury. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 25(9), 1622-1632. https://doi.org/10.1109/tnsre.2016.2626391
DOI https://doi.org/10.1109/tnsre.2016.2626391
Publisher URL https://ieeexplore.ieee.org/document/7797151
Related Public URLs http://eprints.uwe.ac.uk/30884/

Files

Article (3.6 Mb)
PDF

Copyright Statement
© 2016 IEEE. Translations and content mining are permitted for academic research only. Personal use is also permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.





You might also like



Downloadable Citations

;