Skip to main content
  • Expression of Interest

    Towards ecologically valid synergy of BCI and head-mounted VR displays
    virtual reality headset, brain-computer interface, EEG, neurorehabilitation

    The project aims to build and verify an environmentally valid system combining BCI technology with a virtual reality environment (VR) using VR displays mounted on the head (BCI-VR). This opens up several possibilities for scientific research, from technical design, algorithmic part, the protocol of use to convenience, and users' acceptance. One of the promising areas of application of BCI-VR is motor neurorehabilitation. Our pilot studies have shown a high level of interest in such a system in patients after a stroke. While the interaction of the subject with the VR environment forms an interesting motivating element, the fascinating is the possibility of the subject's interaction and cooperation in the VR using their avatar representation.

    An example is the VR interaction between therapist and patient. An example would be a therapeutic process where the patient would observe a virtual movement or perform mental imagery according to the therapist's actions or instructions. Such a method of cooperation in the VR environment can easily complement voice communication, enabling social interaction strengthening leading to patients' increased motivation.

    We would like to build a project raising but extending these ideas. We have developed a pilot model of the BCI-VR environment using an affordable  Oculus Quest 2 VR headset and a pilot study with a mixed reality environment using the Microsoft HoloLens headset.

    From a neurophysiological and BCI perspective, our approach is strongly focused on individuality and long-term training. We adopted a scheme where we control subject-specific motor-related narrow-band scalp EEG oscillations (NSEO). The training scheme is thrown more into the domain of standard neurofeedback training rather than to a classifier driven BCI. We extensively use the passive movement observation strategy to identify NSEOs. However, different avenues of BCI protocols could be considered and designed here.

    As for the technical implementation of EEG measurement, we use the standard form of g.tec amplifiers, caps, and active electrodes, but this opens up the possibility to improve the entire BCI-VR system's technical design due to spatial restrictions resulting from the VR headset attached to the head. We would welcome a partner helping to design a better merge of VR headset and EEG recording. We would be happy to test such a design.

    Finally, we see no reason to limit the project to the field of neurorehabilitation. We also see many unanswered design and functionality issues, especially the BCI-VR environment's effects on healthy subjects and other tasks. We are fully open to discussion in this regard.

     

    Department of Computers and Informatics, Technical University of Kosice (partner not funded)  

    The partner's experience should reflect the themes of the project. It is about constructing a real-world system and implementing real experiments that bring demands on technical feasibility. The practicality of the proposed BCI protocols should be borne in mind.

    We have well-founded professional medical support for the field of neurorehabilitation.

    Any

    The project needs further creation and discussion/telecom. The aim is to search for partners interested in the topic. 

    I've already posted "Partner looking for project" on this server, where I briefly introduced our work and lab. Some info can be found here:

    http://aiolos.um.savba.sk/~roman/rrLab/index.html

    and on my web:

    http://aiolos.um.savba.sk/~roman

    Please write me an e-mail if you are interested in something on this sketch of the project, have any other ideas to direct the project, or have your project into which this would fit.

    roman.rosipal@saba.sk

    {Empty}