Abstract
Project Title: VR-BCI4PM: A Virtual Reality System Controlled by a Hybrid Brain-Computer Interface to Improve Powered Mobility in Individuals with Neuromotor Disorders Abstract: Individuals with spinal cord injuries (SCI), traumatic and acquired brain injuries (ABI), cerebral palsy (CP), multiple sclerosis (MS), amyotrophic lateral sclerosis (ALS), spinal cord injury (SCI) may have limited mobility and often require power wheelchairs for conducting an independent life. Powered mobility is a viable option, but requires strenuous training to guarantee safe driving conditions. Usually, wheelchair training is conducted with therapists at the hospital, with considerable costs for the national health system. Also, 10-40% of people cannot use a power wheelchair due to sensory, motor, and neurocognitive impairments. These people are considered unable to safely drive and are forced to use manual wheelchairs or ask for caregivers’ support. Driving skills and types of aid suitable for independent mobility are established based on the Powered Mobility Program (PMP). However, to date, no clinically validated tools support the user’s training to fulfill the PMP. Virtual reality (VR) constitutes a portable solution to perform safe training at home. To date, no existing VR simulators have been developed to assess users’ driving skills. Also, the existing VR simulators allow controlling movements with joysticks or hand trackers, but they are unusable for individuals with severe upper limb motor impairments. In this context, brain-computer interfaces (BCIs) represent a potential candidate as an innovative control interface. Although previous studies have explored the development of multimodal approaches integrating joysticks, electromyography (EMG), and eye-tracking, there are no training systems based on hybrid BCI solutions that decode information from electroencephalography (EEG) and EMG and that involve a wider audience. Herein, we will develop an innovative simulator based on a VR platform (the VR-BCI4PM) and we will longitudinally evaluate the improvement of wheelchair driving performance with 20 participants suffering from CP, ALS, MS, ABI, or SCI. A self-paced hybrid BCI will be developed for VR joystick-free control. Through 10 driving sessions with VR-BCI4PM at home (if the participant can use the joystick) or in the clinic (if the BCI controller is required), we will evaluate the effectiveness of the simulator by comparing the pre-and post-training results using the PMP protocol as ground-truth. Furthermore, a calibration system for VR-BCI4PM will be developed to compare the VR metrics to real-world conditions during on-road wheelchair tests. Lastly, usability, level of satisfaction, stress due to mental workload, and motion sickness will be assessed via behavioral questionnaires and physiological signals. Not only will VR-BCI4PM improve the wheelchair driving skills of people with severe motor impairment, but it will also establish objective measures to personalize the training, with the ultimate goal of improving the independence of individuals with motor disabilities and reducing the burden on the health system. Project Objectives: The overarching aim of VR-BCI4PM is to enhance mobility and independence for individuals with neuromotor impairments by developing and validating a novel training system that combines VR and a hybrid brain-computer interface (hBCI). The project is structured around four specific objectives: 1. Development of an innovative VR simulator (VR-PM) for clinically validated, PMP-aligned training of powered mobility. 2. Design and evaluation of a self-paced hybrid BCI, integrating EEG and EMG signals, to enable joystick-free control for individuals with severe motor impairments. 3. Integration of VR and BCI technologies to allow customizable control modalities tailored to user needs. 4. Clinical validation of the system (VR-BCI4PM) with a representative sample of individuals with various neuromotor disorders. The project will be carried out through three work packages (WPs) across 24 months (+ an additional 6 months). A longitudinal, exploratory clinical study will assess both technical performance and user outcomes. WP1 – Development and Evaluation of the VR Simulator (Objective 1): This WP was designed, implemented, and calibrated a virtual reality simulator that reproduces tasks from the Wheelchair Skills Program (WSP) and Powered Mobility Program (PMP). The simulator will be validated against real-world performance using a calibration system and tested longitudinally with individuals with neuromotor conditions. Specifically, these are the tasks: VR-PM system design; VR-PM development; Real-world calibration protocol; Longitudinal user evaluation; Behavioral and cybersickness analysis. Expected Results: We expect to complete development of a functional and usable VR platform for at least 10 participants. Approximately 90% of participants are anticipated to improve their powered wheelchair driving skills after two months of VR training. Cybersickness is expected in ~20% of users initially, decreasing to 10% over time. VR and real-world performance are expected to show an 80% correspondence, supporting clinical translatability. WP2 – Development and Evaluation of the Hybrid BCI System (Objective 2): This WP focused on creating a 4-command hybrid neural interface combining a self-paced EEG-based BCI (for left/right control) and an EMG/EOG-based interface (for forward/backward motion). The fusion of these modalities will provide robust, joystick-free navigation within the VR simulator. WP2’s tasks: Design of EEG-based 2-class BCI; Development of full hybrid BCI (hBCI) with EEG+EMG/EOG; Longitudinal evaluation of hBCI performance in end-users; Behavioral and usability evaluation. Expected Results: We expect to achieve >75% accuracy in both EEG and EMG/EOG interfaces individually, and at least 80% of the 10 users will be able to control the VR simulator effectively. The hybrid interface will enable intuitive navigation for individuals unable to use traditional hand-based controls. WP3 – System Integration and Clinical Validation (Objectives 3 & 4): Following the success of WP1 and WP2, WP3 will merge the VR-PM and hBCI systems into a unified VR-BCI4PM platform. End-users will test the system over several weeks in either home (if the joystick is usable) or clinical settings (if the hBCI is required), following PMP-aligned procedures. WP3’s tasks: Integration of VR and BCI systems; User-centered design refinement; Longitudinal training with the integrated system; Final evaluation: usability, behavior, stress, motion sickness. Expected Results: We expect that 90% of users with severe motor impairments (at least 10 participants) will demonstrate improved powered mobility performance (per PMP/WSP criteria) after using the VR-BCI4PM system for two months. Motion sickness will be minimal and decrease over time. The platform will enable objective assessment and personalization of training protocols, thereby increasing the autonomy of users and reducing long-term healthcare costs. Impact: The VR-BCI4PM platform represents an innovative leap in accessible rehabilitation technology. By enabling effective, user-tailored training for powered mobility, even among those with severe impairments, this system addresses a major clinical and societal need. Its hybrid design will extend the accessibility of VR training beyond current technological limits, making independent mobility a reality for a broader population. Clinically, it will enable therapists to personalize interventions using objective metrics. From a health policy perspective, it offers a scalable, cost-effective alternative to hospital-based training, potentially reducing long-term care dependency and increasing quality of life for thousands of individuals.
Dettagli del progetto
Responsabile scientifico: Marilisa Cortesi
Strutture Unibo coinvolte:
Dipartimento di Ingegneria dell'Energia Elettrica e dell'Informazione "Guglielmo Marconi"
Coordinatore:
ALMA MATER STUDIORUM - Università di Bologna(Italy)
Contributo totale di progetto: Euro (EUR) 200.000,00
Contributo totale Unibo: Euro (EUR) 119.887,00
Durata del progetto in mesi: 24
Data di inizio
28/09/2023
Data di fine:
28/02/2026
