Very few research works featuring AR and Brain-Computer Interface (BCI) systems considered integrating cognitive state of the user in their applications. Additionally, even fewer projects explored the wearable, everyday solutions to help the user in their everyday tasks beyond the lab setup. In this project, we propose a wearable, wireless pair of glasses with a monocle-like heads-up display by including information about the current attentional state of the wearer by adapting their environment accordingly. We first introduce a our solution for AR-BCI integration. An application was designed, which adapted to the user’s state of attention measured via electroencephalography (EEG) and electrooculography (EOG). The system only responded if the attentional orientation was classified as "internal". Fourteen users tested the attention-aware system; we show that the adaptation of the interface improved the usability of the system. We conclude that more systems would benefit from awareness of the user’s ongoing attentional state as well further efficient integration of AR and BCI headsets.
Most research works featuring AR and Brain-Computer Interface (BCI) systems are not taking advantage of the opportunities to integrate the two planes of data. In this project, we propose a prototype which combines an existing AR headset HoloLens 2 with a Brain-Computer Interfaces (BCI) system and we perform several tasks to validate this concept. In the first experiment, we reduced the distraction of the user by including information about the current attentional state. A simple game was designed for the Microsoft HoloLens 2, which changed in real time according to the user’s state of attention measured via electroencephalography (EEG). The system only responded if the attentional orientation was classified as "external." Fourteen users tested the attention-aware system; we show that the augmentation of the interface improved the usability of the system. We conclude that more systems would benefit from clearly visualizing the user’s ongoing attentional state as well as further efficient integration of AR and BCI headsets. In the second prototype we propose a system based on covert visuospatial attention (CVSA) – the process of focusing attention on different regions of the visual field without overt eye movements. In the experiment we did not rely on any stimulusdriven responses. Fourteen participants were able to test the system over the course of two days. To the best of our knowledge, this system is the first AR EEG-BCI integrated prototype that explores the complementary features of the AR headset like the HoloLens 2 and the CVSA paradigm.
Wearable devices like XR glasses and headsets can support medical interventions and prevent the progression of the diseases like dementia, and support patients suffering from ALS, anxiety or depression. Augmenting such headsets with sensors that capture brain activity, heart rate variability or skin conductivity can give access to discovering new biomarkers. These biomarkers help modelling, simulating, and finally offering novel datasets with physiological modalities recorded over extended periods of time on an everyday basis. Moreover, patients are often older adults, frail and reluctant to travel for complex exams in hospitals. Hence remotely deployed wearable systems offer a promising alternative to current practices. An ongoing COVID-19 pandemic only added to the burden of these patients and confirmed a need to accelerate the deployment of such systems for pre-clinical and clinical trials. In this talk we will discuss several examples of these systems as well as touching upon the use cases beyond healthcare.
Access to the requested content is limited to institutions that have purchased or subscribe to SPIE eBooks.
You are receiving this notice because your organization may not have SPIE eBooks access.*
*Shibboleth/Open Athens users─please
sign in
to access your institution's subscriptions.
To obtain this item, you may purchase the complete book in print or electronic format on
SPIE.org.
INSTITUTIONAL Select your institution to access the SPIE Digital Library.
PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.