Assessing internal, external and covert visuospatial attention in AR using brain sensing: a pilot study

Nataliya Kosmyna; Pattie Maes

doi:10.1117/12.2613493

7 March 2022 Assessing internal, external and covert visuospatial attention in AR using brain sensing: a pilot study

Nataliya Kosmyna, Pattie Maes

Proceedings Volume 11931, Optical Architectures for Displays and Sensing in Augmented, Virtual, and Mixed Reality (AR, VR, MR) III; 1193106 (2022) https://doi.org/10.1117/12.2613493
Event: SPIE AR VR MR, 2022, San Francisco, California, United States

Abstract

Most research works featuring AR and Brain-Computer Interface (BCI) systems are not taking advantage of the opportunities to integrate the two planes of data. In this project, we propose a prototype which combines an existing AR headset HoloLens 2 with a Brain-Computer Interfaces (BCI) system and we perform several tasks to validate this concept. In the first experiment, we reduced the distraction of the user by including information about the current attentional state. A simple game was designed for the Microsoft HoloLens 2, which changed in real time according to the user’s state of attention measured via electroencephalography (EEG). The system only responded if the attentional orientation was classified as "external." Fourteen users tested the attention-aware system; we show that the augmentation of the interface improved the usability of the system. We conclude that more systems would benefit from clearly visualizing the user’s ongoing attentional state as well as further efficient integration of AR and BCI headsets. In the second prototype we propose a system based on covert visuospatial attention (CVSA) – the process of focusing attention on different regions of the visual field without overt eye movements. In the experiment we did not rely on any stimulusdriven responses. Fourteen participants were able to test the system over the course of two days. To the best of our knowledge, this system is the first AR EEG-BCI integrated prototype that explores the complementary features of the AR headset like the HoloLens 2 and the CVSA paradigm.

Citation Download Citation

Nataliya Kosmyna and Pattie Maes "Assessing internal, external and covert visuospatial attention in AR using brain sensing: a pilot study", Proc. SPIE 11931, Optical Architectures for Displays and Sensing in Augmented, Virtual, and Mixed Reality (AR, VR, MR) III, 1193106 (7 March 2022); https://doi.org/10.1117/12.2613493

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available