Intuitive Brain-Computer Interface Control Using Onomatopoeia for an Enhanced Gaming Experience

Intuitive Brain-Computer Interface Control Using Onomatopoeia for an Enhanced Gaming Experience

Intuitive Brain-Computer Interface Control Using Onomatopoeia for an Enhanced Gaming Experience

著者
二瓶 朝渉
平野 怜旺
渡邊 恵太
学会名
CHI PLAY
発表年
2024年
発表形式
登壇発表

概要

Brain-computer interfaces (BCIs) enable direct communication between the brain and external devices. Electroencephalography(EEG)-based noninvasive BCIs are frequently used for medical applications. These applications allow users with motor dysfunction to control and interact with external devices. Additionally, there is growing interest in using BCIs for able-bodied individuals, particularly in video games. Video games using BCIs have the potential to create novel and engaging modalities for players, enhancing game immersion. In our research, we developed a video game where players control magic using an EEG training method based on onomatopoeias. In this game, Players achieve this by simultaneously recalling the visual imagery of magic and the corresponding onomatopoeic speech imagery while wearing the BCI. This paper evaluates the potential of this method to improve the BCI-controlled video game experience by assessing both BCI performance and overall game experience.The experimental results suggest that the proposed method can achieve stable control performance, with over 60% of participants successfully using magic as intended. Additionally, the high ratings of immersion and enjoyment indicate that the high affinity between BCI-based imagery control and onomatopoeia could enhance the player experience.

デモビデオ

論文情報

Ataru Nihei, Reo Hirano, and Keita Watanabe. 2024. Intuitive Brain-Computer Interface Control Using Onomatopoeia for an Enhanced Gaming Experience. In Companion Proceedings of the 2024 Annual Symposium on Computer-Human Interaction in Play (CHI PLAY Companion '24). Association for Computing Machinery, New York, NY, USA, pp.208-214. https://doi.org/10.1145/3665463.3678789