This study investigated the use of the deformation of the fingertips of a virtual hand to enhance depth perception during freehand interaction in a virtual reality (VR). Artificial fingertip deformation may generate mapping of real hand position and pseudo-haptics, improving UI usability. We conducted two experiments focusing on depth manipulation in both pointing and steering tasks. Our results revealed that changes in fingertip shape reduced operation time in pointing tasks and improved accuracy in steering tasks. Additionally, we conducted subjective evaluation surveys for both experiments, which showed improvements in pseudo-haptics, spatial perception, and user experience. Based on these results, we propose several applications and demonstrate that fingertip deformations in virtual hands can contribute to better 3D UI design.
Kosuke Morimoto, Nobuhito Kasahara, Shota Yamanaka, Homei Miyashita, and Keita Watanabe. 2025. Enhancing Freehand VR Interaction Using Fingertip Deformation on User Performance. In Proceedings of the 2025 31st ACM Symposium on Virtual Reality Software and Technology (VRST '25). Association for Computing Machinery, New York, NY, USA, Article 4, 1–11. https://doi.org/10.1145/3756884.3765975