GeoCtrl: Finger-based Geometric Mapping and Speed-Adaptive Gain for In-Hand Object Rotation in AR/VR

We propose a geometry-based virtual object rotation technique that leverages triangular configuration of fingertips and a speed-responsive Control-Display (CD) gain. Rather than replicating real-world physics which often lead to unnatural mid-air behavior in the absence of physical feedback, we leverage finger-level geometry to enable low-effort object rotation. We map the orientation and morphology of a triangle formed around fingertips directly to the object’s rotation, assuming that users tend to trace the object’s intended motion when physical constraints are missing. To enhance the proposed interaction and accommodate natural motor limits, we implement an adaptive CD gain that scales geometric input according to the fingertip movement speed. In a user evaluation, our method yielded shorter task completion time than physics-based rotation, though longer than a commodity hand-interaction technique, while significantly reducing physical demand relative to both reference conditions without increasing overall workload. We demonstrate that geometry-driven mapping and dynamic gain adaptation enable low-effort, finger-level rotational control of virtual objects in immersive environments.

Authors: Seo Young Oh, Taejun Son, Juyoung Lee, Sang Ho Yoon, and Woontack Woo.
Download Paper