GeoCtrl (2026)

Abstract

We propose a geometry-based virtual object rotation technique that leverages triangular configuration of fingertips and a speed-responsive Control-Display (CD) gain. Rather than replicating real-world physics which often lead to unnatural mid-air behavior in the absence of physical feedback, we leverage finger-level geometry to enable low-effort object rotation. We map the orientation and morphology of a triangle formed around fingertips directly to the object’s rotation, assuming that users tend to trace the object’s intended motion when physical constraints are missing. To enhance the proposed interaction and accommodate natural motor limits, we implement an adaptive CD gain that scales geometric input according to the fingertip movement speed. In a user evaluation, our method yielded shorter task completion time than physics-based rotation, though longer than a commodity hand-interaction technique, while significantly reducing physical demand relative to both reference conditions without increasing overall workload. We demonstrate that geometry-driven mapping and dynamic gain adaptation enable low-effort, finger-level rotational control of virtual objects in immersive environments.

Citation

@article{oh2026geoctrl,
  title={GeoCtrl: Finger-based Geometric Mapping and Speed-Adaptive Gain for In-Hand Object Rotation in AR/VR},
  author={Oh, Seo Young and Son, Taejun and Lee, Juyoung and Yoon, Sang Ho and Woo, Woontack},
  booktitle={2026 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)},
  year={2026},
  publisher={IEEE}
}