室内VR场景中融合视觉与动作捕获的定位方法

    A Positioning Method Fusing Vision and Motion Capture in Indoor VR Scenarios

    • 摘要: 实时精确获取人体头部坐标是虚拟现实(Virtual Reality, VR)站立交互场景中具有良好沉浸感与体验感的关键要素之一。现有获取头部坐标的方法存在空间锚定部署复杂、成本高、人体结构先验利用不足等问题。为此,本文提出一种面向室内VR场景的低成本头部三维坐标获取方法。首先,基于目标检测与字符识别方法获取人体足部锚点坐标,建立人体在室内场景中的基准坐标;其次,结合惯性测量单元与身体几何参数,构建足部锚点约束下的躯干-头部简化运动学先验;第三,基于双路残差结构与物理一致性约束构建自适应回归模型,实现头部三维坐标推理。实验结果表明,足部锚点坐标的平均获取周期为68~87 ms,平均误差低于1.5 cm;推理头部坐标的平均周期为29.4 ms(34 Hz) ,平均欧氏距离误差(Mean_ED)低于5 cm。个体化标定实验表明,少量目标个体数据能够改善模型适配性能;惯性测量单元(Inertial Measurement Unit, IMU)安装误差和视觉锚点偏移实验表明,本文方法在典型部署扰动下仍具有一定稳定性。本文方法能够在低成本硬件条件下获取厘米级头部三维坐标,并在定位精度、部署成本与实时性之间取得较好平衡,为轻量化室内VR头部三维定位提供了一种可行技术路线。

       

      Abstract: Accurate, real-time acquisition of 3D head coordinates is important for immersion and user experience in standing virtual reality (VR) interactions. Current solutions for head localization are limited by cumbersome spatial anchor setup, high hardware costs and underutilization of human body geometric priors. To address these issues, a low-cost method for acquiring 3D head coordinates in indoor VR scenarios is proposed. First, target detection and character recognition are adopted to obtain the coordinates of human foot anchors in order to establish the reference coordinates of the human body in the indoor environment. Second, measure- ments from inertial measurement units (IMUs) are combined with body geometric parameters to construct a simplified trunk-head kinematic prior constrained by foot anchors. Third, an adaptive regression model is built based on a dual-branch residual structure and physical consistency constraints. The 3D head coordinates are then inferred by the adaptive regression model. Experimental results show that the average acquisition cycle of foot anchor coordinates ranges from 68 ms to 87 ms with an average error below 1.5 cm. The average output interval for head coordinates is 29.4 ms (34 Hz) , and the Mean Euclidean Distance error (Mean_ED) is less than 5 cm. Personalized calibration experiments show that a small amount of target-subject data can improve model adaptation; IMU mounting error and visual anchor offset experiments show that the proposed method still maintains certain stability under typical deployment disturbances. The results validate that the proposed method is capable of centimeter-level 3D head localization using low-cost hardware. By striking a favorable trade-off among localization accuracy, deployment cost and real-time performance, this work offers a feasible technical route for lightweight 3D head localization in indoor VR systems.

       

    /

    返回文章
    返回