基于AR技术的冠心病宣教系统设计

    Design of a Coronary Heart Disease Education System Based on AR Technology

    • 摘要: 冠心病作为一种复杂的多因素疾病,其病理机制具有高度抽象性和专业性,这对患者健康教育是一个挑战。传统健康教育模式主要依赖健康手册、宣传视频等静态媒介,在知识传播效果和患者参与度方面存在明显局限性。为解决上述问题,本文开发了一套基于增强现实(Augmented Reality, AR)技术的冠心病交互式健康教育系统。该系统整合了HoloLens2、Kinect DK及Pico4等多模态硬件设备,构建了HoloLens2-Kinect DK-Pico4多端协同框架,实现医患共享AR视角。医生通过空间叠加患者实时心血管模型进行病情推演,患者借助头显同步观察个性化病理演变过程,强化情境认知。在技术实现层面,本文通过参数化处理个性化教育资源,优化了多媒体内容的视觉呈现;提出了基于空间锚点的深度相机注册保持算法,并结合位姿更新频率优化策略,显著提升了心血管模型的注册稳定性;利用Kinect DK捕获的患者骨骼数据与Unity引擎的Avatar模块进行实时映射,实现了心血管模型实时稳定跟随患者移动的效果;通过Unity3D引擎实现了PC服务端、医生AR端以及患者虚拟现实端的应用构建,通过自定义数据包结构、消息类型以及进程池机制等实现了HoloLens2-Kinect DK- Pico4之间的顺利通讯。

       

      Abstract: Coronary heart disease (CHD) , as a complex multifactorial condition, presents significant challenges for patient education due to the abstract and specialized nature of its pathological mechanisms. Conventional health education models relying primarily on static media such as pamphlets and instructional videos exhibit notable limitations in knowledge dissemination efficacy and patient engagement. To address these issues, this study innovatively develops an augmented reality (AR) -based interactive CHD health education system. The system integrates multimodal hardware including HoloLens2, Kinect DK, and Pico4 to establish a HoloLens2-Kinect DK-Pico4 multi-terminal collaborative framework, enabling shared physician-patient AR perspectives. Clinicians overlay real-time cardiovascular models onto patients’ anatomies to simulate disease progression, while patients synchronously observe personalized pathological evolution through headsets, thereby enhancing situational cognition. At the technical implementation level: Personalized educational resources undergo parameterization to optimize multimedia visual presentation; A novel depth-camera registration maintenance algorithm utilizing spatial anchors is proposed, coupled with pose update frequency optimization to significantly enhance cardiovascular model registration stability; Real-time skeletal data captured by Kinect DK is mapped to Unity’s Avatar module, ensuring stable synchronization of cardiovascular models with patient movement; Cross-platform applications (PC server, clinician AR terminal, patient VR terminal) are developed via Unity3D, with seamless HoloLens2-Kinect DK-Pico4 communication achieved through custom data packet structures, message types, and process-pool mechanisms.

       

    /

    返回文章
    返回