Yang Pan, Chen Yangxin, Li Jinfang, et al. Design of a coronary heart disease education system based on AR technology[J]. Journal of Guangdong University of Technology. DOI: 10.12052/gdutxb.250081
    Citation: Yang Pan, Chen Yangxin, Li Jinfang, et al. Design of a coronary heart disease education system based on AR technology[J]. Journal of Guangdong University of Technology. DOI: 10.12052/gdutxb.250081

    Design of a Coronary Heart Disease Education System Based on AR Technology

    • Coronary heart disease (CHD) , as a complex multifactorial condition, presents significant challenges for patient education due to the abstract and specialized nature of its pathological mechanisms. Conventional health education models relying primarily on static media such as pamphlets and instructional videos exhibit notable limitations in knowledge dissemination efficacy and patient engagement. To address these issues, this study innovatively develops an augmented reality (AR) -based interactive CHD health education system. The system integrates multimodal hardware including HoloLens2, Kinect DK, and Pico4 to establish a HoloLens2-Kinect DK-Pico4 multi-terminal collaborative framework, enabling shared physician-patient AR perspectives. Clinicians overlay real-time cardiovascular models onto patients’ anatomies to simulate disease progression, while patients synchronously observe personalized pathological evolution through headsets, thereby enhancing situational cognition. At the technical implementation level: Personalized educational resources undergo parameterization to optimize multimedia visual presentation; A novel depth-camera registration maintenance algorithm utilizing spatial anchors is proposed, coupled with pose update frequency optimization to significantly enhance cardiovascular model registration stability; Real-time skeletal data captured by Kinect DK is mapped to Unity’s Avatar module, ensuring stable synchronization of cardiovascular models with patient movement; Cross-platform applications (PC server, clinician AR terminal, patient VR terminal) are developed via Unity3D, with seamless HoloLens2-Kinect DK-Pico4 communication achieved through custom data packet structures, message types, and process-pool mechanisms.
    • loading

    Catalog

      Turn off MathJax
      Article Contents

      /

      DownLoad:  Full-Size Img  PowerPoint
      Return
      Return