基于图卷积的异常运动模式检测

    Graph Convolution-based Abnormal Movement Pattern Detection

    • 摘要: 针对现有异常运动模式检测方法存在的图拓扑建模运动学可解释性不足、特征缺乏生物力学物理意义、异常定位能力弱且决策过程黑箱化等问题,本文提出一种基于图卷积的异常运动模式检测方法,构建融合位姿特征、帧间动态特征与稳态特征的运动学特征表达,在位姿特征中解耦骨架表示,消除冗余并增强视角鲁棒性,结合关节角度变化信息的动态特征刻画运动的瞬时变化,并引入基于时间窗口的位移方差量化运动的稳定性。进一步,提出多拓扑图卷积模块(Multi-topology graph convolution network,MT-GCN),根据运动链理论构建多个预定义骨架拓扑结构,以拓扑感知自注意力机制根据输入特征分布动态调整邻接矩阵权重,再通过图卷积操作聚合节点特征,捕获全局节点信息。在3个公开数据集上的实验表明,本文方法在大部分动作上的异常识别结果优于其他方法,其中在UI-PRMD数据集上的准确率达到93.93%,消融实验验证了方法的有效性,可视化定性分析表明模型能够准确定位异常关节,使识别结果具有可解释性。

       

      Abstract: Aiming at the problems of insufficient kinematic interpretability of graph topology modeling, lack of biomechanically meaningful feature representation, and weak anomaly localization ability in existing abnormal movement pattern detection methods, a graph convolution-based method for movement anomaly recognition was proposed. A kinematic feature representation was constructed by integrating pose features, inter-frame dynamic features, and steadiness features. The pose representation was decoupled to reduce redundancy and improve viewpoint robustness. Dynamic features derived from joint angular velocity captured instantaneous motion changes, while displacement variance over a time window quantified motion stability. Furthermore, a multi−topology graph convolution module was designed. It incorporated principles from kinematic chain theory to define multiple skeleton topologies. A topology−aware self−attention mechanism dynamically adjusted adjacency matrix weights based on input features, and graph convolution aggregated node information. Experiments on three public datasets demonstrate that the proposed method achieves superior abnormal recognition accuracy for most actions, reaching 93.93% on dataset UI−PRMD.Ablation studies confirm the effectiveness of each feature component. Visualizations show that the model accurately localizes abnormal joints, providing interpretable recognition results.

       

    /

    返回文章
    返回