ConvTriCA-FNet:面向舌象胃病诊断的卷积三级交叉注意力融合网络

    ConvTriCA-FNet: A Convolutional Triple-level Cross-Attention Fusion Network for Tongue Image-Based Gastric Disease Diagnosis

    • 摘要: 胃癌作为全球高发的恶性肿瘤之一,其癌前病变的早期识别与干预对降低疾病负担至关重要。舌诊作为一种非侵入性和高效的筛查手段在胃病初筛中展现出独特价值。针对现有深度学习舌象分析方法存在感受野有限、多层级特征融合不足及临床信息利用不充分等问题,本文提出一种卷积三级交叉注意力融合网络的胃病分类模型。该模型采用双路径结构,分别处理舌象与临床数据:舌象路径通过三级Transformer分支与交叉注意力融合多层级视觉特征;临床路径利用临床表征学习模块提取结构化数据的判别信息。本研究通过有效融合局部视觉特征、全局语义信息与临床先验知识,实现了对胃病的精准分类。在820例临床数据上的实验表明,本方法在正常、非萎缩性与萎缩性胃病分类中准确率达71.95%,优于现有主流方法,为胃病早期智能筛查提供了可靠的技术路径。

       

      Abstract: As one of the most prevalent malignant tumors worldwide, gastric cancer requires early identification and intervention of its precancerous lesions to reduce the disease burden. Tongue diagnosis, as a non-invasive and efficient screening method, demonstrates unique value in the preliminary screening of gastric diseases. To address issues in existing deep learning-based tongue image analysis methods, such as limited receptive fields, insufficient multi-level feature fusion, and inadequate utilization of clinical information, a gastric disease classification model is proposed using a convolutional triple-level cross-attention fusion network. The model adopts a dual-path structure to process tongue images and clinical data separately: the tongue image path integrates multi-level visual features through triple-level Transformer branches and cross-attention, while the clinical path employs a clinical representation learning module to extract discriminative information from structured data. This study achieves accurate classification of gastric diseases by effectively integrating local visual features, global semantic information, and clinical prior knowledge. Experiments on 820 clinical cases show that the proposed method attains an accuracy of 71.95% in classifying normal, non-atrophic, and atrophic gastric conditions, outperforming existing mainstream approaches and providing a reliable technical pathway for early intelligent screening of gastric diseases.

       

    /

    返回文章
    返回