基于多核学习的单分类多示例学习算法

doi:10.12052/gdutxb.230001

Abstract

Abstract: By introducing multiple-kernel into one-class multiple-instance learning, this paper proposes a novel multiple-kernel one-class multiple-instance learning based on support vector data description, which aims to solve the problem of multiple-kernel learning of multiple-instance data with a relatively complex distribution structure in practical applications. This algorithm maps multiple-instance data into the feature space through different multiple-kernel functions, and constructs a spherical classifier by using support vector data description algorithm. To iteratively optimize the proposed algorithm adopts an iterative optimization framework, we first initialize the instances in positive bags as positive, and optimize the objective function to build up the classifier. Then, the labels of the positive instances in each bag are updated according to the classifier obtained in the previous step. The experimental results on the Corel, VOC 2007 and Messidor datasets show that the proposed algorithm achieves significantly better classification performance than state-of-the-art methods, demonstrating its feasibility and effectiveness.

Key words: multiple-kernel learning, one-class classification, support vector data description, multiple-instance learning

CLC Number:

TP181

Gu Hui-min, Xiao Yan-shan, Liu Bo. Multiple-kernel One-class Multiple-instance Learning Algorithm[J].Journal of Guangdong University of Technology, 2024, 41(02): 101-107.

References

[1] DIETTERICH T G, LATHROP R H, LOZANO-PÉREZ T. Solving the multiple instance problem with axis-parallel rectangles [J]. Artificial Intelligence, 1997, 89(1-2): 31-71.
[2] 黎启祥, 肖燕珊, 郝志峰, 等. 基于抗噪声的多任务多示例学习算法研究[J]. 广东工业大学学报, 2018, 35(3): 47-53.
LI Q X, XIAO Y S, HAO Z F, et al. An algorithm based on multi-instance anti-noise learning [J]. Journal of Guangdong University of Technology, 2018, 35(3): 47-53.
[3] 蔡昊, 刘波. 半监督两个视角的多示例聚类模型[J]. 广东工业大学学报, 2021, 38(3): 22-28,47.
CAI H, LIU B. A semi-supervised two-view multiple-instance clustering model [J]. Journal of Guangdong University of Technology, 2021, 38(3): 22-28,47.
[4] SHANG J, HONG S, ZHOU Y, et al. Knowledge guided multi-instance multi-label learning via neural networks in medicines prediction[C] //Asian Conference on Machine Learning. Beijing: PMLR, 2018: 831-846.
[5] YANG Y, TU Y, LEI H, et al. HAMIL: hierarchical aggregation-based multi-instance learning for microscopy image classification [J]. Pattern Recognition, 2023, 136: 109245.
[6] ZHA Y, ZHANG Y, KU T, et al. Multiple instance models regression for robust visual tracking [J]. IEEE Transactions on Circuits and Systems for Video Technology, 2020, 31(3): 1125-1137.
[7] LUTZ B, PRÖLLOCHS N, NEUMANN D. Sentence-level sentiment analysis of financial news using distributed text representations and multi-instance learning[EB/OL]. arXiv: 1901.00400 (2018-12-31) [2023-04-06].https://doi.org/10.48550/arXiv.1901.00400.
[8] XU K, ZHAO Z, GU J, et al. Multi-instance multi-label learning for gene mutation prediction in hepatocellular carcinoma[C]//2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC) . Montreal: IEEE, 2020: 6095-6098.
[9] ANDREWS S, TSOCHANTARIDIS I, HOFMANN T. Support vector machines for multiple-instance learning [J]. Advances in Neural Information Processing Systems, 2002, 15: 561-568.
[10] SCHÖLKOPF B, WILLIAMSON R C, SMOLA A, et al. Support vector method for novelty detection [J]. Advances in Neural Information Processing Systems, 1999, 12: 582-588.
[11] TAX D M J, DUIN R P W. Support vector data description [J]. Machine Learning, 2004, 54(1): 45-66.
[12] HU Z, XUE Z. On the complexity of one-class SVM for multiple instance learning[EB/OL]. arXiv: 1603.04947 (2016-03-16) [2023-04-06].https://doi.org/10.48550/arXiv.1603.04947.
[13] WANG X, ZHANG Z, MA Y, et al. One-class multiple instance learning via robust pca for common object discovery[C] //Asian Conference on Computer Vision. Heidelberg: Springer, 2012: 246-258.
[14] XIAO Y, LIU B, HAO Z, et al. A similarity-based classification framework for multiple-instance learning [J]. IEEE Transactions on Cybernetics, 2013, 44(4): 500-515.
[15] CHEPLYGINA V, TAX D M J, LOOG M. Multiple instance learning with bag dissimilarities [J]. Pattern Recognition, 2015, 48(1): 264-275.
[16] CHEN Y, BI J, WANG J Z. MILES: multiple-instance learning via embedded instance selection [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2006, 28(12): 1931-1947.
[17] SCHÖLKOPF B, SMOLA A, MÜLLER K. Nonlinear component analysis as a kernel eigenvalue problem [J]. Neural Computation, 1998, 10(5): 1299-1319.
[18] 汪洪桥, 孙富春, 蔡艳宁, 等. 多核学习方法[J]. 自动化学报, 2010, 36(8): 1037-1050.
WANG H Q, SUN F C, CAI Y N, et al. On multiple kernel learning methods [J]. Acta Automatica Sinica, 2010, 36(8): 1037-1050.
[19] HONG S, CHAE J. Active learning with multiple kernels [J]. IEEE Transactions on Neural Networks and Learning Systems, 2021, 33(7): 2980-2994.
[20] GAUTAM C, TIWARI A. Localized multiple kernel support vector data description[C]//2018 IEEE International Conference on Data Mining Workshops (ICDMW) . Singapore: IEEE, 2018: 1514-1521.
[21] SOHRAB F, RAITOHARJU J, IOSIFIDIS A, et al. Multimodal subspace support vector data description [J]. Pattern Recognition, 2021, 110: 107648.
[22] 卢明, 刘黎辉, 吴亮红. 多核支持向量数据描述分类方法研究[J]. 计算机工程与应用, 2016, 52(18): 68-73.
LU M, LIU L H, WU L H. Research on multi-kernel support vector data description method of classification [J]. Computer Engineering and Applications, 2016, 52(18): 68-73.
[23] CHEN Y, ZHOU X S, HUANG T S. One-class SVM for learning in image retrieval[C]//Proceedings 2001 International Conference on Image Processing (Cat. No. 01CH37205) . Thessaloniki: IEEE, 2001, 1: 34-37.
[24] EVERINGHAM M, VAN GOOL L, WILLIAMS C K I, et al. The pascal visual object classes (voc) challenge [J]. International Journal of Computer Vision, 2010, 88(2): 303-338.
[25] YUAN T, WAN F, FU M, et al. Multiple instance active learning for object detection[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. Virtual: IEEE, 2021: 5330-5339.
[26] DECENCIÈRE E, ZHANG X, CAZUGUEL G, et al. Feedback on a publicly distributed image database: the Messidor database [J]. Image Analysis & Stereology, 2014, 33(3): 231-234.
[27] HAND D J, TILL R J. A simple generalisation of the area under the ROC curve for multiple class classification problems [J]. Machine Learning, 2001, 45: 171-186.

Metrics

Viewed

Full text

Abstract

Cited

Shared

Discussed

Comments

Recommended 0

No Suggested Reading articles found!

Multiple-kernel One-class Multiple-instance Learning Algorithm

HTML

PDF (PC)

Abstract

Cite this article

share this article

References

Related Articles 7

Metrics

Comments

Recommended 0

[1]	Zhong Geng-jun, Li Dong. A Channel-splited Based Dual-branch Block for 3D Point Cloud Processing [J]. Journal of Guangdong University of Technology, 2023, 40(04): 18-23.
[2]	Zhu Hong-yang, Ding Yi, Chai Hua-jin, Li Sheng. Analysis and Improvement of Decision Trees with Extension Logic and Extension Thinking Mode [J]. Journal of Guangdong University of Technology, 2019, 36(02): 31-36.
[3]	Chen Ping-hua, Huang Hui, Mai Miao, Zhou Hong-hong. Multi-label Feature Selection Algorithm Based on ReliefF and Mutual Information [J]. Journal of Guangdong University of Technology, 2018, 35(05): 20-25,50.
[4]	Rao Dong-ning, Huang Si-hong. Model Optimization of Financial Corpus Sentiment Analysis Based on THUCTC [J]. Journal of Guangdong University of Technology, 2018, 35(03): 37-42.
[5]	Zhang Wei, Huang Jian-hua, Liu Dong-ning, Teng Shao-hua, Liu Zi-ting. An Improved Recommendation Method Using Rating and Review Information [J]. Journal of Guangdong University of Technology, 2017, 34(06): 27-31,48.
[6]	Chen Bing-feng, Hao Zhi-feng, Cai Rui-chu, Wen Wen, Wang Li-juan, Huang Hao, Cai Xiao-feng. A Fine-grained Sentiment Analysis Algorithm for Automotive Reviews [J]. Journal of Guangdong University of Technology, 2017, 34(03): 8-14.
[7]	Yang Ji-sheng, Zhang Yun, Li Dong. A Residual Neural Network with Voting for 3D Object Detection in Point Clouds [J]. Journal of Guangdong University of Technology, 2022, 39(01): 56-62.