Journal of Guangdong University of Technology ›› 2018, Vol. 35 ›› Issue (06): 77-82.doi: 10.12052/gdutxb.180053

Previous Articles     Next Articles

A Research on Local Outlier Factor De-noising Method for Kernel Fuzzy Spectral Clustering

Zhang Wei, Mai Zhi-shen   

  1. School of Computers, Guangdong University of Technology, Guangzhou 510006, China
  • Received:2018-03-22 Online:2018-11-23 Published:2018-11-23

Abstract: To deal with noise reduction of kernel fuzzy spectral clustering for obtaining a better cluster capability, a new spectral clustering based on local outlier factor was presented. With the proposed method the distribution features of outliers were analyzed. Based on the analysis result, the cluster center candidate object was proposed by using local filter factor algorithm. And then a process was constructed to filter the noise data and highlighted normal data's influence in the clustering center adjustment. Secondly, the local filter factor was presented by using local outlier factor between two arbitrary objects. Then the local filter factor was used as weighting factor to improve the similarity measure of kernel fuzzy spectral clustering. The improved similarity measure made weight between normal data and normal data became bigger and weight between normal data and noise data smaller. Therefore, the improved kernel fuzzy spectral clustering can reduce greatly the sensitivity of outliers. The validity experiment and stability experiment results show the proposed method has better clustering accuracy and robustness.

Key words: spectral clustering, kernel fuzzy spectral clustering, cluster center candidate object, local filter factor

CLC Number: 

  • TP391
[1] SHAH M, NAIR S. A survey of data mining clustering algorithms[J]. International Journal of Computer Applications, 2015, 128(1):1-5
[2] NG A Y, JORDAN M I, WEISS Y. On spectral clustering:Analysis and an algorithm[C]//14th International Conference on Neural Information Processing Systems:Natural and Synthetic. Vancouver:MIT Press, 2002:849-856.
[3] VONLUXBURG U. A tutorial on spectral clustering[J]. Statistics and Computing, 2007, 17(4):395-416
[4] 滕少华, 吴昊, 李日贵, 等. 可调多趟聚类挖掘在电信数据分析中的应用[J]. 广东工业大学学报, 2014, 31(3):1-7 TENG S H, WU H, LI R G, et al. The application of the adjustable multi-times clustering algorithm in telecom data[J]. Journal of Guangdong University of Technology, 2014, 31(3):1-7
[5] HAN J, PEI J, KAMBER M. Data mining:concepts and techniques[M].[S.l.]:Elsevier, 2011.
[6] 张巍, 黄健华, 刘冬宁, 等. 一种改进的结合评分和评论信息的推荐方法[J]. 广东工业大学学报, 2017, 34(6):27-31 ZHANG W, HUANG J H, LIU D N, et al. An improved recommendation method using rating and review information[J]. Journal of Guangdong University of Technology, 2017, 34(6):27-31
[7] YANG Y, WANG Y, CHEUNG Y. Kernel fuzzy similarity measure-based spectral clustering for image segmentation[C]//International Conference on Human-Computer Interaction. Berlin, Heidelberg:Springer, 2013:246-253.
[8] ZHAO F, LIU H, JIAO L. Spectral clustering with fuzzy similarity measure[J]. Digital Signal Processing, 2011, 21(6):701-709
[9] LI Q, REN Y, LI L, et al. Fuzzy based affinity learning for spectral clustering[J]. Pattern Recognition, 2016, 60:531-542
[10] BREUNIG M M, KRIEGEL H P, NG R T, et al. LOF:identifying density-based local outliers[C]//ACM SIGMOD International Conference on Management of Data. Dallas:ACM, 2000, 29(2):93-104.
[11] CHEN W Y, SONG Y, BAI H, et al. Parallel spectral clustering in distributed systems[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2011, 33(3):568-586
[12] GOYAL S, KUMAR S, ZAVERI M A, et al. Fuzzy similarity measure based spectral clustering framework for noisy image segmentation[J]. International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems, 2017, 25(4):649-673
[13] AKOGLU L, TONG H, KOUTRA D. Graph based anomaly detection and description:a survey[J]. Data Mining and Knowledge Discovery, 2015, 29(3):626-688
[14] CELEBI M E, KINGRAVI H A, VELA P A. A comparative study of efficient initialization methods for the k-means clustering algorithm[J]. Expert Systems with Applications, 2013, 40(1):200-210
[15] MEILA M, SHI J. Learning segmentation by random walks[C]//Advances in Neural Information Processing Systems. Cambridge:MIT Press, 2001:873-879.
[16] WU M, SCHOLKOPF B. A local learning approach for clustering[C]//Advances in Neural Information Processing Systems. Cambridge:MIT Press, 2007:1529-1536.
[1] Xie Guo-bo, Lin Li, Lin Zhi-yi, He Di-xuan, Wen Gang. An Insulator Burst Defect Detection Method Based on YOLOv4-MP [J]. Journal of Guangdong University of Technology, 2023, 40(02): 15-21.
[2] Chen Jing-yu, Lyu Yi. Frost Detection Method of Cold Chain Refrigerating Machine Based on Spiking Neural Network [J]. Journal of Guangdong University of Technology, 2023, 40(01): 29-38.
[3] Ye Wen-quan, Li Si, Ling Jie. Sparse-view SPECT Image Reconstruction Based on Multilevel-residual U-Net [J]. Journal of Guangdong University of Technology, 2023, 40(01): 61-67.
[4] Zou Heng, Gao Jun-li, Zhang Shu-wen, Song Hai-tao. Design and Implementation of a Dropping Guidance Device for Go Robot [J]. Journal of Guangdong University of Technology, 2023, 40(01): 77-82,91.
[5] Xie Guang-qiang, Xu Hao-ran, Li Yang, Chen Guang-fu. Consensus Opinion Enhancement in Social Network with Multi-agent Reinforcement Learning [J]. Journal of Guangdong University of Technology, 2022, 39(06): 36-43.
[6] Liu Xin-hong, Su Cheng-yue, Chen Jing, Xu Sheng, Luo Wen-jun, Li Yi-hong, Liu Ba. Real Time Detection of High Resolution Bridge Crack Image [J]. Journal of Guangdong University of Technology, 2022, 39(06): 73-79.
[7] Xiong Wu, Liu Yi. Application of Particle Filter Algorithm in Static Deformation Monitoring of BDS High-Speed Rail [J]. Journal of Guangdong University of Technology, 2022, 39(04): 66-72.
[8] Yi Min-qi, Liu Hong-wei, Gao Hong-ming. Research on the Factors Influencing the Co-purchase Network of Products on E-commerce Platforms [J]. Journal of Guangdong University of Technology, 2022, 39(03): 16-24.
[9] Qiu Zhan-chun, Fei Lun-ke, Teng Shao-hua, Zhang Wei. Palmprint Recognition Based on Cosine Similarity [J]. Journal of Guangdong University of Technology, 2022, 39(03): 55-62.
[10] Zheng Jia-bi, Yang Zhen-guo, Liu Wen-yin. Marketing-Effect Estimation Based on Fine-grained Confounder Balancing [J]. Journal of Guangdong University of Technology, 2022, 39(02): 55-61.
[11] Gary Yen, Li Bo, Xie Sheng-li. An Evolutionary Optimization of LSTM for Model Recovery of Geophysical Fluid Dynamics [J]. Journal of Guangdong University of Technology, 2021, 38(06): 1-8.
[12] Li Guang-cheng, Zhao Qing-lin, Xie Kan. A Design of Decentralized Data Processing Scheme [J]. Journal of Guangdong University of Technology, 2021, 38(06): 77-83.
[13] Xie Guang-qiang, Zhao Jun-wei, Li Yang, Xu Hao-ran. Cooperative Lane-changing Based on Multi-cluster System [J]. Journal of Guangdong University of Technology, 2021, 38(05): 1-9.
[14] Zhang Wei, Zhang Zhen-bin. Joint Graph Embedding and Feature Weighting for Unsupervised Feature Selection [J]. Journal of Guangdong University of Technology, 2021, 38(05): 16-23.
[15] Deng Jie-hang, Yuan Zhong-ming, Lin Hao-run, Gu Guo-sheng. Superpixel and Visual Saliency Synergetic Image Quality Assessment [J]. Journal of Guangdong University of Technology, 2021, 38(05): 33-39.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!