微信服务号

微信订阅号

2025-4-21- 20
Home > Archive>Volume 33, Issue 4, 2022 >1354-1372. DOI:10.13328/j.cnki.jos.006471
PDF HTML XML Export Cite reminder
Incomplete Multi-view Clustering Algorithm Based on Multi-order Neighborhood Fusion
Author:
Affiliation:

  • Article
    • | |
  • Metrics
    • |
  • Reference [56]
    • |
  • Related
    • | | |
  • Comments
    Abstract:

    In real applications, it is an important field for clustering the multi-view data in data mining. The incompleteness of multi- view caused by missing samples brings great challenge to multi-view clustering task. The shallow graph structure information is easily affected by noise and missing data. Most of the existing multi-view clustering methods are difficult to describe the underlying structure of all views accurately and comprehensively, which reduces the performance of incomplete multi-view clustering. To this end, this study proposes a robust incomplete multi-view clustering algorithm based on the strategies of diffusing and fusing among multi-order neighborhoods. Firstly, the proposed algorithm obtains the potential structural information from incomplete views by utilizing multi-order similarities. Then, the deep structural information of multi-views is nonlinearly fused by the way of cross-view diffusion. Through all above, the much more comprehensive structural information among views can be extracted from the proposed algorithm, thereby reducing the uncertainty of views-structure caused by missing samples. In addition, this paper presents detailed steps to prove the convergence of the proposed algorithm. Experimental results show that the proposed method is more effective in solving the problem of incomplete multi-view clustering than other existing methods.

    Reference
    [1] Xu XM, Li KK, He SF. GDFace: Gated deformation for multi-view face image synthesis. In: Proc. of the 32nd AAAI Conf. on Artificial Intelligence. New York: AAAI, 2020. 12532-12540.
    [2] Fei HL, Li P. Cross-lingual unsupervised sentiment classification with multi-view transfer learning. In: Proc. of the 58th Annual Meeting of the Association for Computational Linguistics. ACL, 2020. 5759-5771.
    [3] Ulrike VL. A tutorial on spectral clustering. Statistics and Computing, 2007, 17(4): 395-416.
    [4] Alex R, Alessandro L. Clustering by fast search and find of density peaks. Science, 2014, 344(6191): 1492-1496.
    [5] Bai L, Liang JY. Sparse subspace clustering with entropy-norm. In: Proc. of the 37th Int’l Conf. on Machine Learning. Vienna, 2020. 561-568.
    [6] Zhao J, Xie XJ, Xu X, et al. Multi-view learning overview: Recent progress and new challenges. Information Fusion, 2017, 38: 43-54.
    [7] Fu LL, Lin PF, Athanasios VV, et al. An overview of recent multi-view clustering. Neurocomputing, 2020, 402: 148-161.
    [8] Yang Y, Wang H. Multi-view clustering: A survey. Big Data Mining and Analytics, 2018, 1(2): 83-107.
    [9] Zhang YP, Zhou J, Deng ZH, et al. Multi-view fuzzy clustering approach based on medoid invariant constraint. Ruan Jian Xue Bao/Journal of Software, 2019, 30(2): 282-301 (in Chinese with English abstract). http://www.jos.org.cn/1000-9825/5625.htm [doi: 10.13328/j.cnki.jos.005625]
    [10] Kumar A, Daume III H. A co-training approach for multi-view spectral clustering. In: Proc. of the 28th Int’l Conf. on Machine Learning. Washington: Omnipress, 2011. 393-400.
    [11] Kumar A, Rai P, Daume III H. Co-regularized multi-view spectral clustering. In: Proc. of the 25th Annual Conf. on Neural Information Processing Systems. 2011. 1413-1421.
    [12] Jiang YZ, Deng ZH, Wang J, et al. Collaborative partition multi-view fuzzy clustering algorithm using entropy weighting. Ruan Jian Xue Bao/Journal of Software, 2014, 25(10): 2293-2311 (in Chinese with English abstract). http://www.jos.org.cn/1000-9825/4510.htm [doi: 10.13328/j.cnki.jos.004510]
    [13] Zhang Y, Kong XW, Wang ZF, et al. Matrix factorization for multi-view clustering. Acta Automatica Sinica, 2018, 44(12): 2160-2169 (in Chinese with English abstract).
    [14] Zhang CQ, Fu HZ, Hu QH, et al. Generalized latent multi-view subspace clustering. IEEE Trans. on Pattern Analysis and Machine Intelligence, 2020, 42(1): 86-99.
    [15] Chen MS, Huang L, Wang CD, et al. Multi-view clustering in latent embedding space. In: Proc. of the 34th AAAI Conf. on Artificial Intelligence. New York: AAAI, 2020. 3513-3520.
    [16] Liu J, Cao FY, Gao XZ, et al. A cluster-weighted kernel K-means method for multi-view clustering. In: Proc. of the 34th AAAI Conf. on Artificial Intelligence. New York: AAAI, 2020. 4860-4867.
    [17] Zhou SH, Liu XW, Liu JY, et al. Multi-view spectral clustering with optimal neighborhood laplacian matrix. In: Proc. of the 34th AAAI Conf. on Artificial Intelligence. New York: AAAI, 2020. 6965-6972.
    [18] Xia DX, Yang Y, Wang H, et al. Late fusion multi-view clustering based on local multi-kernel learning. Journal of Computer Research and Development, 2020, 57(8): 1627-1638 (in Chinese with English abstract).
    [19] Zhou SH, Liu XW, Li MM, et al. Multiple kernel clustering with neighbor-kernel subspace segmentation. IEEE Trans. on Neural Networks and Learning Systems, 2019, 31(4): 1351-1362.
    [20] Tang C, Liu XW, Zhu XZ, et al. CGD: Multi-view clustering via cross-view graph diffusion. In: Proc. of the 34th AAAI Conf. on Artificial Intelligence. New York: AAAI, 2020. 5924-5931.
    [21] Zhan K, Niu CX, Chen CL, et al. Graph structure fusion for multiview clustering. IEEE Trans. on Knowledge and Data Engineering, 2018, 31(10): 1984-1993.
    [22] Wang H, Yang Y, Liu B. GMC: Graph-based multi-view clustering. IEEE Trans. on Knowledge and Data Engineering, 2020, 32(6): 1116-1129.
    [23] Yang X, Zhu ZF, Xu MX, et al. Missing view completion for multi-view data. Ruan Jian Xue Bao/Journal of Software, 2018, 29(4): 945-956 (in Chinese with English abstract). http://www.jos.org.cn/1000-9825/5416.htm[doi: 10.13328/j.cnki.jos.005416]
    [24] Lin YJ, Gou YB, Liu ZT, et al. COMPLETER: Incomplete multi-view clustering via contrastive prediction. In: Proc. of the IEEE/CVF Conf. on Computer Vision and Pattern Recognition. IEEE, 2021. 11174-11183.
    [25] Zhao BY, Zhang CQ, Chen L, et al. Generative model for partial multi-view clustering. Acta Automatica Sinica, 2020, 47(8): 1867-1875 (in Chinese with English abstract). [doi: 10.16383/j.aas.c200121]
    [26] Trivedi A, Rai P, Daumé III H, et al. Multiview clustering with incomplete views. In: Proc. of the 24th Annual Conf. on Neural Information Processing Systems. 2010. 1-7.
    [27] Shao WX, Shi XX, Philip SY. Clustering on multiple incomplete datasets via collective kernel learning. In: Proc. of the 13th Int’l Conf. on Data Mining. Dallas: IEEE, 2013. 1181-1186.
    [28] Shao WX, He LF, Philip SY. Multiple incomplete views clustering via weighted nonnegative matrix factorization with L21 regularization. In: Proc. of the European Conf. on Machine Learning and Knowledge Discovery in Databases. Porto: Springer, 2015. 318-334.
    [29] Zhu XZ, Liu XW, Li MM, et al. Localized incomplete multiple kernel k-means. In: Proc. of the 27th Int’l Joint Conf. on Artificial Intelligence. Stockholm: IJCAI, 2018. 3271-3277.
    [30] Liu XW, Zhu XZ, Li MM, et al. Efficient and effective incomplete multi-view clustering. In: Proc. of the 33rd AAAI Conf. on Artificial Intelligence. Honolulu: AAAI, 2019. 43292-4399.
    [31] Liu XW, Zhu XZ, Li MM, et al. Multiple kernel k-means with incomplete kernels. IEEE Tans. on Pattern Analysis and Machine Intelligence, 2019, 42(5): 1191-1204.
    [32] Liu XW, Zhu XZ, Li MM, et al. Late fusion incomplete multi-view clustering. IEEE Tans. on Pattern Analysis and Machine Intelligence, 2019, 41(10): 2410-2423.
    [33] Li SY, Jiang Y, Zhou ZH. Partial multi-view clustering. In: Proc. of the 28th AAAI Conf. on Artificial Intelligence. Quebec: AAAI, 2014. 1968-1974.
    [34] Xu N, Guo YQ, Zheng X, et al. Partial multi-view subspace clustering. In: Proc. of the ACM Multimedia Conf. on Multimedia Conf. Seoul: ACM, 2018. 1794-1801.
    [35] Zhao HD, Liu HF, Fu Y. Incomplete multi-modal visual data grouping. In: Proc. of the 25th Int’l Joint Conf. on Artificial Intelligence. Stockholm: IJCAI, 2016. 2392-2398.
    [36] Qian B, Shen XB, Gu YY, et al. Double constrained NMF for partial multi-view clustering. In: Proc. of the 6th Int’l Conf. on Digital Image Computing: Techniques and Applications. Gold Coast: IEEE, 2016. 1-7.
    [37] Min C, Cheng MM, Yu J, et al. Partial multi-view clustering via auto-weighting similarity completion. In: Proc. of the 13th Chinese Conf. on Biometric Recognition. Urumqi: Springer, 2018. 214-222.
    [38] Zhou W, Wang H, Yang Y. Consensus graph learning for incomplete multi-view clustering. In: Proc. of the 23rd Pacific-Asia Conf. on Knowledge Discovery and Data Mining. Macau: Springer, 2019. 529-540.
    [39] Guo J, Ye JH. Anchors bring ease: An embarrassingly simple approach to partial multi-view clustering. In: Proc. of the 31st AAAI Conf. on Artificial Intelligence. Hawaii: AAAI, 2019. 118-125.
    [40] Liu Y, Shen CY, Hu QH, et al. Adaptive sample-level graph combination for partial multiview clustering. IEEE Trans. on Image Processing, 2019, 29: 2780-2794.
    [41] Wu J, Zhuge WZ, Tao H, et al. Incomplete multi-view clustering via structured graph learning. In: Proc. of the 15th Pacific Rim Int’l Conf. on Artificial Intelligence. Nanjing: Springer, 2018. 98-112.
    [42] Wen J, Yan K, Zhang Z, et al. Adaptive graph completion based incomplete multi-view clustering. IEEE Trans. on Multimedia, 2020, 23: 2493-2504.
    [43] Wen J, Zhang Z, Zhang Z, et al. Generalized incomplete multiview clustering with flexible locality structure diffusion. IEEE Trans. on Cybernetics, 2020, 51(1): 101-114.
    [44] Wen J, Zhang Z, Zhang Z, et al. Unified tensor framework for incomplete multi-view clustering and missing-view inferring. In: Proc. of the 35th AAAI Conf. on Artificial Intelligence. AAAI, 2021. 10273-10281.
    [45] Wen J, Xu Y, Liu H. Incomplete multi-view spectral clustering with adaptive graph learning. IEEE Trans. on Cybernetics, 2020, 50: 1418-1429.
    [46] Liu JL, Teng SH, Fei LK, et al. Consensus learning approach to incomplete multi-view clustering. Pattern Recognition, 2021, 115: 107890.
    [47] Li LS, Wan ZQ, He HB. Incomplete multi-view clustering with joint partition and graph learning. IEEE Trans. on Knowledge and Data Engineering, 2021. [doi: 10.1109/TKDE.2021.3082470]
    [48] Wang B, Jiang JY, Wang W, et al. Unsupervised metric fusion by cross diffusion. In: Proc. of the IEEE/CVF Conf. on Computer Vision and Pattern Recognition. Providence: IEEE, 2012. 2997-3004.
    [49] Bai S, Bai X, Latecki LJ. Regularized diffusion process for visual retrieval. In: Proc. of the 31st AAAI Conf. on Artificial Intelligence. California: AAAI, 2017. 3967-3973.
    附中文参考文献:
    [9] 张远鹏, 周洁, 邓赵红, 等. 代表点一致性约束的多视角模糊聚类算法. 软件学报, 2019, 30(2): 282-301. http://www.jos.org.cn/1000-9825/5625.htm[doi: 10.13328/j.cnki.jos.005625]
    [12] 蒋亦樟, 邓赵红, 王骏, 等. 熵加权多视角协同划分模糊聚类算法. 软件学报, 2014, 25(10): 2293-2311. http://www.jos.org.cn/1000-9825/4510.htm [doi: 10.13328/j.cnki.jos.004510]
    [13] 张祎, 孔祥维, 王振帆, 等. 基于多视图矩阵分解的聚类分析. 自动化学报, 2018, 44(12): 2160-2169.
    [18] 夏冬雪, 杨燕, 王浩, 等. 基于邻域多核学习的后融合多视图聚类算法. 计算机研究与发展, 2020, 57(8): 1627-1638.
    [23] 杨旭, 朱振峰, 徐美香, 等. 多视角数据缺失补全. 软件学报, 2018, 29(4): 945-956. http://www.jos.org.cn/1000-9825/5416.htm[doi: 10.13328/j.cnki.jos.005416]
    [25] 赵博宇, 张长青, 陈蕾, 等. 生成式不完整多视图数据聚类. 自动化学报, 2020, 47(8): 1867-1875. [doi: 10.16383/j.aas. c200121]
    Related
    Cited by
Get Citation

刘晓琳,白亮,赵兴旺,梁吉业.基于多阶近邻融合的不完整多视图聚类算法.软件学报,2022,33(4):1354-1372

Copy
Share
Article Metrics
  • Abstract:
  • PDF:
  • HTML:
  • Cited by:
History
  • Received:May 19,2021
  • Revised:July 16,2021
  • Online: October 26,2021
  • Published: April 06,2022
Links:Institute of Software, CASChina Computer FederationCASNSFC
You are the first2036764Visitors
Copyright: Institute of Software, Chinese Academy of Sciences Beijing ICP No. 05046678-4
Address：4# South Fourth Street, Zhong Guan Cun, Beijing 100190,Postal Code：100190
Phone：010-62562563 Fax：010-62562533 Email：jos@iscas.ac.cn
Technical Support：Beijing Qinyun Technology Development Co., Ltd.

Beijing Public Network Security No. 11040202500063