Fuzzy Classification Method for Small- and Medium-scale Datasets
Author:
Affiliation:

Clc Number:

TP18

Fund Project:

National Natural Science Foundation of China (61772239, 61702225, 61572236, 61711540041)

  • Article
  • | |
  • Metrics
  • |
  • Reference [52]
  • |
  • Related [20]
  • | | |
  • Comments
    Abstract:

    Although Takagi-Sugeno-Kang (TSK) is widely used in practically every profession, how to enhance its classification accuracy and interpretability is still a research focus. In this study, a deep TSK fuzzy classifier is proposed. This classifier (i.e., RCC-DTSK-C) can randomly select features and combine features and own triplely concise interpretability for fuzzy rules. There are several other varieties of RCC-DTSK-C such as reasonable structure for rule representation, namely, (1) the proposed RCC-DTSK-C consists of many base-training units and each base-training unit can be trained independently. According to the principle of stacked generalization, the input of the next base-training unit consists of the training set and random result obtained from random projections about prediction results of current base-training unit. (2) In RCC-DTSK-C, the hidden layer of each base-training unit is represented by triplely concise interpretable fuzzy rules which are in the sense of randomly selected features. These features are selected by dividing into the not-fixed several fuzzy partitions and randomly combining rules and keeping the same input space in every base-training unit. (3) The source data set is mapped into each of the independent base-training units as the same input space, which effectively ensures that all the features of the source data are preserved in each separate training unit. The extensive experimental results show RCC-DTSK-C can achieve the enhanced classification performance and triplely concise interpretability for fuzzy rules.

    Reference
    [1] Deng ZH, Choi KS, Chung FL, et al. Scalable TSK fuzzy modeling for very large datasets using minimal-enclosing-ball approximation. IEEE Trans. on Fuzzy Systems, 2011,19(2):210-226.
    [2] Jiang YZ, Deng ZH, Wang ST. 0 order L2 norm Takagi Sugeno Kang type transfer learning fuzzy system. Acta Electronica Sinica, 2013,41(5):897-904(in Chinese with English abstract).
    [3] Jiang YZ, Chung FL, Ishibuchi H, et al. Multitask TSK fuzzy system modeling by mining intertask common hidden structure. IEEE Trans. on Cybernetics, 2015,45(3):548-561.
    [4] Fadali S, Jafarzadeh S. TSK observers for discrete type-1 and type-2 fuzzy systems. IEEE Trans. on Fuzzy Systems, 2014,22(2):451-458.
    [5] Jiang YZ, Chung FL, Ishibuchi H, Deng ZH, Wang ST. Multitask TSK fuzzy system modeling by mining intertask common hidden structure. IEEE Trans. on Cybernetics, 2015,45(3):534-547.
    [6] Mitrakis NE, Theocharis JB. A diversity-driven structure learning algorithm for building hierarchical neuro-fuzzy classifiers. Information Sciences, 2012,186(1):40-58.
    [7] Chen Y, Wang DZ, Tong SC. Forecasting studies by designing Mamdani interval type-2 fuzzy logic systems:With the combination of BP algorithms and KM algorithms. Neurocomputing, 2016,174(22):1133-1146.
    [8] Zhou SM, Gan JQ. Constructing L2-SVM-based fuzzy classifiers in high-dimensional space with automatic model selection and fuzzy rule ranking. IEEE Trans. on Fuzzy Systems, 2007,15(3):398-409.
    [9] Chung FL, Duan JC. On multistage fuzzy neural network modeling. IEEE Trans. on Fuzzy Systems, 2000,8(2):25-142.
    [10] Mantas CJ, Puche JM. Artificial neural networks are zero-order TSK fuzzy systems. IEEE Trans. on Fuzzy Systems, 2008,16(3):630-643.
    [11] Alcala-Fdez J, Alcala R, Gonzalez S, Nojima Y, Garcia S. Evolutionary fuzzy rule-based methods for monotonic classification. IEEE Trans. on Fuzzy Systems, 2017,25(6):1376-1390.
    [12] Li T, Wang ST. Zero-order TSK fuzzy classifier based on LLM for large-scale data sets. Control and Decision, 2017,32(1):21-30(in Chinese with English abstract).
    [13] Ye SZ, Zhang B, Wu MR, Zheng WB. A fuzzy classifier based on the constructive covering approach in neural networks. Ruan Jian Xue Bao/Journal of Software, 2003,14(3):429-434(in Chinese with English abstract). http://www.jos.org.cn/1000-9825/14/429.htm
    [14] Xu ML, Wang ST. Extracting fuzzy rules from the maximum ball containing the homogeneous data. Journal of Electronics & Information Technology, 2017,39(5):1130-1135(in Chinese with English abstract).
    [15] Zhai JH, Wang XZ, Zhang SF. Ensemble incomplete wavelet packet subspaces for face recognition based on fuzzy integral. Pattern Recognition and Artificial Intelligence, 2014,27(9):794-801(in Chinese with English abstract).
    [16] Wang ST, Jiang YZ, Chung FL, Qian PJ. Feedforward kernel neural networks, generalized least learning machine, and its deep learning with application to image classification. Applied Soft Computing, 2015,37:125-141.
    [17] Bell IE, Baranoski GVG. Reducing the dimensionality of plant spectral databases. IEEE Trans. on Genscience and Remote Sensing, 2004,42(3):570-576.
    [18] Papa JP, Rosa GH, Pereira DR, Yang XS. Quaternion-based deep belief networks fine-tuning. Applied Soft Computing, 2017,60:328-335.
    [19] Li F, Zhang J, Shang C, Huang DX, Oko E, Wang MH. Modelling of a post-combustion CO2 capture process using deep belief network. Applied Thermal Engineering, 2018,130:997-1003.
    [20] Chen CLP, Zhang CY, Chen L, Gan M. Fuzzy restricted Boltzmann machine for the enhancement of deep learning. IEEE Trans. on Fuzzy Systems, 2015,23(6):2163-2173.
    [21] Long MS, Wang JM, Cao Y, Sun JG, Yu PS. Deep learning of transferable representation for scalable domain adaptation. IEEE Trans. on Knowledge and Data Engineering, 2016,28(8):2027-2040.
    [22] Wu ZD, Wang YN, Zhang JW. Fouling and damaged fingerprint recognition based on deep learning. Journal of Electronics & Information Technology, 2017,39(7):1585-1591(in Chinese with English abstract).[doi:10.11999/JEIT161121]
    [23] Liu Q, Zhai JW, Zhong S, Zhang ZC, Zhou Q, Zhang P. A deep recurrent q-network based on visual attention mechanism. Journal of Computers, 2017,40(6):1353-1366(in Chinese with English abstract).
    [24] Gao JY, Yang XS, Zhang TZ, Xu CS. Robust visual tracking method via deep learning. Chinese Journal of Computers, 2016,39(7):1419-1434(in Chinese with English abstract).
    [25] Li HY, Bi DY, Yang Y, Zha YF. Research on visual tracking algorithm based on deep feature expression and learning. Journal of Electronics & Information Technology, 2015,37(9):2033-2039(in Chinese with English abstract).
    [26] He YY, Li BQ. A combination form learning rate scheduling for deep learning model. Acta Electronica Sinica, 2016,42(6):953-958(in Chinese with English abstract).
    [27] Sun R, Zhang GH, Gao J. Pedestrian recognition method based on depth hierarchical feature representation. Journal of Electronics & Information Technology, 2016,38(6):1528-1535(in Chinese with English abstract).
    [28] Anifowose F, Labadin J, Abdulraheem A. Improving the prediction of petroleum reservoir characterztion with a stacked generazation ensemble model of support vector machines. Applied Soft Computing, 2015,26:483-496.
    [29] Juang CF, Chen TC, Cheng WY. Speedup of implementing fuzzy neural networks with high-dimensional inputs through parallel processing on graphic processing units. IEEE Trans. on Fuzzy Systems, 2011,19(4):717-728.
    [30] Yuan YF, Zhuang HJ. A genetic algorithm for generating fuzzy classification rules. Fuzzy Sets and Systems, 1996,84:1-19.
    [31] Leski J. TSK-Fuzzy modeling based on ε-insensitive learning. IEEE Trans. on Fuzzy Systems, 2005,13(2):181-193.
    [32] Lin YY, Chang JY, Lin CT. A TSK-type-based self-evolving compensatory interval type-2 fuzzy neural network and its applications. IEEE Trans. on Industrial Electronics, 2014,6(1):447-459.
    [33] Deng ZH, Cao LB, Jiang YZ, Wang ST. Minimax probability TSK fuzzy system classifier:A more transparent and highly interpretable classification model. IEEE Trans. on Fuzzy Systems, 2015,23(4):813-826.
    [34] Zheng YJ, Ling HF, Chen SY, Xue JY. A hybrid neuro-fuzzy network based on differential biogeography-based optimization for online population classification in earthquakes. IEEE Trans. on Fuzzy Systems, 2014,23(4):1070-1083.
    [35] Guenounou O, Dahhou B, Chabour F. TSK fuzzy model with minimal parameters. Applied Soft Computing, 2015,30(2):748-757.
    [36] Bortolan G, Brohet C, Fusaro S. Possibilities of using neural networks for ECG classfication. Journal of Electrocardiology, 1995,29:10-16.
    [37] Valdes JJ. Extreme learning machines with heterogeneous data types. Neurocomputing, 2018,280:38-52.
    [38] 1987. https://archive.ics.uci.edu/ml/datasets.html
    [39] 2009. http://stat-computing.org/dataexpo/2009/
    [40] Li T, Li J, Liu ZL, Li P, Jia CF. Differentially private Naïve Bayes learning over multiple data sources. Information Sciences, 2018, 444:89-104.
    附中文参考文献:
    [2] 蒋亦樟,邓赵红,王士同.0阶L2型TSK迁移学习模糊系统.电子学报,2013,41(5):897-904.
    [12] 李滔,王士同.适合大规模数据集且基于LLM的0阶TSK模糊分类器.控制与决策,2017,32(1):21-30.
    [13] 叶少珍,张钹,吴鸣锐,郑文波.一种基于神经网络覆盖构造法的模糊分类器.软件学报,2003,14(3):429-434. http://www.jos.org.cn/1000-9825/14/429.htm
    [14] 徐明亮,王士同.由最大同类球提取模糊分类规则.电子与信息学报,2017,39(5):1130-1135.
    [15] 翟俊海,王熙照,张素芳.基于模糊积分的不完全小波包子空间集成人脸识别.模式识别与人工智能,2014,27(9):794-801.
    [22] 吴震东,王雅妮,章坚武.基于深度学习的污损指纹识别研究.电子与信息学报,2017,39(7):1585-1591.[doi:10.11999/JEIT161121]
    [23] 刘全,翟建伟,钟珊,章宗长,周倩,章鹏.一种基于视觉注意力机制的深度循环Q网络模型.计算机学报,2017,40(6):1353-1366.
    [24] 高君宇,杨小汕,张天柱,徐常胜.基于深度学习的鲁棒性视觉跟踪方法.计算机学报,2016,39(7):1419-1434.
    [25] 李寰宇,毕笃彦,杨源,查宇飞.基于深度特征表达与学习的视觉跟踪算法研究.电子与信息学报,2015,37(9):2033-2039.
    [26] 贺昱曜,李宝奇.一种组合型的深度学习模型学习率策略.自动化学报,2016,42(6):953-958.
    [27] 孙锐,张广海,高隽.基于深度分层特征表示的行人识别方法.电子与信息学报,2016,38(6):1528-1535.
    Cited by
    Comments
    Comments
    分享到微博
    Submit
Get Citation

周塔,邓赵红,蒋亦樟,王士同.一种面向中小规模数据集的模糊分类方法.软件学报,2019,30(12):3637-3650

Copy
Share
Article Metrics
  • Abstract:2486
  • PDF: 4545
  • HTML: 1899
  • Cited by: 0
History
  • Received:September 17,2017
  • Revised:April 16,2018
  • Online: January 23,2019
You are the first2032480Visitors
Copyright: Institute of Software, Chinese Academy of Sciences Beijing ICP No. 05046678-4
Address:4# South Fourth Street, Zhong Guan Cun, Beijing 100190,Postal Code:100190
Phone:010-62562563 Fax:010-62562533 Email:jos@iscas.ac.cn
Technical Support:Beijing Qinyun Technology Development Co., Ltd.

Beijing Public Network Security No. 11040202500063