Manifold Dimensional Reduction Algorithm Based on Tangent Space Discriminant Learning
Author:
Affiliation:

Fund Project:

National Natural Science Foundation of China (61373055, 61672265); Industry Project of Provincial Departmentof Education of Jiangsu Province (JH10-28); Industry Oriented Project of Jiangsu Provincial Department of Technology (BY2012059)

  • Article
  • | |
  • Metrics
  • |
  • Reference [35]
  • |
  • Related [20]
  • | | |
  • Comments
    Abstract:

    Some good dimensional reduction algorithms based on image set have been developed. The core of these algorithms is performing a geometry-aware dimensionality reduction from the original manifold to a lower-dimensional, more discriminative manifold. Projection Metric Learning is a dimensional reduction algorithm that is based on Grassmann manifold. This algorithm, which is based on projection metric and RCG algorithm, has achieved better results on some benchmark datasets, but for some complicated face datasets, such as YTC, it has just obtained 66.69% classification accuracy. However, RCG algorithm has a poor performance of time efficiency. Based on the above reasons, a dimensional reduction algorithm based on the tangent space discriminant learning is presented. Firstly, perturbation is added to the projection matrix of PML to make it be a SPD matrix. Secondly LEM is adopted to map the element which lies on the SPD manifold to a tangent space, and then the iterative optimization algorithm based on eigen-decomposition is applied to find the discriminant function to obtain the transformation matrix. The experimental results on several standard datasets show the superiority of the proposed algorithm over other state-of-the-art algorithms.

    Reference
    [1] Wold S, Esbensen K, Geladi P. Principal component analysis. Chemometrics and Intelligent Laboratory Systems, 1987,2(1-3):37-52.
    [2] Balakrishnama S, Ganapathiraju A. Linear discriminant analysis-A brief tutorial. In:Proc. of the Institute for Signal and Information Processing. 1998. 18.
    [3] Wright J, Yang AY, Ganesh A, et al. Robust face recognition via sparse representation. IEEE Trans. on Pattern Analysis and Machine Intelligence, 2009,31(2):210-227.
    [4] Shan C, Gong S, McOwan PW. Facial expression recognition based on local binary patterns:A comprehensive study. Image and Vision Computing, 2009,27(6):803-816.
    [5] Wang R, Guo H, Davis LS, et al. Covariance discriminative learning:A natural and efficient approach to image set classification. In:Proc. of the 2012 IEEE Conf. on Computer Vision and Pattern Recognition (CVPR). IEEE, 2012. 2496-2503.
    [6] Shu X, Wu XJ. A novel contour descriptor for 2D shape matching and its application to image retrieval. Image and Vision Computing, 2011,29(4):286-294.
    [7] Roweis ST, Saul LK. Nonlinear dimensionality reduction by locally linear embedding. Science, 2000,290(5500):2323-2326.
    [8] Harandi M, Salzmann M, Hartley R. Dimensionality reduction on SPD manifolds:The emergence of geometry-aware methods. arXiv preprint arXiv:1605.06182, 2016.
    [9] Huang ZW, et al. Projection metric learning on Grassmann manifold with application to video based face recognition. In:Proc. of the IEEE Conf. on Computer Vision and Pattern Recognition. 2015.
    [10] Edelman A, Arias TA, Smith ST. The geometry of algorithms with orthogonality constraints. SIAM Journal on Matrix Analysis and Applications, 1998,20(2):303-353.
    [11] Arandjelovic O, Shakhnarovich G, Fisher J, et al. Face recognition with image sets using manifold density divergence. In:Proc. of the 2005 IEEE Computer Society Conf. on Computer Vision and Pattern Recognition (CVPR 2005). IEEE, 2005. 581-588.
    [12] Beveridge JR, Zhang H, Flynn PJ, et al. The ijcb 2014 pasc video face and person recognition competition. In:Proc. of the 2014 IEEE Int'l Joint Conf. on Biometrics (IJCB). IEEE, 2014. 1-8.
    [13] Wang W, Wang R, Huang Z, et al. Discriminant analysis on Riemannian manifold of Gaussian distributions for face recognition with image sets. In:Proc. of the IEEE Conf. on Computer Vision and Pattern Recognition. 2015. 2048-2057.
    [14] Lee KC, Ho J, Yang MH, et al. Video-Based face recognition using probabilistic appearance manifolds. In:Proc. of the 2003 IEEE Computer Society Conf. on Computer Vision and Pattern Recognition. IEEE, 2003. I-313-I-320.
    [15] HBaudat G, Anouar F. Generalized discriminant analysis using a kernel approach. Neural Computation, 2000,12(10):2385.
    [16] Faraki M, Harandi MT, Porikli F. Image set classification by symmetric positive semi-definite matrices. In:Proc. of the 2016 IEEE Winter Conf. on Applications of Computer Vision (WACV). IEEE, 2016. 1-8.
    [17] Pennec X, Fillard P, Ayache N. A Riemannian framework for tensor computing. Int'l Journal of Computer Vision, 2006,66(1):41-66.
    [18] Yamaguchi O, Fukui K, Maeda K. Face recognition using temporal image sequence. In:Proc. of the '983rd IEEE Int'l Conf. on Automatic Face and Gesture Recognition. IEEE, 1998. 318-323.
    [19] Kim TK, Kittler J, Cipolla R. Discriminative learning and recognition of image set classes using canonical correlations. IEEE Trans. on Pattern Analysis and Machine Intelligence, 2007,29(6):1005-1018.
    [20] Cevikalp H, Triggs B. Face recognition based on image sets. In:Proc. of the 2010 IEEE Conf. on Computer Vision and Pattern Recognition (CVPR). IEEE, 2010. 2567-2573.
    [21] Absil PA, Mahony R, Sepulchre R. Optimization Algorithms on Matrix Manifolds. Princeton University Press, 2009.
    [22] Cetingul HE, Vidal R. Intrinsic mean shift for clustering on Stiefel and Grassmann manifolds. In:Proc. of the IEEE Conf. on Computer Vision and Pattern Recognition (CVPR 2009). IEEE, 2009. 1896-1902.
    [23] Hamm J, Lee DD. Extended grassmann kernels for subspace-based learning. In:Proc. of the Advances in Neural Information Processing Systems. 2009. 601-608.
    [24] Wong YC. Differential geometry of Grassmannmanifolds. Proc. of the National Academy of Sciences of the United States of America, 1967,57(3):589.
    [25] Huang Z, Wang R, Shan S, et al. Log-Euclidean metric learning on symmetric positive definite manifold with application to image set classification. In:Proc. of the 32nd Int'l Conf. on Machine Learning (ICML 2015). 2015. 720-729.
    [26] Cunningham JP, Ghahramani Z. Linear dimensionality reduction:Survey, insights, and generalizations. Journal of Machine Learning Research, 2015,16:2859-2900.
    [27] Arsigny V, Fillard P, Pennec X, et al. Log-Euclidean metrics for fast and simple calculus on diffusion tensors. Magnetic Resonance in Medicine, 2006,56(2):411-421.
    [28] Arsigny V, Fillard P, Pennec X, et al. Geometric means in a novel vector space structure on symmetric positive-definite matrices. SIAM Journal on Matrix Analysis and Applications, 2007,29(1):328-347.
    [29] Uzair M, Mahmood A, Mian A, et al. A compact discriminative representation for efficient image-set classification with application to biometric recognition. In:Proc. of the 2013 Int'l Conf. on Biometrics (ICB). IEEE, 2013. 1-8.
    [30] Cheng SH, Higham NJ, Kenney CS, et al. Approximating the logarithm of a matrix to specified accuracy. SIAM Journal on Matrix Analysis and Applications, 2001,22(4):1112-1125.
    [31] Kokiopoulou E, Chen J, Saad Y. Trace optimization and eigenproblems in dimension reduction methods. Numerical Linear Algebra with Applications, 2011,18(3):565-602.
    [32] Viola P, Jones MJ. Robust real-time face detection. Int'l Journal of Computer Vision, 2004,57(2):137-154.
    [33] Leibe B, Schiele B. Analyzing appearance and contour based methods for object categorization. In:Proc. of the 2003 IEEE Computer Society Conf. on Computer Vision and Pattern Recognition. IEEE, 2003. Ⅱ-409-15.
    [34] Wang R, Shan S, Chen X, et al. Manifold-Manifold distance with application to face recognition based on image set. In:Proc. of the IEEE Conf. on Computer Vision and Pattern Recognition (CVPR 2008). IEEE, 2008. 1-8.
    [35] Hamm J, Lee DD. Grassmann discriminant analysis:A unifying view on subspace-based learning. In:Proc. of the 25th Int'l Conf. on Machine Learning. ACM Press, 2008. 376-383.
    Cited by
    Comments
    Comments
    分享到微博
    Submit
Get Citation

王锐,吴小俊.基于切空间判别学习的流形降维算法.软件学报,2018,29(12):3786-3798

Copy
Share
Article Metrics
  • Abstract:2074
  • PDF: 3857
  • HTML: 1246
  • Cited by: 0
History
  • Received:March 01,2017
  • Revised:May 18,2017
  • Online: December 05,2018
You are the first2044772Visitors
Copyright: Institute of Software, Chinese Academy of Sciences Beijing ICP No. 05046678-4
Address:4# South Fourth Street, Zhong Guan Cun, Beijing 100190,Postal Code:100190
Phone:010-62562563 Fax:010-62562533 Email:jos@iscas.ac.cn
Technical Support:Beijing Qinyun Technology Development Co., Ltd.

Beijing Public Network Security No. 11040202500063