Multi-scale Generative Adversarial Network for Person Re-identification under Occlusion
Author:
Affiliation:

Clc Number:

Fund Project:

National Natural Science Foundation of China (61571379, U1605252, 61872307); Natural Science Foundation of Fujian Province of China (2017J01127, 2018J01576)

  • Article
  • |
  • Figures
  • |
  • Metrics
  • |
  • Reference
  • |
  • Related
  • |
  • Cited by
  • |
  • Materials
  • |
  • Comments
    Abstract:

    Person re-identification (ReID) refers to the task of retrieving a given probe pedestrian image from a large-scale gallery collected by multiple non-overlapping cameras, which belongs to a specific task of image retrieval. With the development of deep learning, the performance of person ReID has been significantly improved. However, in practical applications, person ReID usually suffers from the problem of occlusion (such as background occlusion, pedestrian occlusion). The occluded image not only loses partial target information, but also introduces additional interference, which makes the deep neural network difficult to learn robust feature representations and seriously degrades the performance of person ReID. Recently, generative adversarial network (GAN) has shown the powerful image generation ability on various computer vision tasks. Inspried by GAN, a person ReID method is proposedunder occlusion based on multi-scale GAN. Firstly, the paired occluded images and unoccluded images are usedto train a multi-scale generator and a discriminator. The multi-scale generator can restore the lost information for randomly occluded areas and generate high-quality reconstructed images; while the discriminator can distinguish whether the input image is a real image or a generated image. Then, the trained multi-scale generator is usedto generate the de-occluded images. Adding these de-occluded images to the original training image set can increase the diversity of training samples. Finally, a classification network is trainedbased on the augmented training image set, which effectively improves the generalization capability of the trained model on the testing image set. Experimental results on several challenging person ReID datasets demonstrate the effectiveness of theproposed method.

    Reference
    Related
    Cited by
Get Citation

杨婉香,严严,陈思,张小康,王菡子.基于多尺度生成对抗网络的遮挡行人重识别方法.软件学报,2020,31(7):1943-1958

Copy
Share
Article Metrics
  • Abstract:
  • PDF:
  • HTML:
  • Cited by:
History
  • Received:April 24,2019
  • Revised:July 11,2019
  • Adopted:
  • Online: January 17,2020
  • Published: July 06,2020
You are the firstVisitors
Copyright: Institute of Software, Chinese Academy of Sciences Beijing ICP No. 05046678-4
Address:4# South Fourth Street, Zhong Guan Cun, Beijing 100190,Postal Code:100190
Phone:010-62562563 Fax:010-62562533 Email:jos@iscas.ac.cn
Technical Support:Beijing Qinyun Technology Development Co., Ltd.

Beijing Public Network Security No. 11040202500063