Avatar 1: A Fast 3D Color Full-Body Capture System
Author:
Affiliation:

Fund Project:

National Natural Science Foundation of China (61272334, 61375041); Jiangsu Natural Science Foundation of China Youth Science Fund (BK20150723).

  • Article
  • | |
  • Metrics
  • |
  • Reference [13]
  • |
  • Related [20]
  • | | |
  • Comments
    Abstract:

    This article presents a fast 3D color full-body capture system, named Avatar 1, which can scan a subject in 1.5 seconds and automatically provide the full-body model within 1 minute. It uses eight self-made structure-of-light scanners which are built based on structured lighting technique and have a measuring accuracy of 1mm. The eight scanners are configured to effectively cover the full-body surface of an adult, four scanners are arranged to capture the head, while four target the body. After calibrating the scanners in the offline step, it can capture the real subject and process all partial scanned data in the same coordinate. Through the global registration and seamless texture stitching steps, it robustly reconstructs a high-quality full-body textured model, which has 1mm geometric accuracy and photo-realistic color information. The experiments demonstrate that Avatar 1 achieves state-of-the-art scanning and processing speed under high-quality result requirement.

    Reference
    [1] Robinette K,Dannen H,Paquet E.The CAESAR project:A 3-D surface anthropometry survey.In:Webber B,ed.Proc.of the 2nd Int'l Conf.on 3D Digital Imaging and Modeling.IEEE Computer Society,1999.380-386.[doi:10.1109/IM.1999.805368]
    [2] Bogo F,Romero J,Loper M,Black MJ.FAUST:Dataset and evaluation for 3D mesh registration.In:O'Conner L,ed.Proc.of the IEEE Conf.on Computer Vision and Pattern Recognition.Columbus:IEEE Computer Society,2014.3794-3801.[doi:10.1109/CVPR.2014.491]
    [3] Izadi S,Kim D,Hilliges O,Molyneaux D,Newcombe R,Kohli P,Shotton J,Hodges S,Freeman D,Davison A,Fitzgibbon A.Kinectfusion:Real-Time 3D reconstruction and interaction using a moving depth camera.In:Agrawala M,ed.Proc.of the ACM Symp.on User Interface Software and Technology.New York:ACM,2011.559-568.[doi:10.1145/2047196.2047270]
    [4] Song Z,Chung R,Zhang X.An accurate and robust strip-edge based structured light means for shiny surface micro-measurement in 3D.IEEE Trans.on Industrial Electronics,2013,60(3):1023-1032.[doi:10.1109/TIE.2012.2188875]
    [5] Chen J,Bautembach D,Izadi S.Scalable real-time volumetric surface reconstruction.ACM Trans.on Graphics (SIGGRAPH Issue),2013,32(4):No.113.[doi:10.1145/2461912.2461940]
    [6] Steinbrucker F,Sturm J,Cremers D.Volumetric 3D mapping in real-time on a CPU.In:Hamel W,ed.Proc.of the Int'l Conf.on Robotics and Automation.IEEE Computer Society,2014.2021-2028.[doi:10.1109/ICRA.2014.6907127]
    [7] Newcombe RA,Fox D,Seitz SM.DynamicFusion:Reconstruction and tracking of non-rigid scenes in real-time.In:Grauman K,ed.Proc.of the IEEE Conf.on Computer Vision and Pattern Recognition.Columbus:IEEE Computer Society,2015.343-352.[doi:10.1109/CVPR.2015.7298631]
    [8] Lempitsky VS,Ivanov DV.Seamless mosaicing of image based texture maps.In:Kanade T,ed.Proc.of the IEEE Conf.on Computer Vision and Pattern Recognition.Columbus:IEEE Computer Society,2007.101-106.[doi:10.1109/CVPR.2007.383078]
    [9] Gal R,Wexler Y,Ofek E,Hoppe H,Cohen-Or D.Seamless montage for texturing models.Computer Graphics Forum,2010,29(2):479-486.[doi:10.1111/j.1467-8659.2009.01617.x]
    [10] Boykov Y,Veksler O,Zabih R.Fast approximate energy minimization via graph cuts.IEEE Trans.on Pattern Analysis and Machine Intelligence,2001,23(11):1222-1239.[doi:10.1109/34.969114]
    [11] Chen Y,Dang G,Cheng Z-Q,Xu K.Fast capture of personalized avatar using two kinects.Journal of Manufacturing Systems,2014,33(1):233-240.[doi:10.1016/j.jmsy.2013.11.005]
    [12] Richardt C,Stoll C,Dodgson NA,Seidel H-P,Theobalt C.Coherent spatiotemporal filtering,upsampling and rendering of RGBZ videos.Computer Graphics Forum,2012,31(2):247-256.[doi:10.1111/j.1467-8659.2012.03003.x]
    [13] Perez P,Gangnet M,Blake A.Poisson image editing.ACM Trans.on Graphics,2003,22(3):313-318.[doi:10.1145/882262.882269]
    Cited by
    Comments
    Comments
    分享到微博
    Submit
Get Citation

程志全,陈寅,宋展,吴彤,王进.化身1号:一个快速的三维彩色全身人像捕捉系统.软件学报,2016,27(10):2509-2518

Copy
Share
Article Metrics
  • Abstract:4458
  • PDF: 7123
  • HTML: 2965
  • Cited by: 0
History
  • Received:January 13,2016
  • Revised:March 29,2016
  • Online: August 11,2016
You are the first2036640Visitors
Copyright: Institute of Software, Chinese Academy of Sciences Beijing ICP No. 05046678-4
Address:4# South Fourth Street, Zhong Guan Cun, Beijing 100190,Postal Code:100190
Phone:010-62562563 Fax:010-62562533 Email:jos@iscas.ac.cn
Technical Support:Beijing Qinyun Technology Development Co., Ltd.

Beijing Public Network Security No. 11040202500063