Survey of Non-classical Participating Media Rendering
Author:
Affiliation:

  • Article
  • | |
  • Metrics
  • |
  • Reference [96]
  • | |
  • Cited by
  • | |
  • Comments
    Abstract:

    Participating media are ubiquitous in nature and are also major elements in many rendering applications such as special effects, digital games, and simulation systems. Physically-based simulation and reproduction of their appearance can significantly boost the realism and immersion of 3D virtual scenes. However, both the underlying structures of participating media and the light propagation in them are very complex. Therefore, rendering with participating media is a difficult task and hot topic in computer graphics so far. In order to facilitate the treatment in rendering and lower the computational cost, classical methods for participating media rendering are always based on two assumptions: independent scattering and local continuity. These two assumptions are also the building blocks of classical radiative transfer equation (RTE). However, most participating media in nature do not satisfy these two assumptions. This results in the noticeable discrepancy between rendered images and real images. In recent years, these two assumptions have been relaxed by incorporating more physically accurate methods to model participating media, thus significantly improving the physical realism of participating media rendering. This survey analyzes and discusses existing non-classical participating media rendering techniques from two aspects: correlated media rendering and discrete media rendering. The differences between classical and non-classical participating media rendering are discussed. The principles, advantages, and limitations behind each method are also described. Finally, some future directions are provided around non-classical participating media rendering that are worth delving into. It is hoped that this survey can inspire researchers to study non-classical participating media rendering by addressing some critical issues. It is also hoped that this survey can be a guidance for engineers from industry to improve their renderers by considering non-classical participating media rendering.

    Reference
    [1] Cerezo E, Pérez F, Pueyo X, et al. A survey on participating media rendering techniques. The Visual Computer, 2015, 21(5):303-328.
    [2] Novák J, Georgiev I, Hanika J, et al. Monte Carlo methods for volumetric light transport simulation. In:Hildebrandt K, Theobalt C, eds. Proc. of the Eurographics 2018. 2018, 37, Number 2.
    [3] Wang BB, Fan JH. Survey of rendering methods for homogeneous participating media. Journal of Image and Graphics, 2021, 26(5):961-969(in Chinese with English abstract).
    [4] Fascione L, Hanika J, Heckenberg D, et al. Path tracing in production:Part 1:Modern path tracing. In:Proc. of the ACM SIGGRAPH 2019 Courses (SIGGRAPH 2019). 2019. 19:1-19:113.
    [5] Bauer F. Creating the atmospheric world of red dead redemption 2. In:Proc. of the ACM SIGGRAPH 2019 Course:Advances in Real-Time Rendering in Games. 2019.
    [6] Bowles H, Cutting TR. Multi-resolution water rendering in crest. In:Proc. of the ACM SIGGRAPH 2019 Course:Advances in Real-Time Rendering in Games. 2019.
    [7] Chandrasekhar S. Radiative Transfer. Dover, 1960.
    [8] Henyey LG, Greenstein JL. Diffuse radiation in the galaxy. Astrophysical Journal, 1994, 93:70-83.
    [9] Rayleigh JWSL. On the scattering of light by small particles. Philosophical Magazine, 1871, 64:447-454.
    [10] Lorenz L. Lysbevægelser i og uden for en af plane Lysbølger belyst Kugle. Det Kongelig Danske Videnskabernes Selskabs Skrifter, 1890:2-62.
    [11] Mie G. Beiträge zur optik trüber medien, speziell kolloidaler metallösungen. Annalen der Physik, 1908, 330(3):377-445.
    [12] Joseph JH, Wiscombe WJ, Weinman JA. The delta-Eddington approximation for radiative flux transfer. Journal of the Atmospheric Sciences, 1976, 33:2452-2459.
    [13] Jensen HW, Marschner SR, Levoy M, et al. A practical model for subsurface light transport. In:Proc. of the ACM SIGGRAPH. 2001. 511-518.
    [14] Donner C, Jensen HW. Light diffusion in multi-layered translucent materials. ACM Trans. on Graphics, 2005, 24(3):1032-1039.
    [15] Kajiya JT. The rendering equation. Computer Graphics, 1986. 143-150.
    [16] Tuy HK, Tuy LT. Direct 2-D display of 3-D objects. IEEE Computer Graphics and Applications, 1984, 4(10):29-34.
    [17] Perlin K, Hoffert EM. Hypertexture. Computer Graphics, 1989, 23(2):253-262.
    [18] Raab M, Seibert D, Keller A. Unbiased global illumination with participating media. In:Proc. of the Monte Carlo and Quasi Monte Carlo Methods. 2006. 591-601.
    [19] Woodcock E, Murphy T, Hemmings P, et al. Techniques used in the GEM code for Monte Carlo neutronics calculations in reactors and other systems of complex geometry. Technical Report ANL-7050. Argonne National Laboratory, 1965.
    [20] Galtier M, Blanco S, Caliot C, et al. Integral formulation of null-collision Monte Carlo algorithms. Journal of Quantitative Spectroscopy and Radiative Transfer, 2013, 125:57-68.
    [21] Yue Y, Iwasaki K, Chen B, et al. Unbiased, adaptive stochastic sampling for rendering inhomogeneous participating media. ACM Trans. on Graphics, 2010, 29(6):177:1-177:8.
    [22] Yue Y, Iwasaki K, Chen B, et al. Toward optimal space partitioning for unbiased, adaptive free path sampling of inhomogeneous participating media. Computer Graphics Forum, 2011, 30(7):1911-1919.
    [23] Szirmay-Kalos L, Tóth B, Magdics M. Free path sampling in high resolution inhomogeneous participating media. Computer Graphics Forum, 2011, 30(1):85-97.
    [24] Carter LL, Cashwell ED, Taylor WM. Monte Carlo sampling with continuously varying cross sections along flight paths. Nuclear Science and Engineering, 1972, 48(4):403-411.
    [25] Liu M, Ma Y, Guo X, et al. An improved tracking method for particle transport Monte Carlo simulations. Journal of Computational Physics, 2021:437.
    [26] Rehak JS, Kerby LM, DeHart MD, et al. Weighted delta-tracking in scattering media. Nuclear Engineering and Design, 2019, 342:231-239.
    [27] Morgan LWG, Kotlyar D. Weighted-Delta-Tracking for Monte Carlo particle transport. Annals of Nuclear Energy, 2015, 85:1184-1188.
    [28] Kutz P, Habel R, Li YK, et al. Spectral and decomposition tracking for rendering heterogeneous volumes. ACM Trans. on Graphics, 2017, 36(4).
    [29] Wilkie A, Nawaz S, Droske M, et al. Hero wavelength spectral sampling. Computer Graphics Forum, 2014, 33(4):123-131.
    [30] Novák J, Selle A, Jarosz W. Residual ratio tracking for estimating attenuation in participating media. ACM Trans. on Graphics, 2014, 33(6):179:1-179:11.
    [31] Georgiev I, Misso Z, Hachisuka T, et al. Integral formulations of volumetric transmittance. ACM Trans. on Graphics, 2019, 38(6).
    [32] Jonsson D, Kronander J, Unger J, et al. Direct transmittance estimation in heterogeneous participating media using approximated taylor expansions. IEEE Trans. on Visualization and Computer Graphics, 2020.
    [33] Cramer SN. Application of the fictitious scattering radiation transport model for deep-penetration Monte Carlo calculations. Nuclear Science and Engineering, 1978, 65(2):237-253.
    [34] Kettunen M, d'Eon E, Pantaleoni J, et al. An unbiased ray-marching transmittance estimator. ACM Trans. on Graphics, 2021, 40(4):137.
    [35] Cox DR, Lewis PAW. The Statistical Analysis of Series of Events. Wiley, 1966.
    [36] Jensen HW. Global illumination using photon maps. In:Proc. of the Rendering Techniques'96. 1996. 21-30.
    [37] Jensen HW. Realistic Image Synthesis using Photon Mapping. Publisher:AK Peters, 2001.
    [38] Jensen HW, Christensen PH. Efficient simulation of light transport in scenes with participating media using photon maps. In:Proc. of the SIGGRAPH'98. 1998. 311-320.
    [39] Hachisuka T, Ogaki S, Jensen HW. Progressive photon mapping. In:Proc. of the ACM SIGGRAPH Asia 2008. 2008. 130.
    [40] Hachisuka T, Jensen HW. Stochastic progressive photon mapping. In:Proc. of the ACM SIGGRAPH Asia 2009. 2009. 141.
    [41] Knaus C, Zwicker M. Progressive photon mapping:A probabilistic approach. ACM Trans. on Graphics, 2011, 30(3):25.
    [42] Jarosz W, Zwicker M, Jensen HW. The beam radiance estimate for volumetric photon mapping. Computer Graphics Forum. 2008, 27(2):557-566.
    [43] Jarosz W, Nowrouzezahrai D, Sadeghi I, et al. A comprehensive theory of volumetric radiance estimation using photon points and beams. ACM Trans. on Graphics, 2011, 30(1).
    [44] Jarosz W, Nowrouzezahrai D, Thomas R, et al. Progressive photon beams. ACM Trans. on Graphics (Proc. of the SIGGRAPH Asia), 2011, 30(6).
    [45] Křivánek J, Georgiev I, Hachisuka T, et al. Unifying points, beams, and paths in volumetric light transport simulation. ACM Trans. on Graphics, 2014, 33(4):103:1-103:13.
    [46] Bitterli B, Jarosz W. Beyond points and beams:Higher dimensional photon samples for volumetric light transport. ACM Trans. on Graphics, 2017, 36(4):1-12.
    [47] Deng X, Jiao S, Bitterli B, et al. Photon surfaces for robust, unbiased volumetric density estimation. ACM Trans. on Graphics, 2019, 38(4):46:1-46:12.
    [48] Cahalan RF, Snider JB. Marine stratocumulus structure during FIRE. Remote Sens Environ, 1989, 28:95-107.
    [49] Davis AB, Marshak A, Wiscombe WJ, et al. Scale-invariance of liquid water distributions in marine stratocumulus, Part 1-Spectral properties and stationarity issues. Journal of the Atmospheric Sciences, 1996, 53:11538-11558.
    [50] Marshak A, Davis AB, Wiscombe WJ, et al. Scale invariance in liquid water distributions in marine stratocumulus. Part II:Multifractal properties and intermittency issues. Journal of the Atmospheric Sciences, 1997, 54:1423-1444.
    [51] Pfeilsticker K, Erle F, Funk O, et al. First geometrical pathlengths probability density function derivation of the skylight from spectroscopically highly resolving oxygen A-band observations:1. Measurement technique, atmospheric observations and model calculations. Journal of Geophysical Research, 1998, 103(D10):11483-11504.
    [52] Davis AB, Marshak A. Photon propagation in heterogeneous optical media with spatial correlations:Enhanced mean-free-paths and wider-than-exponential free-path distributions. Journal of Quantitative Spectroscopy and Radiative Transfer, 2004, 84(1):3-34.
    [53] Levermore CD, Pomraning GC, Sanzo DL, et al. Linear transport theory in a random medium. Journal of Mathematical Physics, 1986, 27(10).
    [54] Larsen EW, Vasques R. A generalized linear Boltzmann equation for non-classical particle transport. Journal of Quantitative Spectroscopy and Radiative Transfer, 2011, 112(4).
    [55] Vasques R, Larsen EW. Non-classical particle transport with angular-dependent path-length distributions. I:Theory. Annals of Nuclear Energy, 2014, 70:292-300.
    [56] Camminady T, Frank M, Larsen EW. Nonclassical particle transport in heterogeneous materials. In:Proc. of the Int'l Conf. on Mathematics & Computational Methods Applied to Nuclear Science & Engineering. 2017.
    [57] Loussot T, Harba R, Jacquet G, et al, An oriented fractal analysis for the characterization of texture:Application to bone radiographs. EUSIPCO Signal Process, 1996, 1:371-374.
    [58] Perrin E, Harba R, Berzin-Joseph C, et al. Nth-order fractional Brownian motion and fractional Gaussian noises. IEEE Trans. on Signal Processing, 2001, 49(5):1049-1059.
    [59] Kostinski AB. On the extinction of radiation by a homogeneous but spatially correlated random medium. Journal of the Optical Society of America A, 2001, 18(8):1929-1933.
    [60] Limpert E, Stahel WA, Abbt M. Log-normal distributions across the science:Keys and clues. BioScience, 2001, 51:341-351.
    [61] Moon JT, Walter B, Marschner SR. Rendering discrete random media using precomputed scattering solutions. In:Proc. of the 18th Eurographics Conf. on Rendering Techniques (EGSR 2007). 2007. 231-242.
    [62] Meng J, Papas M, Habel R, et al. Multi-scale modeling and rendering of granular materials. ACM Trans. on Graphics, 2015, 34(4):49:1-49:13.
    [63] Müller T, Papas M, Gross M, et al. Efficient rendering of heterogeneous polydisperse granular media. ACM Trans. on Graphics, 2016, 35(6):168:1-168:14.
    [64] Mishchenko MI. 125 years of radiative transfer:Enduring triumphs and persisting misconceptions. In:Proc. of the AIP Conf., Vol.1531. 2013. 11.
    [65] Jakob W, Arbree A, Moon JT, et al. A radiative transfer framework for rendering materials with anisotropic structure. ACM Trans. on Graphics, 2010, 29(4).
    [66] Heitz E, Dupuy J, Crassin C, et al. The SGGX microflake distribution. ACM Trans. on Graphics, 2015, 34(4):48:1-48:11.
    [67] Dupuy J, Heitz E, d'Eon E. Additional progress towards the unification of microfacet and microflake theories. In:Proc. of the Eurographics Symp. on Rendering:Experimental Ideas & Implementations (EGSR 2016). 2016. 55-63.
    [68] Vasques R, Larsen EW. Non-classical transport with angular-dependent path-length distributions. 1:Theory. arXiv:1309.4817, 2013.
    [69] Vasques R, Larsen EW. Non-classical transport with angular-dependent path-length distributions. 2:Application to pebble bed reactor cores. arXiv:1310.1848, 2013.
    [70] Rukolaine SA. Generalized linear Boltzmann equation, describing non-classical particle transport, and related asymptotic solutions for small mean free paths. Physica A:Statistical Mechanics and its Applications, 2016, 450:205-216.
    [71] Larsen EW, Frank M, Camminady T. The equivalence of forward and backward nonclassical particle transport theories. In:Proc. of the M&C 2017. 2017.
    [72] d'Eon E. A reciprocal formulation of non-exponential radiative transfer. 1:Sketch and motivation. arXiv:1803.03259, 2018. https://arxiv.org/abs/1803.03259
    [73] d'Eon E. A reciprocal formulation of non-exponential radiative transfer. 2:Monte Carlo estimation and diffusion approximation. arXiv:1809.05881, 2018. https://arxiv.org/abs/1809.05881
    [74] Jarabo A, Aliaga C, Gutierrez D. A radiative transfer framework for spatially-correlated materials. ACM Trans. on Graphics, 2018, 37(4):83:1-83:13.
    [75] Frank M, Goudon T. On a generalized Boltzmann equation for non-classical particle transport. Kinetic and Related Models, 2010.
    [76] Davis AB, Marshak A, Gerber H, et al. Horizontal structure of marine boundary layer clouds from centimeter to kilometer scales. Journal of Geophysical Research:Atmospheres, 1999, 104(D6).
    [77] Bitterli BM, Ravichandran S, Müller T, et al. A radiative transfer framework for non-exponential media. ACM Trans. on Graphics, 2018.
    [78] Bal G, Jing W. Fluctuation theory for radiative transfer in random media. Journal of Quantitative Spectroscopy and Radiative Transfer, 2011, 112(4):660-670.
    [79] Guo J, Chen Y, Hu B, et al. Fractional Gaussian fields for modeling and rendering of spatially-correlated media. ACM Trans. on Graphics, 2019, 38(4):45.
    [80] Lodhia A, Sheffield S, Sun X, et al. Fractional Gaussian fields:A survey. Probability Surveys, 2016, 13:1-56.
    [81] Guo Y, Jarabo A, Zhao S. Beyond mie theory:Systematic computation of bulk scattering parameters based on microphysical wave optics. ACM Trans. on Graphics, 2021, 40(6):285.
    [82] Frisvad JR, Christensen NJ, Jensen HW. Computing the scattering properties of participating media using Lorenz-Mie theory. In:Proc. of the ACM SIGGRAPH 2007. 2007. Article 60.
    [83] Guo J, Hu B, Chen Y, et al. Rendering discrete participating media with geometrical optics approximation. Computational Visual Media, 2022, 8(3):425-444.
    [84] Glantschnig WJ, Chen SH. Light scattering from water droplets in the geometrical optics approximation. Applied Optics, 1981, 20(4):2499-2509.
    [85] Ungut A, Grehan G, Gouesbet G. Comparisons between geometrical optics and Lorenz-Mie theory. Applied Optics, 1981, 20(17):2911-2918.
    [86] Kallweit S, Müller T, Mcwilliams B, et al. Deep scattering:Rendering atmospheric clouds with radiance-predicting neural networks. ACM Trans. on Graphics, 2017, 36(6):231.
    [87] Ge LS, Wang BB, Wang L, et al. Interactive simulation of scattering effects in participating media using a neural network model. IEEE Trans. on Visualization and Computer Graphics, 2021, 27(7):3123-3134.
    [88] Vicini D, Koltun V, Jakob W. A learned shape-adaptive subsurface scattering model. ACM Trans. on Graphics, 2019, 38(4):127.
    [89] Tewari A, Fried O, Thies J, et al. State of the art on neural rendering. Computer Graphics Forum, 2020, 39(2):701-727.
    [90] Zhao YZ, Wang L, Xu YN, et al. State-of-the-art survey on photorealistic rendering of 3D sences based on machine learning. Ruan Jian Xue Bao/Journal of Software, 2022, 33(1):356-376(in Chinese with English abstract). http://www.jos.org.cn/1000-9825/6334.htm[doi:10.13328/j.cnki.jos.006334]
    [91] Guo J, Li M, Zong Z, et al. Volumetric appearance stylization with stylizing kernel prediction network. ACM Trans. on Graphics, 2021, 40(4), Article 162.
    [92] Müller T, Rousselle F, Novák J, et al. Real-time neural radiance caching for path tracing. ACM Trans. on Graphics, 2021, 40(4), Article 36.
    [93] Xu Z, Sun Q, Wang L, et al. Unsupervised image reconstruction for gradient-domain volumetric rendering. Computer Graphics Forum, 202, 39:193-203.
    附中文参考文献
    [3] 王贝贝, 樊家辉. 均匀参与介质的渲染方法研究. 中国图像图形学报, 2021, 26(5):961-969.
    [90] 赵烨梓, 王璐, 徐延宁, 等. 基于机器学习的三维场景高度真实感绘制方法综述. 软件学报, 2022, 33(1):356-376. http:// www.jos.org.cn/1000-9825/6334.htm[doi:10.13328/j.cnki.jos.006334]
    Related
    Cited by
    Comments
    Comments
    分享到微博
    Submit
Get Citation

过洁,潘金贵,郭延文.非经典参与介质的渲染方法研究综述.软件学报,2023,34(4):1944-1961

Copy
Share
Article Metrics
  • Abstract:1007
  • PDF: 4371
  • HTML: 2977
  • Cited by: 0
History
  • Received:March 04,2022
  • Revised:June 08,2022
  • Online: July 22,2022
  • Published: April 06,2023
You are the first2033290Visitors
Copyright: Institute of Software, Chinese Academy of Sciences Beijing ICP No. 05046678-4
Address:4# South Fourth Street, Zhong Guan Cun, Beijing 100190,Postal Code:100190
Phone:010-62562563 Fax:010-62562533 Email:jos@iscas.ac.cn
Technical Support:Beijing Qinyun Technology Development Co., Ltd.

Beijing Public Network Security No. 11040202500063