AI Chat Paper
Note: Please note that the following content is generated by AMiner AI. SciOpen does not take any responsibility related to this content.
{{lang === 'zh_CN' ? '文章概述' : 'Summary'}}
{{lang === 'en_US' ? '中' : 'Eng'}}
Chat more with AI
Article Link
Collect
Submit Manuscript
Show Outline
Outline
Show full outline
Hide outline
Outline
Show full outline
Hide outline
Regular Paper

Denoising Stochastic Progressive Photon Mapping Renderings Using a Multi-Residual Network

School of Software, Shandong University, Jinan 250101, China
School of Computer Science and Engineering, Nanjing University of Science and Technology, Nanjing 210094, China
School of Information Science and Engineering, Shandong Normal University, Jinan 250358, China
Show Author Information

Abstract

Stochastic progressive photon mapping (SPPM) is one of the important global illumination methods in computer graphics. It can simulate caustics and specular-diffuse-specular lighting effects efficiently. However, as a biased method, it always suffers from both bias and variance with limited iterations, and the bias and the variance bring multi-scale noises into SPPM renderings. Recent learning-based methods have shown great advantages on denoising unbiased Monte Carlo (MC) methods, but have not been leveraged for biased ones. In this paper, we present the first learning-based method specially designed for denoising-biased SPPM renderings. Firstly, to avoid conflicting denoising constraints, the radiance of final images is decomposed into two components: caustic and global. These two components are then denoised separately via a two-network framework. In each network, we employ a novel multi-residual block with two sizes of filters, which significantly improves the model’s capabilities, and makes it more suitable for multi-scale noises on both low-frequency and high-frequency areas. We also present a series of photon-related auxiliary features, to better handle noises while preserving illumination details, especially caustics. Compared with other state-of-the-art learning-based denoising methods that we apply to this problem, our method shows a higher denoising quality, which could efficiently denoise multi-scale noises while keeping sharp illuminations.

Electronic Supplementary Material

Download File(s)
jcst-35-3-506-Highlights.pdf (220.6 KB)

References

[1]

Hachisuka T, Jensen H W. Stochastic progressive photon mapping. ACM Transactions on Graphics, 2009, 28(5): Article No. 141.

[2]
Jensen H W. Realistic Image Synthesis Using Photon Mapping (1st edition). Routledge, 2001.
[3]

Hachisuka T, Ogaki S, Jensen H W. Progressive photon mapping. ACM Transactions on Graphics, 2008, 27(5): Article No. 130.

[4]

Kang C, Wang L, Xu Y et al. A survey of photon mapping state-of-the-art research and future challenges. Frontiers of Information Technology & Electronic Engineering, 2016, 17(3): 185-199.

[5]

Ritschel T, Dachsbacher C, Grosch T et al. The state of the art in interactive global illumination. Computer Graphics Forum, 2012, 31(1): 160-188.

[6]

Bako S, Vogels T, McWilliams B et al. Kernel-predicting convolutional networks for denoising Monte Carlo renderings. ACM Transactions on Graphics, 2017, 36(4): Article No. 97.

[7]

Vogels T, Rousselle F, McWilliams B et al. Denoising with kernel prediction and asymmetric loss functions. ACM Transactions on Graphics, 2018, 37(4): Article No. 124.

[8]
Wong K M, Wong T T. Robust deep residual denoising for Monte Carlo rendering. In Proc. the 2018 SIGGRAPH Asia Technical Briefs, December 2018, Article No. 14.
[9]

Wong K M, Wong T T. Deep residual learning for denoising Monte Carlo renderings. Computational Visual Media, 2019, 5(3): 239-255.

[10]

Kalantari N K, Bako S, Sen P. A machine learning approach for filtering Monte Carlo noise. ACM Transactions on Graphics, 2015, 34(4): Article No. 122.

[11]

Xu B, Zhang J, Wang R et al. Adversarial Monte Carlo denoising with conditioned auxiliary feature modulation. ACM Transactions on Graphics, 2019, 38(6): Article No. 224.

[12]

Yang X, Wang D, Hu W et al. DEMC: A deep dual-encoder network for denoising Monte Carlo rendering. Journal of Computer Science and Technology, 2019, 34(5): 1123-1135.

[13]

Gharbi M, Li T M, Aittala M et al. Sample-based Monte Carlo denoising using a kernel-splatting network. ACM Transactions on Graphics, 2019, 38(4): Article No. 125.

[14]

Günther T, Grosch T. Distributed out-of-core stochastic progressive photon mapping. Computer Graphics Forum, 2014, 33(6): 154-166.

[15]

Havran V, Bittner J, Herzog R et al. Ray maps for global illumination. Rendering Techniques, 2005, 2005: 43-54.

[16]

Frisvad J R, Schjøth L, Erleben K et al. Photon differential splatting for rendering caustics. Computer Graphics Forum, 2014, 33(6): 252-263.

[17]

Spencer B, Jones M W. Into the blue: Better caustics through photon relaxation. Computer Graphics Forum, 2009, 28(2): 319-328.

[18]
Fu Z, Jensen H W. Noise reduction for progressive photon mapping. In Proc. the International Conference on Computer Graphics and Interactive Techniques, August 2012, Article No. 29.
[19]

Kaplanyan A S, Dachsbacher C. Adaptive progressive photon mapping. ACM Transactions on Graphics, 2013, 32(2): Article No. 16.

[20]

Bengio Y, Simard P, Frasconi P. Learning long-term dependencies with gradient descent is difficult. IEEE Transactions on Neural Networks, 1994, 5(2): 157-166.

[21]
He K, Zhang X, Ren S et al. Identity mappings in deep residual networks. In Proc. the 14th European Conference on Computer Vision, October 2016, pp.630-645.
[22]
He K, Zhang X, Ren S et al. Deep residual learning for image recognition. In Proc. the 2016 IEEE Conference on Computer Vision and Pattern Recognition, June 2016, pp.770-778.
[23]
Zagoruyko S, Komodakis N. Wide residual networks. arXiv: 1605.07146, 2016. https://arxiv.org/abs/1605.07146, Feb. 2019.
[24]
Abdi M, Nahavandi S. Multi-residual networks: Improving the speed and accuracy of residual networks. arXiv: 1609.05672, 2016. https://arxiv.org/abs/1609.05672, Feb. 2019.
[25]
Silverman B W. Density Estimation for Statistics and Data Analysis. Chapman and Hall, 1986.
[26]
Pharr M, Jakob W, Humphreys G. Physically Based Rendering: From Theory to Implementation (3rd edition). Morgan Kaufmann, 2016.
[27]
He K, Zhang X, Ren S et al. Delving deep into rectifiers: Surpassing human-level performance on imageNet classification. In Proc. the IEEE International Conference on Computer Vision, December 2015, pp.1026-1034.
[28]

Schjøth L, Sporring J, Olsen F O. Diffusion based photon mapping. Computer Graphics Forum, 2008, 27(8): 2114- 2127.

[29]
Abadi M, Barham P, Chen J et al. TensorFlow: A system for large-scale machine learning. In Proc. the 12th USENIX Symposium on Operating Systems Design and Implementation, November 2016, pp.265-283.
[30]
Kingma D P, Ba J. Adam: A method for stochastic optimization. arXiv: 1412.6980, 2014. https://arxiv.org/abs/1412.6980, Dec. 2019.
[31]
Glorot X, Bengio Y. Understanding the difficulty of training deep feed forward neural networks. In Proc. the 13th International Conference on Artificial Intelligence and Statistics, May 2010, pp.249-256.
Journal of Computer Science and Technology
Pages 506-521
Cite this article:
Zeng Z, Wang L, Wang B-B, et al. Denoising Stochastic Progressive Photon Mapping Renderings Using a Multi-Residual Network. Journal of Computer Science and Technology, 2020, 35(3): 506-521. https://doi.org/10.1007/s11390-020-0264-1

374

Views

5

Crossref

N/A

Web of Science

8

Scopus

2

CSCD

Altmetrics

Received: 02 January 2020
Revised: 24 March 2020
Published: 29 May 2020
©Institute of Computing Technology, Chinese Academy of Sciences 2020
Return