The dynamic effects of smoke are impressive in illustration design, but it is a troublesome and challenging issue for inexpert users to design smoke effects without domain knowledge of fluid simulations. In this work, we propose DualSmoke, a two-stage global-to-local generation framework for interactive smoke illustration design. In the global stage, the proposed approach utilizes fluid patterns to generate Lagrangian coherent structures from the user's hand-drawn sketches. In the local stage, detailed flow patterns are obtained from the generated coherent structure. Finally, we apply a guiding force field to the smoke simulator to produce the desired smoke illustration. To construct the training dataset, DualSmoke generates flow patterns using finite-time Lyapunov exponents of the velocity fields. The synthetic sketch data are generated from the flow patterns by skeleton extraction. Our user study verifies that the proposed design interface can provide various smoke illustration designs with good user usability. Our code is available at https://github.com/shasph/DualSmoke.
Zhu, B.; Iwata, M.; Haraguchi, R.; Ashihara, T.; Umetani, N.; Igarashi, T.; Nakazawa, K. Sketch-based dynamic illustration of fluid systems. ACM Transactions on Graphics Vol. 30, No. 6, 1–8, 2011.
Hu, Z. Y.; Xie, H. R.; Fukusato, T.; Sato, T.; Igarashi, T. Sketch2VF: Sketch-based flow design with conditional generative adversarial network. Computer Animation and Virtual Worlds Vol. 30, Nos. 3–4, e1889, 2019.
Treuille, A.; McNamara, A.; Popović, Z.; Stam, J. Keyframe control of smoke simulations. ACM Transactions on Graphics Vol. 22, No. 3, 716–723, 2003.
Nielsen, M. B.; Christensen, B. B. Improved variational guiding of smoke animations. Computer Graphics Forum Vol. 29, No. 2, 705–712, 2010.
Sato, S.; Dobashi, Y.; Kim, T. Stream-guided smoke simulations. ACM Transactions on Graphics Vol. 40, No. 4, Article No. 161, 2021.
Kim, B.; Huang, X. C.; Wuelfroth, L.; Tang, J. W.; Cordonnier, G.; Gross, M.; Solenthaler, B. Deep reconstruction of 3D smoke densities from artist sketches. Computer Graphics Forum Vol. 41, No. 2, 97–110, 2022.
Bhattacharjee, S.; Chaudhuri, P. A survey on sketch based content creation: From the desktop to virtual and augmented reality. Computer Graphics Forum Vol. 39, No. 2, 757–780, 2020.
Guérin, É.; Digne, J.; Galin, É.; Peytavie, A.; Wolf, C.; Benes, B.; Martinez, B. Interactive example-based terrain authoring with conditional generative adversarial networks. ACM Transactions on Graphics Vol. 36, No. 6, Article No. 228, 2017.
Brodt, K.; Bessmeltsev, M. Sketch2Pose: Estimating a 3D character pose from a bitmap sketch. ACM Transactions on Graphics Vol. 41, No. 4, Article No. 85, 2022.
Ren, B.; Huang, J. H.; Lin, M. C.; Hu, S. M. Controllable dendritic crystal simulation using orientation field. Computer Graphics Forum Vol. 37, No. 2, 485–495, 2018.
Guay, M.; Ronfard, R.; Gleicher, M.; Cani, M. P. Space-time sketching of character animation. ACM Transactions on Graphics Vol. 34, No. 4, Article No. 118, 2015.
Yan, G. W.; Chen, Z. L.; Yang, J. M.; Wang, H. M. Interactive liquid splash modeling by user sketches. ACM Transactions on Graphics Vol. 39, No. 6, Article No. 165, 2020.
Huang, Z. Y.; Peng, Y. C.; Hibino, T.; Zhao, C. Q.; Xie, H. R.; Fukusato, T.; Miyata, K. DualFace: Two-stage drawing guidance for freehand portrait sketching. Computational Visual Media Vol. 8, No. 1, 63–77, 2022.
Selle, A.; Rasmussen, N.; Fedkiw, R. A vortex particle method for smoke, water and explosions. ACM Transactions on Graphics Vol. 24, No. 3, 910–914, 2005.
Dobashi, Y.; Kusumoto, K.; Nishita, T.; Yamamoto, T. Feedback control of cumuliform cloud formation based on computational fluid dynamics. ACM Transactions on Graphics Vol. 27, No. 3, 1–8, 2008.
Tang, J. W.; Azevedo, V. C.; Cordonnier, G.; Solenthaler, B. Honey, I shrunk the domain: Frequency-aware force field reduction for efficient fluids optimization. Computer Graphics Forum Vol. 40, No. 2, 339–353, 2021.
Yuan, Z.; Chen, F.; Zhao, Y. Pattern-guided smoke animation with Lagrangian coherent structure. ACM Transactions on Graphics Vol. 30, No. 6, 1–8, 2011.
Ladický, L.; Jeong, S.; Solenthaler, B.; Pollefeys, M.; Gross, M. Data-driven fluid simulations using regression forests. ACM Transactions on Graphics Vol. 34, No. 6, Article No. 199, 2015.
Chu, M. Y.; Thuerey, N. Data-driven synthesis of smoke flows with CNN-based feature descriptors. ACM Transactions on Graphics Vol. 36, No. 4, Article No. 69, 2017.
Xie, Y.; Franz, E.; Chu, M. Y.; Thuerey, N. tempoGAN: A temporally coherent, volumetric GAN for super-resolution fluid flow. ACM Transactions on Graphics Vol. 37, No. 4, Article No. 95, 2018.
Chu, M. Y.; Thuerey, N.; Seidel, H. P.; Theobalt, C.; Zayer, R. Learning meaningful controls for fluids. ACM Transactions on Graphics Vol. 40, No. 4, Article No. 100, 2021.
Selle, A.; Fedkiw, R.; Kim, B.; Liu, Y. J.; Rossignac, J. An unconditionally stable MacCormack method. Journal of Scientific Computing Vol. 35, Nos. 2–3, 350–371, 2008.
Shadden, S. C.; Lekien, F.; Marsden, J. E. Definition and properties of Lagrangian coherent structures from finite-time Lyapunov exponents in two-dimensional aperiodic flows. Physica D: Nonlinear Phenomena Vol. 212, Nos. 3–4, 271–304, 2005.
Ferstl, F.; Burger, K.; Theisel, H.; Westermann, R. Interactive separating streak surfaces. IEEE Transactions on Visualization and Computer Graphics Vol. 16, No. 6, 1569–1577, 2010.
Tagliasacchi, A.; Alhashim, I.; Olson, M.; Zhang, H. Mean curvature skeletons. Computer Graphics Forum Vol. 31, No. 5, 1735–1744, 2012.
Gao, F. Y.; Wei, G. S.; Xin, S. Q.; Gao, S. S.; Zhou, Y. F. 2D skeleton extraction based on heat equation. Computers & Graphics Vol. 74, 99–108, 2018.
Hart, S. G.; Staveland, L. E. Development of NASA-TLX (task load index): Results of empirical and theoretical research. Advances in Psychology Vol. 52, 139–183, 1988.
Bangor, A.; Kortum, P.; Miller, J. T. Determining what individual SUS scores mean: Adding an adjective rating scale. Journal of Usability Studies Vol. 4, No. 3, 114–123, 2009.
Su, W. C.; Du, D.; Yang, X.; Zhou, S. Z.; Fu, H. B. Interactive sketch-based normal map generation with deep neural networks. Proceedings of the ACM on Computer Graphics and Interactive Techniques Vol. 1, No. 1, Article No. 22, 2018.
Garth, C.; Gerhardt, F.; Tricoche, X.; Hans, H. Efficient computation and visualization of coherent structures in fluid flow applications. IEEE Transactions on Visualization and Computer Graphics Vol. 13, No. 6, 1464–1471, 2007.