AI Chat Paper
Note: Please note that the following content is generated by AMiner AI. SciOpen does not take any responsibility related to this content.
{{lang === 'zh_CN' ? '文章概述' : 'Summary'}}
{{lang === 'en_US' ? '中' : 'Eng'}}
Chat more with AI
Powered by AMiner. Clicking this button will take you away from SciOpen.
Home Computational Visual Media Article
PDF (773.7 KB)
Cite
EndNote(RIS) BibTeX
Collect
Submit Manuscript AI Chat Paper
Show Outline
Outline
Show full outline
Hide outline
Outline
Show full outline
Hide outline
Research Article | Open Access

Interactive modeling of lofted shapes from a single image

Tsinghua University, Beijing, 100084, China
University of Bath, Bath, BA2 7AY, UK
Show Author Information

Abstract

Modeling the complete geometry of general shapes from a single image is an ill-posed problem. User hints are often incorporated to resolve ambiguities and provide guidance during the modeling process. In this work, we present a novel interactive approach for extracting high-quality freeform shapes from a single image. This is inspired by the popular lofting technique in many CAD systems, and only requires minimal user input. Given an input image, the user only needs to sketch several projected cross sections, provide a "main axis" , and specify some geometric relations. Our algorithm then automatically optimizes the common normal to the sections with respect to these constraints, and interpolates between the sections, resulting in a high-quality 3D model that conforms to both the original image and the user input. The entire modeling session is efficient and intuitive. We demonstrate the effectiveness of our approach based on qualitative tests on a variety of images, and quantitative comparisons with the ground truth using synthetic images.

Keywords

interactive modelingfreeform shapesimage-guided modelinglofting

References

[1]
C. Ding,; L. G. Liu, A survey of sketch based modeling systems. Frontiers of Computer Science Vol. 10, No. 6, 985-999, 2016.
Crossref Google Scholar
[2]
T. Igarashi,; S. Matsuoka,; H. Tanaka, Teddy: A sketching interface for 3D freeform design. In: Proceedings of the ACM SIGGRAPH courses, Article No. 21, 2007.
Crossref
[3]
R. Schmidt,; B. Wyvill,; M. C. Sousa,; J. A. Jorge, ShapeShop: Sketch-based solid modeling with Blob Trees. In: Proceedings of the ACM SIGGRAPH Courses, Article No. 14, 2006.
Crossref
[4]
C.-J. Li,; H. Pan,; Y. Liu,; X. Tong,; A. Sheffer,; W. Wang, BendSketch: Modeling freeform surfaces through 2D sketching. ACM Transactions on Graphics Vol. 36, No. 4, Article No. 125, 2017.
Crossref Google Scholar
[5]
R. Schmidt,; A. Khan,; K. Singh,; G. Kurtenbach, Analytic drawing of 3D scaffolds. ACM Transactions on Graphics Vol. 28, No. 5, Article No. 149, 2009.
Crossref Google Scholar
[6]
A. Shtof,; A. Agathos,; Y. Gingold,; A. Shamir,; D. Cohen-Or, Geosemantic snapping for sketch-based modeling. Computer Graphics Forum Vol. 32, No. 2pt2, 245-253, 2013.
Crossref Google Scholar
[7]
A. Andre,; S. Saito, Single-view sketch based modeling. In: Proceedings of the 8th Eurographics Symposium on Sketch-Based Interfaces and Modeling, 133-140, 2011.
Crossref
[8]
B.-X. Xu,; W. Chang,; A. Sheffer,; A. Bousseau,; J. McCrae,; K. Singh, True2Form: 3D curve networks from 2D sketches via selective regularization. ACM Transactions on Graphics Vol. 33, No. 4, Article No. 131, 2014.
Crossref Google Scholar
[9]
Y. Li,; X. Luo,; Y. Zheng,; P. Xu,; H. Fu, SweepCanvas: Sketch-based 3D prototyping on an RGB-D image. In: Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology, 387-399,2017.
Crossref
[10]
K. Xu,; K. Chen,; H Fu,; W.-L. Sun,; S.-M. Hu, Sketch2Scene: Sketch-based co-retrieval and co-placement of 3D models. ACM Transactions on Graphics Vol. 32, No. 4, Article No. 123, 2013.
Crossref Google Scholar
[11]
X. H. Xie,; K. Xu,; N. J. Mitra,; D. Cohen-Or,; W. Y. Gong,; Q. Su,; B. Chen, Sketch-to-design: Context-based part assembly. Computer Graphics Forum Vol. 32, No. 8, 233-245, 2013.
Crossref Google Scholar
[12]
Y. Zheng,; X. Chen,; M.-M. Cheng,; K. Zhou,; S.-M. Hu,; N. J. Mitra, Interactive images: Cuboid proxies for smart image manipulation. ACM Transactions on Graphics Vol. 31, No. 4, Article No. 99, 2012.
Crossref Google Scholar
[13]
T. Chen,; Z. Zhu,; A. Shamir,; S.-M. Hu,; D. Cohen-Or, 3-sweep: Extracting editable objects from a single photo. ACM Transactions on Graphics Vol. 32, No. 6, Article No. 195, 2013.
Crossref Google Scholar
[14]
Y.-P. Cao,; T. Ju,; Z. Fu,; S.-M. Hu, Interactive image-guided modeling of extruded shapes. Computer Graphics Forum Vol. 33, No. 7, 101-110, 2014.
Crossref Google Scholar
[15]
C. Xin,; Y. W. Li,; X. Luo,; T. J. Shao,; J. Y. Yu,; K. Zhou,; Y. Zheng, AutoSweep: Recovering 3D editable objects from a single photograph. IEEE Transactions on Visualization and Computer Graphics DOI: 10.1109/TVCG.2018.2871190, 2018.
Google Scholar
[16]
Q.-X. Huang,; H. Wang,; V. Koltun, Single-view reconstruction via joint analysis of image and shape collections. ACM Transactions on Graphics Vol. 34, No. 4, Article No. 87, 2015.
Crossref Google Scholar
[17]
K. Xu,; H. L. Zheng,; H. Zhang,; D. Cohen-Or,; L. G. Liu,; Y. S. Xiong, Photo-inspired model-driven 3D object modeling. ACM Transactions on Graphics Vol. 30, No. 4, Article No. 80, 2011.
Crossref Google Scholar
[18]
N. Kholgade,; T. Simon,; A. Efros,; Y. Sheikh, 3D object manipulation in a single photograph using stock 3D models. ACM Transactions on Graphics Vol. 33, No. 4, Article No. 127, 2014.
Crossref Google Scholar
[19]
P. E. Debevec,; C. J. Taylor,; J. Malik, Modeling and rendering architecture from photographs: A hybrid geometry- and image-based approach. In: Proceedings of the SIGGRAPH 96 Conference, 1996. Available at https://www.pauldebevec.com/Research/debevec-siggraph96-paper.pdf.
Crossref
[20]
N. J. Jiang,; P. Tan,; L. F. Cheong, Symmetric architec-ture modeling with a single image. ACM Transactions on Graphics Vol. 28, No. 5, Article No. 113, 2009.
Crossref Google Scholar
[21]
G. Nishida,; A. Bousseau,; D. G. Aliaga, Procedural modeling of a building from a single image. Computer Graphics Forum Vol. 37, No. 2, 415-429, 2018.
Crossref Google Scholar
[22]
B. Zhou,; X. W. Chen,; Q. Fu,; K. Guo,; P. Tan, Garment modeling from a single image. Computer Graphics Forum Vol. 32, No. 7, 85-91, 2013.
Crossref Google Scholar
[23]
P. Tan,; T. Fang,; J. Xiao,; P. Zhao,; L. Quan, Single image tree modeling. ACM Transactions on Graphics Vol. 27, No. 5, Article No. 108, 2008.
Crossref Google Scholar
[24]
H. Chiyokura,; F. Kimura, Design of solids with free-form surfaces. ACM SIGGRAPH Computer Graphics Vol. 17, No. 3, 289-298, 1983.
Crossref Google Scholar
[25]
T. Hermann, G2 interpolation of free form curve networks by biquintic Gregory patches. Computer Aided Geometric Design Vol. 13, No. 9, 873-893, 1996.
Crossref Google Scholar
[26]
Catmull, E.; Clark, J. Recursively generated B-spline surfaces on arbitrary topological meshes. In: Seminal Graphics. ACM, 183-188, 1998.
Crossref
[27]
A. Nasri, Curve interpolation in recursively generated B-spline surfaces over arbitrary topology. Computer Aided Geometric Design Vol. 14, No. 1, 13-30, 1997.
Crossref Google Scholar
[28]
A. H. Nasri, Interpolating an unlimited number of curves meeting at extraordinary points on subdivision surfaces. Computer Graphics Forum Vol. 22, No. 1, 87-97, 2003.
Crossref Google Scholar
[29]
S. Schaefer,; J. D. Warren,; D. Zorin, Lofting curve networks using subdivision surfaces. In: Proceedings of the Eurographics/ACM SIGGRAPH symposium on Geometry processing, 103-114, 2004.
Crossref
[30]
T. W. Sederberg,; E. Greenwood, A physically based approach to 2-D shape blending. ACM SIGGRAPH Computer Graphics Vol. 26, No. 2, 25-34, 1992.
Crossref Google Scholar
[31]
T. W. Sederberg,; P. Gao,; G. Wang,; H. Mu, 2-D shape blending: An intrinsic solution to the vertex path problem. In: Proceedings of the 20th Annual Conference on Computer Graphics and Interactive Techniques, 15-18, 1993.
Crossref
[32]
N. Watanabe,; M. Washida,; T. Igarashi, Bubble clusters: An interface for manipulating spatial aggregation of graphical objects. In: Proceedings of the 20th Annual ACM Symposium on User Interface Software and Technology, 173-182, 2007.
Crossref
[33]
N. J. Mitra,; L. J. Guibas,; M. Pauly, Partial and approximate symmetry detection for 3D geometry. ACM Transactions on Graphics Vol. 25, No. 3, 560-568, 2006.
Crossref Google Scholar
[34]
Z. Y. Shi,; P. Alliez,; M. Desbrun,; H. J. Bao,; J. Huang, Symmetry and orbit detection via lie-algebra voting. Computer Graphics Forum Vol. 35, No. 5, 217-227, 2016.
Google Scholar
Computational Visual Media
Volume 6 Issue 3,
September 2020
Pages 279-289
DOI: 10.1007/s41095-019-0153-0
Cite this article:
Deng C, Huang J, Yang Y-L. Interactive modeling of lofted shapes from a single image. Computational Visual Media, 2020, 6(3): 279-289. https://doi.org/10.1007/s41095-019-0153-0

785

Views

44

Downloads

8

Crossref

N/A

Web of Science

8

Scopus

2

CSCD

Altmetrics
Received: 06 August 2019
Accepted: 02 November 2019
Published: 04 December 2019
© The Author(s) 2020

This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduc-tion in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made.

The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder.

To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Other papers from this open access journal are available free of charge from http://www.springer.com/journal/41095. To submit a manuscript, please go to https://www.editorialmanager.com/cvmj.
Return