AI Chat Paper
Note: Please note that the following content is generated by AMiner AI. SciOpen does not take any responsibility related to this content.
{{lang === 'zh_CN' ? '文章概述' : 'Summary'}}
{{lang === 'en_US' ? '中' : 'Eng'}}
Chat more with AI
Article Link
Collect
Submit Manuscript
Show Outline
Outline
Show full outline
Hide outline
Outline
Show full outline
Hide outline
Research Article | Open Access

Three-Dimensional Leaf Edge Reconstruction Combining Two- and Three-Dimensional Approaches

Hidekazu Murata1Koji Noshita1,2( )
Department of Biology, Kyushu University, Fukuoka, Fukuoka 819–0395, Japan
Plant Frontier Research Center, Kyushu University, Fukuoka, Fukuoka 819–0395, Japan
Show Author Information

Abstract

Leaves, crucial for plant physiology, exhibit various morphological traits that meet diverse functional needs. Traditional leaf morphology quantification, largely 2-dimensional (2D), has not fully captured the 3-dimensional (3D) aspects of leaf function. Despite improvements in 3D data acquisition, accurately depicting leaf morphologies, particularly at the edges, is difficult. This study proposes a method for 3D leaf edge reconstruction, combining 2D image segmentation with curve-based 3D reconstruction. Utilizing deep-learning-based instance segmentation for 2D edge detection, structure from motion for estimation of camera positions and orientations, leaf correspondence identification for matching leaves among images, and curve-based 3D reconstruction for estimating 3D curve fragments, the method assembles 3D curve fragments into a leaf edge model through B-spline curve fitting. The method's performances were evaluated on both virtual and actual leaves, and the results indicated that small leaves and high camera noise pose greater challenges to reconstruction. We developed guidelines for setting a reliability threshold for curve fragments, considering factors occlusion, leaf size, the number of images, and camera error; the number of images had a lesser impact on this threshold compared to others. The method was effective for lobed leaves and leaves with fewer than 4 holes. However, challenges still existed when dealing with morphologies exhibiting highly local variations, such as serrations. This nondestructive approach to 3D leaf edge reconstruction marks an advancement in the quantitative analysis of plant morphology. It is a promising way to capture whole-plant architecture by combining 2D and 3D phenotyping approaches adapted to the target anatomical structures.

References

1

Wright IJ, Reich PB, Westoby M, Ackerly DD, Baruch Z, Bongers F, Cavender-Bares J, Chapin T, Cornelissen JHC, Diemer M, et al. The worldwide leaf economics spectrum. Nature. 2004;428(6985):821–827.

2

Midolo G, De Frenne P, Hölzel N, Wellstein C. Global patterns of intraspecific leaf trait responses to elevation. Glob Chang Biol. 2019;25(7):2485–2498.

3

Luo X, Keenan TF, Chen JM, Croft H, Colin Prentice I, Smith NG, Walker AP, Wang H, Wang R, Xu C, et al. Global variation in the fraction of leaf nitrogen allocated to photosynthesis. Nat Commun. 2021;12(1):1–10.

4

Onoda Y, Wright IJ, Evans JR, Hikosaka K, Kitajima K, Niinemets Ü, Poorter H, Tosens T, Westoby M. Physiological and structural tradeoffs underlying the leaf economics spectrum. New Phytol. 2017;214(4):1447–1463.

5

Smith VC, Ennos AR. The effects of air flow and stem flexure on the mechanical and hydraulic properties of the stems of sunflowers Helianthus annuus l. J Exp Bot. 2003;54(383):845–849.

6

Díaz S, Kattge J, Cornelissen JHC, Wright IJ, Lavorel S, Dray S, Reu B, Kleyer M, Wirth C, Colin Prentice I, et al. The global spectrum of plant form and function. Nature. 2016;529(7585):167–171.

7

Givnish TJ. Comparative studies of leaf form: Assessing the relative roles of selective pressures and phylogenetic constraints. New Phytol. 1987;106(s1):131–160.

8

Onoda Y, Saluñga JB, Akutsu K, Aiba S, ichiro, Yahara T, Anten NPR. Trade-off between light interception efficiency and light use efficiency: Implications for species coexistence in one-sided light competition. J Ecol. 2014;102(1):167–175.

9

Niinemets Ü. A review of light interception in plant stands from leaf to canopy in different plant functional types and in species with varying shade tolerance. Ecol Res. 2010;25(4):693–714.

10

Roth-Nebelsick A. Computer-based analysis of steady-state and transient heat transfer of small-size leaves by free mixed convection. Plant Cell Environ. 2001;24(6):631–640.

11

Vogel S. Convective cooling at low airspeeds and the shapes of broad leaves. J Exp Bot. 1970;21:91–101.

12

Ding J, Johnson EA, Martin YE. Optimization of leaf morphology in relation to leaf water status: A theory. Ecol Evol. 2020;10(3):1510–1525.

13

Sack L, Holbrook NM. Leaf hydraulics. Annu Rev Plant Biol. 2006;57:361–381.

14

Vogel S. Drag and reconfiguration of broad leaves in high winds. J Exp Bot. 1989;40(6915):941–948.

15

Niklas KJ. A mechanical perspective on foliage leaf form and function. New Phytol. 1999;143:19–31.

16

Poorter H, Niinemets Ü, Ntagkas N, Siebenkäs A, Mäenpää M, Matsubara S, Pons TL. A meta-analysis of plant responses to light intensity for 70 traits ranging from molecules to whole plant performance. New Phytol. 2019;223(3):1073–1105.

17

Anjum SA, Ashraf U, Zohaib A, Tanveer M, Naeem M, Ali I, Tabassum T, Nazir U. Growth and developmental responses of crop plants under drought stress: A review. Zemdirbyste-Agriculture. 2017;104:267–276.

18

Agarwal G, Belhumeur P, Feiner S, Jacobs D, Kress WJ, Ramamoorthi R, Bourg NA, Dixit N, Ling H, Mahajan D, et al. First steps toward an electronic field guide for plants. Taxon. 2006;55:597–610.

19

Tomaszewski D, Górzkowska A. Is shape of a fresh and dried leaf the same? PLoS One. 2016;11(4):1–14.

20

Babu AK, Kumaresan G, Raj VAA, Velraj R. Review of leaf drying: Mechanism and influencing parameters, drying methods, nutrient preservation, and mathematical models. Renew Sust Energ Rev. 2018;90:536–556.

21

Černý J, Pokorný R, Haninec P, Bednář P. Leaf area index estimation using three distinct methods in pure deciduous stands. J Vis Exp. 2019;2019(150):1–14.

22

Webb N. WinDIAS User Manual 3.3Cambridge (UK): Delta-T Devices Ltd.; 2019. p. 3–6.

23

Huang C, Wang Z, Quinn D, Suresh S, Jimmy HK. Differential growth and shape formation in plant organs. Proc Natl Acad Sci USA. 2018;115(49):12359–12364.

24

Shultis JK, Myneni RB. Radiative transfer in vegetation canopies with anisotropic scattering. J Quant Spectrosc Radiat Transf. 1988;39:115–129.

25

Li X, Strahler AH, Friedl MA. A conceptual model for effective directional emissivity from nonisothermal surfaces. IEEE Trans Geosci Remote Sens. 1999;37:2508–2517.

26

Widlowski JL, Mio C, Disney M, Adams J, Andredakis I, Atzberger C, Brennan J, Busetto L, Chelle M, Ceccherini G, et al. The fourth phase of the radiative transfer model intercomparison (RAMI) exercise: Actual canopy scenarios and conformity testing. Remote Sens Environ. 2015;169:418–437.

27

Pinty B, Gobron N, Widlowski JL, Gerstl SAW, Verstraete MM, Antunes M, Bacour C, Gascon F, Gastellu JP, Goel N, et al. Radiation transfer model intercomparison (RAMI) exercise. J Geophys Res Atmos. 2001;106:11937–11956.

28

Pearcy RW, Muraoka H, Valladares F. Crown architecture in sun and shade environments: Assessing function and trade-offs with a three-dimensional simulation model. New Phytol. 2005;166(3):791–800.

29

Niinemets Ü. Photosynthesis and resource distribution through plant canopies. Plant Cell Environ. 2007;30(9):1052–1071.

30

Fleck S, Niinemets Ü, Cescatti A, Tenhunen JD. Three-dimensional lamina architecture alters light-harvesting efficiency in Fagus: A leaf-scale analysis. Tree Physiol. 2003;23(9):577–589.

31

Chambelland JC, Dassot M, Adam B, Donès N, Balandier P, Marquier A, Saudreau M, Sonohat G, Sinoquet H. A double-digitising method for building 3D virtual trees with non-planar leaves: Application to the morphology and light-capture properties of young beech trees (Fagus sylvatica). Funct Plant Biol. 2008;35(10):1059–1069.

32

Liu F, Song Q, Zhao J, Mao L, Bu H, Hu Y, Zhu XG. Canopy occupation volume as an indicator of canopy photosynthetic capacity. New Phytol. 2021;232(2):941–956.

33

Chang TG, Shi Z, Zhao H, Song Q, He Z, Van Rie J, et al. 3dCAP-wheat: An open-source comprehensive computational framework precisely quantifies wheat foliar, nonfoliar, and canopy photosynthesis. Plant Phenomics. 2022;2022:9758148.

34

Chang TG, Zhao H, Wang N, Song QF, Xiao Y, Qu M, Zhu XG. A three-dimensional canopy photosynthesis model in rice with a complete description of the canopy architecture, leaf physiology, and mechanical properties. J Exp Bot. 2019;70(9):2479–2490.

35

Song Q, Liu F, Bu H, Zhu XG. Quantifying contributions of different factors to canopy photosynthesis in 2 maize varieties: Development of a novel 3D canopy modeling pipeline. Plant Phenomics. 2023;5:1–16.

36

Schmidt D, Kahlen K. Towards more realistic leaf shapes in functional-structural plant models. Symmetry (Basel). 2018;10:8–13.

37

Sarlikioti V, De Visser PHB, Buck-Sorlin GH, Marcelis LFM. How plant architecture affects light absorption and photosynthesis in tomato: Towards an ideotype for plant architecture using a functionalstructural plant model. Ann Bot. 2011;108(6):1065–1073.

38

Bhatia N, Runions A, Tsiantis M. Leaf shape diversity: From genetic modules to computational models. Annu Rev Plant Biol. 2021;72:325–356.

39

Panjvani K, Dinh A V., Wahid KA. LiDARPheno – A low-cost LiDAR-based 3D scanning system for leaf morphological trait extraction. Front Plant Sci 2019;10:147.

40

Paulus S, Behmann J, Mahlein AK, Plümer L, Kuhlmann H. Low-cost 3D systems: Suitable tools for plant phenotyping. Sensors (Switzerland). 2014;14(2):3001–3018.

41

Lu X, Ono E, Lu S, Zhang Y, Teng P, Aono M, Shimizu Y, Hosoi F, Omasa K. Reconstruction method and optimum range of camera-shooting angle for 3D plant modeling using a multi-camera photography system. Plant Methods. 2020;16.

42

Bradski G. The OpenCV library. Dr Dobb’s Journal of Software Tools. 2000.

43
Cernea D. OpenMVS: Open multi-view stereo reconstruction library. GitHub repository. 2020. [accessed 14 Nov 2023] https://cdcseacave.github.io/openMVS
44

Rossi R, Costafreda-Aumedes S, Leolini L, Leolini C, Bindi M, Moriondo M. Implementation of an algorithm for automated phenotyping through plant 3D-modeling: A practical application on the early detection of water stress. Comput Electron Agric. 2022;1:197.

45

Li Y, Wen W, Miao T, Wu S, Yu Z, Wang X, Guo X, Zhao C. Automatic organ-level point cloud segmentation of maize shoots by integrating high-throughput data acquisition and deep learning. Comput Electron Agric. 2022;2:193.

46

Wu S, Wen W, Wang Y, Fan J, Wang C, Gou W, Guo X. MVS-Pheno: A portable and low-cost phenotyping platform for maize shoots using multiview stereo 3D reconstruction. Plant Phenomics. 2020;2020:1848437.

47

Boukhana M, Ravaglia J, Hétroy-Wheeler F, De Solan B. Geometric models for plant leaf area estimation from 3D point clouds: A comparative study. Graph Visual Comput. 2022;7:Article 200057.

48
He K, Gkioxari G, Dollar P, Girshick R. Mask R-CNN. In: 2017 IEEE International Conference on Computer Vision (ICCV). IEEE; 2017. p. 2980–2988.
49
Yuxin W, Alexander K, Francisco M, Wan-Yen L, Ross G. Detectron2. 2019. [accessed 14 Nov 2023] https://github.com/facebookresearch/detectron2
50
Fabbri R, Kimia B. 3D curve sketch: Flexible curve-based stereo reconstruction and calibration. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. IEEE; 2010. p. 1538–1545.
51

Katz S, Tal A, Basri R. Direct visibility of point sets. ACM Trans Graph. 2007;26:24.

52
Ester M, Kriegel HP, Sander J, Xiaowei X. A density-based algorithm for discovering clusters in large spatial databases with noise. 1996. [cited 17 Feb 2023]. https://www.osti.gov/biblio/421283
53
Rusu RB, Cousins S. 3D is here: Point Cloud Library (PCL). Paper presented at: IEEE International Conference on Robotics and Automation (ICRA); 2011 May 9–13; Shanghai, China.
54
Usumezbas A, Fabbri R, Kimia BB. From multiview image curves to 3D drawings. In: Leibe B, Matas J, Sebe N, Welling M, editors. Computer vision – ECCV 2016. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Cham (Switzerland): Springer International Publishing; 2016. p. 70–87.
55

Virtanen P, Gommers R, Oliphant TE, Haberland M, Reddy T, Cournapeau D, Burovski E, Peterson P, Weckesser W, Bright J, et al. SciPy 1.0: Fundamental algorithms for scientific computing in python. Nat Methods. 2020;17(3):261–272.

56
Ciminera Z. Maple Leaf. Sketchfab; 2023. [accessed 28 Oct 2023] https://sketchfab.com/3d-models/maple-leaf-c06c7cf93eda435dbc5cccf7511907ac
57
Ivanovs A. Leaf test. Sketchfab; 2015. [accessed 28 Oct 2023] https://sketchfab.com/3d-models/leaf-test-f26fb4b0d2ba4eccaa494eb7f4ba138b
58

Kaga A, Shimizu T, Watanabe S, Tsubokura Y, Katayose Y, Harada K, Vaughan DA, Tomooka N. Evaluation of soybean germplasm conserved in NIAS genebank and development of mini core collections. Breed Sci. 2012;61(5):566–592.

59

Alt H, Godau M. Computing the Fréchet distance between two polygonal curves. Int J Comput Geom Appl. 1995;05:75–91.

60

Mann HB, Whitney DR. On a test of whether one of two random variables is stochastically larger than the other. Ann Math Stat. 1947;18:50–60.

61

Benjamini Y, Hochberg Y. Controlling the false discovery rate: A practical and powerful approach to multiple testing. J R Statist Soc: Series B. 1995;57:289–300.

62
Li S, Yao Y, Fang T, Quan L. Reconstructing thin structures of manifold surfaces by integrating spatial curves. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. IEEE; 2018. p. 2887–2896.
63

Mörwald T, Balzer J, Vincze M. Modeling connected regions in arbitrary planar point clouds by robust B-spline approximation. Robot Auton Syst. 2016;76:141–151.

64
Kirillov A, Mintun E, Ravi N, Mao H, Rolland C, Gustafson L, Xiao T, Whitehead S, Berg AC, Lo W-Y, et al. Segment anything. arXiv. 2023. https://doi.org/10.48550/arXiv.2304.02643
65
Yu Z, Feng C, Liu M-Y. Ramalingam S. CASENet: Deep category-aware semantic edge detection. Paper presented at: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR); 2017 Jul 21–26; Honolulu, HI.
66
Cheng T, Wang X, Huang L, Liu W. Boundary-preserving Mask R-CNN. In: Vedaldi A, Bischof H, Brox T, Frahm J-M, editors. Computer vision – ECCV 2020. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Cham (Switzerland): Springer International Publishing; 2020. p. 660–676.
67

Bucksch A, Lindenbergh R, Menenti M. Robust skeleton extraction from imperfect point clouds. Vis Comput. 2010;26:1283–1300.

68
Isokane T, Okura F, Ide A, Matsushita Y, Yagi Y. Probabilistic plant modeling via multi-view image-to-image translation. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. IEEE; 2018. p. 2906–2915.
69

Gené-Mola J, Sanz-Cortiella R, Rosell-Polo JR, Morros JR, Ruiz-Hidalgo J, Vilaplana V, Gregorio E. Fruit detection and 3D location using instance segmentation neural networks and structure-from-motion photogrammetry. Comput Electron Agric. 2020;169:Article 105165.

70

Kang H, Chen C. Fruit detection, segmentation and 3D visualisation of environments in apple orchards. Comput Electron Agric. 2020;171:Article 105302.

71

Zhang W, Hansen MF, Smith M, Smith L, Grieve B. Photometric stereo for three-dimensional leaf venation extraction. Comput Ind. 2018;98:56–67.

72

Wen W, Li B, Li BJ, Guo X. A leaf modeling and multi-scale remeshing method for visual computation via hierarchical parametric vein and margin representation. Front Plant Sci. 2018;9:1–14.

73

Kao W-Y, Forseth IN. Dirunal leaf movement, chlorophyll fluorescence and carbon assimilation in soybean grown under different nitrogen and water availabilities. Plant Cell Environ. 1992;15:703–710.

74

Kahlen K, Wiechers D, Stützel H. Modelling leaf phototropism in a cucumber canopy. Funct Plant Biol. 2008;35(10):876–884.

Plant Phenomics
Article number: 0181
Cite this article:
Murata H, Noshita K. Three-Dimensional Leaf Edge Reconstruction Combining Two- and Three-Dimensional Approaches. Plant Phenomics, 2024, 6: 0181. https://doi.org/10.34133/plantphenomics.0181

217

Views

0

Crossref

1

Web of Science

1

Scopus

0

CSCD

Altmetrics

Received: 13 November 2023
Accepted: 29 March 2024
Published: 09 May 2024
© 2024 Hidekazu Murata and Koji Noshita Exclusive licensee Nanjing Agricultural University. No claim to original U.S. Government Works.

Distributed under a Creative Commons Attribution License 4.0 (CC BY 4.0).

Return