AI Chat Paper
Note: Please note that the following content is generated by AMiner AI. SciOpen does not take any responsibility related to this content.
{{lang === 'zh_CN' ? '文章概述' : 'Summary'}}
{{lang === 'en_US' ? '中' : 'Eng'}}
Chat more with AI
Article Link
Collect
Submit Manuscript
Show Outline
Outline
Show full outline
Hide outline
Outline
Show full outline
Hide outline
Research Article | Open Access

AppleQSM: Geometry-Based 3D Characterization of Apple Tree Architecture in Orchards

Tian Qiu1Tao Wang2Tao Han3Kaspar Kuehn4Lailiang Cheng4Cheng Meng5Xiangtao Xu3Kenong Xu6Jiang Yu6( )
School of Electrical and Computer Engineering, Cornell University, Ithaca, NY, USA
Institute of Statistics and Big Data, Renming University of China, Beijing, China
Department of Ecology and Evolutionary Biology, Cornell University, Ithaca, NY, USA
School of Integrative Plant Science, Cornell University, Ithaca, NY, USA
Center for Applied Statistics, Renmin University of China, Beijing, China
School of Integrative Plant Science, Cornell University, Ithaca, NY, USA
Show Author Information

Abstract

The architecture of apple trees plays a pivotal role in shaping their growth and fruit-bearing potential, forming the foundation for precision apple management. Traditionally, 2D imaging technologies were employed to delineate the architectural traits of apple trees, but their accuracy was hampered by occlusion and perspective ambiguities. This study aimed to surmount these constraints by devising a 3D geometry-based processing pipeline for apple tree structure segmentation and architectural trait characterization, utilizing point clouds collected by a terrestrial laser scanner (TLS). The pipeline consisted of four modules: (a) data preprocessing module, (b) tree instance segmentation module, (c) tree structure segmentation module, and (d) architectural trait extraction module. The developed pipeline was used to analyze 84 trees of two representative apple cultivars, characterizing architectural traits such as tree height, trunk diameter, branch count, branch diameter, and branch angle. Experimental results indicated that the established pipeline attained an R2 of 0.92 and 0.83, and a mean absolute error (MAE) of 6.1 cm and 4.71 mm for tree height and trunk diameter at the tree level, respectively. Additionally, at the branch level, it achieved an R2 of 0.77 and 0.69, and a MAE of 6.86 mm and 7.48° for branch diameter and angle, respectively. The accurate measurement of these architectural traits can enable precision management in high-density apple orchards and bolster phenotyping endeavors in breeding programs. Moreover, bottlenecks of 3D tree characterization in general were comprehensively analyzed to reveal future development.

References

1

Boyer J, Liu RH. Apple phytochemicals and their health benefits. Nutr. J. 2004;3:5.

2
USApple, Industry at a glance Web Page, 2022; https://usapple.org/industry-at-a-glance.
3

Jiang Y, Li C. Convolutional neural networks for image-based high-throughput plant phenotyping: A review. Plant Phenomics. 2020;2020:4152816.

4

Jin S, Sun X, Wu F, Su Y, Li Y, Song S, Xu K, Ma Q, Baret F, Jiang D, et al. Lidar sheds new light on plant phenomics for plant breeding and management: Recent advances and future prospects. ISPRS J Photogramm Remote Sens. 2021;171:202–223.

5

Li L, Zhang Q, Huang D. A review of imaging techniques for plant phenotyping. Sensors. 2014;14(11):20078–20111.

6

Li Z, Guo R, Li M, Chen Y, Li G. A review of computer vision technologies for plant phenotyping. Comput Electron Agric. 2020;176:Article 105672.

7

Straub J, Reiser D, Lüling N, Stana A, Griepentrog HW. Approach for graph based individual branch modelling of meadow orchard trees with 3D point clouds. Precis Agric. 2022;23(6):1967–1982.

8
Sulc M, Matas J, Texture-based leaf identification. Paper presented at: Proceedings of the Computer Vision-ECCV 2014 Workshops, Part Ⅳ 13; 12 September 2014; Zurich, Switzerland.
9

Aggelopoulou A, Bochtis D, Fountas S, Swain KC, Gemtos TA, Nanos GD. Yield prediction in apple orchards based on image processing. Precis Agric. 2011;12:448–456.

10

Gongal A, Amatya S, Karkee M, Zhang Q, Lewis K. Sensors and systems for fruit detection and localization: A review. Comput Electron Agric. 2015;116:8–19.

11

Linker R, Cohen O, Naor A. Determination of the number of green apples in rgb images recorded in orchards. Comput Electron Agric. 2012;81:45–57.

12

Gongal A, Silwal A, Amatya S, Karkee M, Zhang Q, Lewis K. Apple crop-load estimation with over-the-row machine vision system. Comput Electron Agric. 2016;120:26–35.

13
Bargoti S, Underwood J, Deep fruit detection in orchards. Paper presented at: Proceedings of the 2017 IEEE International Conference on Robotics and Automation (ICRA); 29 May to 3 June 2017; Singapore.
14

Juman MA, Wong YW, Rajkumar RK, Goh LJ. A novel tree trunk detection method for oil-palm plantation navigation. Comput Electron Agric. 2016;128:172–180.

15

Majeed Y, Zhang J, Zhang X, Fu L, Karkee M, Zhang Q, Whiting MD. Deep learning based segmentation for automated training of apple trees on trellis wires. Comput Electron Agric. 2020;170:Article 105277.

16

Zhang J, He L, Karkee M, Zhang Q, Zhang X, Gao Z. Branch detection for apple trees trained in fruiting wall architecture using depth features and regions-convolutional neural network (r-cnn). Comput Electron Agric. 2018;155:386–393.

17

Mu X, He L, Heinemann P, Schupp J, Karkee M. Mask R-CNN based apple flower detection and king flower identification for precision pollination. Smart Agric Technol. 2023;4:Article 100151.

18

Wang XA, Tang J, Whitty M. Side-view apple flower mapping using edge-based fully convolutional networks for variable rate chemical thinning. Comput Electron Agric. 2020;178:Article 105673.

19

Ni X, Li C, Jiang H, Takeda F. Deep learning image segmentation and extraction of blueberry fruit traits associated with harvestability and yield. Hortic Res. 2020;7:110.

20

Mochida K, Koda S, Inoue K, Hirayama T, Tanaka S, Nishii R, Melgani F. Computer vision-based phenotyping for improvement of plant productivity: A machine learning perspective. Gigascience. 2019;8(1):giy153.

21

Okura F. 3D modeling and reconstruction of plants and trees: A cross-cutting review across computer graphics, vision, and plant phenotyping. Breed Sci. 2022;72(1):31–47.

22

Paulus S. Measuring crops in 3D: Using geometry for plant phenotyping. Plant Methods. 2019;15(1):103.

23

Paturkar A, Sen Gupta G, Bailey D. Making use of 3D models for plant physiognomic analysis: A review. Remote Sens. (Basel). 2021;13(11):2232.

24

Xia S, Chen D, Wang R, Li J, Zhang X. Geometric primitives in LiDAR point clouds: A review. IEEE J Sel Top Appl Earth Obs Remote Sens. 2020;13:685–707.

25

Bornand A, Rehush N, Morsdorf F, Thürig E, Abegg M. Individual tree volume estimation with terrestrial laser scanning: Evaluating reconstructive and allometric approaches. Agric. For. Meteorol. 2023;341:Article 109654.

26

Brede B, Calders K, Lau A, Raumonen P, Bartholomeus HM, Herold M, Kooistra L. Non-destructive tree volume estimation through quantitative structure modelling: Comparing UAV laser scanning with terrestrial LIDAR. Remote Sens. Environ. 2019;233:Article 111355.

27

Calders K, Newnham G, Burt A, Murphy S, Raumonen P, Herold M, Culvenor D, Avitabile V, Disney M, Armston J, et al. Nondestructive estimates of above-ground biomass using terrestrial laser scanning. Methods Ecol Evol. 2015;6(2):198–208.

28

Disney M, Burt A, Wilkes P, Armston J, Duncanson L. New 3D measurements of large redwood trees for biomass and structure. Sci. Rep. 2020;10(1):16721.

29

Allen MJ, Grieve SW, Owen HJ, Lines ER. Tree species classification from complex laser scanning data in mediterranean forests using deep learning. Methods Ecol Evol. 2023;14(7):1657–1667.

30

Calders K, Origo N, Burt A, Disney M, Nightingale J, Raumonen P, Åkerblom M, Malhi Y, Lewis P. Realistic forest stand reconstruction from terrestrial LiDAR for radiative transfer modelling. Remote Sens. (Basel). 2018;10(6):933.

31
Yan D-M, Wintz J, Mourrain B, Wang W, Boudon F, Godin C. Efficient and robust reconstruction of botanical branching structure from laser scanned points. Paper presented at: Proceedings of the 2009 11th IEEE International Conference on Computer-Aided Design and Computer Graphics; 19–21 August 2009; Huangshan, China.
32

Bucksch A, Lindenbergh R, Menenti M. SkelTre: Robust skeleton extraction from imperfect point clouds. Vis Comput. 2010;26(10):1283–1300.

33

Hackenberg J, Spiecker H, Calders K, Disney M, Raumonen P. Simpletree—An efficient open source tool to build tree models from tls clouds. Forests. 2015;6(11):4245–4294.

34

Raumonen P, Kaasalainen M, Åkerblom M, Kaasalainen S, Kaartinen H, Vastaranta M, Holopainen M, Disney M, Lewis P. Fast automatic precision tree models from terrestrial laser scanner data. Remote Sens. (Basel). 2013;5(2):491–520.

35
Verroust A, Lazarus F, Extracting skeletal curves from 3D scattered data. Paper presented at: Proceedings of the Shape Modeling International ’99. International Conference on Shape Modeling and Applications; 1–4 March 1999; Aizu-Wakamatsu.
36
Dey TK, Sun J, Defining and computing curve-skeletons with medial geodesic function. Paper presented at: Proceedings of the Fourth Eurographics Symposium on Geometry Processing; June 2006; Goslar, Germany.
37
Livny Y, Yan F, Olson M, Chen B, Zhang H, El-Sana J. Automatic reconstruction of tree skeletal structures from point clouds. In: ACM SIGGRAPH Asia 2010 Papers. New York (NY): Association for Computing Machinery; 2010. p. 1–8.
38

Delagrange S, Jauvin C, Rochon P. Pypetree: A tool for reconstructing tree perennial tissues from point clouds. Sensors. 2014;14(3):4271–4289.

39

Fan G, Nan L, Dong Y, Su X, Chen F. AdQSM: A new method for estimating above ground biomass from TLS point clouds. Remote Sens. (Basel). 2020;12(18):3089.

40

Du S, Lindenbergh R, Ledoux H, Stoter J, Nan L. Adtree: Accurate, detailed, and automatic modelling of laser-scanned trees. Remote Sens. (Basel). 2019;11(18):2074.

41

Ge L, Zou K, Zhou H, Yu X, Tan Y, Zhang C, Li W. Three dimensional apple tree organs classification and yield estimation algorithm based on multi-features fusion and support vector machine. Inf Process Agric. 2022;9(3):431–442.

42

Gené-Mola J, Gregorio E, Auat Cheein F, Guevara J, Llorens J, Sanz-Cortiella R, Escolà A, Rosell-Polo JR. Fruit detection, yield prediction and canopy geometric characterization using LiDAR with forced air flow. Comput Electron Agric. 2020;168:Article 105121.

43

Gené-Mola J, Sanz-Cortiella R, Rosell-Polo JR, Morros JR, Ruiz-Hidalgo J, Vilaplana V, Gregorio E. Fruit detection and 3D location using instance segmentation neural networks and structure-from-motion photogrammetry. Comput Electron Agric. 2020;169:Article 105165.

44

Tao Y, Zhou J. Automatic apple recognition based on the fusion of color and 3D feature for robotic fruit picking. Comput Electron Agric. 2017;142:388–396.

45

Jin S, Su Y, Gao S, Wu F, Ma Q, Xu K, Ma Q, Hu T, Liu J, Pang S, et al. Separating the structural components of maize for field phenotyping using terrestrial LiDAR data and deep convolutional neural networks. IEEE Trans. Geosci. Remote Sens. 2019;58(4):2644–2658.

46

Li Y, Wen W, Miao T, Wu S, Yu Z, Wang X, Guo X, Zhao C. Automatic organ-level point cloud segmentation of maize shoots by integrating high-throughput data acquisition and deep learning. Comput Electron Agric. 2022;193:Article 106702.

47

Sun S, Li C, Chee PW, Paterson AH, Jiang Y, Xu R, Robertson JS, Adhikari J, Shehzad T. Three-dimensional photogrammetric mapping of cotton bolls in situ based on point cloud segmentation and clustering. ISPRS J Photogramm Remote Sens. 2020;160:195.

48
Luo L, Jiang X, Yang Y, Samy ERA, Lefsrud M, Hoyos-Villegas V, Sun S. Eff-3DPSeg: 3D organ-level plant shoot segmentation using annotation-efficient point clouds. arXiv. 2022. arXiv:2212.10263.
49

Zhang C, Yang G, Jiang Y, Xu B, Li X, Zhu Y, Lei L, Chen R, Dong Z, Yang H. Apple tree branch information extraction from terrestrial laser scanning and backpack-LiDAR. Remote Sens. (Basel). 2020;12(21):3592.

50

Dong X, Kim WY, Zheng Y, Oh J-Y, Ehsani R, Lee K-H. Three-dimensional quantification of apple phenotypic traits based on deep learning instance segmentation. Comput Electron Agric. 2023;212:108156.

51

Tsoulias N, Xanthopoulos G, Fountas S, Zude-Sasse M. Effects of soil eca and LiDAR-derived leaf area on yield and fruit quality in apple production. Biosyst Eng. 2022;223(Part B):182–199.

53

Vicari MB, Disney M, Wilkes P, Burt A, Calders K, Woodgate W. Leaf and wood classification framework for terrestrial LiDAR point clouds. Methods Ecol Evol. 2019;10(5):680–694.

54

Li T, Meng C. Modern subsampling methods for large-scale least squares regression. Int J Cyber Phys Syst. 2020;2(2):1–28.

55

Meng C, Xie R, Mandal A, Zhang X, Zhong W, Ma P. LowCon: A design-based subsampling approach in a misspecified linear model. J. Comput. Graph. Stat. 2021;30(3):694–708.

56

Meng C, Yu J, Chen Y, Zhong W, Ma P. Smoothing splines approximation using Hilbert curve basis selection. J. Comput. Graph. Stat. 2022;31(3):802–812.

57
Li T, Meng C, Xu H, Yu J. Hilbert curve projection distance for distribution comparison. arXiv. 2022. arXiv:2205.15059.
58
Cao J, Tagliasacchi A, Olson M, Zhang H, Su Z. Point cloud skeletons via laplacian based contraction. Paper presented at: Proceedings of the 2010 Shape Modeling International Conference. 21–23 June 2010; Aix-en-Provence, France.
59

Sun S, Li C, Chee PW, Paterson AH, Meng C, Zhang J, Ma P, Robertson JS, Adhikari J. High resolution 3D terrestrial LiDAR for cotton plant main stalk and node detection. Comput Electron Agric. 2021;187:106276.

60

Fu L, Liu J, Zhou J, Zhang M, Lin Y. Tree skeletonization for raw point cloud exploiting cylindrical shape prior. IEEE Access. 2020;8:27327–27341.

61
Raumonen P. Åkerblom M. Treeqsm (2022); https://github.com/InverseTampere/TreeQSM.
62
Rodriguez-Sanchez J, Li C. An autonomous ground system for 3D LiDAR-based crop scouting. Paper presented at: 2022 ASABE Annual International Meeting; 2022; St. Joseph, Michigan.
63
Huang X, Mei G, Zhang J, Abbas R, A comprehensive survey on point cloud registration. arXiv. 2021. arXiv:2103.02690.
64
Wang Y, Solomon J. Deep closest point: Learning representations for point cloud registration. Paper presented at: Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision; 27 October to 2 November 2019; Seoul, South Korea.
65
Xie H, Yao H, Zhou S, Mao J, Zhang S, Sun W. GRNet: Gridding residual network for dense point cloud completion. Paper presented at: Proceedings of the Computer Vision–ECCV 2020: 16th European Conference, Part Ⅸ; 23–28 August 2020; Glasgow, UK.
66
Yu X, Rao Y, Wang Z, Lu J, Zhou J, AdaPoinTr: Diverse point cloud completion with adaptive geometry-aware transformers. arXiv. 2022. arXiv:2301.04545.
67
Yu X, Rao Y, Wang Z, Liu Z, Lu J, Zhou J. PoinTr: Diverse point cloud completion with geometry-aware transformers. Paper presented at: Proceedings of the 2021 IEEE/CVF International Conference on Computer Vision (ICCV); 10–17 October 2021; Montreal, QC, Canada.
68
Yuan W, Khot T, Held D, Mertz C, Hebert M. PCN: Point completion network. Paper presented at: Proceedings of the 2018 International Conference on 3D Vision (3DV); 5–8 September 2018; Verona, Italy.
Plant Phenomics
Article number: 0179
Cite this article:
Qiu T, Wang T, Han T, et al. AppleQSM: Geometry-Based 3D Characterization of Apple Tree Architecture in Orchards. Plant Phenomics, 2024, 6: 0179. https://doi.org/10.34133/plantphenomics.0179

157

Views

1

Crossref

0

Web of Science

1

Scopus

0

CSCD

Altmetrics

Received: 01 February 2024
Accepted: 27 March 2024
Published: 08 May 2024
© 2024 Tian Qiu et al. Exclusive licensee Nanjing Agricultural University. No claim to original U.S. Government Works.

Distributed under a Creative Commons Attribution License 4.0 (CC BY 4.0).

Return