Discover the SciOpen Platform and Achieve Your Research Goals with Ease.
Search articles, authors, keywords, DOl and etc.
The architecture of apple trees plays a pivotal role in shaping their growth and fruit-bearing potential, forming the foundation for precision apple management. Traditionally, 2D imaging technologies were employed to delineate the architectural traits of apple trees, but their accuracy was hampered by occlusion and perspective ambiguities. This study aimed to surmount these constraints by devising a 3D geometry-based processing pipeline for apple tree structure segmentation and architectural trait characterization, utilizing point clouds collected by a terrestrial laser scanner (TLS). The pipeline consisted of four modules: (a) data preprocessing module, (b) tree instance segmentation module, (c) tree structure segmentation module, and (d) architectural trait extraction module. The developed pipeline was used to analyze 84 trees of two representative apple cultivars, characterizing architectural traits such as tree height, trunk diameter, branch count, branch diameter, and branch angle. Experimental results indicated that the established pipeline attained an R2 of 0.92 and 0.83, and a mean absolute error (MAE) of 6.1 cm and 4.71 mm for tree height and trunk diameter at the tree level, respectively. Additionally, at the branch level, it achieved an R2 of 0.77 and 0.69, and a MAE of 6.86 mm and 7.48° for branch diameter and angle, respectively. The accurate measurement of these architectural traits can enable precision management in high-density apple orchards and bolster phenotyping endeavors in breeding programs. Moreover, bottlenecks of 3D tree characterization in general were comprehensively analyzed to reveal future development.
Boyer J, Liu RH. Apple phytochemicals and their health benefits. Nutr. J. 2004;3:5.
Jiang Y, Li C. Convolutional neural networks for image-based high-throughput plant phenotyping: A review. Plant Phenomics. 2020;2020:4152816.
Jin S, Sun X, Wu F, Su Y, Li Y, Song S, Xu K, Ma Q, Baret F, Jiang D, et al. Lidar sheds new light on plant phenomics for plant breeding and management: Recent advances and future prospects. ISPRS J Photogramm Remote Sens. 2021;171:202–223.
Li L, Zhang Q, Huang D. A review of imaging techniques for plant phenotyping. Sensors. 2014;14(11):20078–20111.
Li Z, Guo R, Li M, Chen Y, Li G. A review of computer vision technologies for plant phenotyping. Comput Electron Agric. 2020;176:Article 105672.
Straub J, Reiser D, Lüling N, Stana A, Griepentrog HW. Approach for graph based individual branch modelling of meadow orchard trees with 3D point clouds. Precis Agric. 2022;23(6):1967–1982.
Aggelopoulou A, Bochtis D, Fountas S, Swain KC, Gemtos TA, Nanos GD. Yield prediction in apple orchards based on image processing. Precis Agric. 2011;12:448–456.
Gongal A, Amatya S, Karkee M, Zhang Q, Lewis K. Sensors and systems for fruit detection and localization: A review. Comput Electron Agric. 2015;116:8–19.
Linker R, Cohen O, Naor A. Determination of the number of green apples in rgb images recorded in orchards. Comput Electron Agric. 2012;81:45–57.
Gongal A, Silwal A, Amatya S, Karkee M, Zhang Q, Lewis K. Apple crop-load estimation with over-the-row machine vision system. Comput Electron Agric. 2016;120:26–35.
Juman MA, Wong YW, Rajkumar RK, Goh LJ. A novel tree trunk detection method for oil-palm plantation navigation. Comput Electron Agric. 2016;128:172–180.
Majeed Y, Zhang J, Zhang X, Fu L, Karkee M, Zhang Q, Whiting MD. Deep learning based segmentation for automated training of apple trees on trellis wires. Comput Electron Agric. 2020;170:Article 105277.
Zhang J, He L, Karkee M, Zhang Q, Zhang X, Gao Z. Branch detection for apple trees trained in fruiting wall architecture using depth features and regions-convolutional neural network (r-cnn). Comput Electron Agric. 2018;155:386–393.
Mu X, He L, Heinemann P, Schupp J, Karkee M. Mask R-CNN based apple flower detection and king flower identification for precision pollination. Smart Agric Technol. 2023;4:Article 100151.
Wang XA, Tang J, Whitty M. Side-view apple flower mapping using edge-based fully convolutional networks for variable rate chemical thinning. Comput Electron Agric. 2020;178:Article 105673.
Ni X, Li C, Jiang H, Takeda F. Deep learning image segmentation and extraction of blueberry fruit traits associated with harvestability and yield. Hortic Res. 2020;7:110.
Mochida K, Koda S, Inoue K, Hirayama T, Tanaka S, Nishii R, Melgani F. Computer vision-based phenotyping for improvement of plant productivity: A machine learning perspective. Gigascience. 2019;8(1):giy153.
Okura F. 3D modeling and reconstruction of plants and trees: A cross-cutting review across computer graphics, vision, and plant phenotyping. Breed Sci. 2022;72(1):31–47.
Paulus S. Measuring crops in 3D: Using geometry for plant phenotyping. Plant Methods. 2019;15(1):103.
Paturkar A, Sen Gupta G, Bailey D. Making use of 3D models for plant physiognomic analysis: A review. Remote Sens. (Basel). 2021;13(11):2232.
Xia S, Chen D, Wang R, Li J, Zhang X. Geometric primitives in LiDAR point clouds: A review. IEEE J Sel Top Appl Earth Obs Remote Sens. 2020;13:685–707.
Bornand A, Rehush N, Morsdorf F, Thürig E, Abegg M. Individual tree volume estimation with terrestrial laser scanning: Evaluating reconstructive and allometric approaches. Agric. For. Meteorol. 2023;341:Article 109654.
Brede B, Calders K, Lau A, Raumonen P, Bartholomeus HM, Herold M, Kooistra L. Non-destructive tree volume estimation through quantitative structure modelling: Comparing UAV laser scanning with terrestrial LIDAR. Remote Sens. Environ. 2019;233:Article 111355.
Calders K, Newnham G, Burt A, Murphy S, Raumonen P, Herold M, Culvenor D, Avitabile V, Disney M, Armston J, et al. Nondestructive estimates of above-ground biomass using terrestrial laser scanning. Methods Ecol Evol. 2015;6(2):198–208.
Disney M, Burt A, Wilkes P, Armston J, Duncanson L. New 3D measurements of large redwood trees for biomass and structure. Sci. Rep. 2020;10(1):16721.
Allen MJ, Grieve SW, Owen HJ, Lines ER. Tree species classification from complex laser scanning data in mediterranean forests using deep learning. Methods Ecol Evol. 2023;14(7):1657–1667.
Calders K, Origo N, Burt A, Disney M, Nightingale J, Raumonen P, Åkerblom M, Malhi Y, Lewis P. Realistic forest stand reconstruction from terrestrial LiDAR for radiative transfer modelling. Remote Sens. (Basel). 2018;10(6):933.
Bucksch A, Lindenbergh R, Menenti M. SkelTre: Robust skeleton extraction from imperfect point clouds. Vis Comput. 2010;26(10):1283–1300.
Hackenberg J, Spiecker H, Calders K, Disney M, Raumonen P. Simpletree—An efficient open source tool to build tree models from tls clouds. Forests. 2015;6(11):4245–4294.
Raumonen P, Kaasalainen M, Åkerblom M, Kaasalainen S, Kaartinen H, Vastaranta M, Holopainen M, Disney M, Lewis P. Fast automatic precision tree models from terrestrial laser scanner data. Remote Sens. (Basel). 2013;5(2):491–520.
Delagrange S, Jauvin C, Rochon P. Pypetree: A tool for reconstructing tree perennial tissues from point clouds. Sensors. 2014;14(3):4271–4289.
Fan G, Nan L, Dong Y, Su X, Chen F. AdQSM: A new method for estimating above ground biomass from TLS point clouds. Remote Sens. (Basel). 2020;12(18):3089.
Du S, Lindenbergh R, Ledoux H, Stoter J, Nan L. Adtree: Accurate, detailed, and automatic modelling of laser-scanned trees. Remote Sens. (Basel). 2019;11(18):2074.
Ge L, Zou K, Zhou H, Yu X, Tan Y, Zhang C, Li W. Three dimensional apple tree organs classification and yield estimation algorithm based on multi-features fusion and support vector machine. Inf Process Agric. 2022;9(3):431–442.
Gené-Mola J, Gregorio E, Auat Cheein F, Guevara J, Llorens J, Sanz-Cortiella R, Escolà A, Rosell-Polo JR. Fruit detection, yield prediction and canopy geometric characterization using LiDAR with forced air flow. Comput Electron Agric. 2020;168:Article 105121.
Gené-Mola J, Sanz-Cortiella R, Rosell-Polo JR, Morros JR, Ruiz-Hidalgo J, Vilaplana V, Gregorio E. Fruit detection and 3D location using instance segmentation neural networks and structure-from-motion photogrammetry. Comput Electron Agric. 2020;169:Article 105165.
Tao Y, Zhou J. Automatic apple recognition based on the fusion of color and 3D feature for robotic fruit picking. Comput Electron Agric. 2017;142:388–396.
Jin S, Su Y, Gao S, Wu F, Ma Q, Xu K, Ma Q, Hu T, Liu J, Pang S, et al. Separating the structural components of maize for field phenotyping using terrestrial LiDAR data and deep convolutional neural networks. IEEE Trans. Geosci. Remote Sens. 2019;58(4):2644–2658.
Li Y, Wen W, Miao T, Wu S, Yu Z, Wang X, Guo X, Zhao C. Automatic organ-level point cloud segmentation of maize shoots by integrating high-throughput data acquisition and deep learning. Comput Electron Agric. 2022;193:Article 106702.
Sun S, Li C, Chee PW, Paterson AH, Jiang Y, Xu R, Robertson JS, Adhikari J, Shehzad T. Three-dimensional photogrammetric mapping of cotton bolls in situ based on point cloud segmentation and clustering. ISPRS J Photogramm Remote Sens. 2020;160:195.
Zhang C, Yang G, Jiang Y, Xu B, Li X, Zhu Y, Lei L, Chen R, Dong Z, Yang H. Apple tree branch information extraction from terrestrial laser scanning and backpack-LiDAR. Remote Sens. (Basel). 2020;12(21):3592.
Dong X, Kim WY, Zheng Y, Oh J-Y, Ehsani R, Lee K-H. Three-dimensional quantification of apple phenotypic traits based on deep learning instance segmentation. Comput Electron Agric. 2023;212:108156.
Tsoulias N, Xanthopoulos G, Fountas S, Zude-Sasse M. Effects of soil eca and LiDAR-derived leaf area on yield and fruit quality in apple production. Biosyst Eng. 2022;223(Part B):182–199.
Vicari MB, Disney M, Wilkes P, Burt A, Calders K, Woodgate W. Leaf and wood classification framework for terrestrial LiDAR point clouds. Methods Ecol Evol. 2019;10(5):680–694.
Li T, Meng C. Modern subsampling methods for large-scale least squares regression. Int J Cyber Phys Syst. 2020;2(2):1–28.
Meng C, Xie R, Mandal A, Zhang X, Zhong W, Ma P. LowCon: A design-based subsampling approach in a misspecified linear model. J. Comput. Graph. Stat. 2021;30(3):694–708.
Meng C, Yu J, Chen Y, Zhong W, Ma P. Smoothing splines approximation using Hilbert curve basis selection. J. Comput. Graph. Stat. 2022;31(3):802–812.
Sun S, Li C, Chee PW, Paterson AH, Meng C, Zhang J, Ma P, Robertson JS, Adhikari J. High resolution 3D terrestrial LiDAR for cotton plant main stalk and node detection. Comput Electron Agric. 2021;187:106276.
Fu L, Liu J, Zhou J, Zhang M, Lin Y. Tree skeletonization for raw point cloud exploiting cylindrical shape prior. IEEE Access. 2020;8:27327–27341.
Distributed under a Creative Commons Attribution License 4.0 (CC BY 4.0).