AI Chat Paper
Note: Please note that the following content is generated by AMiner AI. SciOpen does not take any responsibility related to this content.
{{lang === 'zh_CN' ? '文章概述' : 'Summary'}}
{{lang === 'en_US' ? '中' : 'Eng'}}
Chat more with AI
Article Link
Collect
Submit Manuscript
Show Outline
Outline
Show full outline
Hide outline
Outline
Show full outline
Hide outline
Research Article | Open Access

A Framework for Single-Panicle Litchi Flower Counting by Regression with Multitask Learning

Jiaquan Lin1Jun Li1,2,3( )Zhe Ma1Can Li1Guangwen Huang1Huazhong Lu4
College of Engineering, South China Agricultural University, Guangzhou 510642, China
Guangdong Laboratory for Lingnan Modern Agriculture, Guangzhou 510642, China
State Key Laboratory of Agricultural Equipment Technology, Beijing 100083, China
Guangdong Academy of Agricultural Sciences, Guangzhou 510640, China
Show Author Information

Abstract

The number of flowers is essential for evaluating the growth status of litchi trees and enables researchers to estimate flowering rates and conduct various phenotypic studies, particularly focusing on the information of individual panicles. However, manual counting remains the primary method for quantifying flowers, and there has been insufficient emphasis on the advancement of reliable deep learning methods for estimation and their integration into research. Furthermore, the current density map-based methods are susceptible to background interference. To tackle the challenges of accurately quantifying small and dense male litchi flowers, a framework counting the flowers in panicles is proposed. Firstly, an existing effective algorithm YOLACT++ is utilized to segment individual panicles from images. Secondly, a novel algorithm FlowerNet based on density map regression is proposed to accurately count flowers in each panicle. By employing a multitask learning approach, FlowerNet effectively captures both foreground and background information, thereby overcoming interference from non-target areas during pixel-level regression tasks. It achieves a mean absolute error of 47.71 and a root mean squared error of 61.78 on the flower dataset constructed. Additionally, a regression equation is established using a dataset of inflorescences to examine the application of the algorithm for flower counting. It captures the relationship between the predicted number of flowers by FlowerNet and the manually counted number, resulting in a determination coefficient (R2) of 0.81. The proposed algorithm shows promise for automated estimation of litchi flowering quantity and can serve as a valuable reference for litchi orchard management during flowering period.

References

1

Chen J, Su Z, Yang S. Analysis on the litchi production situation in 2022. China Trop Agric. 2022;3: 5–14.

2

Qi W, Chen H, Li J. Status, trend and countermeasures of development of litchi industry in the mainland of China in 2022. Guangdong Agric Sci. 2023;50: 147–155.

3

Cai C, Chen J, Ou L, Xi X, Sun Q. Study on litchi blooming habits. Guangdong Agric Sci. 2011;38(21): 20–24.

4

Olesen T, Menzel C, McConchie C, Wiltshire N. Pruning to control tree size, flowering and production of litchi. Sci Hortic. 2013;156: 93–98.

5

Li J, Lu H, Yang Z, Zheng S. Design and experimental study of litchi flexible thinning mechanism. J South China Agric Univ. 2013;34(3): 431–435.

6

Farjon G, Krikeb O, Hillel A, Alchanatis V. Detection and counting of flowers on apple trees for better chemical thinning decisions. Precis Agric. 2020;21: 503–521.

7

Hamuda E, Glavin M, Jones E. A survey of image processing techniques for plant extraction and segmentation in the field. Comput Electron Agric. 2016;125: 184–199.

8

Patrício D, Rieder R. Computer vision and artificial intelligence in precision agriculture for grain crops: A systematic review. Comput Electron Agric. 2018;153: 69–81.

9

Zhang Y, Cao Y, Huo H, Tian L, Dong X, Qi D, Zhang X. Research on diversity of pear germplasm resources based on flowers phenotype traits. Acta Hortic Sin. 2016;43: 1245–1256.

10

Aggelopoulou K, Bochtis D, Fountas S, Swain K, Gemtos TA, Nanos GD. Yield prediction in apple orchards based on image processing. Precis Agric. 2011;12: 448–456.

11

Yeom J, Jung J, Chang A, Maeda M, Landivar J. Automated open cotton boll detection for yield estimation using unmanned aircraft vehicle (UAV) data. Remote Sens. 2018;10(12): 1895.

12

Thorp KR, Dierig DA. Color image segmentation approach to monitor flowering in lesquerella. Ind Crop Prod. 2011;34(1): 1150–1159.

13

Hočevar M, Širok B, Godesa T, Stopar M. Flowering estimation in apple orchards by image analysis. Precis Agric. 2014;15: 466–478.

14

Wang A, Tang J, Whitty M. DeepPhenology: Estimation of apple flower phenology distributions based on deep learning. Comput Electron Agric. 2021;185: Article 106123.

15
Simonyan K, Zisserman A. Very deep convolutional networks for large-scale image recognition. arXiv. 2015. https://arxiv.org/abs/1409.1556
16

Koirala A, Walsh K, Wang Z, Anderson N. Deep learning for mango (Mangifera indica) panicle stage classification. Agronomy. 2020;10(1):143.

17

Dias P, Tabb A, Medeiros H. Multispecies fruit flower detection using a refined semantic segmentation network. IEEE Robot Autom Lett. 2018;3(4):3003–3010.

18

Rahim U, Utsumi T, Mineno H. Deep learning-based accurate grapevine inflorescence and flower quantification in unstructured vineyard images acquired using a mobile sensing platform. Comput Electron Agric. 2022;198: Article 107088.

19

Tian Y, Yang G, Wang Z, Li E, Liang Z. Instance segmentation of apple flowers using the improved mask R–CNN model. Biosyst Eng. 2020;193:264–278.

20

Liu Q, Zhang Y, Yang G. Small unopened cotton boll counting by detection with MRF-YOLO in the wild. Comput Electron Agric. 2023;204: Article 107576.

21

Lu H, Cao Z, Xiao Y, Zhuang B, Shen C. TasselNet: Counting maize tassels in the wild via local counts regression network. Plant Methods. 2017;13(1):79.

22

Bhattarai U, Karkee M. A weakly-supervised approach for flower/fruit counting in apple orchards. Comput Ind. 2022;138: Article 103636.

23

Xiao C, Zheng L, Sun H, Zhang Y, Li M. Estimation of the apple flowers based on aerial multispectral image. Am Soc Agri Biol Engr Annual Intl Meeting. 2014;6:4426–4433.

24

Liu Y, Wang K, Xie R, Lü Q, He S, Yi S, Zheng Y, Deng L. Estimating the number of apple tree flowers based on hyperspectral information of a canopy. Sci Agric Sin. 2016;49(18):3608–3617.

25

Horton R, Cano E, Bulanon D, Fallahi E. Peach flower monitoring using aerial multispectral imaging. J. Imaging. 2017;3(1):2.

26

Xiong J, Liu B, Zhong Z, Chen S, Zheng Z. Litchi flower and leaf segmentation and recognition based on deep semantic segmentation. Trans. Chin. Soc. Agric. Mach. 2021;52:252–258.

27

Lyu S, Zhao Y, Liu X, Zhen L, Wang C, Shen J. Detection of male and female litchi flowers using YOLO-HPFD multi-teacher feature distillation and FPGA-embedded platform. Agronomy. 2023;13(4):987.

28

Ye J, Wu M, Qiu W, Yang J, Lan W. Litchi flower detection method based on polyphyletic loss function. Trans Chinese Soc Agric Machinery. 2023;54(5):253–260.

29

Lin J, Li J, Yang Z, Lu H, Ding Y, Cui H. Estimating litchi flower number using a multicolumn convolutional neural network based on a density map. Precis Agric. 2022;23:1226–1247.

30
Kentaro W. labelme: Image polygonal annotation with python. Git Code. 2016. https://github.com/wkentaro/labelme
31

Bolya D, Zhou C, Xiao F, Lee YJ. YOLACT++: Better real-time instance segmentation. IEEE Trans Pattern Anal Mach Intell. 2022;44(2):1108–1121.

32
Kirillov A, Girshick R, He K, Dollár P. Panoptic feature pyramid networks. arXiv. 2019. https://arxiv.org/abs/1901.02446
33
Bochkovskiy A, Wang C, Liao H. YOLOv4: Optimal speed and accuracy of object detection. arXiv. 2020. https://doi.org/10.48550/arXiv.2004.10934.
34
Boominathan L, Kruthiventi S, Babu R. CrowdNet: A deep convolutional network for dense crowd counting. arXiv. 2016. https://arxiv.org/abs/1608.06197
35
He K, Gkioxari G, Dollár P, Girshick R. Mask R-CNN.Paper presented at: 2017 IEEE International Conference onComputer Vision (ICCV); 2017 Oct 22–29; Venice, Italy.
36

Wang X, Zhang R, Kong T, Li L, Shen C. SOLOv2: Dynamic and fast instance segmentation. Adv Neural Inf Proces Syst. 2020;33:17721–17732.

37
Bolya D, Zhou C, Xiao F, Lee YJ. YOLACT: Real-timeinstance segmentation. Paper presented at: 2019 IEEE/CVFInternational Conference on Computer Vision (ICCV); 2019Oct 27–Nov 02; Seoul, Korea (South).
38
Zhang Y, Zhou D, Chen S, Gao S, Ma Y. Single-image crowdcounting via multi-column convolutional neural network.Paper presented at: 2016 IEEE Conference on ComputerVision and Pattern Recognition (CVPR); 2016 Jun 27–30; LasVegas, NV.
39
Li Y, Zhang X, Chen D. CSRNet: Dilated convolutional neural networks for understanding the highly congested scenes. Paper presented at: 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition; 2018 Jun 18–23; Salt Lake City, UT.
Plant Phenomics
Article number: 0172
Cite this article:
Lin J, Li J, Ma Z, et al. A Framework for Single-Panicle Litchi Flower Counting by Regression with Multitask Learning. Plant Phenomics, 2024, 6: 0172. https://doi.org/10.34133/plantphenomics.0172

212

Views

2

Crossref

2

Web of Science

3

Scopus

0

CSCD

Altmetrics

Received: 13 November 2023
Accepted: 17 March 2024
Published: 15 April 2024
© 2024 J. Lin et al. Exclusive licensee Nanjing Agricultural University. No claim to original U.S. Government Works.

Distributed under a Creative Commons Attribution License 4.0 (CC BY 4.0).

Return