Real Time Pear Fruit Detection and Counting Using YOLOv4 Models and Deep SORT.

Addie Ira Borja Parico, Tofael Ahamed
Author Information
  1. Addie Ira Borja Parico: Graduate School of Life and Environmental Sciences, University of Tsukuba, Tennodai 1-1-1, Tsukuba, Ibaraki 305-8577, Japan.
  2. Tofael Ahamed: Faculty of Life and Environmental Sciences, University of Tsukuba, Tennodai 1-1-1, Tsukuba, Ibaraki 305-8577, Japan.

Abstract

This study aimed to produce a robust real-time pear fruit counter for mobile applications using only RGB data, the variants of the state-of-the-art object detection model YOLOv4, and the multiple object-tracking algorithm Deep SORT. This study also provided a systematic and pragmatic methodology for choosing the most suitable model for a desired application in agricultural sciences. In terms of accuracy, YOLOv4-CSP was observed as the optimal model, with an AP@0.50 of 98%. In terms of speed and computational cost, YOLOv4-tiny was found to be the ideal model, with a speed of more than 50 FPS and FLOPS of 6.8-14.5. If considering the balance in terms of accuracy, speed and computational cost, YOLOv4 was found to be most suitable and had the highest accuracy metrics while satisfying a real time speed of greater than or equal to 24 FPS. Between the two methods of counting with Deep SORT, the unique ID method was found to be more reliable, with an F1count of 87.85%. This was because YOLOv4 had a very low false negative in detecting pear fruits. The ROI line is more reliable because of its more restrictive nature, but due to flickering in detection it was not able to count some pears despite their being detected.

Keywords

References

  1. IEEE Trans Pattern Anal Mach Intell. 2017 Jun;39(6):1137-1149 [PMID: 27295650]
  2. Sensors (Basel). 2020 Apr 10;20(7): [PMID: 32290173]
  3. Sci Rep. 2021 Jan 14;11(1):1447 [PMID: 33446897]
  4. J Big Data. 2021;8(1):101 [PMID: 34306963]

MeSH Term

Algorithms
Fruit
Pyrus

Word Cloud

Created with Highcharts 10.0.0YOLOv4detectionmodelDeepSORTspeedobjecttermsaccuracyfoundstudypearfruitsuitable50computationalcostFPSrealtimecountingreliableaimedproducerobustreal-timecountermobileapplicationsusingRGBdatavariantsstate-of-the-artmultipleobject-trackingalgorithmalsoprovidedsystematicpragmaticmethodologychoosingdesiredapplicationagriculturalsciencesYOLOv4-CSPobservedoptimalAP@098%YOLOv4-tinyidealFLOPS68-145consideringbalancehighestmetricssatisfyinggreaterequal24twomethodsuniqueIDmethodF1count8785%lowfalsenegativedetectingfruitsROIlinerestrictivenaturedueflickeringablecountpearsdespitedetectedRealTimePearFruitDetectionCountingUsingModelsYOLO

Similar Articles

Cited By