Panicle-SEG: a robust image segmentation method for rice panicles in the field based on deep learning and superpixel optimization.

Xiong Xiong, Lingfeng Duan, Lingbo Liu, Haifu Tu, Peng Yang, Dan Wu, Guoxing Chen, Lizhong Xiong, Wanneng Yang, Qian Liu
Author Information
  1. Xiong Xiong: Britton Chance Center for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics, and Key Laboratory of Ministry of Education for Biomedical Photonics, Department of Biomedical Engineering, Huazhong University of Science and Technology, Wuhan, 430074 People's Republic of China.
  2. Lingfeng Duan: National Key Laboratory of Crop Genetic Improvement, National Center of Plant Gene Research, Agricultural Bioinformatics Key Laboratory of Hubei Province, and College of Engineering, Huazhong Agricultural University, Wuhan, 430070 People's Republic of China.
  3. Lingbo Liu: Britton Chance Center for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics, and Key Laboratory of Ministry of Education for Biomedical Photonics, Department of Biomedical Engineering, Huazhong University of Science and Technology, Wuhan, 430074 People's Republic of China.
  4. Haifu Tu: National Key Laboratory of Crop Genetic Improvement, National Center of Plant Gene Research, Agricultural Bioinformatics Key Laboratory of Hubei Province, and College of Engineering, Huazhong Agricultural University, Wuhan, 430070 People's Republic of China.
  5. Peng Yang: National Key Laboratory of Crop Genetic Improvement, National Center of Plant Gene Research, Agricultural Bioinformatics Key Laboratory of Hubei Province, and College of Engineering, Huazhong Agricultural University, Wuhan, 430070 People's Republic of China.
  6. Dan Wu: National Key Laboratory of Crop Genetic Improvement, National Center of Plant Gene Research, Agricultural Bioinformatics Key Laboratory of Hubei Province, and College of Engineering, Huazhong Agricultural University, Wuhan, 430070 People's Republic of China.
  7. Guoxing Chen: National Key Laboratory of Crop Genetic Improvement, National Center of Plant Gene Research, Agricultural Bioinformatics Key Laboratory of Hubei Province, and College of Engineering, Huazhong Agricultural University, Wuhan, 430070 People's Republic of China.
  8. Lizhong Xiong: National Key Laboratory of Crop Genetic Improvement, National Center of Plant Gene Research, Agricultural Bioinformatics Key Laboratory of Hubei Province, and College of Engineering, Huazhong Agricultural University, Wuhan, 430070 People's Republic of China.
  9. Wanneng Yang: National Key Laboratory of Crop Genetic Improvement, National Center of Plant Gene Research, Agricultural Bioinformatics Key Laboratory of Hubei Province, and College of Engineering, Huazhong Agricultural University, Wuhan, 430070 People's Republic of China.
  10. Qian Liu: Britton Chance Center for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics, and Key Laboratory of Ministry of Education for Biomedical Photonics, Department of Biomedical Engineering, Huazhong University of Science and Technology, Wuhan, 430074 People's Republic of China.

Abstract

BACKGROUND: Rice panicle phenotyping is important in rice breeding, and rice panicle segmentation is the first and key step for image-based panicle phenotyping. Because of the challenge of illumination differentials, panicle shape deformations, rice accession variations, different reproductive stages and the field's complex background, rice panicle segmentation in the field is a very large challenge.
RESULTS: In this paper, we propose a rice panicle segmentation algorithm called Panicle-SEG, which is based on simple linear iterative clustering superpixel regions generation, convolutional neural network classification and entropy rate superpixel optimization. To build the Panicle-SEG-CNN model and test the segmentation effects, 684 training images and 48 testing images were randomly selected, respectively. Six indicators, including Qseg, Sr, SSIM, Precision, Recall and F-measure, are employed to evaluate the segmentation effects, and the average segmentation results for the 48 testing samples are 0.626, 0.730, 0.891, 0.821, 0.730, and 76.73%, respectively. Compared with other segmentation approaches, including HSeg, i2 hysteresis thresholding and jointSeg, the proposed Panicle-SEG algorithm has better performance on segmentation accuracy. Meanwhile, the executing speed is also improved when combined with multithreading and CUDA parallel acceleration. Moreover, Panicle-SEG was demonstrated to be a robust segmentation algorithm, which can be expanded for different rice accessions, different field environments, different camera angles, different reproductive stages, and indoor rice images. The testing dataset and segmentation software are available online.
CONCLUSIONS: In conclusion, the results demonstrate that Panicle-SEG is a robust method for panicle segmentation, and it creates a new opportunity for nondestructive yield estimation.

Keywords

References

  1. Plant Physiol. 2014 Apr 2;165(2):479-495 [PMID: 24696519]
  2. IEEE Trans Pattern Anal Mach Intell. 2012 Nov;34(11):2274-82 [PMID: 22641706]
  3. Proc Natl Acad Sci U S A. 2007 Oct 16;104(42):16402-9 [PMID: 17923667]
  4. Curr Opin Plant Biol. 2013 May;16(2):180-7 [PMID: 23578473]
  5. Plant J. 2015 Aug;83(3):427-38 [PMID: 26043067]
  6. Plant Dis. 2014 Apr;98(4):566 [PMID: 30708715]
  7. IEEE Trans Image Process. 2004 Apr;13(4):600-12 [PMID: 15376593]
  8. Plant Methods. 2015 Feb 13;11:7 [PMID: 25705245]

Word Cloud

Created with Highcharts 10.0.0segmentationricepanicledifferent0Panicle-SEGfieldalgorithmsuperpixelimagestestingrobustRicephenotypingchallengereproductivestagesbasedneuralnetworkoptimizationeffects48respectivelyincludingresults730methodpanicleslearningBACKGROUND:importantbreedingfirstkeystepimage-basedilluminationdifferentialsshapedeformationsaccessionvariationsfield'scomplexbackgroundlargeRESULTS:paperproposecalledsimplelineariterativeclusteringregionsgenerationconvolutionalclassificationentropyratebuildPanicle-SEG-CNNmodeltest684trainingrandomlyselectedSixindicatorsQsegSrSSIMPrecisionRecallF-measureemployedevaluateaveragesamples6268918217673%ComparedapproachesHSegi2hysteresisthresholdingjointSegproposedbetterperformanceaccuracyMeanwhileexecutingspeedalsoimprovedcombinedmultithreadingCUDAparallelaccelerationMoreoverdemonstratedcanexpandedaccessionsenvironmentscameraanglesindoordatasetsoftwareavailableonlineCONCLUSIONS:conclusiondemonstratecreatesnewopportunitynondestructiveyieldestimationPanicle-SEG:imagedeepConvolutionalDeepImageOsativaSuperpixel

Similar Articles

Cited By