Lettuce Production in Intelligent Greenhouses-3D Imaging and Computer Vision for Plant Spacing Decisions.

Anna Selini Petropoulou, Bart van Marrewijk, Feije de Zwart, Anne Elings, Monique Bijlaard, Tim van Daalen, Guido Jansen, Silke Hemming
Author Information
  1. Anna Selini Petropoulou: Business Unit Greenhouse Horticulture, Wageningen University & Research (WUR), 6708 PB Wageningen, The Netherlands. ORCID
  2. Bart van Marrewijk: Business Unit Greenhouse Horticulture, Wageningen University & Research (WUR), 6708 PB Wageningen, The Netherlands. ORCID
  3. Feije de Zwart: Business Unit Greenhouse Horticulture, Wageningen University & Research (WUR), 6708 PB Wageningen, The Netherlands. ORCID
  4. Anne Elings: Business Unit Greenhouse Horticulture, Wageningen University & Research (WUR), 6708 PB Wageningen, The Netherlands. ORCID
  5. Monique Bijlaard: Business Unit Greenhouse Horticulture, Wageningen University & Research (WUR), 6708 PB Wageningen, The Netherlands.
  6. Tim van Daalen: Business Unit Greenhouse Horticulture, Wageningen University & Research (WUR), 6708 PB Wageningen, The Netherlands.
  7. Guido Jansen: Business Unit Greenhouse Horticulture, Wageningen University & Research (WUR), 6708 PB Wageningen, The Netherlands. ORCID
  8. Silke Hemming: Business Unit Greenhouse Horticulture, Wageningen University & Research (WUR), 6708 PB Wageningen, The Netherlands. ORCID

Abstract

Recent studies indicate that food demand will increase by 35-56% over the period 2010-2050 due to population increase, economic development, and urbanization. Greenhouse systems allow for the sustainable intensification of food production with demonstrated high crop production per cultivation area. Breakthroughs in resource-efficient fresh food production merging horticultural and AI expertise take place with the international competition "Autonomous Greenhouse Challenge". This paper describes and analyzes the results of the third edition of this competition. The competition's goal is the realization of the highest net profit in fully autonomous lettuce production. Two cultivation cycles were conducted in six high-tech greenhouse compartments with operational greenhouse decision-making realized at a distance and individually by algorithms of international participating teams. Algorithms were developed based on time series sensor data of the greenhouse climate and crop images. High crop yield and quality, short growing cycles, and low use of resources such as energy for heating, electricity for artificial light, and CO were decisive in realizing the competition's goal. The results highlight the importance of plant spacing and the moment of harvest decisions in promoting high crop growth rates while optimizing greenhouse occupation and resource use. In this paper, images taken with depth cameras (RealSense) for each greenhouse were used by computer vision algorithms (Deepabv3+ implemented in detectron2 v0.6) in deciding optimum plant spacing and the moment of harvest. The resulting plant height and coverage could be accurately estimated with an R of 0.976, and a mIoU of 98.2, respectively. These two traits were used to develop a light loss and harvest indicator to support remote decision-making. The light loss indicator could be used as a decision tool for timely spacing. Several traits were combined for the harvest indicator, ultimately resulting in a fresh weight estimation with a mean absolute error of 22 g. The proposed non-invasively estimated indicators presented in this article are promising traits to be used towards full autonomation of a dynamic commercial lettuce growing environment. Computer vision algorithms act as a catalyst in remote and non-invasive sensing of crop parameters, decisive for automated, objective, standardized, and data-driven decision making. However, spectral indexes describing lettuces growth and larger datasets than the currently accessible are crucial to address existing shortcomings between academic and industrial production systems that have been encountered in this work.

Keywords

References

  1. Metabolomics. 2018 Oct 29;14(11):146 [PMID: 30830450]
  2. Int J Environ Res Public Health. 2020 Jan 20;17(2): [PMID: 31968567]
  3. Sensors (Basel). 2019 Apr 16;19(8): [PMID: 31014024]
  4. Front Plant Sci. 2017 May 15;8:786 [PMID: 28555150]
  5. Nat Food. 2021 Jul;2(7):494-501 [PMID: 37117684]
  6. Nature. 2011 Oct 12;478(7369):337-42 [PMID: 21993620]
  7. NPJ Sci Food. 2022 Oct 10;6(1):47 [PMID: 36216835]
  8. Sensors (Basel). 2017 Apr 20;17(4): [PMID: 28425947]
  9. Plant Methods. 2019 Sep 3;15:103 [PMID: 31497064]
  10. Hortic Res. 2019 Jun 1;6:70 [PMID: 31231528]
  11. Sensors (Basel). 2020 Nov 11;20(22): [PMID: 33187119]
  12. Front Plant Sci. 2020 Oct 06;11:563386 [PMID: 33123178]
  13. Sensors (Basel). 2022 Jul 23;22(15): [PMID: 35898004]
  14. Sensors (Basel). 2022 Oct 19;22(20): [PMID: 36298316]
  15. Front Plant Sci. 2022 Aug 25;13:980581 [PMID: 36092436]

MeSH Term

Lactuca
Imaging, Three-Dimensional
Crop Production
Climate
Computers

Word Cloud

Created with Highcharts 10.0.0productioncropgreenhouseplantspacingharvestusedfoodlettucealgorithmsgrowinglightvisiontraitsindicatorremoteincreaseGreenhousesystemshighcultivationfreshinternationalcompetitionpaperresultscompetition'sgoalautonomouscyclesdecision-makingdataclimateimagesuseartificialdecisivemomentgrowthcomputerresultingestimatedlossdecisionComputercontrolRecentstudiesindicatedemandwill35-56%period2010-2050duepopulationeconomicdevelopmenturbanizationallowsustainableintensificationdemonstratedperareaBreakthroughsresource-efficientmerginghorticulturalAIexpertisetakeplace"AutonomousChallenge"describesanalyzesthirdeditionrealizationhighestnetprofitfullyTwoconductedsixhigh-techcompartmentsoperationalrealizeddistanceindividuallyparticipatingteamsAlgorithmsdevelopedbasedtimeseriessensorHighyieldqualityshortlowresourcesenergyheatingelectricityCOrealizinghighlightimportancedecisionspromotingratesoptimizingoccupationresourcetakendepthcamerasRealSenseDeepabv3+implementeddetectron2v06decidingoptimumheightcoverageaccuratelyR0976mIoU982respectivelytwodevelopsupporttooltimelySeveralcombinedultimatelyweightestimationmeanabsoluteerror22gproposednon-invasivelyindicatorspresentedarticlepromisingtowardsfullautonomationdynamiccommercialenvironmentactcatalystnon-invasivesensingparametersautomatedobjectivestandardizeddata-drivenmakingHoweverspectralindexesdescribinglettuceslargerdatasetscurrentlyaccessiblecrucialaddressexistingshortcomingsacademicindustrialencounteredworkLettuceProductionIntelligentGreenhouses-3DImagingVisionPlantSpacingDecisionsintelligencegreenhousesdrivenindoorfarmingsensors

Similar Articles

Cited By (3)