Exploring the use of deep learning models for accurate tracking of 3D zebrafish trajectories.

Yi-Ling Fan, Ching-Han Hsu, Fang-Rong Hsu, Lun-De Liao
Author Information
  1. Yi-Ling Fan: Institute of Biomedical Engineering and Nanomedicine, National Health Research Institutes, Miaoli, Taiwan.
  2. Ching-Han Hsu: Department of Biomedical Engineering and Environmental Sciences, National Tsing-Hua University, Hsinchu, Taiwan.
  3. Fang-Rong Hsu: Department of Information Engineering and Computer Science, Feng Chia University, Taichung, Taiwan.
  4. Lun-De Liao: Institute of Biomedical Engineering and Nanomedicine, National Health Research Institutes, Miaoli, Taiwan.

Abstract

Zebrafish are ideal model organisms for various fields of biological research, including genetics, neural transmission patterns, disease and drug testing, and heart disease studies, because of their unique ability to regenerate cardiac muscle. Tracking zebrafish trajectories is essential for understanding their behavior, physiological states, and disease associations. While 2D tracking methods are limited, 3D tracking provides more accurate descriptions of their movements, leading to a comprehensive understanding of their behavior. In this study, we used deep learning models to track the 3D movements of zebrafish. Videos were captured by two custom-made cameras, and 21,360 images were labeled for the dataset. The YOLOv7 model was trained using hyperparameter tuning, with the top- and side-view camera models trained using the v7x.pt and v7.pt weights, respectively, over 300 iterations with 10,680 data points each. The models achieved impressive results, with an accuracy of 98.7% and a recall of 98.1% based on the test set. The collected data were also used to generate dynamic 3D trajectories. Based on a test set with 3,632 3D coordinates, the final model detected 173.11% more coordinates than the initial model. Compared to the ground truth, the maximum and minimum errors decreased by 97.39% and 86.36%, respectively, and the average error decreased by 90.5%.This study presents a feasible 3D tracking method for zebrafish trajectories. The results can be used for further analysis of movement-related behavioral data, contributing to experimental research utilizing zebrafish.

Keywords

References

  1. IEEE Trans Pattern Anal Mach Intell. 2017 Jun;39(6):1137-1149 [PMID: 27295650]
  2. Neurotoxicol Teratol. 2003 Jan-Feb;25(1):51-7 [PMID: 12633736]
  3. Genes Brain Behav. 2004 Apr;3(2):63-74 [PMID: 15005714]
  4. PLoS One. 2017 Jun 30;12(6):e0180254 [PMID: 28665966]
  5. Sci Rep. 2021 Jun 29;11(1):13492 [PMID: 34188116]
  6. Front Public Health. 2023 Jun 16;11:1188304 [PMID: 37397724]
  7. Pharmacol Biochem Behav. 2000 Dec;67(4):773-82 [PMID: 11166068]
  8. Med Biol Eng Comput. 2024 Jan;62(1):135-149 [PMID: 37735296]
  9. Med Biol Eng Comput. 2023 Nov;61(11):2797-2814 [PMID: 37558927]
  10. Toxics. 2022 Feb 04;10(2): [PMID: 35202255]
  11. Med Biol Eng Comput. 2024 Jan;62(1):207-223 [PMID: 37758870]
  12. Prog Neuropsychopharmacol Biol Psychiatry. 2022 Jan 10;112:110405 [PMID: 34320403]
  13. Sci Rep. 2016 Sep 23;6:34015 [PMID: 27659496]
  14. Nat Rev Genet. 2007 May;8(5):353-67 [PMID: 17440532]
  15. Proc Natl Acad Sci U S A. 2001 Sep 25;98(20):11691-6 [PMID: 11553778]
  16. Sci Rep. 2021 Feb 5;11(1):3219 [PMID: 33547349]
  17. Development. 1990 Jul;109(3):577-84 [PMID: 2401211]
  18. Neurotoxicol Teratol. 2004 Nov-Dec;26(6):709-18 [PMID: 15451034]
  19. J Vis Exp. 2013 Dec 05;(82):50681 [PMID: 24336189]
  20. Front Bioeng Biotechnol. 2023 Jan 20;11:1100968 [PMID: 36741759]
  21. Biosensors (Basel). 2021 Sep 17;11(9): [PMID: 34562933]
  22. Environ Sci Technol. 2021 Feb 2;55(3):1919-1929 [PMID: 33470099]

Word Cloud

Created with Highcharts 10.0.0zebrafish3Dtrackingmodeltrajectoriesmodelsdiseaseuseddataresearchunderstandingbehavioraccuratemovementsstudydeeplearningtrainedusingptrespectivelyresults98testsetcoordinatesdecreasedZebrafishidealorganismsvariousfieldsbiologicalincludinggeneticsneuraltransmissionpatternsdrugtestingheartstudiesuniqueabilityregeneratecardiacmuscleTrackingessentialphysiologicalstatesassociations2DmethodslimitedprovidesdescriptionsleadingcomprehensivetrackVideoscapturedtwocustom-madecameras21360imageslabeleddatasetYOLOv7hyperparametertuningtop-side-viewcamerav7xv7weights300iterations10680pointsachievedimpressiveaccuracy7%recall1%basedcollectedalsogeneratedynamicBased3632finaldetected17311%initialComparedgroundtruthmaximumminimumerrors9739%8636%averageerror905%Thispresentsfeasiblemethodcananalysismovement-relatedbehavioralcontributingexperimentalutilizingExploringusebioengineeringobjectrecognitiontrajectorytranslational

Similar Articles

Cited By

No available data.