FluoRender: joint freehand segmentation and visualization for many-channel fluorescence data analysis.

Yong Wan, Hideo Otsuna, Holly A Holman, Brig Bagley, Masayoshi Ito, A Kelsey Lewis, Mary Colasanto, Gabrielle Kardon, Kei Ito, Charles Hansen
Author Information
  1. Yong Wan: Scientific Computing and Imaging Institute, University of Utah, Salt Lake City, USA. wanyong@cs.utah.edu. ORCID
  2. Hideo Otsuna: Janelia Farm Research Campus, Howard Hughes Medical Institute, Ashburn, USA.
  3. Holly A Holman: Department of Bioengineering, University of Utah, Salt Lake City, USA.
  4. Brig Bagley: Scientific Computing and Imaging Institute, University of Utah, Salt Lake City, USA.
  5. Masayoshi Ito: Institute of Molecular and Cellular Biosciences, University of Tokyo, Tokyo, Japan.
  6. A Kelsey Lewis: Department of Biology, University of Florida, Gainesville, USA.
  7. Mary Colasanto: Department of Human Genetics, University of Utah, Salt Lake City, USA.
  8. Gabrielle Kardon: Department of Human Genetics, University of Utah, Salt Lake City, USA.
  9. Kei Ito: Institute of Molecular and Cellular Biosciences, University of Tokyo, Tokyo, Japan.
  10. Charles Hansen: Scientific Computing and Imaging Institute, University of Utah, Salt Lake City, USA.

Abstract

BACKGROUND: Image segmentation and registration techniques have enabled biologists to place large amounts of volume data from fluorescence microscopy, morphed three-dimensionally, onto a common spatial frame. Existing tools built on volume visualization pipelines for single channel or red-green-blue (RGB) channels have become inadequate for the new challenges of fluorescence microscopy. For a three-dimensional atlas of the insect nervous system, hundreds of volume channels are rendered simultaneously, whereas fluorescence intensity values from each channel need to be preserved for versatile adjustment and analysis. Although several existing tools have incorporated support of multichannel data using various strategies, the lack of a flexible design has made true many-channel visualization and analysis unavailable. The most common practice for many-channel volume data presentation is still converting and rendering pseudosurfaces, which are inaccurate for both qualitative and quantitative evaluations.
RESULTS: Here, we present an alternative design strategy that accommodates the visualization and analysis of about 100 volume channels, each of which can be interactively adjusted, selected, and segmented using freehand tools. Our multichannel visualization includes a multilevel streaming pipeline plus a triple-buffer compositing technique. Our method also preserves original fluorescence intensity values on graphics hardware, a crucial feature that allows graphics-processing-unit (GPU)-based processing for interactive data analysis, such as freehand segmentation. We have implemented the design strategies as a thorough restructuring of our original tool, FluoRender.
CONCLUSION: The redesign of FluoRender not only maintains the existing multichannel capabilities for a greatly extended number of volume channels, but also enables new analysis functions for many-channel data from emerging biomedical-imaging techniques.

Keywords

References

  1. IEEE Trans Vis Comput Graph. 2009 Nov-Dec;15(6):1489-96 [PMID: 19834225]
  2. Dis Model Mech. 2016 Nov 1;9(11):1257-1269 [PMID: 27491074]
  3. IEEE Trans Med Imaging. 1989;8(4):297-30 [PMID: 18230529]
  4. Nat Protoc. 2014 Jan;9(1):193-208 [PMID: 24385149]
  5. Neurology. 1978 Jun;28(6):517-33 [PMID: 306588]
  6. Elife. 2014 Dec 23;3:e04577 [PMID: 25535793]
  7. Nat Biotechnol. 2010 Apr;28(4):348-53 [PMID: 20231818]
  8. Nat Methods. 2011 Jun;8(6):493-500 [PMID: 21532582]
  9. Curr Biol. 2013 Apr 22;23(8):644-55 [PMID: 23541729]
  10. Nat Methods. 2012 Jun 17;9(7):735-42 [PMID: 22706672]
  11. J Neurosci. 2014 Aug 27;34(35):11691-704 [PMID: 25164665]
  12. J Comp Neurol. 2015 May 1;523(7):997-1037 [PMID: 25380328]
  13. Nat Methods. 2012 Jun 28;9(7):683-9 [PMID: 22743773]
  14. Nat Methods. 2012 Jun 28;9(7):676-82 [PMID: 22743772]
  15. Cell. 2007 Mar 23;128(6):1187-203 [PMID: 17382886]
  16. Nat Methods. 2012 Jun 28;9(7):697-710 [PMID: 22743775]
  17. Magn Reson Imaging. 2012 Nov;30(9):1323-41 [PMID: 22770690]
  18. Curr Biol. 2011 Jan 11;21(1):1-11 [PMID: 21129968]
  19. Biotechniques. 2007 Jul;43(1 Suppl):25-30 [PMID: 17936939]
  20. Proc IEEE Symp Biol Data Vis. 2012;2012:1-8 [PMID: 24999485]
  21. IEEE Pac Vis Symp. 2012;:201-208 [PMID: 23584131]
  22. J Neurosci. 2010 Jun 2;30(22):7538-53 [PMID: 20519528]
  23. IEEE Trans Vis Comput Graph. 2012 Dec;18(12):2285-94 [PMID: 26357136]
  24. Nat Methods. 2016 Mar;13(3):192-4 [PMID: 26914202]
  25. Nat Methods. 2012 Jun 28;9(7):690-6 [PMID: 22743774]
  26. J Digit Imaging. 2004 Sep;17(3):205-16 [PMID: 15534753]

Grants

  1. P41 GM103545/NIGMS NIH HHS
  2. R01 EB023947/NIBIB NIH HHS
  3. R01 HD087360/NICHD NIH HHS

MeSH Term

Algorithms
Animals
Batrachoidiformes
Extremities
Eye
Image Processing, Computer-Assisted
Imaging, Three-Dimensional
Mice
Microscopy, Fluorescence
Software
Zebrafish

Links to CNCB-NGDC Resources

Word Cloud

Created with Highcharts 10.0.0datavolumeanalysisfluorescencevisualizationsegmentationchannelsmany-channeltoolsmultichanneldesignfreehandFluoRendertechniquesmicroscopycommonchannelnewintensityvaluesexistingusingstrategiesalsooriginalBACKGROUND:Imageregistrationenabledbiologistsplacelargeamountsmorphedthree-dimensionallyontospatialframeExistingbuiltpipelinessinglered-green-blueRGBbecomeinadequatechallengesthree-dimensionalatlasinsectnervoussystemhundredsrenderedsimultaneouslywhereasneedpreservedversatileadjustmentAlthoughseveralincorporatedsupportvariouslackflexiblemadetrueunavailablepracticepresentationstillconvertingrenderingpseudosurfacesinaccuratequalitativequantitativeevaluationsRESULTS:presentalternativestrategyaccommodates100caninteractivelyadjustedselectedsegmentedincludesmultilevelstreamingpipelineplustriple-buffercompositingtechniquemethodpreservesgraphicshardwarecrucialfeatureallowsgraphics-processing-unitGPU-basedprocessinginteractiveimplementedthoroughrestructuringtoolCONCLUSION:redesignmaintainscapabilitiesgreatlyextendednumberenablesfunctionsemergingbiomedical-imagingFluoRender:jointAnalysisFreehandGPUsMultichannelVisualizationVolume

Similar Articles

Cited By (22)