Immersive and interactive visualization of 3D spatio-temporal data using a space time hypercube: Application to cell division and morphogenesis analysis.

Gwendal Fouch��, Ferran Argelaguet, Emmanuel Faure, Charles Kervrann
Author Information
  1. Gwendal Fouch��: Inria de l'Universit�� de Rennes, IRISA, CNRS, Rennes, France.
  2. Ferran Argelaguet: Inria de l'Universit�� de Rennes, IRISA, CNRS, Rennes, France.
  3. Emmanuel Faure: LIRMM, Universit�� Montpellier, CNRS, Montpellier, France.
  4. Charles Kervrann: Inria de l'Universit�� de Rennes, Rennes, France.

Abstract

The analysis of multidimensional time-varying datasets faces challenges, notably regarding the representation of the data and the visualization of temporal variations. We propose an extension of the well-known Space-Time Cube (STC) visualization technique in order to visualize time-varying 3D spatial data, taking advantage of the interaction capabilities of Virtual Reality (VR). First, we propose the Space-Time Hypercube (STH) as an abstraction for 3D temporal data, extended from the STC concept. Second, through the example of embryo development imaging dataset, we detail the construction and visualization of a STC based on a user-driven projection of the spatial and temporal information. This projection yields a 3D STC visualization, which can also encode additional numerical and categorical data. Additionally, we propose a set of tools allowing the user to filter and manipulate the 3D STC which benefits the visualization, exploration and interaction possibilities offered by VR. Finally, we evaluated the proposed visualization method in the context of 3D temporal cell imaging data analysis, through a user study (n = 5) reporting the feedback from five biologists. These domain experts also accompanied the application design as consultants, providing insights on how the STC visualization could be used for the exploration of complex 3D temporal morphogenesis data.

Keywords

References

  1. IEEE Trans Vis Comput Graph. 2018 Jan;24(1):457-467 [PMID: 28866590]
  2. IEEE Trans Vis Comput Graph. 2013 Jun;19(6):1005-19 [PMID: 23559512]
  3. IEEE Trans Vis Comput Graph. 2017 Jan;23(1):1-10 [PMID: 27514046]
  4. IEEE Trans Vis Comput Graph. 2018 Jan;24(1):34-44 [PMID: 28866540]
  5. Science. 2014 Oct 24;346(6208):1257998 [PMID: 25342811]
  6. IEEE Comput Graph Appl. 2010 Sep-Oct;30(5):61-71 [PMID: 24807415]
  7. IEEE Trans Vis Comput Graph. 2007 Nov-Dec;13(6):1344-51 [PMID: 17968083]
  8. Bioinformatics. 2019 May 15;35(10):1802-1804 [PMID: 30346487]
  9. PLoS Comput Biol. 2012;8(6):e1002519 [PMID: 22719236]
  10. IEEE Trans Vis Comput Graph. 2020 Jan;26(1):514-524 [PMID: 31581085]
  11. IEEE Trans Vis Comput Graph. 2008 Jan-Feb;14(1):47-60 [PMID: 17993701]
  12. IEEE Trans Vis Comput Graph. 2016 Jan;22(1):160-9 [PMID: 26529696]
  13. IEEE Trans Vis Comput Graph. 2018 Aug 20;: [PMID: 30136994]
  14. Front Robot AI. 2019 Sep 10;6:82 [PMID: 33501097]
  15. IEEE Trans Vis Comput Graph. 2012 Apr;18(4):597-606 [PMID: 22402687]
  16. Science. 2020 Jul 10;369(6500): [PMID: 32646972]
  17. Dev Biol. 1983 Nov;100(1):64-119 [PMID: 6684600]
  18. IEEE Trans Vis Comput Graph. 2009 Nov-Dec;15(6):1017-24 [PMID: 19834167]
  19. Nat Commun. 2019 Jun 27;10(1):2812 [PMID: 31249294]
  20. IEEE Pac Vis Symp. 2012;:201-208 [PMID: 23584131]
  21. IEEE Trans Vis Comput Graph. 2006 Sep-Oct;12(5):909-16 [PMID: 17080816]
  22. Front Robot AI. 2019 Jul 23;6:61 [PMID: 33501076]
  23. Nucleic Acids Res. 2018 Jan 4;46(D1):D718-D725 [PMID: 29149270]
  24. IEEE Trans Vis Comput Graph. 2010 Nov-Dec;16(6):1458-67 [PMID: 20975187]
  25. IEEE Trans Vis Comput Graph. 2017 Jan;23(1):701-710 [PMID: 27875185]

Word Cloud

Created with Highcharts 10.0.0visualizationdata3DSTCtemporalanalysisproposeinteractiontime-varyingSpace-TimespatialVRimagingprojectionalsouserexplorationcellmorphogenesisspatio-temporalmultidimensionaldatasetsfaceschallengesnotablyregardingrepresentationvariationsextensionwell-knownCubetechniqueordervisualizetakingadvantagecapabilitiesVirtualRealityFirstHypercubeSTHabstractionextendedconceptSecondexampleembryodevelopmentdatasetdetailconstructionbaseduser-driveninformationyieldscanencodeadditionalnumericalcategoricalAdditionallysettoolsallowingfiltermanipulatebenefitspossibilitiesofferedFinallyevaluatedproposedmethodcontextstudyn=5reportingfeedbackfivebiologistsdomainexpertsaccompaniedapplicationdesignconsultantsprovidinginsightsusedcomplexImmersiveinteractiveusingspacetimehypercube:Applicationdivisiondimensionreductionimmersiveanalyticsspace-timecubevirtualreality

Similar Articles

Cited By (2)