Application of Convolutional Recurrent Neural Network for Individual Recognition Based on Resting State fMRI Data.

Lebo Wang, Kaiming Li, Xu Chen, Xiaoping P Hu
Author Information
  1. Lebo Wang: Department of Electrical and Computer Engineering, University of California, Riverside, Riverside, CA, United States.
  2. Kaiming Li: Department of Bioengineering, University of California, Riverside, Riverside, CA, United States.
  3. Xu Chen: Center for Advanced Neuroimaging, University of California, Riverside, Riverside, CA, United States.
  4. Xiaoping P Hu: Department of Electrical and Computer Engineering, University of California, Riverside, Riverside, CA, United States.

Abstract

In most task and resting state fMRI studies, a group consensus is often sought, where individual variability is considered a nuisance. None the less, biological variability is an important factor that cannot be ignored and is gaining more attention in the field. One recent development is the individual identification based on static functional connectome. While the original work was based on the static connectome, subsequent efforts using recurrent neural networks (RNN) demonstrated that the inclusion of temporal features greatly improved identification accuracy. Given that convolutional RNN (ConvRNN) seamlessly integrates spatial and temporal features, the present work applied ConvRNN for individual identification with resting state fMRI data. Our result demonstrates ConvRNN achieving a higher identification accuracy than conventional RNN, likely due to better extraction of local features between neighboring ROIs. Furthermore, given that each convolutional output assembles in-place features, they provide a natural way for us to visualize the informative spatial pattern and temporal information, opening up a promising new avenue for analyzing fMRI data.

Keywords

References

  1. IEEE Trans Neural Netw. 1994;5(2):157-66 [PMID: 18267787]
  2. J Neurosci. 2010 Jun 9;30(23):7755-7 [PMID: 20534823]
  3. Neuron. 2011 Nov 17;72(4):665-78 [PMID: 22099467]
  4. AJNR Am J Neuroradiol. 2013 Oct;34(10):1866-72 [PMID: 22936095]
  5. Neuroimage. 2013 Oct 15;80:105-24 [PMID: 23668970]
  6. Neuroimage. 2013 Oct 15;80:169-89 [PMID: 23684877]
  7. Neuroimage. 2013 Oct 15;80:62-79 [PMID: 23684880]
  8. Neuroimage. 2014 Apr 15;90:449-68 [PMID: 24389422]
  9. Neuroimage. 2014 Oct 15;100:414-26 [PMID: 24939340]
  10. Nat Neurosci. 2015 Nov;18(11):1664-71 [PMID: 26457551]
  11. Front Comput Neurosci. 2017 Feb 09;11:7 [PMID: 28232797]
  12. Neuroimage. 2017 Oct 15;160:140-151 [PMID: 28373122]
  13. Mach Learn Med Imaging. 2017 Sep;10541:362-370 [PMID: 29104967]
  14. Brain Connect. 2018 May;8(4):197-204 [PMID: 29634323]
  15. Nat Commun. 2018 Jul 18;9(1):2807 [PMID: 30022026]
  16. Neural Comput. 1997 Nov 15;9(8):1735-80 [PMID: 9377276]

Word Cloud

Created with Highcharts 10.0.0identificationfMRIindividualfeaturesneuralRNNtemporalconvolutionalConvRNNrestingstatevariabilitybasedstaticfunctionalconnectomeworkrecurrentaccuracyspatialdatanetworktaskstudiesgroupconsensusoftensoughtconsiderednuisanceNonelessbiologicalimportantfactorignoredgainingattentionfieldOnerecentdevelopmentoriginalsubsequenteffortsusingnetworksdemonstratedinclusiongreatlyimprovedGivenseamlesslyintegratespresentappliedresultdemonstratesachievinghigherconventionallikelyduebetterextractionlocalneighboringROIsFurthermoregivenoutputassemblesin-placeprovidenaturalwayusvisualizeinformativepatterninformationopeningpromisingnewavenueanalyzingApplicationConvolutionalRecurrentNeuralNetworkIndividualRecognitionBasedRestingStateDatamagneticresonanceimagingvisualization

Similar Articles

Cited By (8)