Using predictive validity to compare associations between brain damage and behavior.

John F Magnotti, Jaclyn S Patterson, Tatiana T Schnur
Author Information
  1. John F Magnotti: Department of Neurosurgery, Baylor College of Medicine, Houston, Texas, USA. ORCID
  2. Jaclyn S Patterson: Department of Neuroscience, Baylor College of Medicine, Houston, Texas, USA.
  3. Tatiana T Schnur: Department of Neurosurgery, Baylor College of Medicine, Houston, Texas, USA. ORCID

Abstract

Lesion-behavior mapping (LBM) provides a statistical map of the association between voxel-wise brain damage and individual differences in behavior. To understand whether two behaviors are mediated by damage to distinct regions, researchers often compare LBM weight outputs by either the Overlap method or the Correlation method. However, these methods lack statistical criteria to determine whether two LBM are distinct versus the same and are disconnected from a major goal of LBMs: predicting behavior from brain damage. Without such criteria, researchers may draw conclusions from numeric differences between LBMs that are irrelevant to predicting behavior. We developed and validated a predictive validity comparison method (PVC) that establishes a statistical criterion for comparing two LBMs using predictive accuracy: two LBMs are distinct if and only if they provide unique predictive power for the behaviors being assessed. We applied PVC to two lesion-behavior stroke data sets, demonstrating its utility for determining when behaviors arise from the same versus different lesion patterns. Using region-of-interest-based simulations derived from proportion damage from a large data set (n = 131), PVC accurately detected when behaviors were mediated by different regions (high sensitivity) versus the same region (high specificity). Both the Overlap method and Correlation method performed poorly on the simulated data. By objectively determining whether two behavioral deficits can be explained by single versus distinct patterns of brain damage, PVC provides a critical advance in establishing the brain bases of behavior. We have developed and released a GUI-driven web app to encourage widespread adoption.

Keywords

References

  1. Proc Natl Acad Sci U S A. 2011 May 17;108(20):8520-4 [PMID: 21540329]
  2. Cogn Neuropsychol. 2010 Sep;27(6):477-94 [PMID: 21714756]
  3. Brain. 2016 May;139(Pt 5):1517-26 [PMID: 26966139]
  4. Hum Brain Mapp. 2023 Sep;44(13):4738-4753 [PMID: 37417774]
  5. J Cogn Neurosci. 2007 Jul;19(7):1081-8 [PMID: 17583985]
  6. Cortex. 2022 Jan;146:216-226 [PMID: 34902680]
  7. Neuroimage Clin. 2018;20:1129-1138 [PMID: 30380520]
  8. J Cogn Neurosci. 2021 Nov 5;33(12):2494-2511 [PMID: 34407196]
  9. Hum Brain Mapp. 2014 Dec;35(12):5861-76 [PMID: 25044213]
  10. Nature. 1996 Nov 14;384(6605):159-61 [PMID: 8906789]
  11. Hum Brain Mapp. 2021 Mar;42(4):1070-1101 [PMID: 33216425]
  12. Neuroimage Clin. 2015 Dec 11;10:257-66 [PMID: 26900565]
  13. Cortex. 2013 May;49(5):1195-205 [PMID: 22789779]
  14. Neuron. 2009 Mar 12;61(5):681-91 [PMID: 19285465]
  15. J Cogn Neurosci. 2007 Jul;19(7):1067-80 [PMID: 17583984]
  16. Proc Natl Acad Sci U S A. 2010 Mar 9;107(10):4705-9 [PMID: 20176936]
  17. Nat Commun. 2019 Jan 3;10(1):20 [PMID: 30604744]
  18. Nat Neurosci. 2003 May;6(5):448-50 [PMID: 12704393]
  19. Nat Hum Behav. 2021 Dec;5(12):1707-1716 [PMID: 34239076]
  20. Cereb Cortex Commun. 2021 Jan 28;2(2):tgab005 [PMID: 33870195]
  21. Brain. 2012 Dec;135(Pt 12):3799-814 [PMID: 23171662]
  22. Hum Brain Mapp. 2018 Nov;39(11):4169-4182 [PMID: 29972618]
  23. Neuroimage. 2019 Nov 1;201:116000 [PMID: 31295567]
  24. Neuroreport. 2007 Sep 17;18(14):1455-8 [PMID: 17712273]
  25. J Neuropsychol. 2021 Mar;15(1):143-150 [PMID: 32412102]
  26. Brain. 2009 Dec;132(Pt 12):3411-27 [PMID: 19942676]
  27. Brain Commun. 2021 Nov 13;3(4):fcab259 [PMID: 34859213]
  28. J Cogn Neurosci. 2012 Jan;24(1):212-22 [PMID: 21861679]
  29. Nat Rev Neurosci. 2004 Oct;5(10):813-9 [PMID: 15378041]
  30. Neuroimage. 2021 Jan 1;224:117374 [PMID: 32949711]
  31. Brain Struct Funct. 2014 Mar;219(2):485-94 [PMID: 23392844]
  32. Neuroimage. 2022 Jul 15;255:119201 [PMID: 35405342]
  33. Brain. 2020 Jul 1;143(7):2173-2188 [PMID: 32572442]
  34. Brain Struct Funct. 2016 May;221(4):2123-34 [PMID: 25939335]
  35. Neuropsychologia. 2018 Jul 1;115:154-166 [PMID: 28882479]
  36. Hum Brain Mapp. 2016 Apr;37(4):1405-21 [PMID: 26756101]
  37. Hum Brain Mapp. 2020 Apr 15;41(6):1520-1531 [PMID: 31904898]
  38. Proc Natl Acad Sci U S A. 2016 Jul 26;113(30):E4367-76 [PMID: 27402738]
  39. Cortex. 2013 Feb;49(2):487-506 [PMID: 22192727]
  40. Hum Brain Mapp. 2013 Oct;34(10):2715-23 [PMID: 22522937]
  41. Nat Commun. 2015 Apr 16;6:6762 [PMID: 25879574]
  42. Neuropsychologia. 2009 Jul;47(8-9):1944-53 [PMID: 19428427]
  43. Neuropsychologia. 2015 May;71:18-27 [PMID: 25777496]
  44. Med Image Anal. 2008 Feb;12(1):26-41 [PMID: 17659998]
  45. Brain. 2020 Mar 1;143(3):862-876 [PMID: 32155246]
  46. Soc Cogn Affect Neurosci. 2014 Mar;9(3):265-72 [PMID: 23171618]
  47. Neuropsychologia. 2020 Jan;136:107253 [PMID: 31706982]
  48. Cortex. 2015 Jun;67:37-58 [PMID: 25880795]

Grants

  1. R01 DC014976/NIDCD NIH HHS

MeSH Term

Humans
Brain Mapping
Brain
Stroke
Brain Injuries
Head
Magnetic Resonance Imaging

Word Cloud

Created with Highcharts 10.0.0damagetwobrainbehaviormethodbehaviorsdistinctversuspredictivePVCLBMstatisticalwhetherLBMsdatamappingprovidesdifferencesmediatedregionsresearcherscompareOverlapCorrelationcriteriapredictingdevelopedvaliditylesion-behaviorstrokedeterminingdifferentpatternsUsinghighLesion-behaviormapassociationvoxel-wiseindividualunderstandoftenweightoutputseitherHowevermethodslackdeterminedisconnectedmajorgoalLBMs:Withoutmaydrawconclusionsnumericirrelevantvalidatedcomparisonestablishescriterioncomparingusingaccuracy:provideuniquepowerassessedappliedsetsdemonstratingutilityariselesionregion-of-interest-basedsimulationsderivedproportionlargesetn = 131accuratelydetectedsensitivityregionspecificityperformedpoorlysimulatedobjectivelybehavioraldeficitscanexplainedsinglecriticaladvanceestablishingbasesreleasedGUI-drivenwebappencouragewidespreadadoptionassociationsmultivariateanalysisneuropsychology

Similar Articles

Cited By (1)