Schema learning for the cocktail party problem.

Kevin J P Woods, Josh H McDermott
Author Information
  1. Kevin J P Woods: Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139.
  2. Josh H McDermott: Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139; jhm@mit.edu.

Abstract

The cocktail party problem requires listeners to infer individual sound sources from mixtures of sound. The problem can be solved only by leveraging regularities in natural sound sources, but little is known about how such regularities are internalized. We explored whether listeners learn source "schemas"-the abstract structure shared by different occurrences of the same type of sound source-and use them to infer sources from mixtures. We measured the ability of listeners to segregate mixtures of time-varying sources. In each experiment a subset of trials contained schema-based sources generated from a common template by transformations (transposition and time dilation) that introduced acoustic variation but preserved abstract structure. Across several tasks and classes of sound sources, schema-based sources consistently aided source separation, in some cases producing rapid improvements in performance over the first few exposures to a schema. Learning persisted across blocks that did not contain the learned schema, and listeners were able to learn and use multiple schemas simultaneously. No learning was evident when schema were presented in the task-irrelevant (i.e., distractor) source. However, learning from task-relevant stimuli showed signs of being implicit, in that listeners were no more likely to report that sources recurred in experiments containing schema-based sources than in control experiments containing no schema-based sources. The results implicate a mechanism for rapidly internalizing abstract sound structure, facilitating accurate perceptual organization of sound sources that recur in the environment.

Keywords

References

  1. Philos Trans R Soc Lond B Biol Sci. 2012 Apr 5;367(1591):919-31 [PMID: 22371614]
  2. Proc Natl Acad Sci U S A. 2010 Dec 14;107(50):21914-9 [PMID: 21098293]
  3. J Exp Psychol Hum Percept Perform. 2011 Aug;37(4):1253-62 [PMID: 21480747]
  4. Front Psychol. 2012 Feb 07;3:15 [PMID: 22347201]
  5. Percept Psychophys. 1988 Apr;43(4):389-94 [PMID: 3362668]
  6. Proc Natl Acad Sci U S A. 2011 Jan 18;108(3):1188-93 [PMID: 21199948]
  7. J Acoust Soc Am. 2008 Jan;123(1):414-27 [PMID: 18177170]
  8. Psychol Sci. 2008 Dec;19(12):1263-71 [PMID: 19121136]
  9. J Comp Psychol. 2008 Aug;122(3):235-51 [PMID: 18729652]
  10. Top Cogn Sci. 2012 Oct;4(4):525-53 [PMID: 23060126]
  11. Cognition. 1999 Feb 1;70(1):27-52 [PMID: 10193055]
  12. Trends Cogn Sci. 2008 May;12(5):182-6 [PMID: 18396091]
  13. PLoS One. 2013;8(3):e57410 [PMID: 23516406]
  14. J Acoust Soc Am. 1990 Oct;88(4):1712-24 [PMID: 2262628]
  15. Proc Natl Acad Sci U S A. 2003 Sep 30;100(20):11812-5 [PMID: 14500903]
  16. Behav Res Methods. 2014 Dec;46(4):1023-31 [PMID: 24356996]
  17. J Acoust Soc Am. 1992 Jun;91(6):3381-90 [PMID: 1619115]
  18. Curr Opin Neurobiol. 2010 Jun;20(3):361-6 [PMID: 20456940]
  19. Curr Biol. 2009 Dec 1;19(22):R1024-7 [PMID: 19948136]
  20. Neuron. 2010 May 27;66(4):610-8 [PMID: 20510864]
  21. Neuroimage. 2010 Mar;50(1):302-13 [PMID: 20005297]
  22. J Acoust Soc Am. 2010 Dec;128(6):3658-66 [PMID: 21218898]
  23. J Exp Psychol Learn Mem Cogn. 2004 Sep;30(5):1119-30 [PMID: 15355140]
  24. J Acoust Soc Am. 1971 Feb;49(2):Suppl 2:524+ [PMID: 5541747]
  25. J Exp Psychol Hum Percept Perform. 2010 Aug;36(4):1029-39 [PMID: 20695716]
  26. J Acoust Soc Am. 1997 Nov;102(5 Pt 1):2945-53 [PMID: 9373981]
  27. Trends Cogn Sci. 2006 May;10(5):233-8 [PMID: 16616590]
  28. Psychol Rev. 2000 Oct;107(4):885-913 [PMID: 11089410]
  29. Perspect Psychol Sci. 2011 Jan;6(1):3-5 [PMID: 26162106]
  30. Curr Opin Neurobiol. 2007 Aug;17(4):437-55 [PMID: 17714933]
  31. Trends Cogn Sci. 2004 Oct;8(10):465-71 [PMID: 15450511]
  32. Percept Psychophys. 1987 Jun;41(6):642-56 [PMID: 3615158]
  33. Atten Percept Psychophys. 2017 Oct;79(7):2064-2072 [PMID: 28695541]
  34. J Acoust Soc Am. 2014 Mar;135(3):1392-405 [PMID: 24606277]
  35. J Acoust Soc Am. 2010 Jul;128(1):EL1-7 [PMID: 20649182]
  36. Q J Exp Psychol A. 2001 Nov;54(4):1105-24 [PMID: 11765735]
  37. J Exp Psychol Hum Percept Perform. 2014 Apr;40(2):539-55 [PMID: 24059846]
  38. Proc Natl Acad Sci U S A. 2009 Apr 7;106(14):6008-10 [PMID: 19307569]
  39. Curr Dir Psychol Sci. 2012 Jun 1;21(3):170-176 [PMID: 24000273]
  40. Philos Trans R Soc Lond B Biol Sci. 2008 Mar 12;363(1493):1011-21 [PMID: 17827106]
  41. J Acoust Soc Am. 1986 Aug;80(2):479-83 [PMID: 3745680]
  42. Neural Comput. 2005 Sep;17(9):1875-902 [PMID: 15992485]
  43. Curr Biol. 2013 Aug 19;23(16):1585-9 [PMID: 23891107]
  44. Hear Res. 2010 Jul;266(1-2):36-51 [PMID: 19788920]
  45. Percept Psychophys. 2002 Jul;64(5):844-54 [PMID: 12201342]
  46. Psychol Sci. 2013 Oct;24(10):1995-2004 [PMID: 23985575]
  47. Curr Biol. 2015 Aug 31;25(17):2238-46 [PMID: 26279234]
  48. Atten Percept Psychophys. 2015 Jul;77(5):1465-87 [PMID: 25828463]
  49. J Acoust Soc Am. 1994 Jun;95(6):3475-80 [PMID: 8046139]
  50. Exp Psychol. 2004;51(4):240-8 [PMID: 15620225]
  51. J Exp Psychol Hum Percept Perform. 2008 Aug;34(4):992-1006 [PMID: 18665740]

Grants

  1. R01 DC014739/NIDCD NIH HHS
  2. T32 DC000038/NIDCD NIH HHS

MeSH Term

Acoustic Stimulation
Attention
Auditory Perception
Cues
Humans
Learning
Noise
Sound Localization

Word Cloud

Created with Highcharts 10.0.0sourcessoundlearninglistenersschema-basedproblemmixturessourceabstractstructureschemacocktailpartyinferregularitieslearnuseimplicitexperimentscontainingperceptualrequiresindividualcansolvedleveragingnaturallittleknowninternalizedexploredwhether"schemas"-theshareddifferentoccurrencestypesource-andmeasuredabilitysegregatetime-varyingexperimentsubsettrialscontainedgeneratedcommontemplatetransformationstranspositiontimedilationintroducedacousticvariationpreservedAcrossseveraltasksclassesconsistentlyaidedseparationcasesproducingrapidimprovementsperformancefirstexposuresLearningpersistedacrossblockscontainlearnedablemultipleschemassimultaneouslyevidentpresentedtask-irrelevantiedistractorHowevertask-relevantstimulishowedsignslikelyreportrecurredcontrolresultsimplicatemechanismrapidlyinternalizingfacilitatingaccurateorganizationrecurenvironmentSchemaauditorysceneanalysisstatistical

Similar Articles

Cited By