No learning where to go without first knowing where you're coming from: action discovery is trajectory, not endpoint based.

Martin Thirkettle, Thomas Walton, Peter Redgrave, Kevin Gurney, Tom Stafford
Author Information
  1. Martin Thirkettle: Department of Psychology, The Open University Buckinghamshire, UK ; Department of Psychology, University of Sheffield Sheffield, UK.

Abstract

Intrinsic motivations drive an agent to explore, providing essential data for linking behaviors with novel outcomes and so laying the foundation for future flexible action. We present experiments using a new behavioral task which allows us to interrogate the connection between exploration and action learning. Human participants used a joystick to search repeatedly for a target location, only receiving feedback on successful discovery. Feedback delay was manipulated, as was the starting position. Experiment 1 employed stable starting positions, so the task could be learnt with respect to a target location or a target trajectory. Participants were able to learn the correct movement under all delay conditions. Experiment 2 used a variable starting location, so the correct movement could only be learnt in terms of target location. Participants displayed little to no learning in this experiment. These results suggest that movements on this scale are stored as trajectories rather than in terms of target location. Overall the experiments demonstrate the potential of this task for uncovering the native representational substrates of action learning.

Keywords

References

  1. Brain Res Rev. 2008 Aug;58(2):322-39 [PMID: 18055018]
  2. J Neurophysiol. 2005 May;93(5):2822-31 [PMID: 15574795]
  3. J Neurosci Methods. 1984 May;11(1):47-60 [PMID: 6471907]
  4. Psychol Rev. 1948 Jul;55(4):189-208 [PMID: 18870876]
  5. Stat Med. 1995 Apr 30;14(8):811-9 [PMID: 7644861]
  6. Nat Rev Neurosci. 2006 Dec;7(12):967-75 [PMID: 17115078]
  7. Q J Exp Psychol B. 2003 Feb;56(1):102-13 [PMID: 12623541]
  8. Cognition. 1984 Apr;16(3):225-60 [PMID: 6541105]
  9. Annu Rev Neurosci. 2006;29:105-34 [PMID: 16776581]
  10. Science. 1997 Mar 14;275(5306):1593-9 [PMID: 9054347]
  11. Cereb Cortex. 2007 Oct;17(10):2443-52 [PMID: 17220510]
  12. J Exp Psychol. 1948 Apr;38(2):168-72 [PMID: 18913665]
  13. J Neural Transm Gen Sect. 1990;80(1):9-31 [PMID: 2407269]
  14. J Mot Behav. 2013;45(4):351-60 [PMID: 23796130]
  15. PLoS One. 2012;7(6):e37749 [PMID: 22675490]
  16. Annu Rev Neurosci. 2007;30:259-88 [PMID: 17600522]
  17. Proc Natl Acad Sci U S A. 2006 Jul 25;103(30):11370-5 [PMID: 16837575]
  18. Behav Brain Sci. 2001 Oct;24(5):849-78; discussion 878-937 [PMID: 12239891]
  19. Exp Brain Res. 2008 Jan;184(2):165-78 [PMID: 17703284]
  20. Spat Vis. 1997;10(4):433-6 [PMID: 9176952]
  21. Q J Exp Psychol. 1979 Feb;31(1):103-9 [PMID: 424502]
  22. Behav Brain Res. 2007 Oct 1;183(1):118-22 [PMID: 17602760]
  23. Behav Brain Res. 2013 Apr 15;243:267-72 [PMID: 23380676]

Word Cloud

Created with Highcharts 10.0.0learningactiontargetlocationtaskstartingexperimentsuseddiscoverydelayExperimentlearnttrajectoryParticipantscorrectmovementtermsIntrinsicmotivationsdriveagentexploreprovidingessentialdatalinkingbehaviorsnoveloutcomeslayingfoundationfutureflexiblepresentusingnewbehavioralallowsusinterrogateconnectionexplorationHumanparticipantsjoysticksearchrepeatedlyreceivingfeedbacksuccessfulFeedbackmanipulatedposition1employedstablepositionsrespectablelearnconditions2variabledisplayedlittleexperimentresultssuggestmovementsscalestoredtrajectoriesratherOveralldemonstratepotentialuncoveringnativerepresentationalsubstratesgowithoutfirstknowingcomingfrom:endpointbasedoutcomecognitivescienceintrinsicmotivationmotorspatial

Similar Articles

Cited By