Enhancing Spatial Ability Assessment: Integrating Problem-Solving Strategies in Object Assembly Tasks Using Multimodal Joint-Hierarchical Cognitive Diagnosis Modeling.

Jujia Li, Kaiwen Man, Joni M Lakin
Author Information
  1. Jujia Li: Department of Educational Studies in Psychology, Research Methodology and Counseling, College of Education, University of Alabama, Tuscaloosa, AL 35487, USA. ORCID
  2. Kaiwen Man: Department of Educational Studies in Psychology, Research Methodology and Counseling, College of Education, University of Alabama, Tuscaloosa, AL 35487, USA. ORCID
  3. Joni M Lakin: Department of Educational Studies in Psychology, Research Methodology and Counseling, College of Education, University of Alabama, Tuscaloosa, AL 35487, USA. ORCID

Abstract

We proposed a novel approach to investigate how problem-solving strategies, identified using response time and eye-tracking data, can impact individuals' performance on the Object Assembly (OA) task. To conduct an integrated assessment of spatial reasoning ability and problem-solving strategy, we applied the Multimodal Joint-Hierarchical Cognitive Diagnosis Model (MJ-DINA) to analyze the performance of young students (aged 6 to 14) on 17 OA items. The MJ-DINA model consists of three sub-models: a Deterministic Inputs, Noisy "and" Gate (DINA) model for estimating spatial ability, a lognormal RT model for response time, and a Bayesian Negative Binomial (BNF) model for fixation counts. In the DINA model, we estimated five spatial cognitive attributes aligned with problem-solving processes: encoding, falsification, mental rotation, mental displacement, and intractability recognition. Our model fits the data adequately, with Gelman-Rubin convergence statistics near 1.00 and posterior predictive -values between 0.05 and 0.95 for the DINA, Log RT, and BNF sub-models, indicating reliable parameter estimation. Our findings indicate that individuals with faster processing speeds and fewer fixation counts, which we label Reflective-Scanner, outperformed the other three identified problem-solving strategy groups. Specifically, sufficient eye movement was a key factor contributing to better performance on spatial reasoning tasks. Additionally, the most effective method for improving individuals' spatial task performance was training them to master the falsification attribute. This research offers valuable implications for developing tailored teaching methods to improve individuals' spatial ability, depending on various problem-solving strategies.

Keywords

References

  1. Psychol Sci. 2006 Apr;17(4):339-45 [PMID: 16623692]
  2. Br J Math Stat Psychol. 2018 May;71(2):262-286 [PMID: 28872185]
  3. J Exp Psychol Gen. 2001 Dec;130(4):621-640 [PMID: 11757872]
  4. Affect Sci. 2023 Oct 2;4(4):609-616 [PMID: 38156255]
  5. J Exp Psychol Learn Mem Cogn. 2019 Feb;45(2):232-245 [PMID: 29952629]
  6. Psychol Bull. 2012 Nov;138(6):1218-52 [PMID: 22845750]
  7. Psychol Assess. 2011 Jun;23(2):532-44 [PMID: 21668126]
  8. Educ Psychol Meas. 2019 Aug;79(4):617-635 [PMID: 32655176]
  9. Psychol Bull. 1979 Sep;86(5):889-918 [PMID: 386403]
  10. Q J Exp Psychol (Hove). 2008 May;61(5):683-9 [PMID: 18421643]
  11. Child Dev. 1985 Dec;56(6):1479-98 [PMID: 4075870]
  12. Perception. 2002;31(12):1459-66 [PMID: 12916670]
  13. Psychol Bull. 2013 Mar;139(2):352-402 [PMID: 22663761]
  14. Psychon Bull Rev. 2020 Jun;27(3):465-482 [PMID: 31965485]
  15. Vision Res. 2016 Sep;126:3-8 [PMID: 27353224]
  16. Science. 1971 Feb 19;171(3972):701-3 [PMID: 5540314]
  17. J Exp Psychol Appl. 2009 Jun;15(2):163-81 [PMID: 19586255]
  18. Appl Psychol Meas. 2022 Jul;46(5):361-381 [PMID: 35812811]

Grants

  1. #R305A210428/U.S. Department of Education

Word Cloud

Created with Highcharts 10.0.0spatialmodelproblem-solvingperformanceabilityresponsetimeindividuals'reasoningMJ-DINADINAstrategiesidentifieddataObjectAssemblyOAtaskstrategyMultimodalJoint-HierarchicalCognitiveDiagnosisthreeRTBNFfixationcountsfalsificationmental0eyeproposednovelapproachinvestigateusingeye-trackingcanimpactconductintegratedassessmentappliedModelanalyzeyoungstudentsaged61417itemsconsistssub-models:DeterministicInputsNoisy"and"GateestimatinglognormalBayesianNegativeBinomialestimatedfivecognitiveattributesalignedprocesses:encodingrotationdisplacementintractabilityrecognitionfitsadequatelyGelman-Rubinconvergencestatisticsnear100posteriorpredictive-values0595Logsub-modelsindicatingreliableparameterestimationfindingsindicateindividualsfasterprocessingspeedsfewerlabelReflective-ScanneroutperformedgroupsSpecificallysufficientmovementkeyfactorcontributingbettertasksAdditionallyeffectivemethodimprovingtrainingmasterattributeresearchoffersvaluableimplicationsdevelopingtailoredteachingmethodsimprovedependingvariousEnhancingSpatialAbilityAssessment:IntegratingProblem-SolvingStrategiesTasksUsingModelingtracking

Similar Articles

Cited By

No available data.