Reliable Web-Based Auditory Cognitive Testing: Observational Study.

Meher Lad, John-Paul Taylor, Timothy David Griffiths
Author Information
  1. Meher Lad: Translational and Clinical Research Institute, Newcastle University, Newcastle upon Tyne, United Kingdom. ORCID
  2. John-Paul Taylor: Translational and Clinical Research Institute, Newcastle University, Newcastle upon Tyne, United Kingdom. ORCID
  3. Timothy David Griffiths: Biosciences Institute, Newcastle University, Newcastle upon Tyne, United Kingdom. ORCID

Abstract

BACKGROUND: Web-based experimentation, accelerated by the COVID-19 pandemic, has enabled large-scale participant recruitment and data collection. Auditory testing on the web has shown promise but faces challenges such as uncontrolled environments and verifying headphone use. Prior studies have successfully replicated auditory experiments but often involved younger participants, limiting the generalizability to older adults with varying hearing abilities. This study explores the feasibility of conducting reliable auditory cognitive testing using a web-based platform, especially among older adults.
OBJECTIVE: This study aims to determine whether demographic factors such as age and hearing status influence participation in web-based auditory cognitive experiments and to assess the reproducibility of auditory cognitive measures-specifically speech-in-noise perception and auditory memory (AuM)-between in-person and web-based settings. Additionally, this study aims to examine the relationship between musical sophistication, measured by the Goldsmiths Musical Sophistication Index (GMSI), and auditory cognitive measures across different testing environments.
METHODS: A total of 153 participants aged 50 to 86 years were recruited from local registries and memory clinics; 58 of these returned for web-based, follow-up assessments. An additional 89 participants from the PREVENT cohort were included in the web-based study, forming a combined sample. Participants completed speech-in-noise perception tasks (Digits-in-Noise and Speech-in-Babble), AuM tests for frequency and amplitude modulation rate, and the GMSI questionnaire. In-person testing was conducted in a soundproof room with standardized equipment, while web-based tests required participants to use headphones in a quiet room via a web-based app. The reproducibility of auditory measures was evaluated using Pearson and intraclass correlation coefficients, and statistical analyses assessed relationships between variables across settings.
RESULTS: Older participants and those with severe hearing loss were underrepresented in the web-based follow-up. The GMSI questionnaire demonstrated the highest reproducibility (r=0.82), while auditory cognitive tasks showed moderate reproducibility (Digits-in-Noise and Speech-in-Babble r=0.55 AuM tests for frequency r=0.75 and amplitude modulation rate r=0.44). There were no significant differences in the correlation between age and auditory measures across in-person and web-based settings (all P>.05). The study replicated previously reported associations between AuM and GMSI scores, as well as sentence-in-noise perception, indicating consistency across testing environments.
CONCLUSIONS: Web-based auditory cognitive testing is feasible and yields results comparable to in-person testing, especially for questionnaire-based measures like the GMSI. While auditory tasks demonstrated moderate reproducibility, the consistent replication of key associations suggests that web-based testing is a viable alternative for auditory cognition research. However, the underrepresentation of older adults and those with severe hearing loss highlights a need to address barriers to web-based participation. Future work should explore methods to enhance inclusivity, such as remote guided testing, and address factors like digital literacy and equipment standards to improve the representativeness and quality of web-based auditory research.

Keywords

References

  1. Sci Rep. 2022 Mar 3;12(1):3517 [PMID: 35241747]
  2. Behav Res Methods. 2024 Mar;56(3):1433-1448 [PMID: 37326771]
  3. PLoS One. 2014 Feb 26;9(2):e89642 [PMID: 24586929]
  4. J Am Acad Audiol. 2008 Apr;19(4):281-92; quiz 371 [PMID: 18795468]
  5. Sci Rep. 2020 Aug 19;10(1):13997 [PMID: 32814792]
  6. Ann N Y Acad Sci. 2019 Oct;1453(1):67-78 [PMID: 31237357]
  7. JMIR Aging. 2021 Feb 1;4(1):e23384 [PMID: 33522972]
  8. Brain Sci. 2020 Apr 24;10(4): [PMID: 32344671]
  9. Trends Hear. 2021 Jan-Dec;25:23312165211025941 [PMID: 34170748]
  10. BMJ Open. 2012 Nov 19;2(6): [PMID: 23166135]
  11. Behav Res Methods. 2021 Aug;53(4):1551-1562 [PMID: 33300103]
  12. Trends Hear. 2022 Jan-Dec;26:23312165221118792 [PMID: 36131515]
  13. Curr Res Neurobiol. 2023 Nov 07;5:100115 [PMID: 38020808]
  14. Sci Rep. 2019 Nov 14;9(1):16771 [PMID: 31728002]
  15. PLoS One. 2022 Sep 30;17(9):e0275585 [PMID: 36178907]
  16. Behav Res Methods. 2016 Jun;48(2):553-66 [PMID: 25987305]
  17. Res Involv Engagem. 2021 Oct 5;7(1):70 [PMID: 34610847]
  18. Cognition. 2023 Mar;232:105327 [PMID: 36495710]
  19. Trends Cogn Sci. 2017 Oct;21(10):736-748 [PMID: 28803699]
  20. J Med Internet Res. 2022 Jan 6;24(1):e28368 [PMID: 34989691]
  21. Proc Natl Acad Sci U S A. 2011 Sep 13;108(37):15516-21 [PMID: 21844339]
  22. Trends Hear. 2023 Jan-Dec;27:23312165231190688 [PMID: 37828868]
  23. Front Hum Neurosci. 2023 Jul 06;17:1228365 [PMID: 37484919]
  24. Nat Neurosci. 2014 Mar;17(3):347-56 [PMID: 24569831]

Grants

  1. MR/T032553/1/Medical Research Council

MeSH Term

Humans
Aged
Middle Aged
Male
Female
Aged, 80 and over
COVID-19
Reproducibility of Results
Cognition
Internet
Speech Perception
SARS-CoV-2

Word Cloud

Created with Highcharts 10.0.0auditoryweb-basedtestingcognitivehearingstudyparticipantsreproducibilityGMSIolderAuMmeasuresacrossr=0environmentsadultsperceptionmemoryin-personsettingstaskstestsquestionnairelossWeb-basedAuditoryusereplicatedexperimentsusingespeciallyaimsfactorsageparticipationspeech-in-noisefollow-upDigits-in-NoiseSpeech-in-BabblefrequencyamplitudemodulationrateroomequipmentPearsoncorrelationseveredemonstratedmoderateassociationslikeresearchaddressBACKGROUND:experimentationacceleratedCOVID-19pandemicenabledlarge-scaleparticipantrecruitmentdatacollectionwebshownpromisefaceschallengesuncontrolledverifyingheadphonePriorstudiessuccessfullyofteninvolvedyoungerlimitinggeneralizabilityvaryingabilitiesexploresfeasibilityconductingreliableplatformamongOBJECTIVE:determinewhetherdemographicstatusinfluenceassessmeasures-specifically-betweenAdditionallyexaminerelationshipmusicalsophisticationmeasuredGoldsmithsMusicalSophisticationIndexdifferentMETHODS:total153aged5086yearsrecruitedlocalregistriesclinics58returnedassessmentsadditional89PREVENTcohortincludedformingcombinedsampleParticipantscompletedIn-personconductedsoundproofstandardizedrequiredheadphonesquietviaappevaluatedintraclasscoefficientsstatisticalanalysesassessedrelationshipsvariablesRESULTS:Olderunderrepresentedhighest82showed557544significantdifferencesP>05previouslyreportedscoreswellsentence-in-noiseindicatingconsistencyCONCLUSIONS:feasibleyieldsresultscomparablequestionnaire-basedconsistentreplicationkeysuggestsviablealternativecognitionHoweverunderrepresentationhighlightsneedbarriersFutureworkexploremethodsenhanceinclusivityremoteguideddigitalliteracystandardsimproverepresentativenessqualityReliableWeb-BasedCognitiveTesting:ObservationalStudyaudiologyfemalepersonobservationaladultsettingwomen

Similar Articles

Cited By