Development and validation of the AzBio sentence lists.

Anthony J Spahr, Michael F Dorman, Leonid M Litvak, Susan Van Wie, Rene H Gifford, Philipos C Loizou, Louise M Loiselle, Tyler Oakes, Sarah Cook
Author Information
  1. Anthony J Spahr: Arizona State University, Tempe, Arizona, USA.

Abstract

OBJECTIVES: The goal of this study was to create and validate a new set of sentence lists that could be used to evaluate the speech perception abilities of hearing-impaired listeners and cochlear implant (CI) users. Our intention was to generate a large number of sentence lists with an equivalent level of difficulty for the evaluation of performance over time and across conditions.
DESIGN: The AzBio sentence corpus includes 1000 sentences recorded from two female and two male talkers. The mean intelligibility of each sentence was estimated by processing each sentence through a five-channel CI simulation and calculating the mean percent correct score achieved by 15 normal-hearing listeners. Sentences from each talker were sorted by percent correct score, and 165 sentences were selected from each talker and were then sequentially assigned to 33 lists, each containing 20 sentences (5 sentences from each talker). List equivalency was validated by presenting all lists, in random order, to 15 CI users.
RESULTS: Using sentence scores from the CI simulation study produced 33 lists of sentences with a mean score of 85% correct. The results of the validation study with CI users revealed no significant differences in percent correct scores for 29 of the 33 sentence lists. However, individual listeners demonstrated considerable variability in performance on the 29 lists. The binomial distribution model was used to account for the inherent variability observed in the lists. This model was also used to generate 95% confidence intervals for one and two list comparisons. A retrospective analysis of 172 instances where research subjects had been tested on two lists within a single condition revealed that 94% of results were accurately contained within these confidence intervals.
CONCLUSIONS: The use of a five-channel CI simulation to estimate the intelligibility of individual sentences allowed for the creation of a large number of sentence lists with an equivalent level of difficulty. The results of the validation procedure with CI users found that 29 of 33 lists allowed scores that were not statistically different. However, individual listeners demonstrated considerable variability in performance across lists. This variability was accurately described by the binomial distribution model and was used to estimate the magnitude of change required to achieve statistical significance when comparing scores from one and two lists per condition. Fifteen sentence lists have been included in the AzBio Sentence Test for use in the clinical evaluation of hearing-impaired listeners and CI users. An additional eight sentence lists have been included in the Minimum Speech Test Battery to be distributed by the CI manufacturers for the evaluation of CI candidates.

References

  1. J Speech Hear Disord. 1962 Feb;27:62-70 [PMID: 14485785]
  2. Audiol Neurootol. 2008;13(3):193-205 [PMID: 18212519]
  3. Ear Hear. 2005 Aug;26(4 Suppl):2S-6S [PMID: 16082262]
  4. J Acoust Soc Am. 1998 Dec;104(6):3583-5 [PMID: 9857516]
  5. Arch Otolaryngol Head Neck Surg. 2004 May;130(5):624-8 [PMID: 15148187]
  6. J Speech Hear Res. 1978 Sep;21(3):507-18 [PMID: 713519]
  7. J Acoust Soc Am. 1994 Feb;95(2):1085-99 [PMID: 8132902]
  8. Ear Hear. 2007 Apr;28(2):260-75 [PMID: 17496675]
  9. Ear Hear. 1988 Dec;9(6):306-12 [PMID: 2975613]

Grants

  1. R01 DC000654/NIDCD NIH HHS
  2. R01 DC010821/NIDCD NIH HHS

MeSH Term

Adult
Cochlear Implantation
Female
Hearing Loss
Humans
Linguistics
Male
Reproducibility of Results
Speech Discrimination Tests
Speech Intelligibility
Speech Perception
Tape Recording

Word Cloud

Created with Highcharts 10.0.0listssentenceCIsentenceslistenersuserstwousedcorrect33scoresvariabilitystudyevaluationperformanceAzBiomeansimulationpercentscoretalkerresultsvalidation29individualmodelhearing-impairedgeneratelargenumberequivalentleveldifficultyacrossintelligibilityfive-channel15revealedHoweverdemonstratedconsiderablebinomialdistributionconfidenceintervalsonewithinconditionaccuratelyuseestimateallowedincludedTestOBJECTIVES:goalcreatevalidatenewsetevaluatespeechperceptionabilitiescochlearimplantintentiontimeconditionsDESIGN:corpusincludes1000recordedfemalemaletalkersestimatedprocessingcalculatingachievednormal-hearingSentencessorted165selectedsequentiallyassignedcontaining205ListequivalencyvalidatedpresentingrandomorderRESULTS:Usingproduced85%significantdifferencesaccountinherentobservedalso95%listcomparisonsretrospectiveanalysis172instancesresearchsubjectstestedsingle94%containedCONCLUSIONS:creationprocedurefoundstatisticallydifferentdescribedmagnitudechangerequiredachievestatisticalsignificancecomparingperFifteenSentenceclinicaladditionaleightMinimumSpeechBatterydistributedmanufacturerscandidatesDevelopment

Similar Articles

Cited By