Automated Speech Analysis in Bipolar Disorder: The CALIBER Study Protocol and Preliminary Results.

Gerard Anmella, Michele De Prisco, Jeremiah B Joyce, Claudia Valenzuela-Pascual, Ariadna Mas-Musons, Vincenzo Oliva, Giovanna Fico, George Chatzisofroniou, Sanjeev Mishra, Majd Al-Soleiti, Filippo Corponi, Anna Giménez-Palomo, Laura Montejo, Meritxell González-Campos, Dina Popovic, Isabella Pacchiarotti, Marc Valentí, Myriam Cavero, Lluc Colomer, Iria Grande, Antoni Benabarre, Cristian-Daniel Llach, Joaquim Raduà, Melvin McInnis, Diego Hidalgo-Mazzei, Mark A Frye, Andrea Murru, Eduard Vieta
Author Information
  1. Gerard Anmella: Department of Psychiatry and Psychology, Institute of Neuroscience, Hospital Clinic of Barcelona, 08036 Barcelona, Catalonia, Spain. ORCID
  2. Michele De Prisco: Department of Psychiatry and Psychology, Institute of Neuroscience, Hospital Clinic of Barcelona, 08036 Barcelona, Catalonia, Spain. ORCID
  3. Jeremiah B Joyce: School of Graduate Medical Education, Mayo Clinic, Rochester, MN 55902, USA. ORCID
  4. Claudia Valenzuela-Pascual: Department of Psychiatry and Psychology, Institute of Neuroscience, Hospital Clinic of Barcelona, 08036 Barcelona, Catalonia, Spain. ORCID
  5. Ariadna Mas-Musons: Department of Psychiatry and Psychology, Institute of Neuroscience, Hospital Clinic of Barcelona, 08036 Barcelona, Catalonia, Spain.
  6. Vincenzo Oliva: Department of Psychiatry and Psychology, Institute of Neuroscience, Hospital Clinic of Barcelona, 08036 Barcelona, Catalonia, Spain. ORCID
  7. Giovanna Fico: Department of Psychiatry and Psychology, Institute of Neuroscience, Hospital Clinic of Barcelona, 08036 Barcelona, Catalonia, Spain.
  8. George Chatzisofroniou: Office of Information Security, Mayo Clinic, Rochester, MN 55905, USA.
  9. Sanjeev Mishra: Alix School of Medicine, Mayo Clinic, Rochester, MN 55905, USA. ORCID
  10. Majd Al-Soleiti: School of Graduate Medical Education, Mayo Clinic, Rochester, MN 55902, USA.
  11. Filippo Corponi: School of Informatics, University of Edinburgh, Edinburgh EH16 4TJ, UK.
  12. Anna Giménez-Palomo: Department of Psychiatry and Psychology, Institute of Neuroscience, Hospital Clinic of Barcelona, 08036 Barcelona, Catalonia, Spain. ORCID
  13. Laura Montejo: Department of Psychiatry and Psychology, Institute of Neuroscience, Hospital Clinic of Barcelona, 08036 Barcelona, Catalonia, Spain.
  14. Meritxell González-Campos: Department of Psychiatry and Psychology, Institute of Neuroscience, Hospital Clinic of Barcelona, 08036 Barcelona, Catalonia, Spain. ORCID
  15. Dina Popovic: Department of Psychiatry and Psychology, Institute of Neuroscience, Hospital Clinic of Barcelona, 08036 Barcelona, Catalonia, Spain.
  16. Isabella Pacchiarotti: Department of Psychiatry and Psychology, Institute of Neuroscience, Hospital Clinic of Barcelona, 08036 Barcelona, Catalonia, Spain.
  17. Marc Valentí: Department of Psychiatry and Psychology, Institute of Neuroscience, Hospital Clinic of Barcelona, 08036 Barcelona, Catalonia, Spain.
  18. Myriam Cavero: Department of Psychiatry and Psychology, Institute of Neuroscience, Hospital Clinic of Barcelona, 08036 Barcelona, Catalonia, Spain. ORCID
  19. Lluc Colomer: Department of Psychiatry and Psychology, Institute of Neuroscience, Hospital Clinic of Barcelona, 08036 Barcelona, Catalonia, Spain. ORCID
  20. Iria Grande: Department of Psychiatry and Psychology, Institute of Neuroscience, Hospital Clinic of Barcelona, 08036 Barcelona, Catalonia, Spain.
  21. Antoni Benabarre: Department of Psychiatry and Psychology, Institute of Neuroscience, Hospital Clinic of Barcelona, 08036 Barcelona, Catalonia, Spain.
  22. Cristian-Daniel Llach: Mood Disorders Psychopharmacology Unit, University Health Network, Toronto, ON M5G 1M9, Canada. ORCID
  23. Joaquim Raduà: Biomedical Research Networking Centre Consortium on Mental Health (CIBERSAM), Instituto de Salud Carlos III, 28029 Madrid, Madrid, Spain.
  24. Melvin McInnis: Department of Psychiatry, University of Michigan, Ann Arbor, MI 48109, USA.
  25. Diego Hidalgo-Mazzei: Department of Psychiatry and Psychology, Institute of Neuroscience, Hospital Clinic of Barcelona, 08036 Barcelona, Catalonia, Spain.
  26. Mark A Frye: Department of Psychiatry and Psychology, Mayo Clinic, Rochester, MN 55905, USA.
  27. Andrea Murru: Department of Psychiatry and Psychology, Institute of Neuroscience, Hospital Clinic of Barcelona, 08036 Barcelona, Catalonia, Spain.
  28. Eduard Vieta: Department of Psychiatry and Psychology, Institute of Neuroscience, Hospital Clinic of Barcelona, 08036 Barcelona, Catalonia, Spain. ORCID

Abstract

: Bipolar disorder (BD) involves significant mood and energy shifts reflected in speech patterns. Detecting these patterns is crucial for diagnosis and monitoring, currently assessed subjectively. Advances in natural language processing offer opportunities to objectively analyze them. : To (i) correlate speech features with manic-depressive symptom severity in BD, (ii) develop predictive models for diagnostic and treatment outcomes, and (iii) determine the most relevant speech features and tasks for these analyses. : This naturalistic, observational study involved longitudinal audio recordings of BD patients at euthymia, during acute manic/depressive phases, and after-response. Patients participated in clinical evaluations, cognitive tasks, standard text readings, and storytelling. After automatic diarization and transcription, speech features, including acoustics, content, formal aspects, and emotionality, will be extracted. Statistical analyses will (i) correlate speech features with clinical scales, (ii) use lasso logistic regression to develop predictive models, and (iii) identify relevant speech features. : Audio recordings from 76 patients (24 manic, 21 depressed, 31 euthymic) were collected. The mean age was 46.0 ± 14.4 years, with 63.2% female. The mean YMRS score for manic patients was 22.9 ± 7.1, reducing to 5.3 ± 5.3 post-response. Depressed patients had a mean HDRS-17 score of 17.1 ± 4.4, decreasing to 3.3 ± 2.8 post-response. Euthymic patients had mean YMRS and HDRS-17 scores of 0.97 ± 1.4 and 3.9 ± 2.9, respectively. Following data pre-processing, including noise reduction and feature extraction, comprehensive statistical analyses will be conducted to explore correlations and develop predictive models. : Automated speech analysis in BD could provide objective markers for psychopathological alterations, improving diagnosis, monitoring, and response prediction. This technology could identify subtle alterations, signaling early signs of relapse. Establishing standardized protocols is crucial for creating a global speech cohort, fostering collaboration, and advancing BD understanding.

Keywords

References

  1. Gen Hosp Psychiatry. 2023 Mar-Apr;81:51-56 [PMID: 36805332]
  2. Am J Psychiatry. 2013 Jan;170(1):1-5 [PMID: 23288382]
  3. J Neurolinguistics. 2007 Jan;20(1):50-64 [PMID: 21253440]
  4. World Psychiatry. 2018 Feb;17(1):67-75 [PMID: 29352548]
  5. Front Psychiatry. 2021 Sep 06;12:719125 [PMID: 34552519]
  6. IEEE Trans Biomed Eng. 2013 Feb;60(2):497-506 [PMID: 23192475]
  7. Front Psychiatry. 2023 Jul 20;14:1079448 [PMID: 37575564]
  8. Psychiatry Investig. 2018 Jul;15(7):695-700 [PMID: 29969852]
  9. Psychol Med. 2024 Apr 16;:1-8 [PMID: 38623694]
  10. Bipolar Disord. 2009 Aug;11(5):453-73 [PMID: 19624385]
  11. Front Aging Neurosci. 2018 Nov 13;10:369 [PMID: 30483116]
  12. Bipolar Disord. 2022 Nov;24(7):709-719 [PMID: 35322518]
  13. JMIR Ment Health. 2024 Jan 18;11:e49222 [PMID: 38236637]
  14. Eur Neuropsychopharmacol. 2023 Jan;66:64-65 [PMID: 36459959]
  15. Eur Neuropsychopharmacol. 2024 Jul;84:57-58 [PMID: 38677193]
  16. IEEE Trans Biomed Eng. 2004 Sep;51(9):1530-40 [PMID: 15376501]
  17. Annu Int Conf IEEE Eng Med Biol Soc. 2012;2012:2104-7 [PMID: 23366336]
  18. J Affect Disord. 2022 Mar 1;300:226-234 [PMID: 34958814]
  19. Harv Rev Psychiatry. 2023 Jan-Feb 01;31(1):1-13 [PMID: 36608078]
  20. Br J Psychiatry. 1978 Nov;133:429-35 [PMID: 728692]
  21. J Neurolinguistics. 2010 May 1;23(3):270-284 [PMID: 20383310]
  22. J Voice. 2017 Mar;31(2):256.e1-256.e6 [PMID: 27473933]
  23. Eur Neuropsychopharmacol. 2024 Feb;79:17-18 [PMID: 38056029]
  24. Aust N Z J Psychiatry. 2019 Apr;53(4):365-366 [PMID: 30514099]
  25. Schizophr Bull. 2023 Mar 22;49(Suppl_2):S183-S195 [PMID: 36946533]
  26. Sci Rep. 2019 Oct 3;9(1):14282 [PMID: 31582814]
  27. JMIR Ment Health. 2020 Sep 22;7(9):e19476 [PMID: 32960185]
  28. Schizophr Res. 2007 Jul;93(1-3):304-16 [PMID: 17433866]
  29. Acta Psychiatr Scand. 2024 Jun 18;: [PMID: 38890010]
  30. J Neurol Neurosurg Psychiatry. 1960 Feb;23:56-62 [PMID: 14399272]
  31. Eur Neuropsychopharmacol. 2023 Jun;71:6-8 [PMID: 36931073]
  32. J Affect Disord. 2018 Apr 1;230:84-86 [PMID: 29407543]
  33. BJPsych Open. 2024 Aug 01;10(5):e137 [PMID: 39086306]
  34. JAMA. 2013 Nov 27;310(20):2191-4 [PMID: 24141714]
  35. J Psychiatr Res. 2018 Mar;98:59-63 [PMID: 29291581]
  36. J Int Neuropsychol Soc. 2019 Aug;25(7):772-776 [PMID: 31030708]
  37. Transl Psychiatry. 2024 Mar 26;14(1):161 [PMID: 38531865]
  38. Schizophr Res. 2012 Dec;142(1-3):93-5 [PMID: 23102940]
  39. Psychiatry Res. 2015 Jan 30;225(1-2):40-49 [PMID: 25480546]
  40. J Affect Disord. 2024 Jun 15;355:210-219 [PMID: 38548208]
  41. J Speech Lang Hear Res. 2020 Oct 16;63(10):3311-3325 [PMID: 32916082]
  42. JAMA. 2023 Oct 10;330(14):1370-1380 [PMID: 37815563]
  43. IEEE Access. 2020 Jun 01;8:114998-115004 [PMID: 34192109]
  44. Sci Rep. 2014 Jan 15;4:3691 [PMID: 24424108]
  45. Sci Rep. 2021 Sep 30;11(1):19423 [PMID: 34593826]
  46. Annu Int Conf IEEE Eng Med Biol Soc. 2015;2015:6106-9 [PMID: 26737685]
  47. PLoS One. 2019 May 31;14(5):e0217404 [PMID: 31150442]
  48. Laryngoscope Investig Otolaryngol. 2020 Jan 31;5(1):96-116 [PMID: 32128436]
  49. Acta Psychiatr Scand. 2000 Apr;101(4):323-9 [PMID: 10782554]
  50. Rev Psiquiatr Salud Ment. 2015 Jul-Sep;8(3):117-8 [PMID: 25959401]
  51. Eur Neuropsychopharmacol. 2022 Oct;63:17-34 [PMID: 36041245]
  52. Alzheimers Res Ther. 2021 Jun 4;13(1):109 [PMID: 34088354]
  53. IEEE Trans Biomed Eng. 2008 Jan;55(1):96-107 [PMID: 18232351]
  54. BioData Min. 2021 Feb 2;14(1):11 [PMID: 33531048]
  55. Neuropsychopharmacology. 2014 Sep;39(10):2340-8 [PMID: 24694926]
  56. NPJ Schizophr. 2015 Aug 26;1:15030 [PMID: 27336038]
  57. Transl Psychiatry. 2016 Jul 19;6:e856 [PMID: 27434490]

Word Cloud

Created with Highcharts 10.0.0speech±:BDfeaturespatients3predictivemodelsmean4diagnosislanguagedevelopanalyseswill91Bipolardisorderpatternscrucialmonitoringnaturalprocessingcorrelateiiiiirelevanttasksrecordingsclinicalincludingcontentidentifymanic0YMRSscore5post-responseHDRS-172AutomatedanalysisalterationsglobalcohortinvolvessignificantmoodenergyshiftsreflectedDetectingcurrentlyassessedsubjectivelyAdvancesofferopportunitiesobjectivelyanalyzemanic-depressivesymptomseveritydiagnostictreatmentoutcomesdeterminenaturalisticobservationalstudyinvolvedlongitudinalaudioeuthymiaacutemanic/depressivephasesafter-responsePatientsparticipatedevaluationscognitivestandardtextreadingsstorytellingautomaticdiarizationtranscriptionacousticsformalaspectsemotionalityextractedStatisticalscalesuselassologisticregressionAudio762421depressed31euthymiccollectedage4614years632%female227reducingDepressed17decreasing8Euthymicscores97respectivelyFollowingdatapre-processingnoisereductionfeatureextractioncomprehensivestatisticalconductedexplorecorrelationsprovideobjectivemarkerspsychopathologicalimprovingresponsepredictiontechnologysubtlesignalingearlysignsrelapseEstablishingstandardizedprotocolscreatingfosteringcollaborationadvancingunderstandingSpeechAnalysisDisorder:CALIBERStudyProtocolPreliminaryResultsacousticpropertiesbipolaremotionalprofilesprecisionpsychiatry

Similar Articles

Cited By