The integration of emotional and symbolic components in multimodal communication.

Marc Mehu
Author Information
  1. Marc Mehu: Department of Psychology, Webster Vienna Private University , Vienna, Austria.

Abstract

Human multimodal communication can be said to serve two main purposes: information transfer and social influence. In this paper, I argue that different components of multimodal signals play different roles in the processes of information transfer and social influence. Although the symbolic components of communication (e.g., verbal and denotative signals) are well suited to transfer conceptual information, emotional components (e.g., non-verbal signals that are difficult to manipulate voluntarily) likely take a function that is closer to social influence. I suggest that emotion should be considered a property of communicative signals, rather than an entity that is transferred as content by non-verbal signals. In this view, the effect of emotional processes on communication serve to change the quality of social signals to make them more efficient at producing responses in perceivers, whereas symbolic components increase the signals' efficiency at interacting with the cognitive processes dedicated to the assessment of relevance. The interaction between symbolic and emotional components will be discussed in relation to the need for perceivers to evaluate the reliability of multimodal signals.

Keywords

References

  1. Cogn Process. 2012 Oct;13 Suppl 2:397-414 [PMID: 22328016]
  2. Science. 2007 Sep 7;317(5843):1344-7 [PMID: 17823343]
  3. Psychol Bull. 2005 Nov;131(6):898-924 [PMID: 16351328]
  4. Psychol Sci. 2014 Aug;25(8):1511-7 [PMID: 24898726]
  5. J Pers Soc Psychol. 2004 Jan;86(1):57-76 [PMID: 14717628]
  6. Anim Behav. 1999 Nov;58(5):921-931 [PMID: 10564594]
  7. Pers Soc Psychol Rev. 2005;9(4):278-311 [PMID: 16223353]
  8. Emotion. 2012 Aug;12(4):701-15 [PMID: 22642350]
  9. J Pers Soc Psychol. 1998 Mar;74(3):565-77 [PMID: 11407408]
  10. Science. 1999 Feb 26;283(5406):1272-3 [PMID: 10084931]
  11. Philos Trans R Soc Lond B Biol Sci. 2007 Mar 29;362(1479):441-7 [PMID: 17255020]

Word Cloud

Created with Highcharts 10.0.0signalscommunicationcomponentsmultimodalsocialemotionalsymbolicinformationtransferinfluenceprocessesnon-verbalservedifferentegperceiversHumancansaidtwomainpurposes:paperargueplayrolesAlthoughverbaldenotativewellsuitedconceptualdifficultmanipulatevoluntarilylikelytakefunctionclosersuggestemotionconsideredpropertycommunicativeratherentitytransferredcontentvieweffectchangequalitymakeefficientproducingresponseswhereasincreasesignals'efficiencyinteractingcognitivededicatedassessmentrelevanceinteractionwilldiscussedrelationneedevaluatereliabilityintegrationethologypragmatics

Similar Articles

Cited By