Similar representations of emotions across faces and voices. / Kuhn, Lisa; Wydell, Taeko; Lavan, Nadine; McGettigan, Carolyn; Garrido, Lucia.

In: Emotion, Vol. 17, No. 6, 2017, p. 912-937.

Research output: Contribution to journalArticlepeer-review

Published

Standard

Similar representations of emotions across faces and voices. / Kuhn, Lisa; Wydell, Taeko; Lavan, Nadine; McGettigan, Carolyn; Garrido, Lucia.

In: Emotion, Vol. 17, No. 6, 2017, p. 912-937.

Research output: Contribution to journalArticlepeer-review

Harvard

Kuhn, L, Wydell, T, Lavan, N, McGettigan, C & Garrido, L 2017, 'Similar representations of emotions across faces and voices', Emotion, vol. 17, no. 6, pp. 912-937. https://doi.org/10.1037/emo0000282

APA

Vancouver

Author

Kuhn, Lisa ; Wydell, Taeko ; Lavan, Nadine ; McGettigan, Carolyn ; Garrido, Lucia. / Similar representations of emotions across faces and voices. In: Emotion. 2017 ; Vol. 17, No. 6. pp. 912-937.

BibTeX

@article{9ba62c141f5d49e192d7b8b87ed0cc6f,
title = "Similar representations of emotions across faces and voices",
abstract = "Emotions are a vital component of social communication, carried across a range of modalities and via different perceptual signals such as specific muscle contractions in the face and in the upper respiratory system. Previous studies have found that emotion recognition impairments after brain damage depend on the modality of presentation: recognition from faces may be impaired whilst recognition from voices remains preserved, and vice versa. On the other hand, there is also evidence for shared neural activation during emotion processing in both modalities. In a behavioural study, we investigated whether there are shared representations in the recognition of emotions from faces and voices. We used a within-subjects design in which participants rated the intensity of facial expressions and non-verbal vocalisations for each of the six basic emotion labels. For each participant and each modality, we then computed a representation matrix with the intensity ratings of each emotion. These matrices allowed us to examine the patterns of confusions between emotions and to characterise the representations of emotions within each modality. We then compared the representations across modalities by computing the correlations of the representation matrices across faces and voices. We found highly correlated matrices across modalities, which suggest similar representations of emotions across faces and voices. We also showed that these results could not be explained by commonalities between low-level visual and acoustic properties of the stimuli. We thus propose that there are similar or shared coding mechanisms for emotions which may act independently of modality, despite their distinct perceptual inputs. ",
author = "Lisa Kuhn and Taeko Wydell and Nadine Lavan and Carolyn McGettigan and Lucia Garrido",
year = "2017",
doi = "10.1037/emo0000282",
language = "English",
volume = "17",
pages = "912--937",
journal = "Emotion",
issn = "1528-3542",
publisher = "American Psychological Association Inc.",
number = "6",

}

RIS

TY - JOUR

T1 - Similar representations of emotions across faces and voices

AU - Kuhn, Lisa

AU - Wydell, Taeko

AU - Lavan, Nadine

AU - McGettigan, Carolyn

AU - Garrido, Lucia

PY - 2017

Y1 - 2017

N2 - Emotions are a vital component of social communication, carried across a range of modalities and via different perceptual signals such as specific muscle contractions in the face and in the upper respiratory system. Previous studies have found that emotion recognition impairments after brain damage depend on the modality of presentation: recognition from faces may be impaired whilst recognition from voices remains preserved, and vice versa. On the other hand, there is also evidence for shared neural activation during emotion processing in both modalities. In a behavioural study, we investigated whether there are shared representations in the recognition of emotions from faces and voices. We used a within-subjects design in which participants rated the intensity of facial expressions and non-verbal vocalisations for each of the six basic emotion labels. For each participant and each modality, we then computed a representation matrix with the intensity ratings of each emotion. These matrices allowed us to examine the patterns of confusions between emotions and to characterise the representations of emotions within each modality. We then compared the representations across modalities by computing the correlations of the representation matrices across faces and voices. We found highly correlated matrices across modalities, which suggest similar representations of emotions across faces and voices. We also showed that these results could not be explained by commonalities between low-level visual and acoustic properties of the stimuli. We thus propose that there are similar or shared coding mechanisms for emotions which may act independently of modality, despite their distinct perceptual inputs.

AB - Emotions are a vital component of social communication, carried across a range of modalities and via different perceptual signals such as specific muscle contractions in the face and in the upper respiratory system. Previous studies have found that emotion recognition impairments after brain damage depend on the modality of presentation: recognition from faces may be impaired whilst recognition from voices remains preserved, and vice versa. On the other hand, there is also evidence for shared neural activation during emotion processing in both modalities. In a behavioural study, we investigated whether there are shared representations in the recognition of emotions from faces and voices. We used a within-subjects design in which participants rated the intensity of facial expressions and non-verbal vocalisations for each of the six basic emotion labels. For each participant and each modality, we then computed a representation matrix with the intensity ratings of each emotion. These matrices allowed us to examine the patterns of confusions between emotions and to characterise the representations of emotions within each modality. We then compared the representations across modalities by computing the correlations of the representation matrices across faces and voices. We found highly correlated matrices across modalities, which suggest similar representations of emotions across faces and voices. We also showed that these results could not be explained by commonalities between low-level visual and acoustic properties of the stimuli. We thus propose that there are similar or shared coding mechanisms for emotions which may act independently of modality, despite their distinct perceptual inputs.

U2 - 10.1037/emo0000282

DO - 10.1037/emo0000282

M3 - Article

VL - 17

SP - 912

EP - 937

JO - Emotion

JF - Emotion

SN - 1528-3542

IS - 6

ER -