Visual Perception of Emotional and Conversational Facial Expressions
Kathrin Kaulard
Diese Publikation zitieren
Kathrin Kaulard, Visual Perception of Emotional and Conversational Facial Expressions (2015), Logos Verlag, Berlin, ISBN: 9783832595050
5
Accesses
Accesses
4
Quotes
Quotes
Beschreibung / Abstract
One of the defining attributes of the human species is sophisticated communication, for which facial expressions are crucial. Traditional research has so far mainly investigated a minority of 6 basic emotional expressions displayed as pictures. Despite the important insights of this approach, its ecological validity is limited: facial movements express more than emotions, and facial expressions are more than just pictures. The objective of the present thesis is therefore to improve the understanding of facial expression recognition by investigating the internal representations of a large range of facial expressions, displayed both as static pictures and as dynamic videos.
To this end, it was necessary to develop and validate a new facial expression database which includes 20.000 stimuli of 55 expressions (study 1). Perceptual representations of the six basic emotional expressions were found previously to rely on evaluation of valence and arousal; study 2 showed that this evaluation generalises to many more expressions, particularly when displayed as videos. While it is widely accepted that knowledge influences perception, how these are linked is largely unknown; study 3 investigated this question by asking how knowledge about facial expressions, instantiated as conceptual representations, relates to perceptual representations of these expressions. A strong link was found which changed with the kind of expressions and the type of display.
In probably the most extensive behavioural studies (with regards to the number of facial expressions used) to date, this thesis suggests that there are commonalities but also differences in processing of emotional and of other types of facial expressions. Thus, to understand facial expression processing, one needs to consider more than the 6 basic emotional expressions. These findings outline first steps towards a new domain in facial expression research, which has implications for a number of research and application fields where facial expressions play a role, ranging from social, developmental, and clinical psychology to computer vision and affective computing research.
To this end, it was necessary to develop and validate a new facial expression database which includes 20.000 stimuli of 55 expressions (study 1). Perceptual representations of the six basic emotional expressions were found previously to rely on evaluation of valence and arousal; study 2 showed that this evaluation generalises to many more expressions, particularly when displayed as videos. While it is widely accepted that knowledge influences perception, how these are linked is largely unknown; study 3 investigated this question by asking how knowledge about facial expressions, instantiated as conceptual representations, relates to perceptual representations of these expressions. A strong link was found which changed with the kind of expressions and the type of display.
In probably the most extensive behavioural studies (with regards to the number of facial expressions used) to date, this thesis suggests that there are commonalities but also differences in processing of emotional and of other types of facial expressions. Thus, to understand facial expression processing, one needs to consider more than the 6 basic emotional expressions. These findings outline first steps towards a new domain in facial expression research, which has implications for a number of research and application fields where facial expressions play a role, ranging from social, developmental, and clinical psychology to computer vision and affective computing research.
Inhaltsverzeichnis
- BEGINN
- Declaration
- Declaration of Contribution of the Candidate
- Acknowledgements
- Abstract
- Table of Contents
- List of Figures
- List of Tables
- 1 Synopsis
- 1.1 Vision and Perception
- 1.2 Representing and categorising emotional facial expressions
- 1.3 Recognising static and dynamic facial expressions
- 1.4 Beyond emotional facial expressions
- 1.5 Aim and structure of the thesis
- 1.6 Conclusion
- 1.7 Future Work
- 2 The MPI Facial Expression Database:A Validated Database of Emotional and Conversational Facial Expressions
- 2.1 Abstract
- 2.2 Introduction
- 2.3 Ethics Statement
- 2.4 Development of the facial expression database
- 2.5 Validation of the new facial expression database
- 2.6 Discussion
- 2.7 Acknowledgments
- 2.8 Supplementary material
- 3 Beyond Emotions: Valence and Arousal drive the Evaluation of a large range of Emotional and Conversational Facial Expressions
- 3.1 Abstract
- 3.2 Introduction
- 3.3 Method
- 3.4 Results
- 3.5 Discussion
- 3.6 Acknowledgements
- 3.7 Supplementary material
- 4 Perceptual and ConceptualRepresentations of Facial Expressions: Making the Connection
- 4.1 Abstract
- 4.2 Introduction
- 4.3 Experiment 1 and 2: Common aspects
- 4.4 Experiment 1
- 4.5 Experiment 2
- 4.6 Experiment 1 and 2 combined
- 4.7 A common conceptual space?
- 4.8 Discussion
- 4.9 Acknowledgements
- 4.10 Supplementary material
- Bibliography