Alle Publikationen
- <<
- <
- 1
2019
-
(2019): Emotional Expressions Reconsidered: Challenges to Inferring Emotion From Human Facial Movements. In: Psychological science in the public interest : a journal of the American Psychological Society 20 (1), S. 1-68. DOI: 10.1177/1529100619832930
DOI: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6640856 Abstract: It is commonly assumed that a person's emotional state can be readily inferred from his or her facial movements, typically called emotional expressions or facial expressions. This assumption influences legal judgments, policy decisions, national security protocols, and educational practices; guides the diagnosis and treatment of psychiatric illness, as well as the development of commercial applications; and pervades everyday social interactions as well as research in other scientific fields such as artificial intelligence, neuroscience, and computer vision. In this article, we survey examples of this widespread assumption, which we refer to as the common view, and we then examine the scientific evidence that tests this view, focusing on the six most popular emotion categories used by consumers of emotion research: anger, disgust, fear, happiness, sadness, and surprise. The available scientific evidence suggests that people do sometimes smile when happy, frown when sad, scowl when angry, and so on, as proposed by the common view, more than what would be expected by chance. Yet how people communicate anger, disgust, fear, happiness, sadness, and surprise varies substantially across cultures, situations, and even across people within a single situation. Furthermore, similar configurations of facial movements variably express instances of more than one emotion category. In fact, a given configuration of facial movements, such as a scowl, often communicates something other than an emotional state. Scientists agree that facial movements convey a range of information and are important for social communication, emotional or otherwise. But our review suggests an urgent need for research that examines how people actually move their faces to express emotions and other social information in the variety of contexts that make up everyday life, as well as careful study of the mechanisms by which people perceive instances of emotion in one another. We make specific research recommendations that will yield a more valid picture of how people move their faces to express emotions and how they infer emotional meaning from facial movements in situations of everyday life. This research is crucial to provide consumers of emotion research with the translational information they require.
2017
-
(2017): The Eyes as Window to the Mind. In: The American journal of psychiatry 174 (1), S. 1-2. DOI: 10.1176/appi.ajp.2016.16101188
-
Fernández-Dols, José-Miguel; Russell, James A. (Hg.) (2017): The science of facial expression. New York, NY: Oxford University Press (Oxford series in social cognition and social neuroscience)
-
Vinciarelli, Alessandro; Burgoon, Judee K.; Pantic, Maja; Magnenat-Thalmann, Nadia (Hg.) (2017): Social signal processing. Cambridge: Cambridge University Press
DOI: https://doi.org/10.1017/9781316676202 Abstract: What does it mean to be social? distinguishing social from biological signal systems -- Universal dimensions of social cognition -- Measuring responses to nonverbal social signals: research on affect receiving ability -- Computational analysis of vocal expression of affect - trends and challenges -- The vertical dimension of social signaling -- Self-presentation: signaling personal and social characteristics -- Interaction coordination and adaptation -- Social signals and persuasion -- Social presence in CMC and VR -- Facial actions as social signals -- Automatic analysis of bodily social signals -- Computational approaches for personality prediction -- Automatic analysis of aesthetics: human beauty, attractiveness, and likability -- Interpersonal synchrony: from social perception to social interaction -- Automatic analysis of social emotions -- Social signal processing for automatic role recognition -- Machine learning methods for social signal processing -- Speech synthesis: state-of-the-art and challenges for the future -- Body movements generation for virtual characters and social robots -- Approach and dominance as social signals for affective interfaces -- Virtual reality and prosocial behaviour -- Social signal processing in social robotics -- Social signal processing for surveillance -- Analysis of small groups -- Multimedia implicit tagging -- Social signal processing for conflict analysis and understanding -- Social signal processing and socially assistive robotics in developmental disorders -- Social signal of deception and dishonesty Social Signal Processing is the first book to cover all aspects of the modeling, automated detection, analysis, and synthesis of nonverbal behavior in human-human and human-machine interactions. Authoritative surveys address conceptual foundations, machine analysis and synthesis of social signal processing, and applications. Foundational topics include affect perception and interpersonal coordination in communication; later chapters cover technologies for automatic detection and understanding such as computational paralinguistics and facial expression analysis and for the generation of artificial social signals such as social robots and artificial agents. The final section covers a broad spectrum of applications based on social signal processing in healthcare, deception detection, and digital cities, including detection of developmental diseases and analysis of small groups. Each chapter offers a basic introduction to its topic, accessible to students and other newcomers, and then outlines challenges and future perspectives for the benefit of experienced researchers and practitioners in the field
2015
-
(2015): The effects of culture and context on perceptions of robotic facial expressions. In: Interaction Studies: Social Behaviour and Communication in Biological and Artificial Systems 16 (2), S. 272-302. DOI: 10.1075/is.16.2.11ben
DOI: https://doi.org/10.1075/is.16.2.11ben Abstract: We report two experimental studies of human perceptions of robotic facial expressions while systematically varying context effects and the cultural background of subjects (n = 93). Except for Fear, East Asian and Western subjects were not significantly different in recognition rates, and, while Westerners were better at judging affect from mouth movement alone, East Asians were not any better at judging affect based on eye/brow movement alone. Moreover, context effects appeared capable of over-riding such cultural differences, most notably for Fear. The results seem to run counter to previous theories of cultural differences in facial expression based on emoticons and eye fixation patterns. We connect this to broader research in cognitive science – suggesting the findings support a dynamical systems view of social cognition as an emergent phenomenon. The results here suggest that, if we can induce appropriate context effects, it may be possible to create culture-neutral models of robots and affective interaction. (PsycINFO Database Record (c) 2019 APA, all rights reserved)
2013
-
(2013): Why are you looking like that? How the context influences evaluation and processing of human faces. In: Social cognitive and affective neuroscience 8 (4), S. 438-445. DOI: 10.1093/scan/nss013
DOI: http://www.ncbi.nlm.nih.gov/pubmed/22287265 Abstract: Perception and evaluation of facial expressions are known to be heavily modulated by emotional features of contextual information. Such contextual effects, however, might also be driven by non-emotional aspects of contextual information, an interaction of emotional and non-emotional factors, and by the observers' inherent traits. Therefore, we sought to assess whether contextual information about self-reference in addition to information about valence influences the evaluation and neural processing of neutral faces. Furthermore, we investigated whether social anxiety moderates these effects. In the present functional magnetic resonance imaging (fMRI) study, participants viewed neutral facial expressions preceded by a contextual sentence conveying either positive or negative evaluations about the participant or about somebody else. Contextual influences were reflected in rating and fMRI measures, with strong effects of self-reference on brain activity in the medial prefrontal cortex and right fusiform gyrus. Additionally, social anxiety strongly affected the response to faces conveying negative, self-related evaluations as revealed by the participants' rating patterns and brain activity in cortical midline structures and regions of interest in the left and right middle frontal gyrus. These results suggest that face perception and processing are highly individual processes influenced by emotional and non-emotional aspects of contextual information and further modulated by individual personality traits. zitiert von 56
Keywords: Affective Valence, Amygdala, Brain Mapping, Brain/physiology, Cerebral Blood Flow, Context, Emotions/physiology, Face Perception, Face/physiology, Facial Expression, FACIAL EXPRESSIONS, Female, Functional Magnetic Resonance Imaging, Fusiform Gyrus, Humans, Magnetic Resonance Imaging/methods, Male, Neuroanatomy, Neurowissenschaften, Pattern Recognition, Visual/physiology, Perception/physiology, Personality Traits, Photic Stimulation/methods, Self Reference, social anxiety 2009
-
(2009): The social brain: neural basis of social knowledge. In: Annual review of psychology 60, S. 693-716. DOI: 10.1146/annurev.psych.60.110707.163514
DOI: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2588649 Abstract: Social cognition in humans is distinguished by psychological processes that allow us to make inferences about what is going on inside other people-their intentions, feelings, and thoughts. Some of these processes likely account for aspects of human social behavior that are unique, such as our culture and civilization. Most schemes divide social information processing into those processes that are relatively automatic and driven by the stimuli, versus those that are more deliberative and controlled, and sensitive to context and strategy. These distinctions are reflected in the neural structures that underlie social cognition, where there is a recent wealth of data primarily from functional neuroimaging. Here I provide a broad survey of the key abilities, processes, and ways in which to relate these to data from cognitive neuroscience.
2008
-
(2008): On the interplay between familiarity and emotional expression in face perception. In: Psychological research 72 (5), S. 580-586. DOI: 10.1007/s00426-007-0132-4
DOI: http://www.ncbi.nlm.nih.gov/pubmed/18066587 Abstract: Traditional models of face perception (e.g. Bruce and Young 1986) stress independent routes for processing identity and emotional expression. We investigated the interplay between familiarity and emotional expression by systematically varying both factors. In contrast to earlier studies which used binary forced-choice decisions, participants had to judge the familiarity of the presented face and the emotional hedonic valence and emotional arousal of its expressed emotion (angry, happy or neutral), using rating scales. The results demonstrated symmetric, strong interactions between familiarity and expressed emotion. Thus, this study supports more recent models of face perception (Haxby et al. 2000) that were mostly based on brain imaging data. These data together with our behavioural results emphasize the interaction of emotional expression and personal identity and support approaches that propose a relative segregation of these processes, rather than completely independent coding (Calder and Young 2005). zitiert von 28
2007
-
(2007): Language as context for the perception of emotion. In: Trends in cognitive sciences 11 (8), S. 327-332. DOI: 10.1016/j.tics.2007.06.003
DOI: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2225544 Abstract: In the blink of an eye, people can easily see emotion in another person's face. This fact leads many to assume that emotion perception is given and proceeds independently of conceptual processes such as language. In this paper we suggest otherwise and offer the hypothesis that language functions as a context in emotion perception. We review a variety of evidence consistent with the language-as-context view and then discuss how a linguistically relative approach to emotion perception allows for intriguing and generative questions about the extent to which language shapes the sensory processing involved in seeing emotion in another person's face.
-
(2007): The representation of information about faces in the temporal and frontal lobes. In: Neuropsychologia 45 (1), S. 124-143. DOI: 10.1016/j.neuropsychologia.2006.04.019
DOI: http://www.ncbi.nlm.nih.gov/pubmed/16797609 Abstract: Neurophysiological evidence is described showing that some neurons in the macaque inferior temporal visual cortex have responses that are invariant with respect to the position, size and view of faces and objects, and that these neurons show rapid processing and rapid learning. Which face or object is present is encoded using a distributed representation in which each neuron conveys independent information in its firing rate, with little information evident in the relative time of firing of different neurons. This ensemble encoding has the advantages of maximising the information in the representation useful for discrimination between stimuli using a simple weighted sum of the neuronal firing by the receiving neurons, generalisation and graceful degradation. These invariant representations are ideally suited to provide the inputs to brain regions such as the orbitofrontal cortex and amygdala that learn the reinforcement associations of an individual's face, for then the learning, and the appropriate social and emotional responses, generalise to other views of the same face. A theory is described of how such invariant representations may be produced in a hierarchically organised set of visual cortical areas with convergent connectivity. The theory proposes that neurons in these visual areas use a modified Hebb synaptic modification rule with a short-term memory trace to capture whatever can be captured at each stage that is invariant about objects as the objects change in retinal view, position, size and rotation. Another population of neurons in the cortex in the superior temporal sulcus encodes other aspects of faces such as face expression, eye gaze, face view and whether the head is moving. These neurons thus provide important additional inputs to parts of the brain such as the orbitofrontal cortex and amygdala that are involved in social communication and emotional behaviour. Outputs of these systems reach the amygdala, in which face-selective neurons are found, and also the orbitofrontal cortex, in which some neurons are tuned to face identity and others to face expression. In humans, activation of the orbitofrontal cortex is found when a change of face expression acts as a social signal that behaviour should change; and damage to the orbitofrontal cortex can impair face and voice expression identification, and also the reversal of emotional behaviour that normally occurs when reinforcers are reversed.
Keywords: Animals, Computer Simulation, Facial Expression, Frontal Lobe/physiology, Gesicht und assoziierte Zuschreibungen, Gesichtserkennung, Gesichtszüge, Gestik/Mimik, Haplorhini, hierarchy, Humans, Mensch oder Tier, Neurowissenschaften, Social Perception, Temporal Lobe/physiology, Tier und Mensch 2006
-
(2006): Towards the neurobiology of emotional body language. In: Nature reviews. Neuroscience 7 (3), S. 242-249. DOI: 10.1038/nrn1872
DOI: http://www.ncbi.nlm.nih.gov/pubmed/16495945 Abstract: People's faces show fear in many different circumstances. However, when people are terrified, as well as showing emotion, they run for cover. When we see a bodily expression of emotion, we immediately know what specific action is associated with a particular emotion, leaving little need for interpretation of the signal, as is the case for facial expressions. Research on emotional body language is rapidly emerging as a new field in cognitive and affective neuroscience. This article reviews how whole-body signals are automatically perceived and understood, and their role in emotional communication and decision-making.
Keywords: Amygdala, Angst, Animals, Biological, Brain Mapping, dominance, Emotions, entscheiden, Facial Expression, Functional Laterality, Gestik, Humans, Kinesics, Körperhaltung, Mimik, MODELS, Neurobiologie, Neurobiology, Neurowissenschaften, Nonverbale Kommunikation, physiology, Social Perception 2004
-
(2004): Psychology. Is language the key to human intelligence?. In: Science (New York, N.Y.) 303 (5656), S. 318-320. DOI: 10.1126/science.1093993
2003
-
(2003): Perceived gaze direction and the processing of facial displays of emotion. In: Psychological science 14 (6), S. 644-647. DOI: 10.1046/j.0956-7976.2003.psci_1479.x
DOI: http://www.ncbi.nlm.nih.gov/pubmed/14629700 Abstract: There is good reason to believe that gaze direction and facial displays of emotion share an information value as signals of approach or avoidance. The combination of these cues in the analysis of social communication, however, has been a virtually neglected area of inquiry. Two studies were conducted to test the prediction that direct gaze would facilitate the processing of facially communicated approach-oriented emotions (e.g., anger and joy), whereas averted gaze would facilitate the processing of facially communicated avoidance-oriented emotions (e.g., fear and sadness). The results of both studies confirmed the central hypothesis and suggest that gaze direction and facial expression are combined in the processing of emotionally relevant facial information.
Keywords: abgewendeter Blick, Affect, Angst, Blick / Gaze, Blickkontakt, Blickrichtung, Emotionaler Zustand, Emotionen, Facial Expression, Female, Fixation, Ocular, Freude, Gesicht und assoziierte Zuschreibungen, Gesichtsausdruck, Gestik/Mimik, Humans, Male, theory of mind, Traurigkeit, Visual Perception, Wut -
(2003): Toward sociable robots. In: Robotics and Autonomous Systems 42 (3), S. 167-175. DOI: 10.1016/S0921-8890(02)00373-1
DOI: https://doi.org/10.1016/S0921-8890(02)00373-1 Abstract: This paper explores the topic of social robots—the class of robots that people anthropomorphize in order to interact with them. From the diverse and growing number of applications for such robots, a few distinct modes of interaction are beginning to emerge. We distinguish four such classes: socially evocative, social interface, socially receptive, and sociable. For the remainder of the paper, we explore a few key features of sociable robots that distinguish them from the others. We use the vocal turn-taking behavior of our robot, Kismet, as a case study to highlight these points.
1987
-
(1987): Universals and cultural differences in the judgments of facial expressions of emotion. In: Journal of personality and social psychology 53 (4), S. 712-717
Abstract: We present here new evidence of cross-cultural agreement in the judgement of facial expression. Subjects in 10 cultures performed a more complex judgment task than has been used in previous cross-cultural studies. Instead of limiting the subjects to selecting only one emotion term for each expression, this task allowed them to indicate that multiple emotions were evident and the intensity of each emotion. Agreement was very high across cultures about which emotion was the most intense. The 10 cultures also agreed about the second most intense emotion signaled by an expression and about the relative intensity among expressions of the same emotion. However, cultural differences were found in judgments of the absolute level of emotional intensity.
Keywords: Adult, Attitude, Cross-Cultural Comparison, Disziplin, dominance, Emotions, Emotionserkennung, Facial Expression, FACS (Facial Action Coding System) Paul Ekman, Friesen und Tomkins (Vorgänger: FAST Facial Affect Scoring Technique, Favoriten, Female, Gesichtserkennung, Gestik/Mimik, Humans, Judgment, Kulturinvarianz, Kulturtheorie, Male, Mensch-Technik-Relationen (MTR), Realtechnik, Sozialpsychologie, Technik, zugeschriebene Emotionsvarianz
- <<
- <
- 1