Alle Publikationen
- <<
- <
- 1
2019
-
(2019): Learning to Have an Ear for Face Super-Resolution. Online verfügbar unter http://arxiv.org/pdf/1909.12780v1
Abstract: We propose a novel method to perform extreme (16x) face super-resolution by exploiting audio. Super-resolution is the task of recovering a high-resolution image from a low-resolution one. When the resolution of the input image is too low (e.g., 8x8 pixels), the loss of information is so dire that the details of the original identity have been lost. However, when the low-resolution image is extracted from a video, the audio track is also available. Because the audio carries information about the face identity, we propose to exploit it in the face reconstruction process. Towards this goal, we propose a model and a training procedure to extract information about the identity of a person from her audio track and to combine it with the information extracted from the low-resolution input image, which relates more to pose and colors of the face. We demonstrate that the combination of these two inputs yields high-resolution images that better capture the correct identity of the face. In particular, we show that audio can assist in recovering attributes such as the gender and the identity, and thus improve the correctness of the image reconstruction process. Our procedure does not make use of human annotation and thus can be easily trained with existing video datasets. Moreover, we show that our model allows one to mix low-resolution images and audio from different videos and to generate realistic faces with semantically meaningful combinations.
2018
-
(2018): Multicultural Facial Expression Recognition Based on Differences of Western-Caucasian and East-Asian Facial Expressions of Emotions. In: IEICE Transactions on Information and Systems 101 (5), S. 1317-1324. DOI: 10.1587/transinf.2017MVP0025
Abstract: An increasing number of psychological studies have demonstrated that the six basic expressions of emotions are not culturally universal. However, automatic facial expression recognition (FER) systems disregard these findings and assume that facial expressions are universally expressed and recognized across different cultures. Therefore, this paper presents an analysis of Western-Caucasian and East-Asian facial expressions of emotions based on visual representations and cross-cultural FER. The visual analysis builds on the Eigenfaces method, and the cross-cultural FER combines appearance and geometric features by extracting Local Fourier Coefficients (LFC) and Facial Fourier Descriptors (FFD) respectively. Furthermore, two possible solutions for FER under multicultural environments are proposed. These are based on an early race detection, and independent models for culture-specific facial expressions found by the analysis evaluation. HSV color quantization combined with LFC and FFD compose the feature extraction for race detection, whereas culture-independent models of anger, disgust and fear are analyzed for the second solution. All tests were performed using Support Vector Machines (SVM) for classification and evaluated using five standard databases. Experimental results show that both solutions overcome the accuracy of FER systems under multicultural environments. However, the approach which individually considers the culture-specific facial expressions achieved the highest recognition rate.
Keywords: culture specificity, culture specificity of facial expressions of emotions, Emotionserkennung, facial expression recognition, Gestik/Mimik, Mensch-Technik-Relationen (MTR), multicultural FER, Realtechnik, Status / biologische Marker, Technik, universal human tendencies, universality of emotions -
(2018): Virtual Character Facial Expressions Influence Human Brain and Facial EMG Activity in a Decision-Making Game. In: IEEE Transactions on Affective Computing 9 (2), S. 285-298. DOI: 10.1109/TAFFC.2016.2601101
Abstract: We examined the effects of the emotional facial expressions of a virtual character (VC) on human frontal electroencephalographic (EEG) asymmetry (putatively indexing approach/withdrawal motivation), facial electromyographic (EMG) activity (emotional expressions), and social decision making (cooperation/defection). In a within-subjects design, the participants played the Iterated Prisoner's Dilemma game with VCs with different dynamic facial expressions (predefined or dependent on the participant's electrodermal and facial EMG activity). In general, VC facial expressions elicited congruent facial muscle activity. However, both frontal EEG asymmetry and facial EMG activity elicited by an angry VC facial expression varied as a function of preceding interactional events (human collaboration/defection). Pre-decision inner emotional-motivational processes and emotional facial expressions were dissociated, suggesting that human goals influence pre-decision frontal asymmetry, whereas display rules may affect (pre-decision) emotional expressions in human-VC interaction. An angry VC facial expression, high pre-decision corrugator EMG activity, and relatively greater left frontal activation predicted the participant's decision to defect. Both post-decision frontal asymmetry and facial EMG activity were related to reciprocal cooperation. The results suggest that the justifiability of VC emotional expressions and the perceived fairness of VC actions influence human emotional responses.
2017
-
(2017): Evaluating the Sensitivity to Virtual Characters Facial Asymmetry in Emotion Synthesis. In: Applied Artificial Intelligence 31 (2), S. 103-118. DOI: 10.1080/08839514.2017.1299983
Abstract: The use of expressive Virtual Characters is an effective complementary means of communication for social networks offering multi-user 3D-chatting environment. In such contexts, the facial expression channel offers a rich medium to translate the ongoing emotions conveyed by the text-based exchanges. However, until recently, only purely symmetric facial expressions have been considered for that purpose. In this article we examine human sensitivity to facial asymmetry in the expression of both basic and complex emotions. The rationale for introducing asymmetry in the display of facial expressions stems from two well-established observations in cognitive neuroscience: first that the expression of basic emotions generally displays a small asymmetry, second that more complex emotions such as ambivalent feeling may reflect in the partial display of different, potentially opposite, emotions on each side of the face. A frequent occurrence of this second case results from the conflict between the truly felt emotion and the one that should be displayed due to social conventions. Our main hypothesis is that a much larger expressive and emotional space can only be automatically synthesized by means of facial asymmetry when modeling emotions with a general Valence-Arousal-Dominance dimensional approach. Besides, we want also to explore the general human sensitivity to the introduction of a small degree of asymmetry into the expression of basic emotions. We conducted an experiment by presenting 64 pairs of static facial expressions, one symmetric and one asymmetric, illustrating eight emotions (three basic and five complex ones) alternatively for a male and a female character. Each emotion was presented four times by swapping the symmetric and asymmetric positions and by mirroring the asymmetrical expression. Participants were asked to grade, on a continuous scale, the correctness of each facial expression with respect to a short definition. Results confirm the potential of introducing facial asymmetry for a subset of the complex emotions. Guidelines are proposed for designers of embodied conversational agent and emotionally reflective avatars.
Keywords: Asymmetrie, Augmented & Virtual Reality, Authentizität von dargestellter Emotion, dominance, Emotionserkennung, Gesichtszüge, Gestik/Mimik, Kognitionswissenschaft/Social Sciences/Humanities, Konventionen, Mensch-Technik-Relationen (MTR), Neurowissenschaften, Realtechnik, soziale Kognition, Technik 2016
-
(2016): Interactive Human Intention Reading by Learning Hierarchical Behavior Knowledge Networks for Human-Robot Interaction. In: ETRI Journal 38 (6), S. 1229-1239. DOI: 10.4218/etrij.16.0116.0106
Abstract: For efficient interaction between humans and robots, robots should be able to understand the meaning and intention of human behaviors as well as recognize them. This paper proposes an interactive human intention reading method in which a robot develops its own knowledge about the human intention for an object. A robot needs to understand different human behavior structures for different objects. To this end, this paper proposes a hierarchical behavior knowledge network that consists of behavior nodes and directional edges between them. In addition, a human intention reading algorithm that incorporates reinforcement learning is proposed to interactively learn the hierarchical behavior knowledge networks based on context information and human feedback through human behaviors. The effectiveness of the proposed method is demonstrated through play-based experiments between a human and a virtual teddy bear robot with two virtual objects. Experiments with multiple participants are also conducted.
-
(2016): Tweester at SemEval-2016 Task 4: Sentiment Analysis in Twitter Using Semantic-Affective Model Adaptation, S. 155-163
Abstract: We describe our submission to SemEval2016 Task 4: Sentiment Analysis in Twitter. The proposed system ranked first for the subtask B. Our system comprises of multiple independent models such as neural networks, semantic-affective models and topic modeling that are combined in a probabilistic way. The novelty of the system is the employment of a topic modeling approach in order to adapt the semantic-affective space for each tweet. In addition, significant enhancements were made in the main system dealing with the data preprocessing and feature extraction including the employment of word embeddings. Each model is used to predict a tweet’s sentiment (positive, negative or neutral) and a late fusion scheme is adopted for the final decision.
-
(2016): Computational Analysis and Simulation of Empathic Behaviors. A Survey of Empathy Modeling with Behavioral Signal Processing Framework. In: Current psychiatry reports 18 (5). DOI: 10.1007/s11920-016-0682-5
DOI: https://doi.org/10.1007/s11920-016-0682-5 Abstract: Empathy is an important psychological process that facilitates human communication and interaction. Enhancement of empathy has profound significance in a range of applications. In this paper, we review emerging directions of research on computational analysis of empathy expression and perception as well as empathic interactions, including their simulation. We summarize the work on empathic expres- sion analysis by the targeted signal modalities (e.g., text, au- dio, and facial expressions). We categorize empathy simula- tion studies into theory-based emotion space modeling or application-driven user and context modeling. We summarize challenges in computational study of empathy including con- ceptual framing and understanding of empathy, data availability, appropriate use and validation of machine learn- ing techniques, and behavior signal processing. Finally, we propose a unified view of empathy computation and offer a series of open problems for future research.
2015
-
(2015) : Building autonomous sensitive artificial listeners (Extended abstract): 2015 International Conference on Affective Computing and Intelligent Interaction (ACII 2015): Xi'an, China, 21 - 24 September 2015: Piscataway, NJ: IEEE, S. 456-462
Abstract: This paper describes a substantial effort to build a real-time interactive multimodal dialogue system with a focus on emotional and non-verbal interaction capabilities. The work is motivated by the aim to provide technology with competences in perceiving and producing the emotional and non-verbal behaviours required to sustain a conversational dialogue. We present the Sensitive Artificial Listener (SAL) scenario as a setting which seems particularly suited for the study of emotional and non-verbal behaviour, since it requires only very limited verbal understanding on the part of the machine. This scenario allows us to concentrate on non-verbal capabilities without having to address at the same time the challenges of spoken language understanding, task modeling etc. We first summarise three prototype versions of the SAL scenario, in which the behaviour of the Sensitive Artificial Listener characters was determined by a human operator. These prototypes served the purpose of verifying the effectiveness of the SAL scenario and allowed us to collect data required for building system components for analysing and synthesising the respective behaviours. We then describe the fully autonomous integrated real-time system we created, which combines incremental analysis of user behaviour, dialogue management, and synthesis of speaker and listener behaviour of a SAL character displayed as a virtual agent. We discuss principles that should underlie the evaluation of SAL-type systems. Since the system is designed for modularity and reuse, and since it is publicly available, the SAL system has potential as a joint research tool in the affective computing research community.
Keywords: deutsche Community, Emotionserkennung, Emotionssensitive Systeme, Favoriten, Interaktion, Künstliche Intelligenz, Mensch-Technik-Relationen (MTR), Nonverbal communication, Nonverbale Kommunikation, Realtechnik, Sensitive Artificial Listener, Sozial Intelligente Agenten, Soziale Robotik, Soziosensitive Systeme, Sprachverstehen, Technik, Virtual Agents SAL -
(2015): Parafoveal-on-Foveal Effects of Emotional Word Semantics in Reading Chinese Sentences. Evidence From Eye Movements. In: JOURNAL OF EXPERIMENTAL PSYCHOLOGY-LEARNING MEMORY AND COGNITION 41 (4), S. 1237-1243
Abstract: Despite the well-known influence of emotional meaning on cognition, relatively less is known about its effects on reading behavior. We investigated whether fixation behavior during the reading of Chinese sentences is influenced by emotional word meaning in the parafovea. Two-character target words embedded into the same sentence frames provided emotionally positive, negative, or neutral contents. Fixation durations on neutral pretarget words were prolonged for positive parafoveal words and for highly frequent negative parafoveal words. In addition, fixation durations on foveal emotional words were shorter than those on neutral words. We also found that the role of emotional words varied as a function of their valence during foveal and parafoveal processing. These findings suggest a processing advantage for emotional words relative to emotionally neutral stimuli in foveal and parafoveal vision. We discuss implications for the notion of attention attraction due to emotional content. (PsycINFO Database Record (c) 2016 APA, all rights reserved)
Keywords: Aufmerksamkeit, Emotion und Sprachverarbeitung, Emotions, Emotionserkennung, frame semantics, Kognitionswissenschaft/Social Sciences/Humanities, Kognitive Skills/Social Cognition, Lesen, Mensch-Technik-Relationen (MTR), Neurowissenschaften, Realtechnik, Sprachverstehen, Technik, Voraussetzungen für sozial angemessenes Verhalten 2014
-
(2014): Le travail émotionnel du client. La structure séquentielle des émotions dans les usages problématiques d’un serveur vocal. In: Social Science Information 53 (3), S. 311-340. DOI: 10.1177/0539018414523520
Abstract: Recent developments in the service sector have led sociologists to suggest that customers are increasingly encouraged to work' for service organizations. This article develops the hypothesis that the clients who work in this service sector may experience an emotional dimension to their work. In support of this hypothesis, a revision of the notion of emotion work' is proposed on the basis of a study on the problematic usages of a phone interface service supplied by a telecommunications operator. The study made use of a group of genuine calls that were transcribed and coded; utterances were described objectively regarding pitch and intensity; finally, a statistical method for detecting sequential patterns was applied. The results suggest that clients respond emotionally to usability problems, and that their emotions unfold according to a recurrent sequential structure. Goffman's remedial interchange' provides the point of reference for the interpretation, which leads to the suggestion that the emotional patterns revealed are of a social origin, though not socially situated.
2011
-
(2011): Towards Social Robots. Designing an Emotion-Based Architecture. In: International Journal of Social Robotics 3 (3), S. 273-290. DOI: 10.1007/s12369-010-0087-2
Abstract: Service and assistant robots operating in "real world" become more and more important for everyday life. Requirements like social intelligence, social interaction, and social behavior are of enormous importance. Researchers agree that the realization of emotions for a robot is one of the most important steps on the way towards social robots. Still, an open question in robotics is how to model emotion in a way that all its functions are realized. In this paper an emotion-based architecture is presented. The architecture supports the implementation of the five functions of emotion, namely: regulative function, selective function, expressive function, motivational function, and rating function. Scalability, perceptibility, and parameterability are also considered as design features. As basis for the proposed architecture, psychological emotion and motivation theories are used. The derived control architecture is implemented using a behavior-based approach, in order to realize a modular extensible system design. The developed architecture is tested on the humanoid robot ROMAN.
Keywords: Angepasstheit der Maschine an Nutzerbedürfnisse, Design, emotion, Emotionserkennung, expressive function, Favoriten, Five functions of emotion model, functions of emotion, Ingenieurswissenschaft, Interaktionspartner, Mensch oder Maschine, Mensch-Technik-Relationen (MTR), motivational function, parameterability, perceptibility, rating function, Realtechnik, regulative function, scalability, selective function, Serviceroboter, Soziale Robotik, Technik -
(2011): Towards an Effective Design of Social Robots. In: International Journal of Social Robotics 3 (4), S. 333-335. DOI: 10.1007/s12369-011-0121-z
Abstract: In the past decade, we have witnessed an intensive progress of technology spurred on by community initiatives. The guest editors had its first meeting in 2010 to find that it was timely for the community to collectively document the recent advances in social robotics through a special issue in the International Journal of Social Robotics. This special issue presents various designs for social robots in order to make them more effective and natural for human-robot interactions. Social robots are autonomous robots that are able to interact and communicate among themselves, with humans, and with the environment and are designed to operate according to the established social and cultural norms. The main requirement for such robots is intelligence, which forms the basis of human-robot interaction. Many design requirements should be considered for social robots. Among these are the abilities to: 1. recognize the presence of a human through its senses such as vision, touch and sound; 2. engage in physical acknowledgment such as holding or touching; 3. use physical motions and gestures; 4. express and/or perceive emotions and 5. engage in a conversation. This special issue addresses various challenges in the design of social robots, which can be used in a variety of applications, such as research platforms, toys and games, educational tools, and therapeutic aids.
Keywords: Ausdrücken und Erkennen von Emotion, Design, Disziplin, Emotionserkennung, Fähigkeit zu physischer Rückmeldung (Berührung etc.), Fähigkeit, eine Konversation zu führen, Fähigkeit, menschliche Anwesenheit zu erkennen, Gestische und mobile Fähigkeiten, Ingenieurswissenschaft, Intelligenz, Interaktionspartner, Mensch oder Maschine, Mensch-Technik-Relationen (MTR), Realtechnik, Sozial Intelligente Agenten, Soziale Robotik, Technik 2009
-
(2009): Die Intelligence and Development Scale Sozial-Emotionale Kompetenz (IDS-SEK). Psychometrische Eigenschaften eines Tests zur Erfassung sozial-emotionaler Fähigkeiten. In: Diagnostica 55 (4), S. 234-244. DOI: 10.1026/0012-1924.55.4.234
DOI: https://doi.org/10.1026/0012-1924.55.4.234 Abstract: Tested psychometric properties of the Intelligence and Development Scales Sozial-Emotionale Kompetenz Skala (IDS-SEK). To address a lack of adequate measures for capturing the social-emotional abilities of children, the IDS-SEK was constructed. The test measures social-emotional abilities on the dimensions (1) Emotion Recognition (EE), (2) Emotion Regulation (ER), (3) Understanding of Social Situations (SV), and (4) Social-Operation Competence (SH). Results of studies conducted with 839 5- to 10-year-olds from Switzerland support the scale's construct and criterion validity. Comparisons (matched for age, sex, and intelligence quotient) of children without behavioural problems, with Asperger syndrome (n = 38), and with aggressive-behavioral problems (n = 57) provided additional proof of the scale's differentiation ability. It is concluded that the IDS-SEK is well suited to measure capabilities and deficits in the social-emotional domain in a multidimensional way and can be used as the basis of specific interventions.
Keywords: Aggressionsverhalten, Aggressive Behavior, Aspergers Syndrome, Asperger-Syndrom, Autism Spectrum Disorders, Autismus-Spektrum-Störung, Developmental Scales & Schedules, emotion recognition, Emotional Regulation, Emotionen, Emotions, Emotionserkennung, Emotionsforschung, Emotionsregulation, Entwicklungstests, Personality Scales & Inventories, Persönlichkeitstests, psychometrics, Psychometrie, Psychosocial & Personality Development, Psychosoziale Entwicklung und Persönlichkeitsentwicklung, Social intelligence, Social Skills, Soziale Fertigkeiten, Soziale Intelligenz, Test Validity, Testvalidität, Verhaltensforschung 2008
-
(2008): Private emotions versus social interaction. A data-driven approach towards analysing emotion in speech. In: User Modeling and User-Adapted Interaction 18 (1-2), S. 175-206. DOI: 10.1007/s11257-007-9039-4
Abstract: The 'traditional' first two dimensions in emotion research are VALENCE and AROUSAL. Normally, they are obtained by using elicited, acted data. In this paper, we use realistic, spontaneous speech data from our 'AIBO' corpus (human-robot communication, children interacting with Sony's AIBO robot). The recordings were done in a Wizard-of-Oz scenario: the children believed that AIBO obeys their commands; in fact, AIBO followed a fixed script and often disobeyed. Five labellers annotated each word as belonging to one of eleven emotion-related states; seven of these states which occurred frequently enough are dealt with in this paper. The confusion matrices of these labels were used in a Non-Metrical Multi-dimensional Scaling to display two dimensions; the first we interpret as VALENCE, the second, however, not as AROUSAL but as INTERACTION, i.e., addressing oneself (angry, joyful) or the communication partner (motherese, reprimanding). We show that it depends on the specifity of the scenario and on the subjects' conceptualizations whether this new dimension can be observed, and discuss impacts on the practice of labelling and processing emotional data. Two-dimensional solutions based on acoustic and linguistic features that were used for automatic classification of these emotional states are interpreted along the same lines.
Keywords: AIBO, annotation, Arousal, categories, Communication, data-driven, deutsche Community, dimensions, emotion, emotion research, Emotionserkennung, Emotionssensitive Systeme, Interaction, Interaktionspartner, Kognitionswissenschaft/Social Sciences/Humanities, Kommunikation, Mensch oder Maschine, Mensch-Technik-Relationen (MTR), non-metrical multi-dimensional scaling, Psychologie, Rolle von Emotion, Realtechnik, script, Soziosensitive Systeme, speech, Technik, Valence 2006
-
(2006): The influence of emotion recognition and emotion regulation on intercultural adjustment. In: INTERNATIONAL JOURNAL OF INTERCULTURAL RELATIONS 30 (3), S. 345-363. DOI: 10.1016/j.ijintrel.2005.08.006
Abstract: Previous studies have consistently shown emotion regulation to be an important predictor of intercultural adjustment. Emotional intelligence theory suggests that before people can regulate emotions they need to recognize them; thus emotion recognition ability should also predict intercultural adjustment. The present study tested this hypothesis in international students at three times during the school year. Recognition of anger and emotion regulation predicted positive adjustment; recognition of contempt, fear and sadness predicted negative adjustment. Emotion regulation did not mediate the relationship between emotion recognition and adjustment, and recognition and regulation jointly predicted adjustment. These results suggest recognition of specific emotions may have special functions in intercultural adjustment, and that emotion recognition and emotion regulation play independent roles in adjustment.
2003
-
(2003): Cultural differences in emotions. A context for interpreting emotional experiences. In: Behaviour Research and Therapy 41 (7), S. 777-793. DOI: 10.1016/S0005-7967(02)00189-4
Abstract: In this article, it is suggested that cross-cultural assessment of emotional disturbances would benefit from the consideration of cultural differences in the modal, and normative emotions. A summary of the research literature on cultural differences in emotions, in particular in antecedent events, subjective feeling, appraisal, and behavior is provided. Cultural differences in emotions are understood functionally, such that the most prevalent emotional phenomena in a culture are those that fit and reinforce the distinct cultural models (i.e. goals and practices) of self and relationship. It is argued that a culture-sensitive approach to emotional disturbances would entail the assessment of emotional phenomena that are dysfunctional to the cultural models of self and relationship. (C
2001
-
(2001): Cultural variation in hemifacial asymmetry of emotion expressions. In: British Journal of Social Psychology 40 (3), S. 385-398. DOI: 10.1348/014466601164885
Abstract: Photographs of hemifacial composites (left-left, right-right and normal presentation, right-left) of three cultures (Japanese, Oriental Indian and North American) disp laying six emotions (happy, sad, fear, anger, surprise, disgust) and a neutral state were administered successively (one by one) as well as simultaneously (three hemifacial photographs of an expression at a time) to observers for judgment on a 5-point scale in terms of distinctiveness of expression. Observers' judgments were treated with a culture of expressor x sex of expressor x facial presentation x emotion category mixed factorial ANOVA. Cultures did not vary for their distinctiveness of facial expressions, suggesting universality in this respect. Culture-specificity was, however, observed with respect to hemifacial asymmetry and valence of emotion expressions: (1) Japanese showed a right hemifacial bias for positive and left hemifacial bias for negative emotions; Indians and North Americans showed left hemifacial bias for all emotions, and (2) negative emotion expressions were least distinctly identifiable in Japanese faces followed by Indian and North American faces.
2000
-
(2000): The concept of anger. Universal or culture specific?. In: Psychopathology 33 (4), S. 159-170. DOI: 10.1159/000029139
DOI: http://www.ncbi.nlm.nih.gov/pubmed/10867573 Abstract: I will suggest that the English word 'anger' and its counterparts in diverse languages of the world are based on concepts of anger that have a great deal of complexity. This conceptual complexity derives from several sources: (1) the metaphors and metonymies that apply to the concepts in various languages; (2) the prototypes of anger that people share in these cultures, and (3) the many different senses that the word anger and its counterparts have in different languages. We can ask: Are there any universal aspects of the concept(s) of anger? On the basis of linguistic evidence from English, Chinese, Japanese, Hungarian, Zulu and Wolof, I will suggest that there are, but I will also claim that some of the aspects are culture specific. This raises the further important question of why there is both universality and culture specificity in the conceptualization of this emotion. At stake is the issue of which of the following two contradictory claims is valid: (1) that anger is conceptualized in the same way universally, or (2) that anger is a social construction and thus varies considerably from culture to culture. I will propose a compromise view, which can be called 'body-based social constructionism', that enables us to see anger and its counterparts as both universal and culture specific.
1999
-
(1999): The CAD triad hypothesis. A mapping between three moral emotions (contempt, anger, disgust) and three moral codes (community, autonomy, divinity). In: Journal of personality and social psychology 76 (4), S. 574-586. DOI: 10.1037/0022-3514.76.4.574
Abstract: It is proposed that 3 emotions-contempt, anger, and disgust-are typically elicited, across cultures, by violations of 3 moral codes proposed by R. A. Shweder and his colleagues (R. A. Shweder, N. C. Much, M. Mahapatra, & L. Park, 1997). The proposed alignment links anger to autonomy (individual rights violations), contempt to community (violation of communal codes, including hierarchy), and disgust to divinity (violations of purity-sanctity). This is the CAD triad hypothesis. Students in the United States and Japan were presented with descriptions of situations that involve 1 of the types of moral violations and asked to assign either an appropriate facial expression (from a set of 6) or an appropriate word (contempt, anger, disgust, or their translations). Results generally supported the CAD triad hypothesis. Results were further confirmed by analysis of facial expressions actually made by Americans to the descriptions of these situations.
1996
-
(1996): The representation of emotions in groups. The relative impact of social norms, positive–negative asymmetry and familiarity on the perception of emotions. In: European Journal of Social Psychology 26 (1), S. 43-59. DOI: 10.1002/(SICI)1099-0992(199601)26:1<43::AID-EJSP736>3.0.CO;2-6
Abstract: Research in several countries shows that people hold norms of emotion perception, so that socially desirable emotions are perceived as positive and moderate. Subjects also believe that positive and moderate emotions are dominant in their lives. Other research shows that increased familiarity with a social group allows a better differentiation among the members and the attributes of this group (e.g. wider variability of emotions). In the present study, we compare the relative impact of familiarity with pleasant and unpleasant groups and social norms on emotion perception. Subjects (N=150) were to rate imagined family groups, families that they did not know well, and families that they knew very well, on perceived differentiation and variability of emotional episodes, extremity of emotional events, and global family evaluations. Results indicated that familiarity is weakly associated with perceived emotional variability in target families, and that, regardless of their familiarity with the family, subjects viewed unpleasant families as more negative, as less familiar, and as having a larger range of emotions than pleasant families. Results are discussed in terms of the idea that perception of emotions in groups depends more strongly on social norms than either on positive–negative asymmetry or on direct experience with their members. Volume26, Issue1 January/February 1996 Pages 43-59 Figures References Related Information Metrics Details Copyright © 1996 John Wiley & Sons, Ltd. Publication History Issue Online: 04 December 1998
Keywords: Bekanntheitsgrad, Einfluss von sozialem Konsens / Anstand "Decorum", Emotionserkennung, familiarity, Gruppennorm, Kulturell codierte Merkmale, kulturelle Etiketten, Mensch-Technik-Relationen (MTR), Normen der Wahrnehmung von Emotionen, Realtechnik, Soziale Erwünschtheit von Emotionen, Sozialer Wandel der Emotionalität, Sozialpsychologie, Technik, Werte 1987
-
(1987): Universals and cultural differences in the judgments of facial expressions of emotion. In: Journal of personality and social psychology 53 (4), S. 712-717
Abstract: We present here new evidence of cross-cultural agreement in the judgement of facial expression. Subjects in 10 cultures performed a more complex judgment task than has been used in previous cross-cultural studies. Instead of limiting the subjects to selecting only one emotion term for each expression, this task allowed them to indicate that multiple emotions were evident and the intensity of each emotion. Agreement was very high across cultures about which emotion was the most intense. The 10 cultures also agreed about the second most intense emotion signaled by an expression and about the relative intensity among expressions of the same emotion. However, cultural differences were found in judgments of the absolute level of emotional intensity.
Keywords: Adult, Attitude, Cross-Cultural Comparison, Disziplin, dominance, Emotions, Emotionserkennung, Facial Expression, FACS (Facial Action Coding System) Paul Ekman, Friesen und Tomkins (Vorgänger: FAST Facial Affect Scoring Technique, Favoriten, Female, Gesichtserkennung, Gestik/Mimik, Humans, Judgment, Kulturinvarianz, Kulturtheorie, Male, Mensch-Technik-Relationen (MTR), Realtechnik, Sozialpsychologie, Technik, zugeschriebene Emotionsvarianz 1986
-
(1986): The Effect of Verbal and Pictorial Advertising Stimuli on Aesthetic, Utilitarian and Familiarity Perceptions. In: Journal of Advertising 15 (2), S. 27-34. DOI: 10.1080/00913367.1986.10673002
Abstract: The study examined perceptions of advertising stimuli presented in an all-verbal or all-visual format. Three response criteria were investigated: utilitarian/rational perceptions, aesthetic/emotional perceptions and familiarity perceptions. Hypotheses that utilitarian/rational perceptions would be associated with all-verbal advertising stimuli and familiarity perceptions would be associated with all-visual advertising stimuli were supported. A third hypothesis that aesthetic/ emotional perceptions would be associated with all-visual advertising stimuli received mixed support.
1971
-
(1971): Constants across cultures in the face and emotion. In: Journal of personality and social psychology 17 (2), S. 124-129. DOI: 10.1037/h0030377
Abstract: Investigated the question of whether any facial expressions of emotion are universal. Recent studies showing that members of literate cultures associated the same emotion concepts with the same facial behaviors could not demonstrate that at least some facial expressions of emotion are universal; the cultures compared had all been exposed to some of the same mass media presentations of facial expression, and these may have taught the people in each culture to recognize the unique facial expressions of other cultures. To show that members of a preliterate culture who had minimal exposure to literate cultures would associate the same emotion concepts with the same facial behaviors as do members of Western and Eastern literate cultures, data were gathered in New Guinea by telling 342 Ss a story, showing them a set of 3 faces, and asking them to select the face which showed the emotion appropriate to the story. Ss were members of the Fore linguistic-cultural group, which up until 12 yr. ago was an isolated, Neolithic, material culture. Results provide evidence in support of the hypothesis.
Keywords: Disziplin, dominance, Emotionserkennung, FACS (Facial Action Coding System) Paul Ekman, Friesen und Tomkins (Vorgänger: FAST Facial Affect Scoring Technique, Gesichtserkennung, Gesichtszüge, Gestik/Mimik, Kulturinvarianz, Kulturtheorie, Mensch-Technik-Relationen (MTR), Realtechnik, Sozialpsychologie, Technik 1872
-
(1872): The expression of the emotions in man and animals
-
: Characterizing Types of Convolution in Deep Convolutional Recurrent Neural Networks for Robust Speech Emotion Recognition. Online verfügbar unter http://arxiv.org/pdf/1706.02901v2
Abstract: Deep convolutional neural networks are being actively investigated in a wide range of speech and audio processing applications including speech recognition, audio event detection and computational paralinguistics, owing to their ability to reduce factors of variations, for learning from speech. However, studies have suggested to favor a certain type of convolutional operations when building a deep convolutional neural network for speech applications although there has been promising results using different types of convolutional operations. In this work, we study four types of convolutional operations on different input features for speech emotion recognition under noisy and clean conditions in order to derive a comprehensive understanding. Since affective behavioral information has been shown to reflect temporally varying of mental state and convolutional operation are applied locally in time, all deep neural networks share a deep recurrent sub-network architecture for further temporal modeling. We present detailed quantitative module-wise performance analysis to gain insights into information flows within the proposed architectures. In particular, we demonstrate the interplay of affective information and the other irrelevant information during the progression from one module to another. Finally we show that all of our deep neural networks provide state-of-the-art performance on the eNTERFACE'05 corpus.
Keywords: Alter, Computer Science - Computation and Language, Computer Science - Learning, Computer Science - Multimedia, Computer Science - Sound, Emotionserkennung, Favoriten, Genderabhängigkeit, Mensch-Technik-Relationen (MTR), Realtechnik, Situationsbedingter Kontext, Sprachgebrauch, Stimme / Prosodie, Technik
- <<
- <
- 1