Alle Publikationen
- <<
- <
- 1
2017
-
(2017): Decoding images. Toward a theory of pictorial framing. In: Discourse & Society 28 (4), S. 327-352
Abstract: Using data from the Egyptian public discourse on the United States, this article lays out the foundation for building a general theory of pictorial framing. In this theory, at the most general level, the concept of pictorial framing refers to subtle alterations in the visual presentation of judgment and choice problems. Specifically, pictures are viewed as constructions, and pictorial meaning is seen as an intricate web of connected frames. The article thus adopts the view that a visual grammar is part of cognitive science and is fundamentally concerned with the relation between what goes on in the human mind and manifestations of this activity. The article draws on insights from blending model (Fauconnier and Turner, 2002), Relevance Theory (Sperber and Wilson, 1995) and frame semantics (Fillmore, 1985), discussing a large corpus of 90 multimodal cartoons on the United States.
-
(2017): Online Recognition of Daily Activities by Color-Depth Sensing and Knowledge Models. In: SENSORS 17 (7)
Abstract: Visual activity recognition plays a fundamental role in several research fields as a way to extract semantic meaning of images and videos. Prior work has mostly focused on classification tasks, where a label is given for a video clip. However, real life scenarios require a method to browse a continuous video flow, automatically identify relevant temporal segments and classify them accordingly to target activities. This paper proposes a knowledge-driven event recognition framework to address this problem. The novelty of the method lies in the combination of a constraint-based ontology language for event modeling with robust algorithms to detect, track and re-identify people using color-depth sensing (Kinect® sensor). This combination enables to model and recognize longer and more complex events and to incorporate domain knowledge and 3D information into the same models. Moreover, the ontology-driven approach enables human understanding of system decisions and facilitates knowledge transfer across different scenes. The proposed framework is evaluated with real-world recordings of seniors carrying out unscripted, daily activities at hospital observation rooms and nursing homes. Results demonstrated that the proposed framework outperforms state-of-the-art methods in a variety of activities and datasets, and it is robust to variable and low-frame rate recordings. Further work will investigate how to extend the proposed framework with uncertainty management techniques to handle strong occlusion and ambiguous semantics, and how to exploit it to further support medicine on the timely diagnosis of cognitive disorders, such as Alzheimer’s disease.
Keywords: activities of daily living, activity recognition, assisted living, Bildsemantik, color-depth sensing, complex events, Ereigniserkennung, Ereignisverständnis, frame semantics, Informations- & Kommunikationstechnik, Knowledge representation, Kognitive Skills/Social Cognition, Mensch-Technik-Relationen (MTR), people detection and tracking, Realtechnik, senior monitoring, Sprachverstehen, Technik, Voraussetzungen für sozial angemessenes Verhalten, Weltwissen -
(2017): Key-frame Extraction With Semantic Graphs in Assembly Processes. In: IEEE ROBOTICS AND AUTOMATION LETTERS 2 (3), S. 1264-1271
Abstract: In this letter, we present a novel method for key-frame extraction in assembly processes, with the support of visual sensors. The method is based on the construction of a sequence of weighted graphs containing the semantics of the underlying scene, encoded as primitive temporal and spatial relations between the involved objects. The objects are modeled as three-dimensional ellipsoids, with the formulation of the minimum volume covering ellipsoid problem as a convex optimization program, which is solved by an efficient algorithm. The new models are used in the sequence of actions-relations to increase the accuracy of the key-frame extraction, by extending the states encoded in the graphs. We present and analyze the method, followed by preliminary experimental results, and provide significant evidence on its potential.
2014
-
(2014): Managing subjects, manufacturing citizens. Picturing sites of social control in nineteenth-century America. In: Early Popular Visual Culture 12 (2), S. 104-126. DOI: 10.1080/17460654.2014.923160
Abstract: This article examines structures of social control that became institutionalized in the United States in the 1870s and 1880s. In particular, it examines how key philanthropic and penal institutions within New York City, including the school, workhouse and prison, were represented in the illustrated popular press as sites for both controlling and training an industrializing workforce. Examining how the language of scientific management seeped into the social realm, this essay argues that visual representations of these sites helped to reinforce normative middle-class ideals about education, work and punishment. Examining the ways that artists interpreted and framed these sites for a group of primarily middle-class viewers and readers, this essay argues that social systems helped to construct an ideal, imagined citizen who is, first and foremost, an efficient worker. The purpose of these institutions was, in main part, to teach their inmates to labor and to replicate the state apparatus by maintaining social order. This article also deals with the increasingly structured and professional implementation of education and social work during the years leading up to the Progressive Era.
Keywords: Bildsemantik, education, Identitätsstiftung, Kulturtechnik, Kunst, Kunstgeschichte, labor, Rollen, social control, Social Rank, social systems, Soziale Klasse / Schicht, Soziale Ordnung, United States, Vergangenheit / Erziehung, visual culture, Vorurteile, Zuschreiben einer erwarteten Rolle 2005
-
(2005): The decorum of a defecating dog. In: PRINT QUARTERLY 22 (2), S. 119-132
Abstract: In his otherwise grandiose, monumental woodcut, the "Submersion of Pharaoh's Army in the Red Sea", Titian included a realistic depiction of a defecating dog (figs. 39-40). The dog is one small figure in a huge work, but is prominently placed in the foreground, so that it and Moses' commanding arm are the only elements projecting into a block otherwise filled with water. The few scholars who have commented on this detail have tended to dismiss it as an insignificant vulgarity or tasteless lapse in decorum.
- <<
- <
- 1