Building Bridges for Multimodal Research

The book takes differences in multimodality research as a starting point to discuss old and new theoretical, methodological as well as analytical ideas for building bridges between various disciplines and approaches.

Janina Wildfeuer teaches and researches in the areas of multimodal and interdisciplinary linguistics in the Department of Linguistics, University of Bremen. Her research interests also include discourse analysis, media studies, and semiotics.

«Overall, the volume provides rich information on approaches to multimodal research, which can be readily adopted by discourse analysts. Furthermore, the interdisciplinary theoretical innovations in the book shed light on potential methodological developments for discourse studies.» (Yiqiong Zhang, Discourse Studies 19(3), 2017)

Contents: Janina Wildfeuer: Bridging the Gap between Here and There: Combining Multimodal Analysis from International Perspectives – Diane Mavers: Issues in Multimodality: Reflecting on Definitions, Transcription, and Analysis – Hartmut Stöckl: From Text Linguistics to Multimodality: Mapping Concepts and Methods Across Domains – Alina Kwiatkowska: Cognitively Oriented Semiotics as a Common Descriptive Framework for Pictorial and Verbal Representation – Ognyan Seizov: Spotlight on the Image: Adding the Missing Visual Piece to the Multimodal Puzzle – Sandra Handl: Visual Rhetoric and Cognitive Semantics: The Relevance of Entrenched Conceptual Patterns for the Reconstruction of Visual and Multimodal Arguments – Anna Mattfeldt: Conflicts and Pictures: A Study of Images and Agonality in Discourse – Shaimaa El Naggar: Multimodality in Perspective: Creating a Synergy of the Discourse Historical Approach and the Framework of Visual Grammar – Wendy L. Bowcher: Structure and Multimodal Texts – Simone Ponzetto/Hartmut Wessler/Lydia Weiland/Stephan Kopf/Wolfgang Effelsberg/Heiner Stuckenschmidt: Automatic Classification of Iconic Images Based on a Multimodal Model: An Interdisciplinary Project – Marc Debus/Heiner Stuckenschmidt/Hartmut Wessler: On the Use of Different Modalities in Political Communication: Evidence from German Election Manifestos – Martin Kaltenbacher/Thomas Kaltenbacher: Seeing the Unforeseen: Eye-Tracking Reading Paths in Multimodal Webpages – Martin Siefkes/Emanuele Arielli: An Experimental Approach to Multimodality: How Musical and Architectural Styles Interact in Aesthetic Perception – Elisa Vales: Narrative Process Annotation of Comic Strips in Corpus Analysis – Tuomo Hiippala: Combining Computer Vision and Multimodal Analysis: A Case Study of Layout Symmetry in Bilingual In-Flight Magazines – Christina Schmitt: Embodied Meaning in Audio-Visuals: First Steps Towards a Notion of Assimakis Tseronis: Documentary Film as Multimodal Argumentation: Arguing Audio-Visually About the 2008 Financial Crisis – Jan Krasni: Reflecting on a Gap Between Polyphony and Multimodality in Online Media Formats – Kate Maxwell: When Here is Now and There is Then: Bridging the Gap in Time with «Sumer Is Icumen In» – Dorra Moalla: Visual Literacy in EAP: The Dialogue between Reader/Designer Features and Multimodal Text.