WIKINDX Resources

Cohn, Neil. "Beyond speech balloons and thought bubbles: The integration of text and image." Semiotica (2013): 35–63. 
Added by: joachim (10/27/13, 7:31 PM)   
Resource type: Journal Article
Language: en: English
Peer reviewed
DOI: 10.1515/sem-2013-0079
BibTeX citation key: Cohn2013b
Email resource to friend
View all bibliographic details
Categories: General
Keywords: Intermediality, Language, Speech balloon
Creators: Cohn
Collection: Semiotica
Views: 38/820
Attachments   URLs   http://www.visuall ... speechballoons.pdf
Speech balloons and thought bubbles are among the most recognizable visual signs of the visual language used in comics. These enclosed graphic containers provide a way in which text and image can interface with each other. However, their stereotypical meanings as representing speech or thought betray much deeper semantic richness. This paper uses these graphic signs as a platform for examining the multimodal interfaces between text and image, and details four types of interfaces that characterize the connections between modalities: Inherent, Emergent, Adjoined, and Independent relationships. Each interface facilitates different levels of multimodal integration, tempered by principles of Gestalt grouping and underlying semantic features. This process allows the possibility of creating singular cohesive units of text and image that is on par with other multimodal interfaces, such as between speech and gesture.
WIKINDX 6.10.2 | Total resources: 14584 | Username: -- | Bibliography: WIKINDX Master Bibliography | Style: Modern Language Association (MLA)