Multimedia Comprehension

A systematic synthesis of research and theory on how people comprehend text and pictures as communication tools.

Wolfgang Schnotz (Author)

9781009303231, Cambridge University Press

Paperback / softback, published 23 February 2023

160 pages
22.8 x 15.2 x 1.4 cm, 0.36 kg

Multimedia messages use combinations of texts, pictures, maps, and graphs as tools for communication. This book provides a synthesis of theory and research about how people comprehend multimedia. It adopts the perspectives of cognitive psychology, semiotics, anthropology, linguistics, education, and art. Its central idea is that information displays can be categorized into two different but complementary forms of representations, which service different purposes in human cognition and communication. Specific interaction between these representations enhances comprehension, thinking, and problem solving, as illustrated by numerous examples. Multimedia Comprehension is written for a broad audience with no special prior knowledge. It is of interest to everyone trying to understand how people comprehend multimedia, from scholars and students in psychology, communication, and education, to web- and interface-designers and instructors.

1. Introduction
2. A short history of multimedia sign systems
3. Basic forms of representations
4. Comprehension of text
5. Comprehension of pictures
6. Integrative comprehension of texts and pictures
7. Quasi-Symbolic relations between text and picture comprehension
8. Beyond comprehension: multimedia in thinking and problem solving
9. Practical implications
Concluding remarks.

Subject Areas: Educational: History [YQH], Educational psychology [JNC], Cognition & cognitive psychology [JMR]