At the Multimodality Research Group, we study how human communication relies on intentional combinations of multiple modes of expression.
This phenomenon, known as multimodality, is an inherent feature of human communication. Whereas face-to-face interaction relies on coordinated combinations of spoken language, gestures, posture and gaze, everyday media such as newspapers and school textbooks combine written language, photography, diagrams and illustrations, to name just a few examples.
We seek to understand how such combinations are formed and their role in communication.