Multimodality and Active Listenership: A Corpus Approach(Corpus and Discourse)

Current corpora are invaluable resources for generating accurate and objective analyses of patterns of language use. However, spoken corpora are effectively mono-modal, presenting data in the same physical medium – text. The reality of a discourse situation is lost in its representation as text. Using multimodal data sets when conducting corpus-based pragmatic analyses is one solution. This book looks at multimodal corpora in some depth, using backchanneling as the conversational feature to be analysed. It provides a bottom-up investigation of the issues and challenges faced at every stage of multimodal corpus construction and analysis, as well as providing an in-depth linguistic analysis of a cross section of multimodal corpus data. The collaborative and co-operative nature of backchannels is highlighted in this book and an adapted pragmatic-functional linguistic coding matrix for the characterisation of backchanneling phenomena is presented. Dawn Knight also looks at possible directions in the construction and use of multimodal corpus linguistics.

Table of Contents:
Acknowledgements \ Acronyms \ List of tables \ List of figures \ 1. Introduction \ 2. Corpora beyond text - developing multimodal corpora \ 3. Language and gesture \ 4. Backchannels \ 5. Analysing backchanneling head nods \ 6. A coding matrix for backchanneling phenomena \ 7. Semi-automated head nod tracking \ 8. Concluding remarks \ Glossary \ References \ Index

About the Author :
Dawn Knight is a Research Fellow at the Centre for Research in Applied Linguistics (CRAL), University of Nottingham, UK.

Review :
In face-to-face interaction movements of the head and body can carry meaning that is as important as the words. Yet in the analysis of talk, this is seldom acknowledged or methodically handled. Dawn Knight's clear and persuasive account of how such movements can be systematically recorded and analyzed achieves a major step forward for both discourse analysis and corpus linguistics. This is an important book documenting the move from mono-modal to multi-modal corpora of spoken language. It brings the reader into the exciting new world of multimodal corpora which capture much more fully the realtime context of spoken interactions, from the prosodic, to the behavioural and the situational, whereby the corpus moves from being a one-dimensional to the multidimensional repository of spoken interaction. Anyone who is interested in corpora should read this book.  Based on data from the Nottingham Multimodal Corpus (NMMC), the book very clearly illustrates the process of building a multimodal corpus and it focuses on its potential for indepth research, the scale of which would not have previously been possible. The level of detail on how to build a multi-modal corpus is invaluable, including key information on recording, mark-up and coding of the data. The clear writing style and the frequent use of screenshots greatly enhance the presentation of these details making it accessible to readers who do not have a high level of technical knowledge about corpus building.  The analysis of headnods from the NMMC is the main analytical focus of the book and this provides a glimpse of the potential of the new world of multi-modal corpora. It provides fascinating quantitative results and correlations on when headnods are used and when they are not. In addition, it provides a functional analysis of headnods based on the data sample. The analysis of headnods is testimony to the enormous potential of this exciting new research tool.