Interpreting Motion Grounded Representations for Spatial Language

Interpreting Motion presents an integrated perspective on how language structures constrain concepts of motion and how the world shapes the way motion is linguistically expressed. Natural language allows for efficient communication of elaborate descriptions of movement without requiring a precise specification of the motion. Interpreting Motion is the first book to analyze the semantics of motion expressions in terms of the formalisms of qualitative spatial reasoning. It shows how motion descriptions in language are mapped to trajectories of moving entities based on qualitative spatio-temporal relationships. The authors provide an extensive discussion of prior research on spatial prepositions and motion verbs, devoting chapters to the compositional semantics of motion sentences, the formal representations needed for computers to reason qualitatively about time, space, and motion, and the methodology for annotating corpora with linguistic information in order to train computer programs to reproduce the annotation. The applications they illustrate include route navigation, the mapping of travel narratives, question-answering, image and video tagging, and graphical rendering of scenes from textual descriptions.

The book is written accessibly for a broad scientific audience of linguists, cognitive scientists, computer scientists, and those working in fields such as artificial intelligence and geographic information systems.

Inderjeet Mani has been a Senior Principal Scientist at The MITRE Corporation, a Visiting Fellow at Cambridge University, and an Associate Professor at Georgetown University. He is the author of Automatic Summarization (John Benjamins 2001) and The Imagined Moment: Time, Narrative, and Computation (Nebraska 2010), and co-editor of The Language of Time (OUP 2005).

James Pustejovsky is the TJX/Feldberg Chair in Computer Science at Brandeis University. His topics of research are natural language processing, lexical semantics, temporal reasoning, events, information extraction, and computational linguistics. His books include The Generative Lexicon (MIT 1995); with Bran Boguraev, Lexical Semantics: The Problem of Polysemy (OUP 1997); with Carol Tenny, Events as Grammatical Objects (CSLI 2001); with Elisabetta Jezek, Generative Lexicon Theory: A Guide (OUP 2012); and Coercion and Compositionality (MIT Press 2012).