Information Technology Research Institute
University of Brighton
Montag, 11.03.2002, 16 Uhr c.t., H 9
We discuss how the construction of multimodal dialogue systems can be
informed by empirical investigations into human conversational
behaviour. We argue that the notion of a dialogue game provides a good
framework for guiding both empirical investigations and the
construction of multimodal generation and interpretation algorithms. A
dialogue game is defined in terms of its participants, initial state of
play, goal state and roles. As an illustration, we present a specific
observational study into deictic reference in a task-oriented dialogue
game. The results which we obtained in this context shed some light on
the following two questions:
Under which circumstances is a speaker likely to use a pointing
gesture as part of a referential act (as in: "You have to remove
this blue one [+ pointing]")?
Is there any interaction between the choice of the linguistic form
of a referential act (in particular, the choice of the determiner)
and the decision on whether to use a pointing gesture or not?
Zur Startseite