Title | Integration of Visual Perception in Dialogue Understanding for Virtual Humans in Multi-Party interaction. |
Publication Type | Conference Paper |
Year of Publication | 2010 |
Authors | Traum, D. R., and L. P. Morency |
Conference Name | AAMAS International Workshop on Interacting with ECAs as Virtual Characters |
Date Published | May 2010 |
Conference Location | Toronto, Canada |
Abstract | While the dialogue functions of speech in two-party dialogue have been extensively studied, there has been much less work on either multi-party communication, multimodal communication, and especially vision in a multi-party face-to-face setting. In this paper we report on one such effort to apply state of the art real-time visual processing to enhance a dialogue model of multi-party communication. We are concerned with situations in which there are at least three parties involved in conversation (at least one of whom is a human participant and at least one of whom is a virtual human). We focus on the visual behaviors of head orientation, head nods |
URL | http://people.ict.usc.edu/~traum/Papers/TraumMorency-aamas2010.pdf |