Virtual Humans: Natural Language
The virtual humans project at ICT started in 2000. As a part of this since close to the beginning has been an effort of the natural language group, to provide dialogue capabilities for virtual humans. A large part of this effort involves integrated virtual humans, with embodied conversation, emotions, planning and task reasoning, knowledge representation and perception, as realized in the MRE
http://projects.ict.usc.edu/nld/group/projects/mission-rehearsal-exercise and SASO projects
http://projects.ict.usc.edu/nld/group/projects/saso-st
http://projects.ict.usc.edu/nld/group/projects/saso-en
There has also been effort on taxonomizing natural language dialogue geres, other architectures for natural language components and corpus creation to support this research.
since 2000
US Army
Alumni
Research Efforts
Publications
-
Full TextPrediction and realisation of conversational characteristics by utilising spontaneous speech for unit selection. In: Speech Prosody. Chicago, Illinois; 2010. Abstract
-
Towards Natural Language Understanding of Partial Speech Recognition Results in Dialogue Systems.. In: Short Paper Proceedings of NAACL HLT.; 2009.
-
A comparison of addressee detection methods for multiparty conversations. In: Proceedings of DIAHOLMIA'09, the 13th Semdial Workshop on the Semantics and Pragmatics of Dialogue. Stockholm, Sweden; 2009. p. 99-106.
-
Full TextA Virtual Human Dialogue Model for Non-team Interaction. In: Dybkjaer L, Minker W, editors. Recent Trends in Discourse and Dialogue. Springer; 2008.
-
Full TextTalking to Virtual Humans: Dialogue Models and Methodologies for Embodied Conversational Agents. In: Wachsmuth I, Knoblich G, editors. Modeling Communication with Robots and Virtual Humans. Springer; 2008. p. 296-309.
-
Full TextA Statistical Approach for Text Processing in Virtual Humans. In: Proceedings of the 26th Army Science Conference. Orlando, Florida, USA; 2008.
-
Full TextMulti-party, Multi-issue, Multi-strategy Negotiation for Multi-modal Virtual Agents. In: IVA.; 2008. p. 117-30.
-
Full TextPractical Grammar-Based NLG from Examples. In: Proceedings of the Fifth International Natural Language Generation Conference. Salt Fork, Ohio: Association for Computational Linguistics; 2008. p. 77-85.
-
A Common Ground for Virtual Humans: Using an Ontology in a Natural Language Oriented Virtual Human Architecture. In: Language Resources and Evaluation Conference (LREC).; 2008.
-
Thoughts on {FML}: Behavior Generation in the Virtual Human Communication Architecture. In: Proceedings of FML 2008, The First Functional Markup Language Workshop at AAMAS.; 2008.
-
An evaluation understudy for dialogue coherence models. In: SIGdial '08: Proceedings of the 9th SIGdial Workshop on Discourse and Dialogue. Morristown, NJ, USA: Association for Computational Linguistics; 2008. p. 172-81.
-
Full TextMaking Grammar-Based Generation Easier to Deploy in Dialogue Systems. In: Proceedings of the 9th SIGdial Workshop on Discourse and Dialogue. Columbus, Ohio: Association for Computational Linguistics; 2008. p. 198-207.
-
The {R}ickel {G}aze {M}odel: A Window on the Mind of a {V}irtual {H}uman. In: IVA.; 2007. p. 296-303.
-
Building Interactive Virtual Humans for Training Environments. In: Proceedings of I/ITSEC.; 2007.
-
Creating Spoken Dialogue Characters from Corpora without Annotations. In: Proceedings of Interspeech-07. Antwerp, Belgium; 2007.
-
First Steps towards Dialogue Modeling from an Un-annotated Human-Human Corpus. In: 5th Workshop on knowledge and reasoning in practical dialogue systems. Hyderabad, India; 2007.
-
Full TextFight, Flight, or Negotiate: Believable Strategies for Conversing under Crisis. In: proceedings of the Intelligent Virtual Agents Conference (IVA). Springer-Verlag Lecture Notes in Computer Science; 2005. p. 52-64.
-
Full TextStatistical Shallow Semantic Parsing despite Little Training Data. In: Proceedings of 9th International Workshop on Parsing Technologies (ACL/SIGPARSE'05). Vancouver, B.C., Canada; 2005.
-
Full TextVirtual Humans for non-team Interaction training. In: In proceedings of the AAMAS Workshop on Creating Bonds with Embodied Conversational Agents.; 2005.
-
Full TextDealing With Doctors: Virtual Humans for non-team interaction training. In: Proceedings of ACL/ISCA 6th SIGdial Workshop on Discourse and Dialogue. Lisbon, Portugal; 2005.
-
Simulation of Small Group Discussions for Middle Level of Detail Crowds. In: Proceedings of the Army Science Conference.; 2004.
-
Full TextEvaluation of multi-party virtual reality dialogue interaction. In: Proceedings of Fourth International Conference on Language Resources and Evaluation (LREC 2004).; 2004. p. 1699-702.
-
Full TextIssues in multi-party dialogues. In: Dignum F, editor. Advances in Agent Communication. Springer Verlag; 2004. p. 201-11. (LNAI 2922).
-
Full TextThe Information State Approach to Dialogue Management. In: van Kuppevelt J, Smith R, editors. Current and New Directions in Discourse and Dialogue. Kluwer; 2003. p. 325-53.
-
Functions and Patterns of Speaker and Addressee Identifications in Distributed Complex Organizational Tasks Over Radio. In: Diabruck: seventh workshop on semantics and pragmatics of dialogue.; 2003.
-
Full TextNL Generation for Virtual Humans in a Complex Social Environment. In: Working Notes AAAI Spring Symposium on Natural Language Generation in Spoken and Written Dialogue.; 2003.
-
Full TextSemantics and Pragmatics of Questions and Answers for Dialogue Agents. In: proceedings of the International Workshop on Computational Semantics.; 2003. p. 380-94.
-
Full TextNegotiation over Tasks in Hybrid Human-Agent Teams for Simulation-Based Training. In: Proceedings of AAMAS 2003: Second International Joint Conference on Autonomous Agents and Multi-Agent Systems.; 2003. p. 441-8.
-
Full TextEmbodied Agents for Multi-party Dialogue in Immersive Virtual Worlds. In: Proceedings of the first International Joint conference on Autonomous Agents and Multiagent systems.; 2002. p. 766-73.
-
Toward a new generation of Virtual Humans for Interactive Experiences. IEEE Intelligent Systems. 2002;17:32-8.
-
Full TextIdeas on Multi-layer Dialogue Management for Multi-party, Multi-conversation, Multi-modal Communication. In: CLIN.; 2001. p. 1-7.
-
Information state and dialogue management in the {TRINDI} Dialogue Move Engine Toolkit. Natural Language Engineering. 2000;6:323-40.
-
Cooperation, Dialog, and Ethics. In International Journal of Human Computer Studies. 2000;53:871-914.