SCOUT – Bot Language

SCOUT team presenting paper

ICT Lead: David Traum

The goal of the Bot Language Project is to provide more natural ways for people to interact and communicate with robots using dialogue. The project is a collaboration with and sponsored by the ​U.S. Army Research Laboratory.
Several experiments have been performed, where people collaborate with a distant robot in a navigation and reconnaissance task, under bandwidth limitations (some involving human control of the robot in a wizard of OZ setting, and some involving a simulated robot and environment).

An overview of the first two experiments is here:
https://www.ttic.edu/nchrc/papers/12.pdf
https://arxiv.org/abs/1710.06406
Claire Bonial, Matthew Marge, Ron Artstein, Ashley Foots, Felix Gervits, Cory J. Hayes, Cassidy Henry, Susan G. Hill, Anton Leuski, Stephanie M. Lukin, Pooja Moolchandani, Kimberly A. Pollard, David Traum, and Clare R. Voss. 2017. ​Laying Down the Yellow Brick Road: Development of a Wizard-of-Oz Interface for Collecting Human-Robot Dialogue. In Proc. of the AAAI Fall Symposium Series: Natural Communication for Human-Robot Collaboration. AAAI FSS 2017.

A demo of the initial fully automated system is here:
https://aclanthology.org/P18-4016/
Stephanie M. Lukin, Felix Gervits, Cory Hayes, Pooja Moolchandani, Anton Leuski, John Rogers, Carlos Sanchez Amaro, Matthew Marge, Clare Voss and David Traum. ​ScoutBot: A Dialogue System for Collaborative Navigation. In Proc. of ACL, Demonstration Track

The initial corpus release is here:
https://github.com/USArmyResearchLab/ARL-SCOUT

A paper describing the data and annotations is here:
Bonial, Claire and Lukin, Stephanie M. and Abrams, Mitchell and Baker, Anthony and Donatelli, Lucia and Foots, Ashley and Hayes, Cory J. and Henry, Cassidy and Hudson, Taylor and Marge, Matthew and Pollard, Kimberly A. and Artstein, Ron and Traum, David and Voss, Clare R. 2024. Human–robot dialogue annotation for multi-modal common ground. Language Resources and Evaluation.