| Title | End User Programing of Intelligent Agents Using Demonstrations and Natural Language Instructions |
| Publication Type | Conference Paper |
| Year of Publication | 2019 |
| Authors | Li, Toby Jia-Jun |
| Conference Name | Proceedings of the 24th International Conference on Intelligent User Interfaces: Companion |
| Publisher | Association for Computing Machinery |
| Conference Location | Marina del Ray, California |
| ISBN Number | 978-1-4503-6673-1 |
| Keywords | compositionality, end user development, expandability, multi-modal interaction, natural language programming, programming by demonstration, pubcrawl, resilience, Resiliency |
| Abstract | End-user programmable intelligent agents that can learn new tasks and concepts from users' explicit instructions are desired. This paper presents our progress on expanding the capabilities of such agents in the areas of task applicability, task generalizability, user intent disambiguation and support for IoT devices through our multi-modal approach of combining programming by demonstration (PBD) with learning from natural language instructions. Our future directions include facilitating better script reuse and sharing, and supporting greater user expressiveness in instructions. |
| DOI | 10.1145/3308557.3308724 |
| Citation Key | li_end_2019 |
End User Programing of Intelligent Agents Using Demonstrations and Natural Language Instructions