User-Aware Shared Perception for Embodied Agents
| Title | User-Aware Shared Perception for Embodied Agents |
| Publication Type | Conference Paper |
| Year of Publication | 2019 |
| Authors | McNeely-White, David G., Ortega, Francisco R., Beveridge, J. Ross, Draper, Bruce A., Bangar, Rahul, Patil, Dhruva, Pustejovsky, James, Krishnaswamy, Nikhil, Rim, Kyeongmin, Ruiz, Jaime, Wang, Isaac |
| Conference Name | 2019 IEEE International Conference on Humanized Computing and Communication (HCC) |
| Date Published | sep |
| Publisher | IEEE |
| ISBN Number | 978-1-7281-4125-1 |
| Keywords | 3D virtual world, Avatars, conversational agents, DIANA, embodied agents, embodied avatars, Embodied Conversational Agents, facial expressions, human agent interaction, Human Behavior, Metrics, multi modal interfaces, physical space, pubcrawl, Scalability, shared perception, software agents, user interfaces, user-aware shared perception, virtual reality, virtual space |
| Abstract | We present Diana, an embodied agent who is aware of her own virtual space and the physical space around her. Using video and depth sensors, Diana attends to the user's gestures, body language, gaze and (soon) facial expressions as well as their words. Diana also gestures and emotes in addition to speaking, and exists in a 3D virtual world that the user can see. This produces symmetric and shared perception, in the sense that Diana can see the user, the user can see Diana, and both can see the virtual world. The result is an embodied agent that begins to develop the conceit that the user is interacting with a peer rather than a program. |
| URL | https://ieeexplore.ieee.org/document/8940869 |
| DOI | 10.1109/HCC46620.2019.00015 |
| Citation Key | mcneely-white_user-aware_2019 |
- Metrics
- virtual space
- virtual reality
- user-aware shared perception
- user interfaces
- software agents
- shared perception
- Scalability
- pubcrawl
- physical space
- multi modal interfaces
- 3D virtual world
- Human behavior
- human agent interaction
- facial expressions
- Embodied Conversational Agents
- embodied avatars
- embodied agents
- DIANA
- conversational agents
- Avatars