Visible to the public Biblio

Filters: Keyword is 3D pointing  [Clear All Filters]
2017-10-18
Zha, Xiaojie, Bourguet, Marie-Luce.  2016.  Experimental Study to Elicit Effective Multimodal Behaviour in Pedagogical Agents. Proceedings of the International Workshop on Social Learning and Multimodal Interaction for Designing Artificial Agents. :1:1–1:6.

This paper describes a small experimental study into the use of avatars to remediate the lecturer's absence in voice-over-slide material. Four different avatar behaviours are tested. Avatar A performs all the upper-body gestures of the lecturer, which were recorded using a 3D depth sensor. Avatar B is animated using few random gestures in order to create a natural presence that is unrelated to the speech. Avatar C only performs the lecturer's pointing gestures, as these are known to indicate important parts of a lecture. Finally, Avatar D performs "lecturer-like" gestures, but these are desynchronised with the speech. Preliminary results indicate students' preference for Avatars A and C. Although the effect of avatar behaviour on learning did not prove statistically significant, students' comments indicate that an avatar that behaves quietly and only performs some of the lecturer's gestures (pointing) is effective. The paper also presents a simple empirical method for automatically detecting pointing gestures in Kinect recorded lecture data.