Visible to the public NeuronUnityIntegration2.0. A Unity Based Application for Motion Capture and Gesture Recognition

TitleNeuronUnityIntegration2.0. A Unity Based Application for Motion Capture and Gesture Recognition
Publication TypeConference Paper
Year of Publication2019
AuthorsBecattini, Federico, Ferracani, Andrea, Principi, Filippo, Ghianni, Marioemanuele, Del Bimbo, Alberto
Conference NameProceedings of the 27th ACM International Conference on Multimedia
PublisherAssociation for Computing Machinery
Conference LocationNice, France
ISBN Number978-1-4503-6889-6
Keywordscomposability, gesture recognition, motion capture, Predictive Metrics, pubcrawl, Resiliency, Support vector machines, unity, virtual reality
AbstractNeuronUnityIntgration2.0 (demo video is avilable at http://tiny.cc/u1lz6y) is a plugin for Unity which provides gesture recognition functionalities through the Perception Neuron motion capture suit. The system offers a recording mode, which guides the user through the collection of a dataset of gestures, and a recognition mode, capable of detecting the recorded actions in real time. Gestures are recognized by training Support Vector Machines directly within our plugin. We demonstrate the effectiveness of our application through an experimental evaluation on a newly collected dataset. Furthermore, external applications can exploit NeuronUnityIntgration2.0's recognition capabilities thanks to a set of exposed API.
URLhttps://doi.org/10.1145/3343031.3350598
DOI10.1145/3343031.3350598
Citation Keybecattini_neuronunityintegration20_2019