| Title | An Evaluation of Lower Facial Micro Expressions as an Implicit QoE Metric for an Augmented Reality Procedure Assistance Application |
| Publication Type | Conference Paper |
| Year of Publication | 2020 |
| Authors | Hynes, E., Flynn, R., Lee, B., Murray, N. |
| Conference Name | 2020 31st Irish Signals and Systems Conference (ISSC) |
| Keywords | affective state, AR application, augmented reality, augmented reality procedure assistance application, Cameras, complex procedure assistance, Computer vision, continuous QoE metric, continuously infer user QoE, emotion recognition, ergonomics, face recognition, human factors, implicit metrics, implicit QoE metric, lower facial microexpressions, Measurement, micro facial expression, microfacial expressions, mobile computing, normal expressions, paper-based procedure assistance control, procedure assistance AR applications, pubcrawl, quality of experience, repeatable procedures, Resiliency, Resists, Scalability, statistical analysis, Task Analysis, traditional accepted post-experience, user acceptability, user quality, Videos, work factor metrics |
| Abstract | Augmented reality (AR) has been identified as a key technology to enhance worker utility in the context of increasing automation of repeatable procedures. AR can achieve this by assisting the user in performing complex and frequently changing procedures. Crucial to the success of procedure assistance AR applications is user acceptability, which can be measured by user quality of experience (QoE). An active research topic in QoE is the identification of implicit metrics that can be used to continuously infer user QoE during a multimedia experience. A user's QoE is linked to their affective state. Affective state is reflected in facial expressions. Emotions shown in micro facial expressions resemble those expressed in normal expressions but are distinguished from them by their brief duration. The novelty of this work lies in the evaluation of micro facial expressions as a continuous QoE metric by means of correlation analysis to the more traditional and accepted post-experience self-reporting. In this work, an optimal Rubik's Cube solver AR application was used as a proof of concept for complex procedure assistance. This was compared with a paper-based procedure assistance control. QoE expressed by affect in normal and micro facial expressions was evaluated through correlation analysis with post-experience reports. The results show that the AR application yielded higher task success rates and shorter task durations. Micro facial expressions reflecting disgust correlated moderately to the questionnaire responses for instruction disinterest in the AR application. |
| DOI | 10.1109/ISSC49989.2020.9180173 |
| Citation Key | hynes_evaluation_2020 |
An Evaluation of Lower Facial Micro Expressions as an Implicit QoE Metric for an Augmented Reality Procedure Assistance Application