Visible to the public Exploiting Visual Artifacts to Expose Deepfakes and Face Manipulations

TitleExploiting Visual Artifacts to Expose Deepfakes and Face Manipulations
Publication TypeConference Paper
Year of Publication2019
AuthorsMatern, F., Riess, C., Stamminger, M.
Conference Name2019 IEEE Winter Applications of Computer Vision Workshops (WACVW)
Keywordsartificial faces, classical computer vision issues, computer animation, Computer vision, DeepFake, Deepfakes, Estimation, Face, face editing algorithms, face manipulations, face recognition, face tracking, Face2Face, facial editing methods, Geometry, high quality face editing, Human Behavior, human factors, lighting, manipulation types, Metrics, pubcrawl, resilience, Resiliency, Scalability, video content, video signal processing, Videos, visual artifacts, visual features, visualization
AbstractHigh quality face editing in videos is a growing concern and spreads distrust in video content. However, upon closer examination, many face editing algorithms exhibit artifacts that resemble classical computer vision issues that stem from face tracking and editing. As a consequence, we wonder how difficult it is to expose artificial faces from current generators? To this end, we review current facial editing methods and several characteristic artifacts from their processing pipelines. We also show that relatively simple visual artifacts can be already quite effective in exposing such manipulations, including Deepfakes and Face2Face. Since the methods are based on visual features, they are easily explicable also to non-technical experts. The methods are easy to implement and offer capabilities for rapid adjustment to new manipulation types with little data available. Despite their simplicity, the methods are able to achieve AUC values of up to 0.866.
DOI10.1109/WACVW.2019.00020
Citation Keymatern_exploiting_2019