Visible to the public DeepfakeStack: A Deep Ensemble-based Learning Technique for Deepfake Detection

TitleDeepfakeStack: A Deep Ensemble-based Learning Technique for Deepfake Detection
Publication TypeConference Paper
Year of Publication2020
AuthorsRana, M. S., Sung, A. H.
Conference Name2020 7th IEEE International Conference on Cyber Security and Cloud Computing (CSCloud)/2020 6th IEEE International Conference on Edge Computing and Scalable Cloud (EdgeCom)
KeywordsComputer crime, counterfeit contents, Deep Ensemble Learning, deep ensemble learning technique, deep ensemble-based, deep learning models, DeepFake, deepfake detection, Deepfake multimedia, DeepfakeStack, gan, GANs, generative adversarial network models, Greedy Layer-wise Pretraining, Human Behavior, human factors, human perception, hyper-realistic images, improved composite classifier, innovative applications, learning (artificial intelligence), legitimate applications, manipulated audio, manipulated videos, Metrics, numerous nefarious ways, pattern classification, Political Campaigns, pubcrawl, Realtime Deepfake detector, resilience, Resiliency, Scalability, state-of-art classification models, unlawful ways, video clips
AbstractRecent advances in technology have made the deep learning (DL) models available for use in a wide variety of novel applications; for example, generative adversarial network (GAN) models are capable of producing hyper-realistic images, speech, and even videos, such as the so-called "Deepfake" produced by GANs with manipulated audio and/or video clips, which are so realistic as to be indistinguishable from the real ones in human perception. Aside from innovative and legitimate applications, there are numerous nefarious or unlawful ways to use such counterfeit contents in propaganda, political campaigns, cybercrimes, extortion, etc. To meet the challenges posed by Deepfake multimedia, we propose a deep ensemble learning technique called DeepfakeStack for detecting such manipulated videos. The proposed technique combines a series of DL based state-of-art classification models and creates an improved composite classifier. Based on our experiments, it is shown that DeepfakeStack outperforms other classifiers by achieving an accuracy of 99.65% and AUROC of 1.0 score in detecting Deepfake. Therefore, our method provides a solid basis for building a Realtime Deepfake detector.
DOI10.1109/CSCloud-EdgeCom49738.2020.00021
Citation Keyrana_deepfakestack_2020