Abstract
Rapid developments in deepfake technology have produced hyper-realistic fake media such as images, audio, and video. Especially, the fabricated videos, which have gained a large widespread in social media sites. Because of the great harm inflicted by these videos, many researchers have increased their efforts to find a reliable method to identify and distinguish these fake videos from the actual ones. In this work, we suggested a new model to detect fake videos, based on two major techniques. First, the VGGFace model was used to extract the most important facial features combined with, second: the estimation of the head pose angle that represents the relative orientation of the human face in video frames. All these calculations are done on human faces detected and cropped from video frames, where 10, 20, and 30 frames were extracted from each video. FF++ dataset was used to train and test the model, which produced a max test accuracy of 0.885. The code was written using Python version 3.9.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Kingma, D.P., Welling, M.: Auto‐encoding variational bayes. In: International Conference on Learning Representations (ICLR), vol. 1 (2014)
Goodfellow, I., et al.: Generative adversarial nets. Adv. Neural Inf. Process. Syst. 27 (2014)
Sultan, D.A., Ibrahim, L.M.: A comprehensive survey on deepfake detection techniques. Int. J. Intell. Syst. Appl. Eng. 10(3s), 89–202 (2022)
Afchar, D., Nozick, V., Yamagishi, J., Echizen, I.: Mesonet: a compact facial video forgery detection network. In: 2018 IEEE international workshop on information forensics and security (WIFS), vol. 11, pp. 1–7. IEEE (2018)
Ismail, A., Elpeltagy, M.S., Zaki, M., Eldahshan, K.: A new deep learning-based methodology for video deepfake detection using xgboost. Sensors 21(16), 5413 (2021)
Amerini, I., Galteri, L., Caldelli, R., Del Bimbo, A.: Deepfake video detection through optical flow based CNN. In: Proceedings of the IEEE/CVF International Conference on Computer Vision Workshops (2019)
Tran, V.N., Lee, S.H., Le, H.S., Kwon, K.R.: High Performance deepfake video detection on CNN-based with attention target-specific regions and manual distillation extraction. Appl. Sci. 11(16), 7678 (2021)
Matern, F., Riess, C., Stamminger, M.: Exploiting visual artifacts to expose deepfakes and face manipulations. In: 2019 IEEE Winter Applications of Computer Vision Workshops (WACVW), pp. 83–92. IEEE (2019)
Wodajo, D., Atnafu, S.: Deepfake video detection using convolutional vision transformer. ar**v preprint ar**v:2102.11126 (2021)
Güera, D., Delp, E.J.: Deepfake video detection using recurrent neural networks. In: 2018 15th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), pp. 1–6. IEEE (2018)
Abdul Jamsheed, V., Janet, B.: Deep fake video detection using recurrent neural networks. Int. J. Sci. Res. Comput. Sci. Eng. 9(2), 22–26 (2021)
Yadav, P., Jaswal, I., Maravi, J., Choudhary, V., Khanna, G.: DeepFake Detection using InceptionResNetV2 and LSTM. In: International Conference on Emerging Technologies: AI, IoT, and CPS for Science Technology Applications (2021)
Li, Y., Chang, M.C., Lyu, S.: In ictu oculi: Exposing ai created fake videos by detecting eye blinking. In: 2018 IEEE International workshop on information forensics and security (WIFS), pp. 1–7. IEEE (2018)
Zhang, D., Li, C., Lin, F., Zeng, D., Ge, S.: Detecting deepfake videos with temporal dropout 3DCNN. In: IJCAI, pp. 1288–1294 (2021)
Zhou, Y., Lim, S.N.: Joint audio-visual deepfake detection. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 14800–14809 (2021)
Agarwal, S., Farid, H., Fried, O., Agrawala, M.: Detecting deep-fake videos from phoneme-viseme mismatches. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, pp. 660–661 (2020)
Parkhi, O., Vedaldi A., Zisserman A.: Deep face recognition. In: BMVC 2015-Proceedings of the British Machine Vision Conference 2015. British Machine Vision Association (BMVC) (2015)
Rossler, A., et al.: Faceforensics++: learning to detect manipulated facial images. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 1–11 (2019)
Obayes, H.K., Al-Shareefi, F.: Secure heart disease classification system based on three pass protocol and machine learning. Iraqi J. Comput. Sci. Math. 4(2), 72–82 (2023)
Chandani, K., Arora, M.: Automatic facial forgery detection using deep neural networks. In: Kumar, N., Tibor, S., Sindhwani, R., Lee, J., Srivastava, P. (eds.) Advances in Interdisciplinary Engineering. LNME, pp. 205–214. Springer, Singapore (2021). https://doi.org/10.1007/978-981-15-9956-9_21
Mittal, H., Saraswat, M., Bansal, J.C., Nagar, A.: Fake-face image classification using improved quantum-inspired evolutionary-based feature selection method. In: 2020 IEEE Symposium Series on Computational Intelligence (SSCI), pp. 989–995. IEEE (2020)
van Asseldonk S., Önal, I.: Deepfake video detection using deep convolutional and hand-crafted facial features with long short-term memory network. In: 33rd Benelux Conference on Artificial Intelligence and the 30th Belgian Dutch Conference on Machine Learning (2021)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Sultan, D.A., Ibrahim, L.M. (2024). Deepfake Detection Model Based on VGGFace with Head Pose Estimation Technique. In: Al-Bakry, A.M., et al. New Trends in Information and Communications Technology Applications. NTICT 2023. Communications in Computer and Information Science, vol 2096. Springer, Cham. https://doi.org/10.1007/978-3-031-62814-6_8
Download citation
DOI: https://doi.org/10.1007/978-3-031-62814-6_8
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-62813-9
Online ISBN: 978-3-031-62814-6
eBook Packages: Computer ScienceComputer Science (R0)