Comprehensive Layer-wise Analysis of SSL Models for Audio Deepfake Detection

Yassine El Kheir, Younes Samih, Suraj Maharjan, Tim Polzehl, Sebastian Möller


Abstract
This paper conducts a comprehensive layer-wise analysis of self-supervised learning (SSL) models for audio deepfake detection across diverse contexts, including multilingual datasets (English, Chinese, Spanish), partial, song, and scene-based deepfake scenarios. By systematically evaluating the contributions of different transformer layers, we uncover critical insights into model behavior and performance. Our findings reveal that lower layers consistently provide the most discriminative features, while higher layers capture less relevant information. Notably, all models achieve competitive equal error rate (EER) scores even when employing a reduced number of layers. This indicates that we can reduce computational costs and increase the inference speed of detecting deepfakes by utilizing only a few lower layers. This work enhances our understanding of SSL models in deepfake detection, offering valuable insights applicable across varied linguistic and contextual settings. Our models and code are publicly available at https://github.com/Yaselley/SSL_Layerwise_Deepfake.
Anthology ID:
2025.findings-naacl.227
Volume:
Findings of the Association for Computational Linguistics: NAACL 2025
Month:
April
Year:
2025
Address:
Albuquerque, New Mexico
Editors:
Luis Chiruzzo, Alan Ritter, Lu Wang
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
4070–4082
Language:
URL:
https://aclanthology.org/2025.findings-naacl.227/
DOI:
10.18653/v1/2025.findings-naacl.227
Bibkey:
Cite (ACL):
Yassine El Kheir, Younes Samih, Suraj Maharjan, Tim Polzehl, and Sebastian Möller. 2025. Comprehensive Layer-wise Analysis of SSL Models for Audio Deepfake Detection. In Findings of the Association for Computational Linguistics: NAACL 2025, pages 4070–4082, Albuquerque, New Mexico. Association for Computational Linguistics.
Cite (Informal):
Comprehensive Layer-wise Analysis of SSL Models for Audio Deepfake Detection (El Kheir et al., Findings 2025)
Copy Citation:
PDF:
https://aclanthology.org/2025.findings-naacl.227.pdf

OSZAR »