Search arXivSearch

arXiv · 2506.02401

Trusted Fake Audio Detection Based on Dirichlet Distribution

Abstract

With the continuous development of deep learning-based speech conversion and speech synthesis technologies, the cybersecurity problem posed by fake audio has become increasingly serious. Previously proposed models for defending against fake audio have attained remarkable performance. However, they all fall short in modeling the trustworthiness of the decisions made by the models themselves. Based on this, we put forward a plausible fake audio detection approach based on the Dirichlet distribution with the aim of enhancing the reliability of fake audio detection. Specifically, we first generate evidence through a neural network. Uncertainty is then modeled using the Dirichlet distribution. By modeling the belief distribution with the parameters of the Dirichlet distribution, an estimate of uncertainty can be obtained for each decision. Finally, the predicted probabilities and corresponding uncertainty estimates are combined to form the final opinion. On the ASVspoof series dataset (i.e., ASVspoof 2019 LA, ASVspoof 2021 LA, and DF), we conduct a number of comparison experiments to verify the excellent performance of the proposed model in terms of accuracy, robustness, and trustworthiness.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Chi Ding, Junxiao Xue, Cong Wang, Hao Zhou. 2025-06-03. Trusted Fake Audio Detection Based on Dirichlet Distribution. https://arxiv.org/abs/2506.02401

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Speaker Disentanglement of Speech Pre-trained Model Based on Interpretability

Self-supervised speech models learn representations that capture both content and speaker information. Yet this entanglement creates problems: content tasks suffer from speaker bias, and privacy concerns arise when speaker identity leaks through supposedly anonymized representations. We present two contributions to address these challenges. First, we develop InterpTRQE-SptME (Timbre Residual Quantitative Evaluation Benchmark of Speech pre-training Models Encoding via Interpretability), a benchmark that directly measures residual speaker information in content embeddings using SHAP-based interpretability analysis. Unlike existing indirect metrics, our approach quantifies the exact proportion of speaker information remaining after disentanglement. Second, we propose InterpTF-SptME, which uses these interpretability insights to filter speaker information from embeddings. Testing on VCTK with seven models including HuBERT, WavLM, and ContentVec, we find that SHAP Noise filtering reduces speaker residuals from 18.05% to nearly zero while maintaining recognition accuracy (CTC loss increase under 1%). The method is model-agnostic and requires no retraining.

cs.SD

ArtifactNet: Detecting AI-Generated Music via Forensic Residual Physics

Detecting artificially generated music requires distinguishing synthesis-related traces from musical content and artifacts introduced by audio distribution. We present ArtifactNet, a compact framework based on learned forensic residuals. A pretrained music source separator supplies residual targets during training, but the final system replaces it with ArtifactUNet, a task-directed bounded-mask extractor. Seven channels describe harmonic and percussive residual structure, their balance, and temporal variation, and a lightweight convolutional classifier produces recording scores. The extractor and classifier contain 4.03 million parameters. We evaluate the retained checkpoints on a frozen, recording-level test containing 534 generated and 479 real recordings after conservative source-family and identity exclusions from the reconstructed training lineage. At the pre-established threshold of 0.225, ArtifactNet obtains F1=0.9671, 93.63% recall, and no observed false positive; AUROC and average precision are 0.9982 and 0.9988. Released SpecTTTra and CLAM checkpoints are evaluated on the same files under their model-specific frontends. A diagnostic further shows that the released CLAM head changes substantially with execution batch composition. In a separate paired four-codec study on 100 real and 100 generated recordings, codec-aware extraction reduces the mean score range from 0.276 to 0.033 for real music but increases it from 0.035 to 0.249 for generated music; Opus recall falls from 96% to 74%. The results support compact residual detection while exposing class-dependent codec and implementation sensitivities.

cs.SD

VoxReason: Auditing Source-Grounded Speech Plans Before Synthesis

Speech systems increasingly infer how an utterance should be delivered from context, but a plausible delivery plan may not be supported by the input. VoxReason is a small public benchmark and verifier for testing this failure before waveform synthesis. Each of its 100 cases fixes the utterance, provides derived records that name the source emotion and intensity, and changes one licensed cue. A system must cite the record for its delivery decision and update only the plan fields associated with the edit. We use deterministic verifier references, not a model leaderboard. This holdout excludes every emotion and intensity combination observed in training. A prior-only predictor achieves 0.958 accuracy across plan fields but never changes its plan consistently after a cue edit. This contrast shows that plan agreement does not demonstrate source grounding. The released suite provides an auditable measurement layer for screening structured speech plans before synthesis. It is limited to derived records, not audio inputs.

cs.SD