Search arXivSearch

arXiv subjects

Heewon Oh

Publications and source records attributed to Heewon Oh.

2 recordsLinked to original sources

ArtifactNet: Detecting AI-Generated Music via Forensic Residual Physics

Detecting artificially generated music requires distinguishing synthesis-related traces from musical content and artifacts introduced by audio distribution. We present ArtifactNet, a compact framework based on learned forensic residuals. A pretrained music source separator supplies residual targets during training, but the final system replaces it with ArtifactUNet, a task-directed bounded-mask extractor. Seven channels describe harmonic and percussive residual structure, their balance, and temporal variation, and a lightweight convolutional classifier produces recording scores. The extractor and classifier contain 4.03 million parameters. We evaluate the retained checkpoints on a frozen, recording-level test containing 534 generated and 479 real recordings after conservative source-family and identity exclusions from the reconstructed training lineage. At the pre-established threshold of 0.225, ArtifactNet obtains F1=0.9671, 93.63% recall, and no observed false positive; AUROC and average precision are 0.9982 and 0.9988. Released SpecTTTra and CLAM checkpoints are evaluated on the same files under their model-specific frontends. A diagnostic further shows that the released CLAM head changes substantially with execution batch composition. In a separate paired four-codec study on 100 real and 100 generated recordings, codec-aware extraction reduces the mean score range from 0.276 to 0.033 for real music but increases it from 0.035 to 0.249 for generated music; Opus recall falls from 96% to 74%. The results support compact residual detection while exposing class-dependent codec and implementation sensitivities.

cs.SD

ArtifactBench: Lineage-Aware Evaluation of AI-Generated Music Detectors under Distribution Shift

AI-generated music detectors are commonly compared using aggregate scores on benchmarks whose training overlap, generator lineage, source provenance, and audio-transformation history are only partially observable. This paper introduces ArtifactBench, a lineage-aware evaluation suite for measuring detector behavior across generator families and versions, real-music domains, collection-cohort shift, and inference coverage. The benchmark groups source recordings and their derived variants by content identity, separates calibration from final testing, records inference failures independently from classification errors, and reports source-level performance with uncertainty in addition to aggregate metrics. We evaluate multiple publicly available detectors under a version-pinned common protocol and examine how leakage control, cohort availability, threshold policy, and model-specific missingness alter measured performance and model ranking. On the 562-track common-success test intersection, ArtifactNet obtains 0.982 AUROC and 0.918 balanced accuracy, compared with 0.761/0.776 for the public Deezer detector; SpecTTTra and CLAM fall below 0.30 AUROC under this shifted cohort. These results also expose substantial generator- and real-domain shifts that aggregate scores alone conceal.

cs.SD