Search arXiv⌕ Search

arXiv · 2610.38740

Automated Parameter Sensitivity Ranking in Audio Synthesis

Abstract

Software synthesizers expose dozens of coupled controls, many of them redundant or perceptually inert at typical operating points. This paper presents a two-stage, measure-and-validate framework that ranks parameters by their influence on the audio output and then checks that ranking against an independent, variance-based experiment. Every rendered clip is normalized to -23 LUFS and described by five spectral fingerprints, so that gain shifts cannot masquerade as timbral change. The Sweep Test scores each parameter by spectral deviation over a 101-step sweep; the Sobol Test scores it by summed per-cell variance over a 128-point Sobol excitation. Across five architecturally distinct synthesizers (TorchSynth, Pyo, Pedalboard, Csound, and FluidSynth) spanning 48 to 76 parameters, the two tests agree at Spearman ρ= 0.82-0.96 (p-values \le 7.2 \times 10^{-15}) on the four engines that render deterministically, and at ρ= 0.32 on the one with process-level render noise--a diagnostic of that engine rather than of the method. The strong correlations survive reducing the Sobol budget from 128 to 32 points, and the complete analysis costs a one-time offline budget of about 66,000 renders.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Ogulcan Kibar, Baris Ozcan. 2026-10-28. Automated Parameter Sensitivity Ranking in Audio Synthesis. https://arxiv.org/abs/2610.38740

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

IsoNet: Face-Guided Speech Extraction for Compact Microphone Arrays

Listening to one chosen talker in a crowded room is effortless for people but hard for small devices, whose microphone arrays are too compact for classical beamforming to separate nearby voices. We present IsoNet, a select-to-listen system: the user selects a face in the camera view, and a 4-microphone array with a 9.4 cm aperture returns that person's speech. IsoNet fuses multi-channel complex spectra, GCC-PHAT spatial cues, and a face embedding at the bottleneck of a U-Net mask estimator, trained with auxiliary direction-of-arrival supervision and an SNR curriculum on simulated reverberant VoxCeleb mixtures. On a hard test set spanning -1 to 10 dB SNR, IsoNet reaches 9.31 dB SI-SDR, a 4.85 dB improvement over the mixture, and raises PESQ from 1.40 to 2.13 and STOI from 0.72 to 0.84. The gains are largest where the task is hardest (5.71 dB SI-SDR improvement at -1 to 1 dB SNR), and IsoNet outperforms oracle-steered delay-and-sum and MVDR beamformers by 9.7 and 10.9 dB SI-SDR. Ablations show that visual and spatial cues are complementary, and a 4.9M-parameter audio-spatial variant stays within 0.16 dB of the full model while running 26 times faster than real time.

cs.SD↗

Reading-Level Verification of Kanji Words in Japanese Financial Speech Synthesis

Few-shot voice cloning makes it cheap to produce daily Japanese financial commentary with several synthetic speakers, but kanji words with more than one reading, such as the word for "market" (shijo vs. ichiba) or "overall trend" (taisei vs. oze), are still misread. A common quality gate transcribes each synthesized sentence with automatic speech recognition (ASR), converts both the input and the transcript to kana, and regenerates on mismatch. We show that this gate is unreliable in both directions: when the audio contains a misreading, the ASR language model frequently writes the expected kanji back, hiding the error, and when the audio is correct, ordinary recognition errors trigger needless regeneration. We propose a reading-level check that scores the expected reading and its confusable alternatives with a connectionist temporal classification (CTC) hiragana recognizer and flags a word when an alternative explains the audio better. On 540 utterances from three voice-cloned production voices covering 30 financial terms, with misreadings injected under controlled conditions, the transcript-based gate detected 78.9% of misreadings at a 44.4% false-alarm rate, whereas the proposed check detected 91.7% at 5.0% (AUC 0.990). On natural kanji input, it caught a front-end error that the transcript-based gate missed for one voice, and reduced regeneration requests from 38.9% to 6.1% of sentences.

cs.SD↗

A learning-based method of automatic music transcription

Automatic Music Transcription (AMT) seeks to convert acoustic music recordings into symbolic musical notation, a process that remains remarkably difficult for polyphonic piano due to concurrent polyphony, harmonic partial interference, expressive timing, and severe pitch activation sparsity. In this paper, we formulate polyphonic piano transcription as a frame-level multi-label classification problem across the standard 88 piano pitches (MIDI notes 21 to 108). Raw audio waveforms are processed using the Constant-Q Transform (CQT) to construct a geometrically spaced log-frequency time-frequency representation that aligns with the chromatic musical scale across seven octaves (252 frequency bins per frame). We systematically investigate recurrent sequence models, contrasting unidirectional Long Short-Term Memory (LSTM) with Bidirectional LSTM (BiLSTM) backbones, and propose two architectural adaptations tailored to recurrent temporal representations: a modified additive attention module and a modified multihead attention mechanism equipped with hyperbolic tangent activation and head-wise summation. Furthermore, to mitigate the severe class imbalance between inactive and active notes (approximately 41:1), we evaluate Weighted Binary Cross-Entropy (WBCE) alongside standard Binary Cross-Entropy (BCE). Rigorous empirical evaluations on the MAPS and MAESTRO datasets demonstrate steady, compounding gains from bidirectionality and attention mechanisms. Our proposed Multihead Attention-BiLSTM architecture attains an F1-score of 88.20%, an accuracy of 78.90%, a precision of 0.89, and a recall of 0.86, substantially outperforming the baseline unidirectional LSTM (F1-score of 71.20%) while maintaining a compact parameter budget of 4.43M. Qualitative piano-roll visualizations confirm that our model generates faithful transcriptions even in complex harmonic passages.

cs.SD↗