A GAN-Based Framework for Generating STFT Spectrograms of Rare Acoustic Events in Structural Health Monitoring

Abstract

Structural Health Monitoring plays a crucial role in ensuring the safety, reliability, and longevity of bridge infrastructures through early damage detection. Although recent advances in deep learning-based models have enabled automated event detection, their performance is often limited by data scarcity, environmental noise, and class imbalance. To address these challenges, this study introduces a customized Generative Adversarial Network model, STFTSynth, designed particularly for generating short-time Fourier transform spectrograms derived from acoustic event signals. In contrast to augmentation techniques such as MixUp, generative adversarial networks can synthesize spectrograms that visually and statistically resemble real event representations, providing a basis for representation-level dataset enrichment. The proposed model integrates dense residual blocks for spatial consistency with bidirectional gated recurrent units for temporal dependency modeling. Model performance is evaluated against three baseline generative models using qualitative inspection and quantitative metrics, including Structural Similarity Index Measure, Peak Signal-to-Noise Ratio, and Frechet Inception Distance. Results show that STFTSynth outperforms baseline models, producing high-resolution, temporally consistent spectrograms that align closely with real-world data. These findings highlight the potential of GAN-based spectrogram synthesis for representation-level enrichment of rare acoustic-event datasets in bridge monitoring, particularly when real examples such as prestressing wire breakage are limited.