Beyond the Raw Waveform: Fusing Visual Representations of EDA for Stress Detection

Abstract

Electrodermal activity (EDA) is widely used in automatic stress detection, yet most pipelines treat it only as a raw one-dimensional waveform. This study examines whether complementary visual representations of EDA provide useful information for stress classification and whether their fusion im- proves recognition performance. Six image-based representations are derived from each EDA recording: an unwrapped short-time Fourier transform (STFT) phase spectrogram, an instantaneous-frequency map computed from that phase, a power spectral density (PSD) spectrogram, a continuous wavelet transform scalogram, a recurrence plot, and a rendered waveform trace. The selected representations are stacked as channels of a single multichannel input, together with the raw waveform, and processed by a shared asymmetric-attention architecture. Experiments on a 58-subject stress dataset show that representation fusion improves over the raw waveform. The best configuration, which combines five representations while excluding the unwrapped phase spectrogram, reaches 70.97% test accuracy, compared with 67.36% for the raw waveform. The single PSD spectrogram achieves 69.44%, remaining close to the best-fused configuration at a lower computational cost. The results show that alternative visual forms of the same EDA signal can provide useful inductive biases for stress detection, and that a compact selection of complementary representations can be more effective than the raw waveform alone.