betaFeedback

WorksEngineering

Towards Microphone-Invariant Speech Representations for Transformer-Based Voice Disorder Detection

Abstract

Automatic voice disorder detection from speech offers strong potential for early diagnosis and continuous disease monitoring. While models based on pre-trained transformers have improved detection performance, their robustness to microphone variation remains underexplored, particularly for consumer-grade devices. To the best of our knowledge, we present the first study of microphone mismatch in transformer-based binary voice disorder detection across 20 smartphone microphones. While most mismatched microphone conditions cause moderate performance degradation, the worst-case condition reduces unweighted average recall by up to 12.53 percentage points. To address this, we introduce a Barlow Twins-inspired module to learn microphone-invariant representations. Our approach reduces the performance gap between matched and mismatched conditions by up to 62%, while maintaining comparable matched-condition performance. Qualitative analysis of the embedding space demonstrates more compact, distinct speaker clusters across microphones. Importantly, results indicate generalisation to unseen microphones across manufacturers, smartphone generations, and release periods, without requiring any inference-time adaptation.

Paper details

vlnc:W_x5xteehu
Version
v1 · latest
Published
Fresh — added to the Hub within the last 30 days
Added
License
arXiv nonexclusive license
Usage

views · 0

downloads · 0

A view counts once per browser per day, a download each time the PDF is requested.

  • Engineering

Not recorded for this paper

View statement
Looking for related papers…