Inside the Nativeness Axis
Compared how wav2vec2-XLS-R and Whisper Large v3 represent native and non-native Arabic speech. Layer-wise probes identified a perfectly separating direction at intermediate layers; causal ablation weakened nativeness decoding while preserving gender, and phoneme-conditioned attention analysis connected the effect to Arabic emphatics and uvulars.