HyperConformer: Multi-head HyperMixer for Efficient Speech Recognition
Published in InterSpeech, 2023
Recommended citation: Florian Mai, Juan Zuluaga-Gomez, Titouan Parcollet and Petr Motlicek (2023). "HyperConformer: Multi-head HyperMixer for Efficient Speech Recognition." InterSpeech 2023. https://arxiv.org/abs/2305.18281
We show that the attention mechanism in the popular Conformer architecture can be replaced with a more efficient alternative at no performance loss.