Attention is not what you need