Mitesh Khapra

The heads hypothesis: A unifying statistical approach towards understanding multi-headed attention in BERT
On Controllable Sparse Alternatives to Softmax
An autoencoder approach to learning bilingual word representations