Aakriti Budhraja

The heads hypothesis: A unifying statistical approach towards understanding multi-headed attention in BERT
On the weak link between importance and prunability of attention heads
On the Importance of Local Information in Transformer Based Models