Attention Head

publications

Publication Image
The heads hypothesis: A unifying statistical approach towards understanding multi-headed attention in BERT

Madhura Pande, Aakriti Budhraja, Preksha Nema, Pratyush Kumar, Mitesh Khapra,

In Proceedings of the AAAI Conference on Artificial Intelligence (Vol. 35, No. 15, pp. 13613-13621)

https://ojs.aaai.org/index.php/AAAI/article/view/17605