Attention Head

publications

Publication Image
The heads hypothesis: A unifying statistical approach towards understanding multi-headed attention in BERT

Madhura Pande , Aakriti Budhraja , Preksha Nema & more

In Proceedings of the AAAI Conference on Artificial Intelligence (Vol. 35, No. 15, pp. 13613-13621)