Big Bird: Transformers for Longer Sequences on ShortScience.org

arxiv.org
scholar.google.com

Big Bird: Transformers for Longer Sequences
Zaheer, Manzil and Guruganesh, Guru and Dubey, Avinava and Ainslie, Joshua and Alberti, Chris and Ontañón, Santiago and Pham, Philip and Ravula, Anirudh and Wang, Qifan and Yang, Li and Ahmed, Amr
arXiv e-Print archive - 2020 via Local Bibsonomy
Keywords: transfer-learning, pre-trained, transformer, bert

Summaries/Notes 1

Write your summary here (You can use $\LaTeX$ and markdown syntax):

Anon Private

ShortScience.org allows researchers to publish paper summaries that are voted on and ranked!
About

Sponsored by: