CoLT5: Faster Long-Range Transformers with Conditional Computation

202324 citationsJournal Articlegold Open Access

Authors

Joshua Ainslie · Google (United States)

Tao Lei · Google (United States)

Michiel de Jong · Google (United States)

Santiago Ontañón · Google (United States)

Siddhartha Brahma · Google (United States)

Yury Zemlyanskiy · Google (United States)

David Uthus ·

Abstract

Joshua Ainslie, Tao Lei, Michiel de Jong, Santiago Ontanon, Siddhartha Brahma, Yury Zemlyanskiy, David Uthus, Mandy Guo, James Lee-Thorp, Yi Tay, Yun-Hsuan Sung, Sumit Sanghai. Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing. 2023.

Topics & Keywords

Topic Modeling Natural Language Processing Techniques Speech Recognition and Synthesis

UN Sustainable Development Goals

Quality Education

Publication Details

DOI: 10.18653/v1/2023.emnlp-main.309

Field-Weighted Citation Impact: 4.18