UniDrop: A Simple yet Effective Technique to Improve Transformer without Extra Cost

202123 citationsJournal Articlegold Open Access

Authors

Zhen Wu · Nanjing University

Lijun Wu · Microsoft Research Asia (China)

Qi Meng · Microsoft Research Asia (China)

Yingce Xia · Microsoft Research Asia (China)

Shufang Xie · Microsoft Research Asia (China)

Tao Qin · Microsoft Research Asia (China)

Xinyu Dai ·

Abstract

Zhen Wu, Lijun Wu, Qi Meng, Yingce Xia, Shufang Xie, Tao Qin, Xinyu Dai, Tie-Yan Liu. Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 2021.

Topics & Keywords

Natural Language Processing Techniques Topic Modeling Speech Recognition and Synthesis

UN Sustainable Development Goals

Quality Education

Publication Details

DOI: 10.18653/v1/2021.naacl-main.302

Field-Weighted Citation Impact: 3.07