Match the Script, Adapt if Multilingual: Analyzing the Effect of Multilingual Pretraining on Cross-lingual Transferability

Yoshinari Fujinuma1
aws ai Labs
Amazon.com
fujinumay@gmail.com Jordan Boyd-Graber
umiacs, cs, lsc, iSchool
University of Maryland
jbg@umiacs.umd.edu Katharina Kann
Computer Science
University of Colorado Boulder
katharina.kann@colorado.edu


Acknowledgements↩︎

We sincerely thank the reviewers for their constructive and detailed feedback. We also thank the members of University of Colorado Boulder’s NALA group, especially Abteen Ebrahimi for providing the code and Stéphane Aroca-Ouellette for giving feedback on an early draft. Boyd-Graber is supported by ODNI, IARPA, via the BETTER Program contract #2019-19051600005. The views and conclusions contained herein are those of the authors and should not be interpreted as necessarily representing the official policies, either expressed or implied, of ODNI, IARPA, or the U.S. Government. The U.S. Government is authorized to reproduce and distribute reprints for governmental purposes notwithstanding any copyright annotation therein.


  1. This work was done while the first author was a student at University of Colorado Boulder.↩︎