Bridging Linguistic Typology and Multilingual Machine Translation with Multi-View Language Representations

Arturo Oncevay, Barry Haddow, Alexandra Birch

Machine Translation and Multilinguality Long Paper

Zoom-6B: Nov 17, Zoom-6B: Nov 17 (09:00-10:00 UTC) [Join Zoom Meeting]

You can open the pre-recorded video in a separate window.

Abstract: Sparse language vectors from linguistic typology databases and learned embeddings from tasks like multilingual machine translation have been investigated in isolation, without analysing how they could benefit from each other's language characterisation. We propose to fuse both views using singular vector canonical correlation analysis and study what kind of information is induced from each source. By inferring typological features and language phylogenies, we observe that our representations embed typology and strengthen correlations with language relationships. We then take advantage of our multi-view language vector space for multilingual machine translation, where we achieve competitive overall translation accuracy in tasks that require information about language similarities, such as language clustering and ranking candidates for multilingual transfer. With our method, we can easily project and assess new languages without expensive retraining of massive multilingual or ranking models, which are major disadvantages of related approaches.
NOTE: Video may display a random order of authors. Correct author list is at the top of this page.

Connected Papers in EMNLP2020

Similar Papers

Improving Multilingual Models with Language-Clustered Vocabularies
Hyung Won Chung, Dan Garrette, Kiat Chuan Tan, Jason Riesa,
UDapter: Language Adaptation for Truly Universal Dependency Parsing
Ahmet Üstün, Arianna Bisazza, Gosse Bouma, Gertjan van Noord,
Multilingual AMR-to-Text Generation
Angela Fan, Claire Gardent,
Improving Word Sense Disambiguation with Translations
Yixing Luan, Bradley Hauer, Lili Mou, Grzegorz Kondrak,