WMT20

Location

Online

Shared Tasks

Schedule

Day 1


9:45	Opening Remarks
10:00	Session 1: Shared Task Overview Papers I Chair: Rachel Bawden
	Findings of the 2020 Conference on Machine Translation (WMT20) Loïc Barrault, Magdalena Biesialska, Ondřej Bojar, Marta R. Costa-jussà, Christian Federmann, Yvette Graham, Roman Grundkiewicz, Barry Haddow, Matthias Huck, Eric Joanis, Tom Kocmi, Philipp Koehn, Chi-kiu Lo, Nikola Ljubešić, Christof Monz, Makoto Morishita, Masaaki Nagata, Toshiaki Nakazawa, Santanu Pal, Matt Post, Marcos Zampieri
	Findings of the First Shared Task on Lifelong Learning Machine Translation Loïc Barrault, Magdalena Biesialska, Marta R. Costa-jussà, Fethi Bougares, Olivier Galibert
	Findings of the WMT 2020 Shared Task on Chat Translation M. Amin Farajian, António V. Lopes, André F. T. Martins, Sameen Maruf, Gholamreza Haffari
	Findings of the WMT 2020 Shared Task on Machine Translation Robustness Lucia Specia, Zhenhao Li, Juan Pino, Vishrav Chaudhary, Francisco Guzmán, Graham Neubig, Nadir Durrani, Yonatan Belinkov, Philipp Koehn, Hassan Sajjad, Paul Michel, Xian Li
11:00	Session 2: Shared Task Posters I
11:00	News Translation Task
11:00	The University of Edinburgh’s English-Tamil and English-Inuktitut Submissions to the WMT20 News Translation Task Rachel Bawden, Alexandra Birch, Radina Dobreva, Arturo Oncevay, Antonio Valerio Miceli Barone, Philip Williams
11:00	GTCOM Neural Machine Translation Systems for WMT20 Chao Bei, Hao Zong, Qingmin Liu, Conghu Yuan
11:00	DiDi’s Machine Translation System for WMT2020 Tanfang Chen, Weiwei Wang, Wenyang Wei, Xing Shi, Xiangang Li, Jieping Ye, Kevin Knight
11:00	Facebook AI’s WMT20 News Translation Task Submission Peng-Jen Chen, Ann Lee, Changhan Wang, Naman Goyal, Angela Fan, Mary Williamson, Jiatao Gu
11:00	Linguistically Motivated Subwords for English-Tamil Translation: University of Groningen’s Submission to WMT-2020 Prajit Dhar, Arianna Bisazza, Gertjan van Noord
11:00	The TALP-UPC System Description for WMT20 News Translation Task: Multilingual Adaptation for Low Resource MT Carlos Escolano, Marta R. Costa-jussà, José A. R. Fonollosa
11:00	An Iterative Knowledge Transfer NMT System for WMT20 News Translation Task Jiwan Kim, Soyoon Park, Sangha Kim, Yoonjung Choi
11:00	Tohoku-AIP-NTT at WMT 2020 News Translation Task Shun Kiyono, Takumi Ito, Ryuto Konno, Makoto Morishita, Jun Suzuki
11:00	NRC Systems for the 2020 Inuktitut-English News Translation Task Rebecca Knowles, Darlene Stewart, Samuel Larkin, Patrick Littell
11:00	CUNI Submission for the Inuktitut Language in WMT News 2020 Tom Kocmi
11:00	Tilde at WMT 2020: News Task Systems Rihards Krišlauks, Mārcis Pinnis
11:00	Samsung R&D Institute Poland submission to WMT20 News Translation Task Mateusz Krubiński, Marcin Chochowski, Bartłomiej Boczek, Mikołaj Koszowski, Adam Dobrowolski, Marcin Szymański, Paweł Przybysz
11:00	Speed-optimized, Compact Student Models that Distill Knowledge from a Larger Teacher Model: the UEDIN-CUNI Submission to the WMT 2020 News Translation Task Ulrich Germann, Roman Grundkiewicz, Martin Popel, Radina Dobreva, Nikolay Bogoychev, Kenneth Heafield
11:00	The University of Edinburgh’s submission to the German-to-English and English-to-German Tracks in the WMT 2020 News Translation and Zero-shot Translation Robustness Tasks Ulrich Germann
11:00	Contact Relatedness can help improve multilingual NMT: Microsoft STCI-MT @ WMT20 Vikrant Goyal, Anoop Kunchukuttan, Rahul Kejriwal, Siddharth Jain, Amit Bhagwat
11:00	The AFRL WMT20 News Translation Systems Jeremy Gwinnup, Tim Anderson
11:00	The Ubiqus English-Inuktitut System for WMT20 François Hernandez, Vincent Nguyen
11:00	SJTU-NICT’s Supervised and Unsupervised Neural Machine Translation Systems for the WMT20 News Translation Task Zuchao Li, Hai Zhao, Rui Wang, Kehai Chen, Masao Utiyama, Eiichiro Sumita
11:00	Combination of Neural Machine Translation Systems at WMT20 Benjamin Marie, Raphael Rubino, Atsushi Fujita
11:00	WeChat Neural Machine Translation Systems for WMT20 Fandong Meng, Jianhao Yan, Yijin Liu, Yuan Gao, Xianfeng Zeng, Qinsong Zeng, Peng Li, Ming Chen, Jie Zhou, Sifan Liu, Hao Zhou
11:00	PROMT Systems for WMT 2020 Shared News Translation Task Alexander Molchanov
11:00	eTranslation’s Submissions to the WMT 2020 News Translation Task Csaba Oravecz, Katina Bontcheva, László Tihanyi, David Kolovratnik, Bhavani Bhaskar, Adrien Lardilleux, Szymon Klocek, Andreas Eisele
11:00	The ADAPT System Description for the WMT20 News Translation Task Venkatesh Parthasarathy, Akshai Ramesh, Rejwanul Haque, Andy Way
11:00	CUNI English-Czech and English-Polish Systems in WMT20: Robust Document-Level Training Martin Popel
11:00	Machine Translation for English–Inuktitut with Segmentation, Data Acquisition and Pre-Training Christian Roest, Lukas Edman, Gosse Minnema, Kevin Kelly, Jennifer Spenader, Antonio Toral
11:00	OPPO’s Machine Translation Systems for WMT20 Tingxun Shi, Shiyu Zhao, Xiaopu Li, Xiaoxue Wang, Qian Zhang, Di Ai, Dawei Dang, Xue Zhengshan, Jie Hao
11:00	HW-TSC’s Participation in the WMT 2020 News Translation Shared Task Daimeng Wei, Hengchao Shang, Zhanglin Wu, Zhengzhe Yu, Liangyou Li, Jiaxin Guo, Minghan Wang, Hao Yang, Lizhi Lei, Ying Qin, Shiliang Sun
11:00	IIE’s Neural Machine Translation Systems for WMT20 Xiangpeng Wei, Ping Guo, Yunpeng Li, Xingsheng Zhang, Luxi Xing, Yue Hu
11:00	The Volctrans Machine Translation System for WMT20 Liwei Wu, Xiao Pan, Zehui Lin, Yaoming ZHU, Mingxuan Wang, Lei Li
11:00	Tencent Neural Machine Translation Systems for the WMT20 News Translation Task Shuangzhi Wu, Xing Wang, Longyue Wang, Fangxu Liu, Jun Xie, Zhaopeng Tu, Shuming Shi, Mu Li
11:00	Russian-English Bidirectional Machine Translation System Ariel Xv
11:00	The DeepMind Chinese–English Document Translation System at WMT2020 Lei Yu, Laurent Sartran, Po-Sen Huang, Wojciech Stokowiec, Domenic Donato, Srivatsan Srinivasan, Alek Andreev, Wang Ling, Sona Mokra, Agustin Dal Lago, Yotam Doron, Susannah Young, Phil Blunsom, Chris Dyer
11:00	The NiuTrans Machine Translation Systems for WMT20 Yuhao Zhang, Ziyang Wang, Runzhe Cao, Binghao Wei, Weiqiao Shan, Shuhan Zhou, Abudurexiti Reheman, Tao Zhou, Xin Zeng, Laohu Wang, Yongyu Mu, Jingnan Zhang, Xiaoqian Liu, Xuanjun Zhou, Yinqiao Li, Bei Li, Tong Xiao, Jingbo Zhu
11:00	Test Sets
11:00	Fine-grained linguistic evaluation for state-of-the-art Machine Translation Eleftherios Avramidis, Vivien Macketanz, Ursula Strohriegel, Aljoscha Burchardt, Sebastian Möller
11:00	Gender Coreference and Bias Evaluation at WMT 2020 Tom Kocmi, Tomasz Limisiewicz, Gabriel Stanovsky
11:00	The MUCOW word sense disambiguation test suite at WMT 2020 Yves Scherrer, Alessandro Raganato, Jörg Tiedemann
11:00	WMT20 Document-Level Markable Error Exploration Vilém Zouhar, Tereza Vojtěchová, Ondřej Bojar
11:00	Similar Language Translation Task
11:00	Translating Similar Languages: Role of Mutual Intelligibility in Multilingual Transformers Ife Adebara, El Moatez Billah Nagoudi, Muhammad Abdul Mageed
11:00	Attention Transformer Model for Translation of Similar Languages Farhan Dhanani, Muhammad Rafi
11:00	Transformer-based Neural Machine Translation System for Hindi – Marathi: WMT20 Shared Task Amit Kumar, Rupjyoti Baruah, Rajesh Kumar Mundotiya, Anil Kumar Singh
11:00	Hindi-Marathi Cross Lingual Model Sahinur Rahman Laskar, Abdullah Faiz Ur Rahman Khilji, Partha Pakray, Sivaji Bandyopadhyay
11:00	Transfer Learning for Related Languages: Submissions to the WMT20 Similar Language Translation Task Lovish Madaan, Soumya Sharma, Parag Singla
11:00	The IPN-CIC team system submission for the WMT 2020 similar language task Luis A. Menéndez-Salazar, Grigori Sidorov, Marta R. Costa-Jussà
11:00	NMT based Similar Language Translation for Hindi - Marathi Vandan Mujadia, Dipti Sharma
11:00	NUIG-Panlingua-KMI Hindi-Marathi MT Systems for Similar Language Translation Task @ WMT 2020 Atul Kr. Ojha, Priya Rani, Akanksha Bansal, Bharathi Raja Chakravarthi, Ritesh Kumar, John P. McCrae
11:00	Neural Machine Translation for Similar Languages: The Case of Indo-Aryan Languages Santanu Pal, Marcos Zampieri
11:00	Neural Machine Translation between similar South-Slavic languages Maja Popović, Alberto Poncelas
11:00	Infosys Machine Translation System for WMT20 Similar Language Translation Task Kamalkumar Rathinasamy, Amanpreet Singh, Balaguru Sivasambagupta, Prajna Prasad Neerchal, Vani Sivasankaran
11:00	Document Level NMT of Low-Resource Languages with Backtranslation Sami Ul Haq, Sadaf Abdul Rauf, Arsalan Shaukat, Abdullah Saeed
11:00	Multilingual Neural Machine Translation: Case-study for Catalan, Spanish and Portuguese Romance Languages Pere Vergés Boncompte, Marta R. Costa-jussà
11:00	A3-108 Machine Translation System for Similar Language Translation Shared Task 2020 Saumitra Yadav, Manish Shrivastava
11:00	Chat Translation Task
11:00	The University of Maryland’s Submissions to the WMT20 Chat Translation Task: Searching for More Data to Adapt Discourse-Aware Neural Machine Translation Calvin Bao, Yow-Ting Shiue, Chujun Song, Jie Li, Marine Carpuat
11:00	Naver Labs Europe’s Participation in the Robustness, Chat, and Biomedical Tasks at WMT 2020 Alexandre Berard, Ioan Calapodescu, Vassilina Nikoulina, Jerin Philip
11:00	The University of Edinburgh-Uppsala University’s Submission to the WMT 2020 Chat Translation Task Nikita Moghe, Christian Hardmeier, Rachel Bawden
11:00	JUST System for WMT20 Chat Translation Task Roweida Mohammed, Mahmoud Al-Ayyoub, Malak Abdullah
11:00	Tencent AI Lab Machine Translation Systems for WMT20 Chat Translation Task Longyue Wang, Zhaopeng Tu, Xing Wang, Li Ding, Liang Ding, Shuming Shi
12:30	🕑
13:00	Session 3: Research Papers I Chair: Tom Kocmi
	Combining Sequence Distillation and Transfer Learning for Efficient Low-Resource Neural Machine Translation Models Raj Dabre, Atsushi Fujita
	Fast Interleaved Bidirectional Sequence Generation Biao Zhang, Ivan Titov, Rico Sennrich
	Priming Neural Machine Translation Minh Quang Pham, Jitao Xu, Josep Crego, François Yvon, Jean Senellart
	Subword Segmentation and a Single Bridge Language Affect Zero-Shot Neural Machine Translation Annette Rios, Mathias Müller, Rico Sennrich
	~~Look It Up: Bilingual and Monolingual Dictionaries Improve Neural Machine Translation~~ Xing Jie Zhong, David Chiang
14:00	🕑
16:00	Session 4: Shared Task Overview I Chair: Antonio Toral
17:00	Session 5: Shared Task Posters I
18:30	🕑
19:00	Session 6: Research Papers II Chair: Colin Cherry
	Complete Multilingual Neural Machine Translation Markus Freitag, Orhan Firat
	Paraphrase Generation as Zero-Shot Multilingual Translation: Disentangling Semantic Similarity from Lexical and Syntactic Diversity Brian Thompson, Matt Post
	When Does Unsupervised Machine Translation Work? Kelly Marchisio, Kevin Duh, Philipp Koehn
	Language Models not just for Pre-training: Fast Online Neural Noisy Channel Modeling Shruti Bhosale, Kyra Yee, Sergey Edunov, Michael Auli

Day 2


9:00	Session 7: Research Papers III Chair: Marta R. Costa-jussà
	Towards Multimodal Simultaneous Neural Machine Translation Aizhan Imankulova, Masahiro Kaneko, Tosho Hirasawa, Mamoru Komachi
	Diving Deep into Context-Aware Neural Machine Translation Jingjing Huo, Christian Herold, Yingbo Gao, Leonard Dahlmann, Shahram Khadivi, Hermann Ney
	A Study of Residual Adapters for Multi-Domain Neural Machine Translation Minh Quang Pham, Josep Maria Crego, François Yvon, Jean Senellart
	Mitigating Gender Bias in Machine Translation with Target Gender Annotations Artūrs Stafanovičs, Toms Bergmanis, Mārcis Pinnis
	Document-aligned Japanese-English Conversation Parallel Corpus Matīss Rikters, Ryokan Ri, Tong Li, Toshiaki Nakazawa
10:00	Session 8: Shared Task Overview Papers II Chair: Jindřich Libovický
	Findings of the WMT 2020 Shared Task on Automatic Post-Editing Rajen Chatterjee, Markus Freitag, Matteo Negri, Marco Turchi
	Findings of the WMT 2020 Biomedical Translation Shared Task: Basque, Italian and Russian as New Additional Languages Rachel Bawden, Giorgio Maria Di Nunzio, Cristian Grozea, Inigo Jauregi Unanue, Antonio Jimeno Yepes, Nancy Mah, David Martinez, Aurélie Névéol, Mariana Neves, Maite Oronoz, Olatz Perez-de-Viñaspre, Massimo Piccardi, Roland Roller, Amy Siu, Philippe Thomas, Federica Vezzani, Maika Vicente Navarro, Dina Wiemann, Lana Yeganova
	Results of the WMT20 Metrics Shared Task Nitika Mathur, Johnny Wei, Markus Freitag, Qingsong Ma, Ondřej Bojar
	Findings of the WMT 2020 Shared Task on Parallel Corpus Filtering and Alignment Philipp Koehn, Vishrav Chaudhary, Ahmed El-Kishky, Naman Goyal, Peng-Jen Chen, Francisco Guzmán
	Findings of the WMT 2020 Shared Task on Quality Estimation Lucia Specia, Frédéric Blain, Marina Fomicheva, Erick Fonseca, Vishrav Chaudhary, Francisco Guzmán, André F. T. Martins
	Findings of the WMT 2020 Shared Tasks in Unsupervised MT and Very Low Resource Supervised MT Alexander Fraser
11:00	Session 9: Shared Task Posters II
	Automatic Post-Editing Task
11:00	Cross-Lingual Transformers for Neural Automatic Post-Editing Dongjun Lee
11:00	POSTECH-ETRI’s Submission to the WMT2020 APE Shared Task: Automatic Post-Editing with Cross-lingual Language Model Jihyung Lee, WonKee Lee, Jaehun Shin, Baikjin Jung, Young-Kil Kim, Jong-Hyeok Lee
11:00	Noising Scheme for Data Augmentation in Automatic Post-Editing WonKee Lee, Jaehun Shin, Baikjin Jung, Jihyung Lee, Jong-Hyeok Lee
11:00	Alibaba’s Submission for the WMT 2020 APE Shared Task: Improving Automatic Post-Editing with Pre-trained Conditional Cross-Lingual BERT Jiayi Wang, Ke Wang, Kai Fan, Yuqi Zhang, Jun Lu, Xin Ge, Yangbin Shi, Yu Zhao
11:00	HW-TSC’s Participation at WMT 2020 Automatic Post Editing Shared Task Hao Yang, Minghan Wang, Daimeng Wei, Hengchao Shang, Jiaxin Guo, Zongyao Li, Lizhi Lei, Ying Qin, Shimin Tao, Shiliang Sun, Yimeng Chen
11:00	Biomedical Translation Task
11:00	LIMSI @ MT 2020 Sadaf Abdul Rauf, José Carlos Rosales Núñez, Minh Quang Pham, François Yvon
11:00	Elhuyar submission to the Biomedical Translation Task 2020 on terminology and abstracts translation Ander Corral, Xabier Saralegi
11:00	YerevaNN’s Systems for WMT20 Biomedical Translation Task: The Effect of Fixing Misaligned Sentence Pairs Karen Hambardzumyan, Hovhannes Tamoyan, Hrant Khachatrian
11:00	Pretrained Language Models and Backtranslation for English-Basque Biomedical Neural Machine Translation Inigo Jauregi Unanue, Massimo Piccardi
11:00	Lite Training Strategies for Portuguese-English and English-Portuguese Translation Alexandre Lopes, Rodrigo Nogueira, Roberto Lotufo, Helio Pedrini
11:00	The ADAPT’s Submissions to the WMT20 Biomedical Translation Task Prashant Nayak, Rejwanul Haque, Andy Way
11:00	FJWU participation for the WMT20 Biomedical Translation Task Sumbal Naz, Sadaf Abdul Rauf, Noor-e- Hira, Sami Ul Haq
11:00	Huawei’s Submissions to the WMT20 Biomedical Translation Task Wei Peng, Jianfeng Liu, Minghan Wang, Liangyou Li, Xupeng Meng, Hao Yang, Qun Liu
11:00	Addressing Exposure Bias With Document Minimum Risk Training: Cambridge at the WMT20 Biomedical Translation Task Danielle Saunders, Bill Byrne
11:00	UoS Participation in the WMT20 Translation of Biomedical Abstracts Felipe Soares, Delton Vaz
11:00	Ixamed’s submission description for WMT20 Biomedical shared task: benefits and limitations of using terminologies for domain adaptation Xabier Soto, Olatz Perez-de-Viñaspre, Gorka Labaka, Maite Oronoz
11:00	Tencent AI Lab Machine Translation Systems for the WMT20 Biomedical Translation Task Xing Wang, Zhaopeng Tu, Longyue Wang, Shuming Shi
	Metrics Task
11:00	ParBLEU: Augmenting Metrics with Automatic Paraphrases for the WMT’20 Metrics Shared Task Rachel Bawden, Biao Zhang, Andre Tättar, Matt Post
11:00	Extended Study on Using Pretrained Language Models and YiSi-1 for Machine Translation Evaluation Chi-kiu Lo
11:00	Machine Translation Reference-less Evaluation using YiSi-2 with Bilingual Mappings of Massive Multilingual Language Model Chi-kiu Lo, Samuel Larkin
11:00	Unbabel’s Participation in the WMT20 Metrics Shared Task Ricardo Rei, Craig Stewart, Ana C Farinha, Alon Lavie
11:00	Learning to Evaluate Translation Beyond English: BLEURT Submissions to the WMT Metrics 2020 Shared Task Thibault Sellam, Amy Pu, Hyung Won Chung, Sebastian Gehrmann, Qijun Tan, Markus Freitag, Dipanjan Das, Ankur Parikh
11:00	Towards a Better Evaluation of Metrics for Machine Translation Peter Stanchev, Weiyue Wang, Hermann Ney
11:00	Incorporate Semantic Structures into Machine Translation Evaluation via UCCA Jin Xu, Yinuo Guo, Junfeng Hu
	Parallel Corpus Filtering Task
11:00	Filtering Noisy Parallel Corpus using Transformers with Proxy Task Learning Haluk Açarçiçek, Talha Çolakoğlu, pınar ece aktan hatipoğlu, Chong Hsuan Huang, Wei Peng
11:00	Score Combination for Improved Parallel Corpus Filtering for Low Resource Conditions Muhammad ElNokrashy, Amr Hendy, Mohamed Abdelghaffar, Mohamed Afify, Ahmed Tawfik, Hany Hassan Awadalla
11:00	Bicleaner at WMT 2020: Universitat d’Alacant-Prompsit’s submission to the parallel corpus filtering shared task Miquel Esplà-Gomis, Víctor M. Sánchez-Cartagena, Jaume Zaragoza-Bernabeu, Felipe Sánchez-Martínez
11:00	An exploratory approach to the Parallel Corpus Filtering shared task WMT20 Ankur Kejriwal, Philipp Koehn
11:00	Dual Conditional Cross Entropy Scores and LASER Similarity Scores for the WMT20 Parallel Corpus Filtering Shared Task Felicia Koerner, Philipp Koehn
11:00	Improving Parallel Data Identification using Iteratively Refined Sentence Alignments and Bilingual Mappings of Pre-trained Language Models Chi-kiu Lo, Eric Joanis
11:00	Alibaba Submission to the WMT20 Parallel Corpus Filtering Task Jun Lu, Xin Ge, Yangbin Shi, Yuqi Zhang
11:00	Volctrans Parallel Corpus Filtering System for WMT 2020 Runxin Xu, Zhuo Zhi, Jun Cao, Mingxuan Wang, Lei Li
	Quality Estimation Task
11:00	PATQUEST: Papago Translation Quality Estimation Yujin Baek, Zae Myung Kim, Jihyung Moon, Hyunjoong Kim, Eunjeong Park
11:00	RTM Ensemble Learning Results at Quality Estimation Task Ergun Biçici
11:00	NJU’s submission to the WMT20 QE Shared Task Qu Cui, Xiang Geng, Shujian Huang, Jiajun Chen
11:00	BERGAMOT-LATTE Submissions for the WMT20 Quality Estimation Shared Task Marina Fomicheva, Shuo Sun, Lisa Yankovskaya, Frédéric Blain, Vishrav Chaudhary, Mark Fishel, Francisco Guzmán, Lucia Specia
11:00	The NiuTrans System for the WMT20 Quality Estimation Shared Task Chi Hu, Hui Liu, Kai Feng, Chen Xu, Nuo Xu, Zefan Zhou, Shiqin Yan, Yingfeng Luo, Chenglong Wang, Xia Meng, Tong Xiao, Jingbo Zhu
11:00	Two-Phase Cross-Lingual Language Model Fine-Tuning for Machine Translation Quality Estimation Dongjun Lee
11:00	IST-Unbabel Participation in the WMT20 Quality Estimation Shared Task João Moura, miguel vera, Daan van Stigt, Fabio Kepler, André F. T. Martins
11:00	TMUOU Submission for WMT20 Quality Estimation Shared Task Akifumi Nakamachi, Hiroki Shimanaka, Tomoyuki Kajiwara, Mamoru Komachi
11:00	NICT Kyoto Submission for the WMT’20 Quality Estimation Task: Intermediate Training for Domain and Task Adaptation Raphael Rubino
11:00	TransQuest at WMT2020: Sentence-Level Direct Assessment Tharindu Ranasinghe, Constantin Orasan, Ruslan Mitkov
11:00	HW-TSC’s Participation at WMT 2020 Quality Estimation Shared Task Minghan Wang, Hao Yang, Hengchao Shang, Daimeng Wei, Jiaxin Guo, Lizhi Lei, Ying Qin, Shimin Tao, Shiliang Sun, Yimeng Chen, Liangyou Li
11:00	Tencent submission for WMT20 Quality Estimation Shared Task Haijiang Wu, Zixuan Wang, Qingsong Ma, Xinjie Wen, Ruichen Wang, Xiaoli Wang, Yulin Zhang, Zhipeng Yao, Siyao Peng
11:00	Zero-Shot Translation Quality Estimation with Explicit Cross-Lingual Patterns Lei Zhou, Liang Ding, Koichi Takeda
	Unsupervised and Very Low-Resource Translation Task
11:00	NLPRL System for Very Low Resource Supervised Machine Translation Rupjyoti Baruah, Rajesh Kumar Mundotiya, Amit Kumar, Anil Kumar Singh
11:00	Low-Resource Translation as Language Modeling Tucker Berckmann, Berkan Hiziroglu
11:00	The LMU Munich System for the WMT 2020 Unsupervised Machine Translation Shared Task Alexandra Chronopoulou, Dario Stojanovski, Viktor Hangya, Alexander Fraser
11:00	UdS-DFKI@WMT20: Unsupervised MT and Very Low Resource Supervised MT for German-Upper Sorbian Sourav Dutta, Jesujoba Alabi, Saptarashmi Bandyopadhyay, Dana Ruiter, Josef van Genabith
11:00	Data Selection for Unsupervised Translation of German–Upper Sorbian Lukas Edman, Antonio Toral, Gertjan van Noord
11:00	The LMU Munich System for the WMT20 Very Low Resource Supervised MT Task Jindřich Libovický, Viktor Hangya, Helmut Schmid, Alexander Fraser
11:00	NRC Systems for Low Resource German-Upper Sorbian Machine Translation 2020: Transfer Learning with Lexical Modifications Rebecca Knowles, Samuel Larkin, Darlene Stewart, Patrick Littell
11:00	CUNI Systems for the Unsupervised and Very Low Resource Translation Task in WMT20 Ivana Kvapilíková, Tom Kocmi, Ondřej Bojar
11:00	The University of Helsinki and Aalto University submissions to the WMT 2020 news and low-resource translation tasks Yves Scherrer, Stig-Arne Grönroos, Sami Virpioja
11:00	The NITS-CNLP System for the Unsupervised MT Task at WMT 2020 Salam Michael Singh, Thoudam Doren Singh, Sivaji Bandyopadhyay
11:00	Adobe AMPS’s Submission for Very Low Resource Supervised Translation Task at WMT20 Keshaw Singh
12:30	🕑
13:00	Session 10: Invited Talk: "Low-resourcedness" Beyond Data Ignatius Ezeani, Jade Abbott, Julia Kreutzer, Salomon Kabongo, Perez Ogayo, Shamsuddeen Hassan Muhammad, Rubungo Andre Niyongabo, Jamiil Toure Ali, Kathleen Siminyu, Salomey Osei, Wilhelmina Nekoto, Arshath Ramkilowan, Masabata Mokgesi-Selinga, Bonaventure Dossou, Ayodele Olabiyi, Blessing Sibanda, Akinola Oluwole, Vukosi Marivate, Orevaoghene Ahia
14:00	Session 11: Panel Discussion Moderator: Lexi Birch
	Panel: Jade Abbott, Anoop Kunchukuttan, Kathleen Siminyu, Jörg Tiedemann
15:30	🕑
16:00	Session 12: Shared Task Overview II Chair: Matt Post
17:00	Session 13: Shared Task Posters II
18:30	🕑
19:00	Session 14: Research Papers IV Chair: Michael Auli
	On the Same Page? Comparing Inter-Annotator Agreement in Sentence and Document Level Human Machine Translation Evaluation Sheila Castilho
	How Should Markup Tags Be Translated? Greg Hanneman, Georgiana Dinu
	The Tatoeba Translation Challenge – Realistic Data Sets for Low Resource and Multilingual MT Jörg Tiedemann
	Human-Paraphrased References Improve Neural Machine Translation Markus Freitag, George Foster, David Grangier, Colin Cherry
	Incorporating Terminology Constraints in Automatic Post-Editing David Wan, Chris Kedzie, Faisal Ladhak, Marine Carpuat, Kathleen McKeown

Results

General Task

Full results of the shared task: Findings of the 2020 Conference on Machine Translation (WMT20

The winner systems were listed according to their average score and average z-score.

→ English

The results were determined with a monolingual direct assessment with document context.

Language pair	System	Average score	Average z-score
Chinese →	VolcTrans	77.5	0.102
Czech →	CUNI-DocTransformer	78.3	0.118
German →	VolcTrans	82.6	0.228
Japanese →	Tohoku-AIP-NTT	75.1	0.184
Polish →	SRPOL	77.2	0.131
Russian →	Online-G	79.3	0.124
Tamil →	GTCOM	68.7	0.203

The results were determined with a monolingual direct assessment without document context.

Language pair	System	Average score	Average z-score
Inuktitut →	NiuTrans	73.1	0.168
Khmer →	Online-B	69.0	0.168
Pashto →	Online-B	67.3	0.032

English →

The results were determined with a bilingual direct assessment with document context.

Language pair	System	Average score	Average z-score
→ Chinese	OPPO	80.0	0.447
→ Czech	CUNI-DocTransformer	82.2	0.546
→ German	OPPO	87.4	0.495
→ Japanese	NiuTrans	77.7	0.502
→ Polish	SRPOL	76.4	0.493
→ Russian	Online-G	81.5	0.469
→ Tamil	Facebook-AI	79.0	0.663

The results were determined with a bilingual direct assessment without document context.

Language pair	System	Average score	Average z-score
→ Inuktitut	MultiLingual-Ubiqus	75.3	0.425
→ Khmer	GTCOM	77.4	0.478
→ Pashto	GTCOM	73.0	0.244

French ↔︎ German