WMT22

Seventh Conference on Machine Translation


The Seventh Conference on Machine Translation (WMT22) took place from 7 December to 8 December, 2022, at EMNLP 2022 in Abu Dhabi. It was organised by WMT.

statmt.org/wmt22/

Table of contents
  1. Important dates
  2. Shared tasks
    1. General machine translation
      1. Language pairs
  3. Scientific papers
    1. Topics:
    2. Research Papers
    3. System Papers
  4. Paper submission
  5. Schedule
    1. Day 1
    2. Day 2
  6. Results
    1. General task
      1. → English
      2. English →
      3. Czech ↔︎ Ukrainian
      4. Yakut → Russian

Important dates

   
Release of training data for shared tasks February-March, 2022
Evaluation periods for shared tasks June-July, 2022
Paper submission deadline 7 September, 2022
Paper notification 9 October, 2022
Camera-ready version 20 October, 2022
Conference 7-8 December, 2022

Shared tasks

The News machine translation task has been renamed the General machine translation task.

General machine translation

  • Multi-domain direction

Blind tests for all languages will contain (up to) four different domains. Likely news, social, conversational, and e-commerce.

  • Aggregated blind testsets across tasks

Participants from each shared task will translate blind testsets from other shared tasks if given language pair is shared. This will allow comparisons of participants across tasks. Each shared task will evaluate their blind testsets separately.

  • Rethinking human evaluation

  • Removing 10 hours annotation per primary system requirement

Instead, participants will be required to submit a system description paper if they submit the primary system.

  • Pre-trained models in constrained setup allowed

Language pairs

Confirmed language pairs:

  • English-Chinese
  • English-Czech
  • English-German
  • English-Japanese
  • English-Russian
  • French-German
  • Croatian-English
  • Livonian-English
  • Yakut-Russian
  • Ukrainian-English
  • Ukrainian-Czech

Scientific papers

Topics:

  • MT models (neural, statistical etc. )
  • Analysis of neural models for MT
  • Using comparable corpora for MT
  • Selection and preparation of data for MT
  • Semi-supervised and unsupervised learning for MT, transfer learning
  • Multilingual MT
  • Incorporating linguistic information into MT
  • MT inference
  • Manual and automatic methods for evaluating MT
  • Quality estimation for MT

Research Papers

Research papers should describe original research corresponding to the categories listed above. Research papers that have been or will be submitted to other meetings or publications must indicate this at submission time, and must be withdrawn from the other venues if accepted and published at WMT 2022.

We will not accept for publication papers that overlap significantly in content or results with papers that have been or will be published elsewhere. It is acceptable to submit work that has been made available as a technical report (or similar, e.g. in arXiv) without citing it.

For the research track, papers should be anonymised, be between 6 and 10 pages in length (excluding references) and may include supplementary material.

System Papers

System papers must describe one or more shared task submissions. System paper submissions that we cannot link to a shared task submission will be rejected without review. System papers can overlap with other published work, and do not have to follow the double submission policy. There is no maximum length for system papers, but normally a short paper (4-6 pages) is appropriate. System papers should not be anonymised.

Paper submission

Schedule

Day 1

   
09:00 – 9:10 Opening remarks
09:10 – 10:30 Session 1
Shared Task Overview Papers I
09:10 – 09:30 Findings of the 2022 Conference on Machine Translation (WMT22)
Tom Kocmi, Rachel Bawden, Ondřej Bojar, Anton Dvorkovich, Christian Federmann, Mark Fishel, Thamme Gowda, Yvette Graham, Roman Grundkiewicz, Barry Haddow, Rebecca Knowles, Philipp Koehn, Christof Monz, Makoto Morishita, Masaaki Nagata, Toshiaki Nakazawa, Michal Novák, Martin Popel, Maja Popović, Mariya Shmatova
09:30 – 09:50 Results of the WMT22 Metrics Shared Task
Markus Freitag, Ricardo Rei, Nitika Mathur, George Foster, Chi-kiu Lo, Craig Stewart, Tom Kocmi, Eleftherios Avramidis, Alon Lavie, André F. T. Martins
09:50 – 10:00 Findings of the WMT 2022 Shared Task on Quality Estimation
Chrysoula Zerva, Frédéric Blain, Ricardo Rei, Piyawat Lertvittayakumjorn, José G. C. de Souza, Steffen Eger, Diptesh Kanojia, Duarte Alves, Constantin Orăsan, Marina Fomicheva, André F. T. Martins, Lucia Specia
10:00 – 10:15 Findings of the WMT 2022 Shared Task on Efficient Translation
Kenneth Heafield, Biao Zhang, Graeme Nail, Jelmer van der Linde, Nikolay Bogoychev
10:15 – 10:30 Findings of the WMT 2022 Shared Task on Automatic Post-Editing
Pushpak Bhattacharyya, Rajen Chatterjee, Markus Freitag, Diptesh Kanojia, Matteo Negri, Marco Turchi
10:30 – 11:00 ☕️
11:00 - 12:40 Session 2: Research Papers on Evaluation and Bias
11:00 - 11:20 Embarrassingly Easy Document-Level MT Metrics: How to Convert Any Pretrained Metric into a Document-Level Metric
Giorgos Vernikos, Brian Thompson, Prashant Mathur, Marcello Federico
11:20 - 11:40 Searching for a Higher Power in the Human Evaluation of MT
Johnny Wei, Tom Kocmi, Christian Federmann
11:40 - 12:00 Analyzing the Use of Influence Functions for Instance-Specific Data Filtering in Neural Machine Translation
Tsz Kin Lam, Eva Hasler, Felix Hieber
12:00 - 12:20 Continuous Rating as Reliable Human Evaluation of Simultaneous Speech Translation
Dávid Javorský, Dominik Macháček, Ondřej Bojar
12:20 - 12:40 Gender Bias Mitigation for NMT Involving Genderless Languages
Ander Corral, Xabier Saralegi
12:40 - 14:00 🍴
14:00 - 15:30 Session 3: Research Papers on Multilingual, Multimodal, Multidomain Translation
14:00 - 14:20 Exploring the Benefits and Limitations of Multilinguality for Non-autoregressive Machine Translation
Sweta Agrawal, Julia Kreutzer, Colin Cherry
14:20 - 14:40 Learning an Artificial Language for Knowledge-Sharing in Multilingual Translation
Danni Liu, Jan Niehues
14:40 - 15:00 Don’t Discard Fixed-Window Audio Segmentation in Speech-to-Text Translation
Chantal Amrhein, Barry Haddow
15:00 - 15:20 Additive Interventions Yield Robust Multi-Domain Machine Translation Models
Elijah Rippeth, Matt Post
15:20 - 15:40 Test Set Sampling Affects System Rankings: Expanded Human Evaluation of WMT20 English-Inuktitut Systems
Rebecca Knowles, Chi-kiu Lo
15:40 - 16:00 Can Domains Be Transferred across Languages in Multi-Domain Multilingual Neural Machine Translation?
Thuy-Trang Vu, Shahram Khadivi, Xuanli He, Dinh Phung, Gholamreza Haffari
15:30 - 16:00 ☕️
16:00 - 17:30 Session 4: Shared Task System Description Posters I
16:00 - 17:30 News Translation Task
16:00 - 17:30 Inria-ALMAnaCH at WMT 2022: Does Transcription Help Cross-Script Machine Translation?
Jesujoba Alabi, Lydia Nishimwe, Benjamin Muller, Camille Rey, Benoît Sagot, Rachel Bawden
16:00 - 17:30 NAIST-NICT-TIT WMT22 General MT Task Submission
Hiroyuki Deguchi, Kenji Imamura, Masahiro Kaneko, Yuto Nishida, Yusuke Sakai, Justin Vasselli, Huy Hien Vu, Taro Watanabe
16:00 - 17:30 Samsung R&D Institute Poland Participation in WMT 2022
Adam Dobrowolski, Mateusz Klimaszewski, Adam Myśliwy, Marcin Szymański, Jakub Kowalski, Kornelia Szypuła, Paweł Przewłocki, Paweł Przybysz
16:00 - 17:30 Tencent AI Lab - Shanghai Jiao Tong University Low-Resource Translation System for the WMT22 Translation Task
Zhiwei He, Xing Wang, Zhaopeng Tu, Shuming Shi, Rui Wang
16:00 - 17:30 Lan-Bridge MT’s Participation in the WMT 2022 General Translation Shared Task
Bing Han, Yangjian Wu, Gang Hu, Qiulin Chen
16:00 - 17:30 Manifold’s English-Chinese System at WMT22 General MT Task
Chang Jin, Tingxun Shi, Zhengshan Xue, Xiaodong Lin
16:00 - 17:30 CUNI-Bergamot Submission at WMT22 General Translation Task
Josef Jon, Martin Popel, Ondřej Bojar
16:00 - 17:30 KYB General Machine Translation Systems for WMT22
Shivam Kalkar, Yoko Matsuzaki, Ben Li
16:00 - 17:30 The AISP-SJTU Translation System for WMT 2022
Guangfeng Liu, Qinpei Zhu, Xingyu Chen, Renjie Feng, Jianxin Ren, Renshou Wu, Qingliang Miao, Rui Wang, Kai Yu
16:00 - 17:30 NT5 at WMT 2022 General Translation Task
Makoto Morishita, Keito Kudo, Yui Oka, Katsuki Chousa, Shun Kiyono, Sho Takase, Jun Suzuki
16:00 - 17:30 Adam Mickiewicz University at WMT 2022: NER-Assisted and Quality-Aware Neural Machine Translation
Artur Nowakowski, Gabriela Pałka, Kamil Guttmann, Mikołaj Pokrywka
16:00 - 17:30 Evaluating Corpus Cleanup Methods in the WMT’22 News Translation Task
Marilena Malli, George Tambouratzis
16:00 - 17:30 PROMT Systems for WMT22 General Translation Task
Alexander Molchanov, Vladislav Kovalenko, Natalia Makhamalkina
16:00 - 17:30 eTranslation’s Submissions to the WMT22 General Machine Translation Task
Csaba Oravecz, Katina Bontcheva, David Kolovratnìk, Bogomil Kovachev, Christopher Scott
16:00 - 17:30 CUNI Systems for the WMT 22 Czech-Ukrainian Translation Task
Martin Popel, Jindřich Libovický, Jindřich Helcl
16:00 - 17:30 The ARC-NKUA Submission for the English-Ukrainian General Machine Translation Shared Task at WMT22
Dimitrios Roussis, Vassilis Papavassiliou
16:00 - 17:30 The NiuTrans Machine Translation Systems for WMT22
Weiqiao Shan, Zhiquan Cao, Yuchen Han, Siming Wu, Yimin Hu, jie wang, Yi Zhang, Hou Baoyu, Hang Cao, Chenghao Gao, Xiaowen Liu, Tong Xiao, Anxiang Ma, Jingbo Zhu
16:00 - 17:30 Teaching Unseen Low-resource Languages to Large Translation Models
Maali Tars, Taido Purason, Andre Tättar
16:00 - 17:30 DUTNLP Machine Translation System for WMT22 General MT Task
Ting Wang, Huan Liu, Junpeng Liu, Degen Huang
16:00 - 17:30 HW-TSC’s Submissions to the WMT 2022 General Machine Translation Shared Task
Daimeng Wei, Zhiqiang Rao, Zhanglin Wu, Shaojun Li, Yuanchang Luo, Yuhao Xie, Xiaoyu Chen, Hengchao Shang, Zongyao Li, Zhengzhe Yu, Jinlong Yang, Miaomiao Ma, Lizhi Lei, Hao Yang, Ying Qin
16:00 - 17:30 Vega-MT: The JD Explore Academy Machine Translation System for WMT22
Changtong Zan, keqin Peng, Liang Ding, Baopu Qiu, Boan Liu, Shwai He, Qingyu Lu, Zheng Zhang, Chuang Liu, Weifeng Liu, Yibing Zhan, Dacheng Tao
16:00 - 17:30 No Domain Left behind
Hui Zeng
16:00 - 17:30 GTCOM Neural Machine Translation Systems for WMT22
Hao Zong, Chao Bei
16:00 - 17:30 Test Suites
16:00 - 17:30 Linguistically Motivated Evaluation of the 2022 State-of-the-art Machine Translation Systems for Three Language Directions
Vivien Macketanz, Shushen Manakhimova, Eleftherios Avramidis, Ekaterina Lapshinova-Koltunski, Sergei Bagdasarov, Sebastian Möller
16:00 - 17:30 Automated Evaluation Metric for Terminology Consistency in MT
Kirill Semenov, Ondřej Bojar
16:00 - 17:30 Test Suite Evaluation: Morphological Challenges and Pronoun Translation
Marion Weller-Di Marco, Alexander Fraser
16:00 - 17:30 Metrics Task
16:00 - 17:30 Robust MT Evaluation with Sentence-level Multilingual Augmentation
Duarte Alves, Ricardo Rei, Ana C Farinha, José G. C. de Souza, André F. T. Martins
16:00 -17:30 ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics
Chantal Amrhein, Nikita Moghe, Liane Guillou
16:00 - 17:30 Linguistically Motivated Evaluation of Machine Translation Metrics Based on a Challenge Set
Eleftherios Avramidis, Vivien Macketanz
16:00 - 17:30 Exploring Robustness of Machine Translation Metrics: A Study of Twenty-Two Automatic Metrics in the WMT22 Metric Task
Xiaoyu Chen, Daimeng Wei, Hengchao Shang, Zongyao Li, Zhanglin Wu, Zhengzhe Yu, Ting Zhu, Mengli Zhu, Ning Xie, Lizhi Lei, Shimin Tao, Hao Yang, Ying Qin
16:00 - 17:30 MS-COMET: More and Better Human Judgements Improve Metric Performance
Tom Kocmi, Hitokazu Matsushita, Christian Federmann
16:00 - 17:30 Partial Could Be Better than Whole. HW-TSC 2022 Submission for the Metrics Shared Task
Yilun Liu, Xiaosong Qiao, Zhanglin Wu, Su Chang, Min Zhang, Yanqing Zhao, Song Peng, shimin tao, Hao Yang, Ying Qin, Jiaxin Guo, Minghan Wang, Yinglu Li, Peng Li, Xiaofeng Zhao
16:00 - 17:30 Unsupervised Embedding-based Metric for MT Evaluation with Improved Human Correlation
Ananya Mukherjee, Manish Shrivastava
16:00 - 17:30 REUSE: REference-free UnSupervised Quality Estimation Metric
Ananya Mukherjee, Manish Shrivastava
16:00 - 17:30 MaTESe: Machine Translation Evaluation as a Sequence Tagging Problem
Stefano Perrella, Lorenzo Proietti, Alessandro Scirè, Niccolò Campolungo, Roberto Navigli
16:00 - 17:30 COMET-22: Unbabel-IST 2022 Submission for the Metrics Shared Task
Ricardo Rei, José G. C. de Souza, Duarte Alves, Chrysoula Zerva, Ana C Farinha, Taisiya Glushkova, Alon Lavie, Luisa Coheur, André F. T. Martins
16:00 - 17:30 Alibaba-Translate China’s Submission for WMT2022 Metrics Shared Task
Yu Wan, Keqin Bao, Dayiheng Liu, Baosong Yang, Derek F. Wong, Lidia S. Chao, Wenqiang Lei, Jun Xie
16:00 - 17:30 Quality Estimation Task
16:00 - 17:30 Quality Estimation via Backtranslation at the WMT 2022 Quality Estimation Task
Sweta Agrawal, Nikita Mehandru, Niloufar Salehi, Marine Carpuat
16:00 - 17:30 Alibaba-Translate China’s Submission for WMT 2022 Quality Estimation Shared Task
Keqin Bao, Yu Wan, Dayiheng Liu, Baosong Yang, Wenqiang Lei, Xiangnan He, Derek F. Wong, Jun Xie
16:00 - 17:30 KU X Upstage’s Submission for the WMT22 Quality Estimation: Critical Error Detection Shared Task
Sugyeong Eo, Chanjun Park, Hyeonseok Moon, Jaehyung Seo, Heuiseok Lim
16:00 - 17:30 NJUNLP’s Participation for the WMT2022 Quality Estimation Shared Task
Xiang Geng, Yu Zhang, Shujian Huang, shimin tao, Hao Yang, Jiajun Chen
16:00 - 17:30 BJTU-Toshiba’s Submission to WMT22 Quality Estimation Shared Task
Hui Huang, Hui Di, Chunyou Li, Hanming Wu, Kazushige Ouchi, Yufeng Chen, Jian Liu, Jinan Xu
16:00 - 17:30 Papago’s Submission to the WMT22 Quality Estimation Shared Task
Seunghyun Lim, Jeonghyeok Park
16:00 - 17:30 CometKiwi: IST-Unbabel 2022 Submission for the Quality Estimation Shared Task
Ricardo Rei, Marcos Treviso, Nuno M. Guerreiro, Chrysoula Zerva, Ana C Farinha, Christine Maroti, José G. C. de Souza, Taisiya Glushkova, Duarte Alves, Luisa Coheur, Alon Lavie, André F. T. Martins
16:00 - 17:30 CrossQE: HW-TSC 2022 Submission for the Quality Estimation Shared Task
shimin tao, Su Chang, Ma Miaomiao, Hao Yang, Xiang Geng, Shujian Huang, Min Zhang, Jiaxin Guo, Minghan Wang, Yinglu Li
16:00 - 17:30 Welocalize-ARC/NKUA’s Submission to the WMT 2022 Quality Estimation Shared Task
Eirini Zafeiridou, Sokratis Sofianopoulos
16:00 - 17:30 Efficient Translation Task
16:00 - 17:30 Edinburgh’s Submission to the WMT 2022 Efficiency Task
Nikolay Bogoychev, Maximiliana Behnke, Jelmer van der Linde, Graeme Nail, Kenneth Heafield, Biao Zhang, Sidharth Kashyap
16:00 - 17:30 CUNI Non-Autoregressive System for the WMT 22 Efficient Translation Shared Task
Jindřich Helcl
16:00 - 17:30 The RoyalFlush System for the WMT 2022 Efficiency Task
Bo Qin, Aixin Jia, Qiang Wang, Jianning Lu, Shuqin Pan, Haibo Wang, Ming Chen
16:00 - 17:30 HW-TSC’s Submission for the WMT22 Efficiency Task
Hengchao Shang, Ting Hu, Daimeng Wei, Zongyao Li, Xianzhi Yu, Jianfei Feng, Ting Zhu, Lizhi Lei, Shimin Tao, Hao Yang, Ying Qin, Jinlong Yang, Zhiqiang Rao, Zhengzhe Yu
16:00 - 17:30 Automatic Post-Editing Task
16:00 - 17:30 IIT Bombay’s WMT22 Automatic Post-Editing Shared Task Submission
Sourabh Deoghare, Pushpak Bhattacharyya
16:00 - 17:30 LUL’s WMT22 Automatic Post-Editing Shared Task Submission
Xiaoying Huang, Xingrui Lou, Fan Zhang, Tu Mei
16:00 - 17:30 EMNLP Findings Papers
16:00 - 17:30 Translating Hanja Historical Documents to Contemporary Korean and English
Alice Oh, Kyunghyun Cho, JinYeong Bak, Haneul Yoo, Jiho Jin, Juhee Son
16:00 - 17:30 Data Selection Curriculum for Neural Machine Translation
Shafiq Joty, Shruti Bhosale, James Cross, Vishrav Chaudhary, Philipp Koehn, Tasnim Mohiuddin
16:00 - 17:30 Bitext Mining Using Distilled Sentence Representations for Low-Resource Languages
Holger Schwenk, Onur Çelebi, Kevin Heffernan
16:00 - 17:30 m^4 Adapter: Multilingual Multi-Domain Adaptation for Machine Translation
Alexander Fraser, Alexandra Chronopoulou, Wen Lai
16:00 - 17:30 What Do Compressed Multilingual Machine Translation Models Forget?
Laurent Besacier, James Henderson, Caroline Brun, Alexandre Berard, Vassilina Nikoulina, Alireza Mohammadshahi
16:00 - 17:30 Improving HowNet-Based Chinese Word Sense Disambiguation with Translations
Grzegorz Kondrak, Bradley Hauer, Xiang Zhang
16:00 - 17:30 Finding Memo: Extractive Memorization in Constrained Sequence Generation
Arul Menezes, Vikas Raunak
16:00 - 17:30 SALTED: A Framework for SAlient Long-tail Translation Error Detection
Arul Menezes, Matt Post, Vikas Raunak
16:00 - 17:30 Data Cartography for Low-Resource Neural Machine Translation
Marine Carpuat, Aquia Richburg
16:00 - 17:30 Improving Zero-Shot Multilingual Translation with Universal Representations
Yang Feng, Shuhao Gu
16:00 - 17:30 Guiding Neural Machine Translation with Semantic Kernels
Yuqiang Xie, Luxi Xing, Yunpeng Li, Yubing Ren, Xiangpeng Wei, Yue Hu, Ping Guo
16:00 - 17:30 Does Simultaneous Speech Translation need Simultaneous Models?
Marco Turchi, Matteo Negri, Marco Gaido, Sara Papi
16:00 - 17:30 Utilizing Language-Image Pretraining for Efficient and Robust Bilingual Word
Kangwook Lee, Dimitris Papailiopoulos, Junjie Hu, Yifei Ming, Timothy Ossowski, Shashank Rajput, Jy-yong Sohn, Tuan Dinh
16:00 - 17:30 Subword-Delimited Downsampling for Better Character-Level Translation
Lukas Edman, Antonio Toral, Gertjan van Noord
16:00 - 17:30 COMET-QE and Active Learning for Low-Resource Machine Translation
Everlyn Chimoto, Bruce Bassett

Day 2

   
09:00 - 10:30 Session 5: Shared Task Overview Papers I
09:00 - 09:10 Findings of the WMT 2022 Biomedical Translation Shared Task: Monolingual Clinical Case Reports
Mariana Neves, Antonio Jimeno Yepes, Amy Siu, Roland Roller, Philippe Thomas, Maika Vicente Navarro, Lana Yeganova, Dina Wiemann, Giorgio Maria Di Nunzio, Federica Vezzani, Christel Gerardin, Rachel Bawden, Darryl Johan Estrada, Salvador Lima-Lopez, Eulalia Farre-Maduel, Martin Krallinger, Cristian Grozea, Aurelie Neveol
09:10 - 09:20 Findings of the WMT 2022 Shared Task on Chat Translation
Ana C Farinha, M. Amin Farajian, Marianna Buchicchio, Patrick Fernandes, José G. C. de Souza, Helena Moniz, André F. T. Martins
09:20 - 09:35 Findings of the First WMT Shared Task on Sign Language Translation (WMT-SLT22)
Mathias Müller, Sarah Ebling, Eleftherios Avramidis, Alessia Battisti, Michèle Berger, Richard Bowden, Annelies Braffort, Necati Cihan Camgöz, Cristina España-Bonet, Roman Grundkiewicz, Zifan Jiang, Oscar Koller, Amit Moryossef, Regula Perrollaz, Sabine Reinhard, Annette Rios, Dimitar Shterionov, Sandra Sidler-Miserez, Katja Tissi, Davy Van Landuyt
09:35 - 09:50 Findings of the WMT’22 Shared Task on Large-Scale Machine Translation Evaluation for African Languages
David Adelani, Md Mahfuz Ibn Alam, Antonios Anastasopoulos, Akshita Bhagia, Marta R. Costa-jussà, Jesse Dodge, Fahim Faisal, Christian Federmann, Natalia Fedorova, Francisco Guzmán, Sergey Koshelev, Jean Maillard, Vukosi Marivate, Jonathan Mbuya, Alexandre Mourachko, Safiyyah Saleem, Holger Schwenk, Guillaume Wenzek
09:50 - 10:00 Findings of the WMT 2022 Shared Tasks in Unsupervised MT and Very Low Resource Supervised MT
Marion Weller-Di Marco, Alexander Fraser
10:00 - 10:10 Overview and Results of MixMT Shared-Task at WMT 2022
Vivek Srivastava, Mayank Singh
10:10 - 10:20 Findings of the Word-Level AutoCompletion Shared Task in WMT 2022
Francisco Casacuberta, George Foster, Guoping Huang, Philipp Koehn, Geza Kovacs, Lemao Liu, Shuming Shi, Taro Watanabe, Chengqing Zong
10:20 - 10:30 Findings of the WMT 2022 Shared Task on Translation Suggestion
Zhen Yang, Fandong Meng, Yingxue Zhang, Ernan Li, Jie Zhou
10:30 - 11:00 ☕️
11:00 - 12:40 Session 6: Research Papers on Practical Aspect of Machine Translation
11:00 - 11:20 Focused Concatenation for Context-Aware Neural Machine Translation
Lorenzo Lupo, Marco Dinarelli, Laurent Besacier
11:20 - 11:40 Does Sentence Segmentation Matter for Machine Translation?
Rachel Wicks, Matt Post
11:40 - 12:00 Revisiting Locality Sensitive Hashing for Vocabulary Selection in Fast Neural Machine Translation
Hieu Hoang, Marcin Junczys-Dowmunt, Roman Grundkiewicz, Huda Khayrallah
12:00 - 12:20 Too Brittle to Touch: Comparing the Stability of Quantization and Distillation towards Developing Low-Resource MT Models
Harshita Diddee, Sandipan Dandapat, Monojit Choudhury, Tanuja Ganu, Kalika Bali
12:20 - 12:40 Data Augmentation for Inline Tag-Aware Neural Machine Translation
Yonghyun Ryu, Yoonjung Choi, Sangha Kim
12:40 - 14:00 🍴
14:00 - 15:30 Session 7: Invited Talk
Speech Translation: When Two Superhuman Technologies Combined Fail
Ondrej Bojar
15:30 - 16:00 ☕️
16:00 - 17:30 Session 8: Shared Task System Description Posters II
16:00 - 17:30 Biomedical Translation Task
16:00 - 17:30 The SPECTRANS System Description for the WMT22 Biomedical Task
Nicolas Ballier, Jean-Baptiste Yunès, Guillaume Wisniewski, Lichao Zhu, Maria Zimina
16:00 - 17:30 SRT’s Neural Machine Translation System for WMT22 Biomedical Translation Task
Yoonjung Choi, jiho shin, Yonghyun Ryu, Sangha Kim
16:00 - 17:30 Examining Large Pre-Trained Language Models for Machine Translation: What You Don’t Know about It
Lifeng Han, Gleb Erofeev, Irina Sorokina, Serge Gladkoff, Goran Nenadic
16:00 - 17:30 Summer: WeChat Neural Machine Translation Systems for the WMT22 Biomedical Translation Task
Ernan Li, Fandong Meng, Jie Zhou
16:00 - 17:30 Optum’s Submission to WMT22 Biomedical Translation Tasks
Sahil Manchanda, Saurabh Bhagwat
16:00 - 17:30 Huawei BabelTar NMT at WMT22 Biomedical Translation Task: How We Further Improve Domain-specific NMT
Weixuan Wang, Xupeng Meng, Suqing Yan, Ye Tian, Wei Peng
16:00 - 17:30 HW-TSC Translation Systems for the WMT22 Biomedical Translation Task
Zhanglin Wu, Jinlong Yang, Zhiqiang Rao, Zhengzhe Yu, Daimeng Wei, Xiaoyu Chen, Zongyao Li, Hengchao Shang, Shaojun Li, Ming Zhu, Yuanchang Luo, Yuhao Xie, Miaomiao Ma, Ting Zhu, Lizhi Lei, Song Peng, Hao Yang, Ying Qin
16:00 - 17:30 Chat Translation Task
16:00 - 17:30 Unbabel-IST at the WMT Chat Translation Shared Task
João Alves, Pedro Henrique Martins, José G. C. de Souza, M. Amin Farajian, André F. T. Martins
16:00 - 17:30 Investigating Effectiveness of Multi-Encoder for Conversational Neural Machine Translation
Baban Gain, Ramakrishna Appicharla, Soumya Chennabasavaraj, Nikesh Garera, Asif Ekbal, Muthusamy Chelliah
16:00 - 17:30 BJTU-WeChat’s Systems for the WMT22 Chat Translation Task
Yunlong Liang, Fandong Meng, Jinan Xu, Yufeng Chen, Jie Zhou
16:00- 17:30 HW-TSC Translation Systems for the WMT22 Chat Translation Task
Jinlong Yang, Zongyao Li, Daimeng Wei, Hengchao Shang, Xiaoyu Chen, Zhengzhe Yu, Zhiqiang Rao, Shaojun Li, Zhanglin Wu, Yuhao Xie, YUanchang Luo, Ting Zhu, Yanqing Zhao, Lizhi Lei, Hao Yang, Ying Qin
16:00 - 17:30 Sign Language Translation Task
16:00 - 17:30 Clean Text and Full-Body Transformer: Microsoft’s Submission to the WMT22 Shared Task on Sign Language Translation
Subhadeep Dey, Abhilash Pal, Cyrine Chaabani, Oscar Koller
16:00 - 17:30 Spatio-temporal Sign Language Representation and Translation
Yasser Hamidullah, Josef van Genabith, Cristina España-Bonet
16:00 - 17:30 Experimental Machine Translation of the Swiss German Sign Language via 3D Augmentation of Body Keypoints
Lorenz Hufe, Eleftherios Avramidis
16:00 - 17:30 TTIC’s WMT-SLT 22 Sign Language Translation System
Bowen Shi, Diane Brentari, Gregory Shakhnarovich, Karen Livescu
16:00 - 17:30 Tackling Low-Resourced Sign Language Translation: UPC at WMT-SLT 22
Laia Tarres, Gerard I. Gállego, Xavier Giro-i-Nieto, Jordi Torres
16:00 - 17:30 African Languages Translation Task
16:00 - 17:30 Separating Grains from the Chaff: Using Data Filtering to Improve Multilingual Translation for Low-Resourced African Languages
Idris Abdulmumin, Michael Beukman, Jesujoba Alabi, Chris Chinenye Emezue, Everlyn Chimoto, Tosin Adewumi, Shamsuddeen Muhammad, Mofetoluwa Adeyemi, Oreen Yousuf, Sahib Singh, Tajuddeen Gwadabe
16:00 - 17:30 Language Adapters for Large-Scale MT: The GMU System for the WMT 2022 Large-Scale Machine Translation Evaluation for African Languages Shared Task
Md Mahfuz Ibn Alam, Antonios Anastasopoulos
16:00 - 17:30 Samsung Research Philippines - Datasaur AI’s Submission for the WMT22 Large Scale Multilingual Translation Task
Jan Christian Blaise Cruz, Lintang Sutawika
16:00 - 17:30 University of Cape Town’s WMT22 System: Multilingual Machine Translation for Southern African Languages
Khalid N. Elmadani, Francois Meyer, Jan Buys
16:00 - 17:30 Tencent’s Multilingual Machine Translation System for WMT22 Large-Scale African Languages
Wenxiang Jiao, Zhaopeng Tu, Jiarui Li, Wenxuan Wang, Jen-tse Huang, Shuming Shi
16:00 - 17:30 DENTRA: Denoising and Translation Pre-training for Multilingual Machine Translation
Samta Kamboj, Sunil Kumar Sahu, Neha Sengupta
16:00 - 17:30 The VolcTrans System for WMT22 Multilingual Machine Translation Task
Xian Qian, Kai Hu, Jiaqiang Wang, Yifeng Liu, Xingyuan Pan, Jun Cao, Mingxuan Wang
16:00 - 17:30 WebCrawl African : A Multilingual Parallel Corpora for African Languages
Pavanpankaj Vegi, Sivabhavani J, Biswajit Paul, Abhinav Mishra, Prashant Banjare, Prasanna Kumar K R, Chitra Viswanathan
16:00 - 17:30 ANVITA-African: A Multilingual Neural Machine Translation System for African Languages
Pavanpankaj Vegi, Sivabhavani J, Biswajit Paul, Prasanna Kumar K R, Chitra Viswanathan
16:00 - 17:30 Unsupervised and Very Low Resource Translation Task
16:00 - 17:30 HW-TSC Systems for WMT22 Very Low Resource Supervised MT Task
Shaojun Li, Yuanchang Luo, Daimeng Wei, Zongyao Li, Hengchao Shang, Xiaoyu Chen, Zhanglin Wu, Jinlong Yang, Zhiqiang Rao, Zhengzhe Yu, Yuhao Xie, Lizhi Lei, Hao Yang, Ying Qin
16:00 - 17:30 Unsupervised and Very-Low Resource Supervised Translation on German and Sorbian Variant Languages
Rahul Tangsali, Aditya Jagdish Vyawahare, Aditya Vyankatesh Mandke, Onkar Rupesh Litake, Dipali Dattatray Kadam
16:00 - 17:30 MUNI-NLP Systems for Lower Sorbian-German and Lower Sorbian-Upper Sorbian Machine Translation @ WMT22
Edoardo Signoroni, Pavel Rychlý
16:00 - 17:30 The AIC System for the WMT 2022 Unsupervised MT and Very Low Resource Supervised MT Task
Ahmad Shapiro, Mahmoud Tarek Salama, Omar Khaled Abdelhakim, Mohamed Essam Fayed, Ayman Khalafallah, Noha Adly
16:00 - 17:30 Code-Mixed Translation Task
16:00 - 17:30 NICT at MixMT 2022: Synthetic Code-Mixed Pre-training and Multi-way Fine-tuning for Hinglish–English Translation
Raj Dabre
16:00 - 17:30 Gui at MixMT 2022 : English-Hinglish : An MT Approach for Translation of Code Mixed Data
Akshat Gahoi, Jayant Duneja, Anshul Padhi, Shivam Mangale, Saransh Rajput, Tanvi Kamble, Dipti Misra Sharma, Vasudev Varma
16:00 - 17:30 MUCS@MixMT: IndicTrans-based Machine Translation for Hinglish Text
Asha Hegde, Shashirekha Hosahalli Lakshmaiah
16:00 - 17:30 SIT at MixMT 2022: Fluent Translation Built on Giant Pre-trained Models
Abdul Khan, Hrishikesh Dinkar Kanade, Girish Amar Budhrani, Preet Jhanglani, Jia Xu
16:00 - 17:30 The University of Edinburgh’s Submission to the WMT22 Code-Mixing Shared Task (MixMT)
Faheem Kirefu, Vivek Iyer, Pinzhen Chen, Laurie Burchell
16:00 - 17:30 CNLP-NITS-PP at MixMT 2022: Hinglish-English Code-Mixed Machine Translation
Sahinur Rahman Laskar, Rahul Singh, Shyambabu Pandey, Riyanka Manna, Partha Pakray, Sivaji Bandyopadhyay
16:00 - 17:30 Domain Curricula for Code-Switched MT at MixMT 2022
Lekan Raheem, Maab Elrashid, Melvin Johnson, Julia Kreutzer
16:00 - 17:30 Word-Level Autocompletion Task
16:00 - 17:30 Lingua Custodia’s Participation at the WMT 2022 Word-Level Auto-completion Shared Task
Melissa Ailem, Jingshu Liu, Jean-Gabriel Barthelemy, Raheel Qader
16:00 - 17:30 Translation Word-Level Auto-Completion: What Can We Achieve Out of the Box?
Yasmin Moslem, Rejwanul Haque, Andy Way
16:00 - 17:30 PRHLT’s Submission to WLAC 2022
Angel Navarro, Miguel Domingo, Francisco Casacuberta
16:00 - 17:30 IIGROUP Submissions for WMT22 Word-Level AutoCompletion Task
Cheng Yang, Siheng Li, Chufan Shi, Yujiu Yang
16:00 - 17:30 HW-TSC’s Submissions to the WMT22 Word-Level Auto Completion Task
Hao Yang, Hengchao Shang, Zongyao Li, Daimeng Wei, Xianghui He, Xiaoyu Chen, Zhengzhe Yu, Jiaxin Guo, Jinlong Yang, Shaojun Li, Yuanchang Luo, Yuhao Xie, Lizhi Lei, Ying Qin
16:00 - 17:30 Translation Suggestion Task
16:00 - 17:30 TSMind: Alibaba and Soochow University’s Submission to the WMT22 Translation Suggestion Task
Xin Ge, Ke Wang, Jiayi Wang, Nini Xiao, Xiangyu Duan, Yu Zhao, Yuqi Zhang
16:00 - 17:30 Transn’s Submissions to the WMT22 Translation Suggestion Task
Mao Hongbao, Zhang Wenbo, Cai Jie, Cheng Jianwei
16:00 - 17:30 Improved Data Augmentation for Translation Suggestion
Hongxiao Zhang, Siyu Lai, Songming Zhang, Hui Huang, Yufeng Chen, Jinan Xu, Jian Liu

Results

General task

Full results of the shared task: Findings of the 2022 Conference on Machine Translation (WMT22)

The winner systems were listed according to their average score and average z-score.

→ English

The results were determined with a monolingual direct assessment with document context.

Language pair System Average score Average z-score
Czech → Online-W 74.0 0.133
Japanese → DLUT 66.7 0.069
Russian → JDExploreAcademy 77.5 0.055
German → Lan-Bridge 68.8 0.004
Ukrainian → Lan-Bridge 73.5 0.048
Livonian → TartuNLP 67.7 0.024
Chinese → JDExploreAcademy 69.8 −0.026

English →

The results were determined with a bilingual direct assessment with scalar quality metric (SQM) in a full document. For English → Livonian, the results were determined with a bilingual direct assessment without document context.

Language pair System Average score Average z-score
→ Czech Online-W 90.9 0.279
→ Japanese NT5 84.1 0.103
→ Russian Online-W 87.3 0.222
→ German Online-B 93.6 0.106
→ Ukrainian Online-B 84.0 0.124
→ Livonian TAL-SJTU 46.2 0.215
→ Chinese Online-W 81.9 0.099
→ Croatian Online-B 92.0 0.232

Czech ↔︎ Ukrainian

The results were determined with a bilingual direct assessment with SQM in a full document.

Language pair System Average score Average z-score
Czech → Ukrainian Online-B 84.6 0.225
Ukrainian → Czech AMU 85.6 0.182

Yakut → Russian

The results were determined with a bilingual direct assessment with SQM in a full document.

System Average score Average z-score
Online-G 54.6 0.178

Want to learn more about WMT22?


Edit this article →

Machine Translate is created and edited by contributors like you!

Learn more about contributing →

Licensed under CC-BY-SA-4.0.

Cite this article →