WMT14
Workshop on Machine Translation
The Ninth Workshop on Machine Translation (WMT14) took place from 26 June to 27 June, 2014, in Baltimore, Maryland. It was organised by WMT.
Tasks
Schedule
Day 1
09:00 – 09:10 | Opening Remarks |
09:10 – 09:30 | Session 1: Shared Translation Tasks Efficient Elicitation of Annotations for Human Evaluation of Machine Translation Keisuke Sakaguchi, Matt Post, Benjamin Van Durme |
09:30 – 10:00 | Findings of the 2014 Workshop on Statistical Machine Translation Ondrej Bojar, Christian Buck, Christian Federmann, Barry Haddow, Philipp Koehn, Johannes Leveling, Christof Monz, Pavel Pecina, Matt Post, Herve Saint-Amand, Radu Soricut, Lucia Specia, Aleš Tamchyna |
10:00 - 10:30 | Panel Discussion (slides) |
10:30 – 11:00 | ☕️ |
11:00 - 12:30 | Session 2: Poster Session Shared Task: Translation |
Parallel FDA5 for Fast Deployment of Accurate Statistical Machine Translation Systems Ergun Bicici, Qun Liu, Andy Way | |
Yandex School of Data Analysis Russian-English Machine Translation System for WMT14 Alexey Borisov, Irina Galinskaya | |
CimS – The CIS and IMS joint submission to WMT 2014 translating from English into German Fabienne Cap, Marion Weller, Anita Ramm, Alexander Fraser | |
English-to-Hindi system description for WMT 2014: Deep Source-Context Features for Moses Marta R. Costa-jussà, Parth Gupta, Paolo Rosso, Rafael E. Banchs | |
The KIT-LIMSI Translation System for WMT 2014 Quoc Khanh Do, Teresa Herrmann, Jan Niehues, Alexander Allauzen, François Yvon, Alex Waibel | |
The IIT Bombay Hindi-English Translation System at WMT 2014 Piyush Dungarwal, Rajen Chatterjee, Abhijit Mishra, Anoop Kunchukuttan, Ritesh Shah, Pushpak Bhattacharyya | |
Edinburgh’s Phrase-based Machine Translation Systems for WMT-14 Nadir Durrani, Barry Haddow, Philipp Koehn, Kenneth Heafield | |
EU-BRIDGE MT: Combined Machine Translation Markus Freitag, Stephan Peitz, Joern Wuebker, Hermann Ney, Matthias Huck, Rico Sennrich, Nadir Durrani, Maria Nadejde, Philip Williams, Philipp Koehn, Teresa Herrmann, Eunah Cho, Alex Waibel | |
Phrasal: A Toolkit for New Directions in Statistical Machine Translation Spence Green, Daniel Cer, Christopher Manning | |
Anaphora Models and Reordering for Phrase-Based SMT Christian Hardmeier, Sara Stymne, Jörg Tiedemann, Aaron Smith, Joakim Nivre | |
The Karlsruhe Institute of Technology Translation Systems for the WMT 2014 Teresa Herrmann, Mohammed Mediani, Eunah Cho, Thanh-Le Ha, Jan Niehues, Isabel Slawik, Yuqi Zhang, Alex Waibel | |
The DCU-ICTCAS MT system at WMT 2014 on German-English Translation Task Liangyou Li, Xiaofeng Wu, Santiago Cortes Vaillo, Jun Xie, Andy Way, Qun Liu | |
The CMU Machine Translation Systems at WMT 2014 Austin Matthews, Waleed Ammar, Archna Bhatia, Weston Feely, Greg Hanneman, Eva Schlinger, Swabha Swayamdipta, Yulia Tsvetkov, Alon Lavie, Chris Dyer | |
Stanford University’s Submissions to the WMT 2014 Translation Task Julia Neidert, Sebastian Schuster, Spence Green, Kenneth Heafield, Christopher Manning | |
The RWTH Aachen German-English Machine Translation System for WMT 2014 Stephan Peitz, Joern Wuebker, Markus Freitag, Hermann Ney | |
Large-scale Exact Decoding: The IMS-TTT submission to WMT14 Daniel Quernheim, Fabienne Cap | |
Abu-MaTran at WMT 2014 Translation Task: Two-step Data Selection and RBMT-Style Synthetic Rules Raphael Rubino, Antonio Toral, Víctor M. Sánchez-Cartagena, Jorge Ferrández-Tordera, Sergio Ortiz Rojas, Gema Ramírez-Sánchez, Felipe Sánchez-Martínez, Andy Way | |
The UA-Prompsit hybrid machine translation system for the 2014 Workshop on Statistical Machine Translation Víctor M. Sánchez-Cartagena, Juan Antonio Pérez-Ortiz, Felipe Sánchez-Martínez | |
Machine Translation and Monolingual Postediting: The AFRL WMT-14 System Lane Schwartz, Timothy Anderson, Jeremy Gwinnup, Katherine Young | |
CUNI in WMT14: Chimera Still Awaits Bellerophon Aleš Tamchyna, Martin Popel, Rudolf Rosa, Ondrej Bojar | |
Manawi: Using Multi-Word Expressions and Named Entities to Improve Machine Translation Liling Tan, Santanu Pal | |
Edinburgh’s Syntax-Based Systems at WMT 2014 Philip Williams, Rico Sennrich, Maria Nadejde, Matthias Huck, Eva Hasler, Philipp Koehn | |
DCU-Lingo24 Participation in WMT 2014 Hindi-English Translation task Xiaofeng Wu, Rejwanul Haque, Tsuyoshi Okita, Piyush Arora, Andy Way, Qun Liu | |
11:00 - 12:30 | Shared Task: Medical Translation |
Machine Translation of Medical Texts in the Khresmoi Project Ondřej Dušek, Jan Hajič, Jaroslava Hlaváčová, Michal Novák, Pavel Pecina, Rudolf Rosa, Aleš Tamchyna, Zdeňka Urešová, Daniel Zeman | |
Postech’s System Description for Medical Text Translation Task Jianri Li, Se-Jong Kim, Hwidong Na, Jong-Hyeok Lee | |
Domain Adaptation for Medical Text Translation using Web Resources Yi Lu, Longyue Wang, Derek F. Wong, Lidia S. Chao, Yiming Wang | |
DCU Terminology Translation System for Medical Query Subtask at WMT14 Tsuyoshi Okita, Ali Vahid, Andy Way, Qun Liu | |
LIMSI @ WMT’14 Medical Translation Task Nicolas Pécheux, Li Gong, Quoc Khanh Do, Benjamin Marie, Yulia Ivanishcheva, Alexander Allauzen, Thomas Lavergne, Jan Niehues, Aurélien Max, François Yvon | |
Combining Domain Adaptation Approaches for Medical Text Translation Longyue Wang, Yi Lu, Derek F. Wong, Lidia S. Chao, Yiming Wang, Francisco Oliveira | |
Experiments in Medical Translation Shared Task at WMT 2014 Jian Zhang | |
12:30 – 14:00 | 🍴 |
14:00 - 15:30 | Session 3: Invited Talk Machine Translation in Academia and in the Commercial World – a Contrastive Perspective Alon Lavie |
15:30 – 16:00 | ☕️ |
16:00 – 16:20 | Session 4: Evaluation Chair: Christian Federmann Randomized Significance Tests in Machine Translation Yvette Graham, Nitika Mathur, Timothy Baldwin |
16:20 – 16:40 | Estimating Word Alignment Quality for SMT Reordering Tasks Sara Stymne, Jörg Tiedemann, Joakim Nivre |
16:40 – 17:00 | Dependency-based Automatic Enumeration of Semantically Equivalent Word Orders for Evaluating Japanese Translations Hideki Isozaki, Natsume Kouchi, Tsutomu Hirao |
Day 2
Results
Full results of the shared tasks: Findings of the 2014 Workshop on Statistical Machine Translation
News translation
The results were determined with a relative ranking through the TrueSkill model.
→ English
Language pair | System | Score |
---|---|---|
Czech → | ONLINE-B | 0.591 |
Russian → | AFRL-PE | 0.583 |
German → | ONLINE-B | 0.451 |
French → | UEDIN-PHRASE | 0.608 |
Hindi → | ONLINE-B | 1.326 |
English →
Language pair | System | Score |
---|---|---|
→ Czech | CU-DEPFIX | 0.371 |
→ Russian | PROMT-RULE | 0.575 |
→ German | UEDIN-SYNTAX | 0.264 |
→ French | ONLINE-B | 0.327 |
→ Hindi | ONLINE-B | 1.008 |