WMT09
Workshop on Machine Translation
The Fourth Workshop on Machine Translation (WMT09) took place from 30 March to 31 March, 2009, in Athens, Greece. It was organised by WMT.
Tasks
Schedule
Day 1
| 09:00 – 09:15 | Opening Remarks |
| Overview of the Shared Tasks | |
| 09:15 – 09:45 | Findings of the 2009 Workshop on Statistical Machine Translation Chris Callison-Burch, Philipp Koehn, Christof Monz, Josh Schroeder |
| 09:45 - 10:15 | Shared Task: Evaluation and System Combination Boaster Session |
| 10:15 - 11:30 | Poster Session: Shared Evaluation Task |
| Syntax-Oriented Evaluation Measures for Machine Translation Output Maja Popovic, Hermann Ney | |
| A Simple Automatic MT Evaluation Metric Petr Homola, Vladislav Kubon, Pavel Pecina | |
| Machine Translation Evaluation with Textual Entailment Features Sebastian Pado, Michel Galley, Daniel Jurafsky, Christopher D. Manning | |
| 10:15 - 11:30 | Poster Session: Shared System Combinations |
| Combining Multi-Engine Translations with Moses Yu Chen, Michael Jellinghaus, Andreas Eisele, Yi Zhang, Sabine Hunsicker, Silke Theison, Christian Federmann, Hans Uszkoreit | |
| CMU System Combination for WMT09 Almut Silja Hildebrand, Stephan Vogel | |
| The RWTH System Combination System for WMT 2009 Gregor Leusch, Evgeny Matusov, Hermann Ney | |
| Machine Translation System Combination with Flexible Word Ordering Kenneth Heafield, Greg Hanneman, Alon Lavie | |
| Incremental Hypothesis Alignment with Flexible Matching for Building Confusion Networks: BBN System Description for WMT09 System Combination Task Antti-Veikko Rosti, Bing Zhang, Spyros Matsoukas, Richard Schwartz | |
| 11:30 - 12:30 | Invited Talk Martin Kay |
| 12:30 - 14:00 | 🍴 |
| 14:00 - 14:30 | Panel Discussion |
| 14:30 - 15:30 | Shared Task: Translation Boaster Session |
| 15:30 - 17:30 | Poster Session |
| The RWTH Machine Translation System for WMT 2009 Maja Popovic, David Vilar, Daniel Stein, Evgeny Matusov, Hermann Ney | |
| Translation Combination using Factored Word Substitution Christian Federmann, Silke Theison, Andreas Eisele, Hans Uszkoreit, Yu Chen, Michael Jellinghaus, Sabine Hunsicker | |
| NUS at WMT09: Domain Adaptation Experiments for English-Spanish Machine Translation of News Commentary Text Preslav Nakov, Hwee Tou Ng | |
| The Universität Karlsruhe Translation System for the EACL-WMT 2009 Jan Niehues, Teresa Herrmann, Muntsin Kolss, Alex Waibel | |
| The TALP-UPC Phrase-Based Translation System for EACL-WMT 2009 José A. R. Fonollosa, Maxim Khalilov, Marta R. Costa-jussá, José B. Mariño, Carlos A. Henráquez Q., Adolfo Hernández H., Rafael E. Banchs | |
| Deep Linguistic Multilingual Translation and Bilingual Dictionaries Eric Wehrli, Luka Nerima, Yves Scherrer | |
| MATREX: The DCU MT System for WMT 2009 Jinhua Du, Yifan He, Sergio Penkale, Andy Way | |
| LIMSI’s Statistical Translation Systems for WMT09 Alexandre Allauzen, Josep Crego, Aurélien Max, François Yvon | |
| NICT@WMT09: Model Adaptation and Transliteration for Spanish-English SMT Michael Paul, Andrew Finch, Eiichiro Sumita | |
| Statistical Post Editing and Dictionary Extraction: Systran/Edinburgh submissions for ACL-WMT2009 Loïc Dugast, Jean Senellart, Philipp Koehn | |
| Experiments in Morphosyntactic Processing for Translating to and from German Alexander Fraser | |
| Improving Alignment for SMT by Reordering and Augmenting the Training Corpus Maria Holmqvist, Sara Stymne, Jody Foo, Lars Ahrenberg | |
| English-Czech MT in 2008 Ondřej Bojar, David Mareček, Václav Novák, Martin Popel, Jan Ptáček, Jan Rouš, Zdenek Zabokrtsky | |
| SMT and SPE Machine Translation Systems for WMT09 Holger Schwenk, Sadaf Abdul Rauf, Loic Barrault, Jean Senellart | |
| Joshua: An Open Source Toolkit for Parsing-Based Machine Translation Zhifei Li, Chris Callison-Burch, Chris Dyer, Sanjeev Khudanpur, Lane Schwartz, Wren Thornton, Jonathan Weese, Omar Zaidan | |
| An Improved Statistical Transfer System for French-English Machine Translation Greg Hanneman, Vamshi Ambati, Jonathan H. Clark, Alok Parlikar, Alon Lavie | |
| The University of Maryland Statistical Machine Translation System for the Fourth Workshop on Machine Translation Chris Dyer, Hendra Setiawan, Yuval Marton, Philip Resnik | |
| Toward Using Morphology in French-English Phrase-Based SMT Marine Carpuat | |
| MorphoLogic’s Submission for the WMT 2009 Shared Task Attila Novák | |
| Edinburgh’s Submission to all Tracks of the WMT2009 Shared Task with Reordering and Speed Improvements to Moses Philipp Koehn, Barry Haddow |
Day 2
| 09:00 – 09:30 | Full Papers Session 1: Use of training data Mining a Comparable Text Corpus for a Vietnamese-French Statistical Machine Translation System Thi Ngoc Diep Do, Viet Bac Le, Brigitte Bigi, Laurent Besacier, Eric Castelli |
| 09:30 – 10:00 | Improving Arabic-Chinese Statistical Machine Translation using English as Pivot Language Nizar Habash, Jun Hu |
| 10:00 – 10:30 | Domain Adaptation for Statistical Machine Translation with Monolingual Resources Nicola Bertoldi, Marcello Federico |
| 10:30 - 11:00 | ☕️ |
| 11:00 – 11:30 | Full Papers Session 2: Reordering Chinese Syntactic Reordering for Adequate Generation of Korean Verbal Phrases in Chinese-to-Korean SMT Jin-Ji Li, Jungi Kim, Dong-Il Kim, Jong-Hyeok Lee |
| 11:30 – 12:00 | A Quantitative Analysis of Reordering Phenomena Alexandra Birch, Phil Blunsom, Miles Osborne |
| 12:00 – 12:30 | A POS-Based Model for Long-Range Reorderings in SMT Jan Niehues, Muntsin Kolss |
| 12:30 - 14:30 | 🍴 |
| 14:30 – 15:00 | Full Papers Session 3: Linguistic modeling Disambiguating “DE” for Chinese-English Machine Translation Pi-Chuan Chang, Daniel Jurafsky, Christopher D. Manning |
| 15:00 – 15:30 | A Systematic Analysis of Translation Model Search Spaces Michael Auli, Adam Lopez, Hieu Hoang, Philipp Koehn |
| 15:30 – 16:00 | A Deep Learning Approach to Machine Transliteration Thomas Deselaers, Saša Hasan, Oliver Bender, Hermann Ney |
| 16:00 - 16:30 | ☕️ |
| 16:30 – 17:00 | Full Papers Session 4: Error metrics and tuning Stabilizing Minimum Error Rate Training George Foster, Roland Kuhn |
| 17:00 – 17:30 | On the Robustness of Syntactic and Semantic Features for Automatic MT Evaluation Jesús Giménez, Lluís Màrquez |
| 17:30 – 18:00 | Fluency, Adequacy, or HTER? Exploring Different Human Judgments with a Tunable MT Metric Matthew Snover, Nitin Madnani, Bonnie Dorr, Richard Schwartz |
Results
Full results of the shared tasks: Findings of the 2009 Workshop on Statistical Machine Translation
News translation
The results were determined with a relative ranking, the ≥ others (“greater than or equal to others”) score.
It measures how often a system was judged to be better than or equal to any other system.
→ English
| Language pair | System | ≥ others |
|---|---|---|
| French → | GOOGLE DCU LIMSI JHU UEDIN CMU-STATXFER RWTH | 0.76 0.66 0.65 0.62 0.61 0.58 0.52 |
| German → | USAAR GOOGLE RBMT2 STUTTGART SYSTRAN UEDIN UKA UMD LIU | 0.65 0.65 0.64 0.61 0.60 0.59 0.58 0.56 0.50 |
| Spanish → | GOOGLE TALP-UPC UEDIN RBMT1 RBMT3 RBMT5 RBMT4 RWTH | 0.70 0.59 0.56 0.55 0.55 0.55 0.53 0.51 |
| Czech → | GOOGLE UEDIN CU-BOJAR | 0.75 0.57 0.51 |
| Hungarian → | MORPHO UMD | 0.75 0.66 |
English →
| Language pair | System | ≥ others |
|---|---|---|
| → French | LIUM-SYSTRAN GOOGLE UKA SYSTRAN RBMT3 DCU LIMSI UEDIN | 0.73 0.68 0.66 0.65 0.65 0.65 0.64 0.60 |
| → German | RBMT2 RBMT3 RBMT5 UKA UEDIN LIU RWTH | 0.66 0.64 0.64 0.54 0.51 0.49 0.48 |
| → Spanish | RBMT3 UEDIN GOOGLE RBMT5 NUS | 0.66 0.66 0.65 0.64 0.59 |
| → Czech | PCTRANS EUROTRANXP CU-BOJAR | 0.67 0.67 0.61 |