WMT09
Workshop on Machine Translation
Location
- Athens, Greece
Links
Shared Tasks
Schedule
Day 1
| 9:00 | Opening Remarks |
| Overview of the Shared Tasks | |
| 9:15 | Findings of the 2009 Workshop on Statistical Machine Translation Chris Callison-Burch, Philipp Koehn, Christof Monz, Josh Schroeder |
| 9:45 | Shared Task: Evaluation and System Combination Boaster Session |
| 10:15 | Poster Session: Shared Evaluation Task |
| Syntax-Oriented Evaluation Measures for Machine Translation Output Maja Popovic, Hermann Ney | |
| A Simple Automatic MT Evaluation Metric Petr Homola, Vladislav Kubon, Pavel Pecina | |
| Machine Translation Evaluation with Textual Entailment Features Sebastian Pado, Michel Galley, Daniel Jurafsky, Christopher D. Manning | |
| 10:15 | Poster Session: Shared System Combinations |
| Combining Multi-Engine Translations with Moses Yu Chen, Michael Jellinghaus, Andreas Eisele, Yi Zhang, Sabine Hunsicker, Silke Theison, Christian Federmann, Hans Uszkoreit | |
| CMU System Combination for WMT09 Almut Silja Hildebrand, Stephan Vogel | |
| The RWTH System Combination System for WMT 2009 Gregor Leusch, Evgeny Matusov, Hermann Ney | |
| Machine Translation System Combination with Flexible Word Ordering Kenneth Heafield, Greg Hanneman, Alon Lavie | |
| Incremental Hypothesis Alignment with Flexible Matching for Building Confusion Networks: BBN System Description for WMT09 System Combination Task Antti-Veikko Rosti, Bing Zhang, Spyros Matsoukas, Richard Schwartz | |
| 11:30 | Invited Talk Martin Kay |
| 12:30 | 🍴 |
| 14:00 | Panel Discussion |
| 14:30 | Shared Task: Translation Boaster Session |
| 15:30 | Poster Session |
| The RWTH Machine Translation System for WMT 2009 Maja Popovic, David Vilar, Daniel Stein, Evgeny Matusov, Hermann Ney | |
| Translation Combination using Factored Word Substitution Christian Federmann, Silke Theison, Andreas Eisele, Hans Uszkoreit, Yu Chen, Michael Jellinghaus, Sabine Hunsicker | |
| NUS at WMT09: Domain Adaptation Experiments for English-Spanish Machine Translation of News Commentary Text Preslav Nakov, Hwee Tou Ng | |
| The Universität Karlsruhe Translation System for the EACL-WMT 2009 Jan Niehues, Teresa Herrmann, Muntsin Kolss, Alex Waibel | |
| The TALP-UPC Phrase-Based Translation System for EACL-WMT 2009 José A. R. Fonollosa, Maxim Khalilov, Marta R. Costa-jussá, José B. Mariño, Carlos A. Henráquez Q., Adolfo Hernández H., Rafael E. Banchs | |
| Deep Linguistic Multilingual Translation and Bilingual Dictionaries Eric Wehrli, Luka Nerima, Yves Scherrer | |
| MATREX: The DCU MT System for WMT 2009 Jinhua Du, Yifan He, Sergio Penkale, Andy Way | |
| LIMSI’s Statistical Translation Systems for WMT09 Alexandre Allauzen, Josep Crego, Aurélien Max, François Yvon | |
| NICT@WMT09: Model Adaptation and Transliteration for Spanish-English SMT Michael Paul, Andrew Finch, Eiichiro Sumita | |
| Statistical Post Editing and Dictionary Extraction: Systran/Edinburgh submissions for ACL-WMT2009 Loïc Dugast, Jean Senellart, Philipp Koehn | |
| Experiments in Morphosyntactic Processing for Translating to and from German Alexander Fraser | |
| Improving Alignment for SMT by Reordering and Augmenting the Training Corpus Maria Holmqvist, Sara Stymne, Jody Foo, Lars Ahrenberg | |
| English-Czech MT in 2008 Ondřej Bojar, David Mareček, Václav Novák, Martin Popel, Jan Ptáček, Jan Rouš, Zdenek Zabokrtsky | |
| SMT and SPE Machine Translation Systems for WMT09 Holger Schwenk, Sadaf Abdul Rauf, Loic Barrault, Jean Senellart | |
| Joshua: An Open Source Toolkit for Parsing-Based Machine Translation Zhifei Li, Chris Callison-Burch, Chris Dyer, Sanjeev Khudanpur, Lane Schwartz, Wren Thornton, Jonathan Weese, Omar Zaidan | |
| An Improved Statistical Transfer System for French-English Machine Translation Greg Hanneman, Vamshi Ambati, Jonathan H. Clark, Alok Parlikar, Alon Lavie | |
| The University of Maryland Statistical Machine Translation System for the Fourth Workshop on Machine Translation Chris Dyer, Hendra Setiawan, Yuval Marton, Philip Resnik | |
| Toward Using Morphology in French-English Phrase-Based SMT Marine Carpuat | |
| MorphoLogic’s Submission for the WMT 2009 Shared Task Attila Novák | |
| Edinburgh’s Submission to all Tracks of the WMT2009 Shared Task with Reordering and Speed Improvements to Moses Philipp Koehn, Barry Haddow |
Day 2
Results
General Task
Full results of the shared task: Findings of the 2009 Workshop on Statistical Machine Translation
News translation
The results were determined with a relative ranking, the ≥ others (“greater than or equal to others”) score.
It measures how often a system was judged to be better than or equal to any other system.
→ English
| Language pair | System | ≥ others |
|---|---|---|
| French → | GOOGLE DCU LIMSI JHU UEDIN CMU-STATXFER RWTH | 0.76 0.66 0.65 0.62 0.61 0.58 0.52 |
| German → | USAAR GOOGLE RBMT2 STUTTGART SYSTRAN UEDIN UKA UMD LIU | 0.65 0.65 0.64 0.61 0.60 0.59 0.58 0.56 0.50 |
| Spanish → | GOOGLE TALP-UPC UEDIN RBMT1 RBMT3 RBMT5 RBMT4 RWTH | 0.70 0.59 0.56 0.55 0.55 0.55 0.53 0.51 |
| Czech → | GOOGLE UEDIN CU-BOJAR | 0.75 0.57 0.51 |
| Hungarian → | MORPHO UMD | 0.75 0.66 |
English →
| Language pair | System | ≥ others |
|---|---|---|
| → French | LIUM-SYSTRAN GOOGLE UKA SYSTRAN RBMT3 DCU LIMSI UEDIN | 0.73 0.68 0.66 0.65 0.65 0.65 0.64 0.60 |
| → German | RBMT2 RBMT3 RBMT5 UKA UEDIN LIU RWTH | 0.66 0.64 0.64 0.54 0.51 0.49 0.48 |
| → Spanish | RBMT3 UEDIN GOOGLE RBMT5 NUS | 0.66 0.66 0.65 0.64 0.59 |
| → Czech | PCTRANS EUROTRANXP CU-BOJAR | 0.67 0.67 0.61 |