Link Search Menu Expand Document

WMT09

Workshop on Machine Translation


The Fourth Workshop on Machine Translation (WMT09) took place from 30 March to 31 March, 2009, in Athens, Greece.

statmt.org/wmt09/program.html

Table of contents
  1. Tasks
  2. Schedule
    1. Day 1
    2. Day 2
  3. Results
    1. News translation
      1. → English
      2. English →

Tasks

Schedule

Day 1

   
09:00 – 09:15 Opening Remarks
  Overview of the Shared Tasks
09:15 – 09:45 Findings of the 2009 Workshop on Statistical Machine Translation
Chris Callison-Burch, Philipp Koehn, Christof Monz, Josh Schroeder
09:45 - 10:15 Shared Task: Evaluation and System Combination
Boaster Session
10:15 - 11:30 Poster Session: Shared Evaluation Task
  Syntax-Oriented Evaluation Measures for Machine Translation Output
Maja Popovic, Hermann Ney
  A Simple Automatic MT Evaluation Metric
Petr Homola, Vladislav Kubon, Pavel Pecina
  Machine Translation Evaluation with Textual Entailment Features
Sebastian Pado, Michel Galley, Daniel Jurafsky, Christopher D. Manning
10:15 - 11:30 Poster Session: Shared System Combinations
  Combining Multi-Engine Translations with Moses
Yu Chen, Michael Jellinghaus, Andreas Eisele, Yi Zhang, Sabine Hunsicker, Silke Theison, Christian Federmann, Hans Uszkoreit
  CMU System Combination for WMT09
Almut Silja Hildebrand, Stephan Vogel
  The RWTH System Combination System for WMT 2009
Gregor Leusch, Evgeny Matusov, Hermann Ney
  Machine Translation System Combination with Flexible Word Ordering
Kenneth Heafield, Greg Hanneman, Alon Lavie
  Incremental Hypothesis Alignment with Flexible Matching for Building Confusion Networks: BBN System Description for WMT09 System Combination Task
Antti-Veikko Rosti, Bing Zhang, Spyros Matsoukas, Richard Schwartz
11:30 - 12:30 Invited Talk
Martin Kay
12:30 - 14:00 🍴
14:00 - 14:30 Panel Discussion
14:30 - 15:30 Shared Task: Translation
Boaster Session
15:30 - 17:30 Poster Session
  The RWTH Machine Translation System for WMT 2009
Maja Popovic, David Vilar, Daniel Stein, Evgeny Matusov, Hermann Ney
  Translation Combination using Factored Word Substitution
Christian Federmann, Silke Theison, Andreas Eisele, Hans Uszkoreit, Yu Chen, Michael Jellinghaus, Sabine Hunsicker
  NUS at WMT09: Domain Adaptation Experiments for English-Spanish Machine Translation of News Commentary Text
Preslav Nakov, Hwee Tou Ng
  The Universität Karlsruhe Translation System for the EACL-WMT 2009
Jan Niehues, Teresa Herrmann, Muntsin Kolss, Alex Waibel
  The TALP-UPC Phrase-Based Translation System for EACL-WMT 2009
José A. R. Fonollosa, Maxim Khalilov, Marta R. Costa-jussá, José B. Mariño, Carlos A. Henráquez Q., Adolfo Hernández H., Rafael E. Banchs
  Deep Linguistic Multilingual Translation and Bilingual Dictionaries
Eric Wehrli, Luka Nerima, Yves Scherrer
  MATREX: The DCU MT System for WMT 2009
Jinhua Du, Yifan He, Sergio Penkale, Andy Way
  LIMSI’s Statistical Translation Systems for WMT09
Alexandre Allauzen, Josep Crego, Aurélien Max, François Yvon
  [email protected]: Model Adaptation and Transliteration for Spanish-English SMT
Michael Paul, Andrew Finch, Eiichiro Sumita
  Statistical Post Editing and Dictionary Extraction: Systran/Edinburgh submissions for ACL-WMT2009
Loïc Dugast, Jean Senellart, Philipp Koehn
  Experiments in Morphosyntactic Processing for Translating to and from German
Alexander Fraser
  Improving Alignment for SMT by Reordering and Augmenting the Training Corpus
Maria Holmqvist, Sara Stymne, Jody Foo, Lars Ahrenberg
  English-Czech MT in 2008
Ondřej Bojar, David Mareček, Václav Novák, Martin Popel, Jan Ptáček, Jan Rouš, Zdenek Zabokrtsky
  SMT and SPE Machine Translation Systems for WMT09
Holger Schwenk, Sadaf Abdul Rauf, Loic Barrault, Jean Senellart
  Joshua: An Open Source Toolkit for Parsing-Based Machine Translation
Zhifei Li, Chris Callison-Burch, Chris Dyer, Sanjeev Khudanpur, Lane Schwartz, Wren Thornton, Jonathan Weese, Omar Zaidan
  An Improved Statistical Transfer System for French-English Machine Translation
Greg Hanneman, Vamshi Ambati, Jonathan H. Clark, Alok Parlikar, Alon Lavie
  The University of Maryland Statistical Machine Translation System for the Fourth Workshop on Machine Translation
Chris Dyer, Hendra Setiawan, Yuval Marton, Philip Resnik
  Toward Using Morphology in French-English Phrase-Based SMT
Marine Carpuat
  MorphoLogic’s Submission for the WMT 2009 Shared Task
Attila Novák
  Edinburgh’s Submission to all Tracks of the WMT2009 Shared Task with Reordering and Speed Improvements to Moses
Philipp Koehn, Barry Haddow

Day 2

   
09:00 – 09:30 Full Papers Session 1: Use of training data
Mining a Comparable Text Corpus for a Vietnamese-French Statistical Machine Translation System
Thi Ngoc Diep Do, Viet Bac Le, Brigitte Bigi, Laurent Besacier, Eric Castelli
09:30 – 10:00 Improving Arabic-Chinese Statistical Machine Translation using English as Pivot Language
Nizar Habash, Jun Hu
10:00 – 10:30 Domain Adaptation for Statistical Machine Translation with Monolingual Resources
Nicola Bertoldi, Marcello Federico
10:30 - 11:00 ☕️
11:00 – 11:30 Full Papers Session 2: Reordering
Chinese Syntactic Reordering for Adequate Generation of Korean Verbal Phrases in Chinese-to-Korean SMT
Jin-Ji Li, Jungi Kim, Dong-Il Kim, Jong-Hyeok Lee
11:30 – 12:00 A Quantitative Analysis of Reordering Phenomena
Alexandra Birch, Phil Blunsom, Miles Osborne
12:00 – 12:30 A POS-Based Model for Long-Range Reorderings in SMT
Jan Niehues, Muntsin Kolss
12:30 - 14:30 🍴
14:30 – 15:00 Full Papers Session 3: Linguistic modeling
Disambiguating “DE” for Chinese-English Machine Translation
Pi-Chuan Chang, Daniel Jurafsky, Christopher D. Manning
15:00 – 15:30 A Systematic Analysis of Translation Model Search Spaces
Michael Auli, Adam Lopez, Hieu Hoang, Philipp Koehn
15:30 – 16:00 A Deep Learning Approach to Machine Transliteration
Thomas Deselaers, Saša Hasan, Oliver Bender, Hermann Ney
16:00 - 16:30 ☕️
16:30 – 17:00 Full Papers Session 4: Error metrics and tuning
Stabilizing Minimum Error Rate Training
George Foster, Roland Kuhn
17:00 – 17:30 On the Robustness of Syntactic and Semantic Features for Automatic MT Evaluation
Jesús Giménez, Lluís Màrquez
17:30 – 18:00 Fluency, Adequacy, or HTER? Exploring Different Human Judgments with a Tunable MT Metric
Matthew Snover, Nitin Madnani, Bonnie Dorr, Richard Schwartz

Results

Full results of the shared tasks: Findings of the 2009 Workshop on Statistical Machine Translation

News translation

The results were determined with a relative ranking, the ≥ others (“greater than or equal to others”) score.

It measures how often a system was judged to be better than or equal to any other system.

→ English

Language pair System ≥ others
French → GOOGLE
DCU
LIMSI
JHU
UEDIN
CMU-STATXFER
RWTH
0.76
0.66
0.65
0.62
0.61
0.58
0.52
German → USAAR
GOOGLE
RBMT2
STUTTGART
SYSTRAN
UEDIN
UKA
UMD
LIU
0.65
0.65
0.64
0.61
0.60
0.59
0.58
0.56
0.50
Spanish → GOOGLE
TALP-UPC
UEDIN
RBMT1
RBMT3
RBMT5
RBMT4
RWTH
0.70
0.59
0.56
0.55
0.55
0.55
0.53
0.51
Czech → GOOGLE
UEDIN
CU-BOJAR
0.75
0.57
0.51
Hungarian → MORPHO
UMD
0.75
0.66

English →

Language pair System ≥ others
→ French LIUM-SYSTRAN
GOOGLE
UKA
SYSTRAN
RBMT3
DCU
LIMSI
UEDIN
0.73
0.68
0.66
0.65
0.65
0.65
0.64
0.60
→ German RBMT2
RBMT3
RBMT5
UKA
UEDIN
LIU
RWTH
0.66
0.64
0.64
0.54
0.51
0.49
0.48
→ Spanish RBMT3
UEDIN
GOOGLE
RBMT5
NUS
0.66
0.66
0.65
0.64
0.59
→ Czech PCTRANS
EUROTRANXP
CU-BOJAR
0.67
0.67
0.61

Edit this article →

Machine Translate is created and edited by contributors like you!

Learn more about contributing →

Licensed under CC-BY-SA-4.0.

Cite this article →