Link Search Menu Expand Document


Workshop on Machine Translation

The Eighth Workshop on Machine Translation (WMT13) took place from 8 August to 9 August, 2013, in Sofia, Bulgaria. It was organised by WMT.

Table of contents
  1. Tasks
  2. Schedule
    1. Day 1
    2. Day 2
  3. Results
    1. News translation
      1. → English
      2. English →



Day 1

09:00 – 09:10 Opening Remarks
09:10 – 10:10 Session 1: Shared Tasks and their Evaluation
Findings of the 2013 Workshop on Statistical Machine Translation
Ondřej Bojar, Christian Buck, Chris Callison-Burch, Christian Federmann, Barry Haddow, Philipp Koehn, Christof Monz, Matt Post, Radu Soricut, Lucia Specia
  Results of the WMT13 Metrics Shared Task
Matouš Macháček, Ondřej Bojar
10:10 – 10:30 The Feasibility of HMEANT as a Human MT Evaluation Metric
Alexandra Birch, Barry Haddow, Ulrich Germann, Maria Nadejde, Christian Buck, Philipp Koehn
10:30 – 11:00 ☕️
11:00 – 12:30 Session 2: Poster Session
Shared Task: Translation
Alexander Allauzen, Nicolas Pécheux, Quoc Khanh Do, Marco Dinarelli, Thomas Lavergne, Aurélien Max, Hai-Son Le, François Yvon
  The CMU Machine Translation Systems at WMT 2013: Syntax, Synthetic Translation Options, and Pseudo-References
Waleed Ammar, Victor Chahuneau, Michael Denkowski, Greg Hanneman, Wang Ling, Austin Matthews, Kenton Murray, Nicola Segall, Alon Lavie, Chris Dyer
  Feature Decay Algorithms for Fast Deployment of Accurate Statistical Machine Translation Systems
Ergun Bicici
  CUni Multilingual Matrix in the WMT 2013 Shared Task
Karel Bílek, Daniel Zeman
  Chimera – Three Heads for English-to-Czech Translation
Ondřej Bojar, Rudolf Rosa, Aleš Tamchyna
  Yandex School of Data Analysis Machine Translation Systems for WMT13
Alexey Borisov, Jacob Dlougach, Irina Galinskaya
  The Karlsruhe Institute of Technology Translation Systems for the WMT 2013
Eunah Cho, Thanh-Le Ha, Mohammed Mediani, Jan Niehues, Teresa Herrmann, Isabel Slawik, Alex Waibel
  TÜBITAK-BILGEM German-English Machine Translation Systems for W13
Ilknur Durgar El-Kahlout, Coşkun Mermer
  Edinburgh’s Machine Translation Systems for European Language Pairs
Nadir Durrani, Barry Haddow, Kenneth Heafield, Philipp Koehn
  Munich-Edinburgh-Stuttgart Submissions of OSM Systems at WMT13
Nadir Durrani, Alexander Fraser, Helmut Schmid, Hassan Sajjad, Richárd Farkas
  Towards Efficient Large-Scale Feature-Rich Statistical Machine Translation
Vladimir Eidelman, Ke Wu, Ferhan Ture, Philip Resnik, Jimmy Lin
  The TALP-UPC Phrase-Based Translation Systems for WMT13: System Combination with Morphology Generation, Domain Adaptation and Corpus Filtering
Lluís Formiga, Marta R. Costa-jussà, José B. Mariño, José A. R. Fonollosa, Alberto Barrón-Cedeño, Lluis Marquez
  PhraseFix: Statistical Post-Editing of TectoMT
Petra Galuščáková, Martin Popel, Ondřej Bojar
  Feature-Rich Phrase-based Translation: Stanford University’s Submission to the WMT 2013 Translation Task
Spence Green, Daniel Cer, Kevin Reschke, Rob Voigt, John Bauer, Sida Wang, Natalia Silveira, Julia Neidert, Christopher D. Manning
  Factored Machine Translation Systems for Russian-English
Stéphane Huet, Elena Manishina, Fabrice Lefèvre
  Omnifluent English-to-French and Russian-to-English Systems for the 2013 Workshop on Statistical Machine Translation
Evgeny Matusov, Gregor Leusch
  Pre-Reordering for Machine Translation Using Transition-Based Walks on Dependency Parse Trees
Antonio Valerio Miceli Barone, Giuseppe Attardi
  Edinburgh’s Syntax-Based Machine Translation Systems
Maria Nadejde, Philip Williams, Philipp Koehn
  Shallow Semantically-Informed PBSMT and HPBSMT
Tsuyoshi Okita, Qun Liu, Josef van Genabith
  Joint WMT 2013 Submission of the QUAERO Project
Stephan Peitz, Saab Mansour, Matthias Huck, Markus Freitag, Hermann Ney, Eunah Cho, Teresa Herrmann, Mohammed Mediani, Jan Niehues, Alex Waibel, Alexander Allauzen, Quoc Khanh Do, Bianka Buschbeck, Tonio Wandmacher
  The RWTH Aachen Machine Translation System for WMT 2013
Stephan Peitz, Saab Mansour, Jan-Thorsten Peter, Christoph Schmidt, Joern Wuebker, Matthias Huck, Markus Freitag, Hermann Ney
  The University of Cambridge Russian-English System at WMT13
Juan Pino, Aurelien Waite, Tong Xiao, Adrià de Gispert, Federico Flego, William Byrne
  Joshua 5.0: Sparser, Better, Faster, Server
Matt Post, Juri Ganitkevitch, Luke Orland, Jonathan Weese, Yuan Cao, Chris Callison-Burch
  The CNGL-DCU-Prompsit Translation Systems for WMT13
Raphael Rubino, Antonio Toral, Santiago Cortés Vaíllo, Jun Xie, Xiaofeng Wu, Stephen Doherty, Qun Liu
  QCRI-MES Submission at WMT13: Using Transliteration Mining to Improve Statistical Machine Translation
Hassan Sajjad, Svetlana Smekalova, Nadir Durrani, Alexander Fraser, Helmut Schmid
  Tunable Distortion Limits and Corpus Cleaning for SMT
Sara Stymne, Christian Hardmeier, Jörg Tiedemann, Joakim Nivre
  Munich-Edinburgh-Stuttgart Submissions at WMT13: Morphological and Syntactic Processing for SMT
Marion Weller, Max Kisselew, Svetlana Smekalova, Alexander Fraser, Helmut Schmid, Nadir Durrani, Hassan Sajjad, Richárd Farkas
12:30 – 14:00 🍴
14:00 – 15:10 Session 3: Invited Talk
[email protected]: Serving the multilingual needs of the European Commission
Andreas Eisele
15:10 – 15:30 Session 4: Quality Estimation
Coping with the Subjectivity of Human Judgements in MT Quality Estimation
Marco Turchi, Matteo Negri, Marcello Federico
15:30 – 16:00 ☕️
16:00 – 16:20 Session 5: Translation Models
Online Polylingual Topic Models for Fast Document Translation Detection
Kriste Krstovski, David A. Smith
16:20 – 16:40 Combining Bilingual and Comparable Corpora for Low Resource Machine Translation
Ann Irvine, Chris Callison-Burch
16:40 – 17:00 Generating English Determiners in Phrase-Based Translation with Synthetic Translation Options
Yulia Tsvetkov, Chris Dyer, Lori Levin, Archna Bhatia
17:00 – 17:20 Dramatically Reducing Training Data Size Through Vocabulary Saturation
William Lewis, Sauleh Eetemadi

Day 2

09:00 – 09:20 Session 6: Learning
Multi-Task Learning for Improved Discriminative Training in SMT
Patrick Simianer, Stefan Riezler
09:20 – 09:40 Online Learning Approaches in Computer Assisted Translation
Prashant Mathur, Cettolo Mauro, Marcello Federico
09:40 – 10:00 Length-Incremental Phrase Training for SMT
Joern Wuebker, Hermann Ney
10:00 – 10:20 Positive Diversity Tuning for Machine Translation System Combination
Daniel Cer, Christopher D. Manning, Dan Jurafsky
10:20 – 11:00 ☕️
11:00 – 12:30 Session 7: Poster Session
Shared Task: Quality Estimation
  Selecting Feature Sets for Comparative and Time-Oriented Quality Estimation of Machine Translation Output
Eleftherios Avramidis, Maja Popovic
  SHEF-Lite: When Less is More for Translation Quality Estimation
Daniel Beck, Kashif Shah, Trevor Cohn, Lucia Specia
  Referential Translation Machines for Quality Estimation
Ergun Bicici
  FBK-UEdin Participation to the WMT13 Quality Estimation Shared Task
José Guilherme Camargo de Souza, Christian Buck, Marco Turchi, Matteo Negri
  The TALP-UPC Approach to System Selection: Asiya Features and Pairwise Classification Using Random Forests
Lluís Formiga, Meritxell Gonzàlez, Alberto Barrón-Cedeño, José A. R. Fonollosa, Lluis Marquez
  Quality Estimation for Machine Translation Using the Joint Method of Evaluation Criteria and Statistical Modeling
Aaron Li-Feng Han, Yi Lu, Derek F. Wong, Lidia S. Chao, Liangye He, Junwen Xing
  MT Quality Estimation: The CMU System for WMT’13
Silja Hildebrand, Stephan Vogel
  LORIA System for the WMT13 Quality Estimation Shared Task
David Langlois, Kamel Smaili
  LIG System for WMT13 QE Task: Investigating the Usefulness of Features in Word Confidence Estimation for MT
Ngoc Quang Luong, Benjamin Lecouteux, Laurent Besacier
  DCU-Symantec at the WMT 2013 Quality Estimation Shared Task
Raphael Rubino, Joachim Wagner, Jennifer Foster, Johann Roturier, Rasoul Samad Zadeh Kaljahi, Fred Hollowood
  LIMSI Submission for the WMT’13 Quality Estimation Task: an Experiment with N-Gram Posteriors
Anil Kumar Singh, Guillaume Wisniewski, François Yvon
11:00 – 12:30 Shared Task: Evaluation
  Ranking Translations using Error Analysis and Quality Estimation
Mark Fishel
  Are ACT’s Scores Increasing with Better Translation Quality?
Najeh Hajlaoui
  A Description of Tunable Machine Translation Evaluation Systems in WMT13 Metrics Task
Aaron Li-Feng Han, Derek F. Wong, Lidia S. Chao, Yi Lu, Liangye He, Yiming Wang, Jiaji Zhou
  MEANT at WMT 2013: A Tunable, Accurate yet Inexpensive Semantic Frame Based MT Evaluation Metric
Chi-kiu Lo, Dekai Wu
  An Approach Using Style Classification Features for Quality Estimation
Erwan Moreau, Raphael Rubino
  DCU Participation in WMT2013 Metrics Task
Xiaofeng Wu, Hui Yu, Qun Liu
12:30 – 14:00 🍴
14:00 – 14:20 Session 8: Reordering and Hierarchical Models
Efficient Solutions for Word Reordering in German-English Phrase-Based Statistical Machine Translation
Arianna Bisazza, Marcello Federico
14:20 – 14:40 A Phrase Orientation Model for Hierarchical Machine Translation
Matthias Huck, Joern Wuebker, Felix Rietig, Hermann Ney
14:40 – 15:00 A Dependency-Constrained Hierarchical Model with Moses
Yvette Graham
15:00 – 15:20 Investigations in Exact Inference for Hierarchical Translation
Wilker Aziz, Marc Dymetman, Sriram Venkatapathy
15:20 – 16:00 ☕️
16:00 – 16:20 Session 9: Alignment and Word Translation Models
Evaluating (and Improving) Sentence Alignment under Noisy Conditions
Omar Zaidan, Vishal Chowdhary
16:20 – 16:40 Multi-Rate HMMs for Word Alignment
Elif Eyigöz, Daniel Gildea, Kemal Oflazer
16:40 – 17:00 Hidden Markov Tree Model for Word Alignment
Shuhei Kondo, Kevin Duh, Yuji Matsumoto
17:00 – 17:20 An MT Error-Driven Discriminative Word Lexicon using Sentence Structure Features
Jan Niehues, Alex Waibel


Full results of the shared tasks: Findings of the 2013 Workshop on Statistical Machine Translation

News translation

The results were determined with a relative ranking.

→ English

Language pair System Score
Czech → UEDIN-HEAFIELD 0.607
Spanish → UEDIN-HEAFIELD 0.624
German → ONLINE-B 0.660
Russian → ONLINE-B 0.657
French → UEDIN-HEAFIELD 0.638

English →

Language pair System Score
→ Czech CU-BOJAR 0.580
→ Spanish ONLINE-B 0.637
→ German ONLINE-B 0.637
→ Russian PROMT 0.641
→ French UEDIN 0.607

Edit this article →

Machine Translate is created and edited by contributors like you!

Learn more about contributing →

Licensed under CC-BY-SA-4.0.

Cite this article →