WMT13

Workshop on Machine Translation

---

Location

• Sofia, Bulgaria

Links

• statmt.org/wmt13/program.html

Shared Tasks

• Translation
• Metrics
• Quality estimation

Schedule

Day 1

9:00	Opening Remarks
9:10	Session 1: Shared Tasks and their Evaluation Findings of the 2013 Workshop on Statistical Machine Translation Ondřej Bojar, Christian Buck, Chris Callison-Burch, Christian Federmann, Barry Haddow, Philipp Koehn, Christof Monz, Matt Post, Radu Soricut, Lucia Specia
	Results of the WMT13 Metrics Shared Task Matouš Macháček, Ondřej Bojar
10:10	The Feasibility of HMEANT as a Human MT Evaluation Metric Alexandra Birch, Barry Haddow, Ulrich Germann, Maria Nadejde, Christian Buck, Philipp Koehn
10:30	☕️
11:00	Session 2: Poster Session Shared Task: Translation
	LIMSI @ WMT13 Alexander Allauzen, Nicolas Pécheux, Quoc Khanh Do, Marco Dinarelli, Thomas Lavergne, Aurélien Max, Hai-Son Le, François Yvon
	The CMU Machine Translation Systems at WMT 2013: Syntax, Synthetic Translation Options, and Pseudo-References Waleed Ammar, Victor Chahuneau, Michael Denkowski, Greg Hanneman, Wang Ling, Austin Matthews, Kenton Murray, Nicola Segall, Alon Lavie, Chris Dyer
	Feature Decay Algorithms for Fast Deployment of Accurate Statistical Machine Translation Systems Ergun Bicici
	CUni Multilingual Matrix in the WMT 2013 Shared Task Karel Bílek, Daniel Zeman
	Chimera – Three Heads for English-to-Czech Translation Ondřej Bojar, Rudolf Rosa, Aleš Tamchyna
	Yandex School of Data Analysis Machine Translation Systems for WMT13 Alexey Borisov, Jacob Dlougach, Irina Galinskaya
	The Karlsruhe Institute of Technology Translation Systems for the WMT 2013 Eunah Cho, Thanh-Le Ha, Mohammed Mediani, Jan Niehues, Teresa Herrmann, Isabel Slawik, Alex Waibel
	TÜBITAK-BILGEM German-English Machine Translation Systems for W13 Ilknur Durgar El-Kahlout, Coşkun Mermer
	Edinburgh’s Machine Translation Systems for European Language Pairs Nadir Durrani, Barry Haddow, Kenneth Heafield, Philipp Koehn
	Munich-Edinburgh-Stuttgart Submissions of OSM Systems at WMT13 Nadir Durrani, Alexander Fraser, Helmut Schmid, Hassan Sajjad, Richárd Farkas
	Towards Efficient Large-Scale Feature-Rich Statistical Machine Translation Vladimir Eidelman, Ke Wu, Ferhan Ture, Philip Resnik, Jimmy Lin
	The TALP-UPC Phrase-Based Translation Systems for WMT13: System Combination with Morphology Generation, Domain Adaptation and Corpus Filtering Lluís Formiga, Marta R. Costa-jussà, José B. Mariño, José A. R. Fonollosa, Alberto Barrón-Cedeño, Lluis Marquez
	PhraseFix: Statistical Post-Editing of TectoMT Petra Galuščáková, Martin Popel, Ondřej Bojar
	Feature-Rich Phrase-based Translation: Stanford University’s Submission to the WMT 2013 Translation Task Spence Green, Daniel Cer, Kevin Reschke, Rob Voigt, John Bauer, Sida Wang, Natalia Silveira, Julia Neidert, Christopher D. Manning
	Factored Machine Translation Systems for Russian-English Stéphane Huet, Elena Manishina, Fabrice Lefèvre
	Omnifluent English-to-French and Russian-to-English Systems for the 2013 Workshop on Statistical Machine Translation Evgeny Matusov, Gregor Leusch
	Pre-Reordering for Machine Translation Using Transition-Based Walks on Dependency Parse Trees Antonio Valerio Miceli Barone, Giuseppe Attardi
	Edinburgh’s Syntax-Based Machine Translation Systems Maria Nadejde, Philip Williams, Philipp Koehn
	Shallow Semantically-Informed PBSMT and HPBSMT Tsuyoshi Okita, Qun Liu, Josef van Genabith
	Joint WMT 2013 Submission of the QUAERO Project Stephan Peitz, Saab Mansour, Matthias Huck, Markus Freitag, Hermann Ney, Eunah Cho, Teresa Herrmann, Mohammed Mediani, Jan Niehues, Alex Waibel, Alexander Allauzen, Quoc Khanh Do, Bianka Buschbeck, Tonio Wandmacher
	The RWTH Aachen Machine Translation System for WMT 2013 Stephan Peitz, Saab Mansour, Jan-Thorsten Peter, Christoph Schmidt, Joern Wuebker, Matthias Huck, Markus Freitag, Hermann Ney
	The University of Cambridge Russian-English System at WMT13 Juan Pino, Aurelien Waite, Tong Xiao, Adrià de Gispert, Federico Flego, William Byrne
	Joshua 5.0: Sparser, Better, Faster, Server Matt Post, Juri Ganitkevitch, Luke Orland, Jonathan Weese, Yuan Cao, Chris Callison-Burch
	The CNGL-DCU-Prompsit Translation Systems for WMT13 Raphael Rubino, Antonio Toral, Santiago Cortés Vaíllo, Jun Xie, Xiaofeng Wu, Stephen Doherty, Qun Liu
	QCRI-MES Submission at WMT13: Using Transliteration Mining to Improve Statistical Machine Translation Hassan Sajjad, Svetlana Smekalova, Nadir Durrani, Alexander Fraser, Helmut Schmid
	Tunable Distortion Limits and Corpus Cleaning for SMT Sara Stymne, Christian Hardmeier, Jörg Tiedemann, Joakim Nivre
	Munich-Edinburgh-Stuttgart Submissions at WMT13: Morphological and Syntactic Processing for SMT Marion Weller, Max Kisselew, Svetlana Smekalova, Alexander Fraser, Helmut Schmid, Nadir Durrani, Hassan Sajjad, Richárd Farkas
12:30	🍴
14:00	Session 3: Invited Talk MT@EC: Serving the multilingual needs of the European Commission Andreas Eisele
15:10	Session 4: Quality Estimation Coping with the Subjectivity of Human Judgements in MT Quality Estimation Marco Turchi, Matteo Negri, Marcello Federico
15:30	☕️
16:00	Session 5: Translation Models Online Polylingual Topic Models for Fast Document Translation Detection Kriste Krstovski, David A. Smith
16:20	Combining Bilingual and Comparable Corpora for Low Resource Machine Translation Ann Irvine, Chris Callison-Burch
16:40	Generating English Determiners in Phrase-Based Translation with Synthetic Translation Options Yulia Tsvetkov, Chris Dyer, Lori Levin, Archna Bhatia
17:00	Dramatically Reducing Training Data Size Through Vocabulary Saturation William Lewis, Sauleh Eetemadi

Day 2

9:00	Session 6: Learning Multi-Task Learning for Improved Discriminative Training in SMT Patrick Simianer, Stefan Riezler
9:20	Online Learning Approaches in Computer Assisted Translation Prashant Mathur, Cettolo Mauro, Marcello Federico
9:40	Length-Incremental Phrase Training for SMT Joern Wuebker, Hermann Ney
10:00	Positive Diversity Tuning for Machine Translation System Combination Daniel Cer, Christopher D. Manning, Dan Jurafsky
10:20	☕️
11:00	Session 7: Poster Session Shared Task: Quality Estimation
	Selecting Feature Sets for Comparative and Time-Oriented Quality Estimation of Machine Translation Output Eleftherios Avramidis, Maja Popovic
	SHEF-Lite: When Less is More for Translation Quality Estimation Daniel Beck, Kashif Shah, Trevor Cohn, Lucia Specia
	Referential Translation Machines for Quality Estimation Ergun Bicici
	FBK-UEdin Participation to the WMT13 Quality Estimation Shared Task José Guilherme Camargo de Souza, Christian Buck, Marco Turchi, Matteo Negri
	The TALP-UPC Approach to System Selection: Asiya Features and Pairwise Classification Using Random Forests Lluís Formiga, Meritxell Gonzàlez, Alberto Barrón-Cedeño, José A. R. Fonollosa, Lluis Marquez
	Quality Estimation for Machine Translation Using the Joint Method of Evaluation Criteria and Statistical Modeling Aaron Li-Feng Han, Yi Lu, Derek F. Wong, Lidia S. Chao, Liangye He, Junwen Xing
	MT Quality Estimation: The CMU System for WMT’13 Silja Hildebrand, Stephan Vogel
	LORIA System for the WMT13 Quality Estimation Shared Task David Langlois, Kamel Smaili
	LIG System for WMT13 QE Task: Investigating the Usefulness of Features in Word Confidence Estimation for MT Ngoc Quang Luong, Benjamin Lecouteux, Laurent Besacier
	DCU-Symantec at the WMT 2013 Quality Estimation Shared Task Raphael Rubino, Joachim Wagner, Jennifer Foster, Johann Roturier, Rasoul Samad Zadeh Kaljahi, Fred Hollowood
	LIMSI Submission for the WMT’13 Quality Estimation Task: an Experiment with N-Gram Posteriors Anil Kumar Singh, Guillaume Wisniewski, François Yvon
11:00	Shared Task: Evaluation
	Ranking Translations using Error Analysis and Quality Estimation Mark Fishel
	Are ACT’s Scores Increasing with Better Translation Quality? Najeh Hajlaoui
	A Description of Tunable Machine Translation Evaluation Systems in WMT13 Metrics Task Aaron Li-Feng Han, Derek F. Wong, Lidia S. Chao, Yi Lu, Liangye He, Yiming Wang, Jiaji Zhou
	MEANT at WMT 2013: A Tunable, Accurate yet Inexpensive Semantic Frame Based MT Evaluation Metric Chi-kiu Lo, Dekai Wu
	An Approach Using Style Classification Features for Quality Estimation Erwan Moreau, Raphael Rubino
	DCU Participation in WMT2013 Metrics Task Xiaofeng Wu, Hui Yu, Qun Liu
12:30	🍴
14:00	Session 8: Reordering and Hierarchical Models Efficient Solutions for Word Reordering in German-English Phrase-Based Statistical Machine Translation Arianna Bisazza, Marcello Federico
14:20	A Phrase Orientation Model for Hierarchical Machine Translation Matthias Huck, Joern Wuebker, Felix Rietig, Hermann Ney
14:40	A Dependency-Constrained Hierarchical Model with Moses Yvette Graham
15:00	Investigations in Exact Inference for Hierarchical Translation Wilker Aziz, Marc Dymetman, Sriram Venkatapathy
15:20	☕️
16:00	Session 9: Alignment and Word Translation Models Evaluating (and Improving) Sentence Alignment under Noisy Conditions Omar Zaidan, Vishal Chowdhary
16:20	Multi-Rate HMMs for Word Alignment Elif Eyigöz, Daniel Gildea, Kemal Oflazer
16:40	Hidden Markov Tree Model for Word Alignment Shuhei Kondo, Kevin Duh, Yuji Matsumoto
17:00	An MT Error-Driven Discriminative Word Lexicon using Sentence Structure Features Jan Niehues, Alex Waibel

Results

General Task

Full results of the shared task: Findings of the 2013 Workshop on Statistical Machine Translation

News translation

The results were determined with a relative ranking.

→ English

Language pair	System	Score
Czech →	UEDIN-HEAFIELD	0.607
Spanish →	UEDIN-HEAFIELD	0.624
German →	ONLINE-B	0.660
Russian →	ONLINE-B	0.657
French →	UEDIN-HEAFIELD	0.638

English →

Language pair	System	Score
→ Czech	CU-BOJAR	0.580
→ Spanish	ONLINE-B	0.637
→ German	ONLINE-B	0.637
→ Russian	PROMT	0.641
→ French	UEDIN	0.607