Tunable Distortion Limits and Corpus Cleaning for SMT

Sara Stymne; Christian Hardmeier; Jörg Tiedemann; Joakim Nivre

Tunable Distortion Limits and Corpus Cleaning for SMT

Sara Stymne
, Christian Hardmeier
, Jörg Tiedemann
, Joakim Nivre

Uppsala University

Research output: Conference Article in Proceeding or Book/Report chapter › Article in proceedings › Research › peer-review

Abstract

We describe the Uppsala University system for WMT13, for English-to-German translation. We use the Docent decoder, a local search decoder that translates at the document level. We add tunable distortion limits, that is, soft constraints on the maximum distortion allowed, to Docent. We also investigate cleaning of the noisy Common Crawl corpus. We show that we can use alignment-based filtering for cleaning with good results. Finally we investigate effects of corpus selection for recasing.

Original language	English
Title of host publication	Proceedings of the Eighth Workshop on Statistical Machine Translation
Publication date	9 Aug 2013
ISBN (Print)	978-1-937284-57-2
Publication status	Published - 9 Aug 2013
Externally published	Yes

Keywords

machine translation
document-level decoding
corpus cleaning
alignment-based filtering
recasing

Access to Document

https://aclanthology.org/W13-2229.pdf

Cite this

@inproceedings{858c312b838d48f68d95572517618554,

title = "Tunable Distortion Limits and Corpus Cleaning for SMT",

abstract = "We describe the Uppsala University system for WMT13, for English-to-German translation. We use the Docent decoder, a local search decoder that translates at the document level. We add tunable distortion limits, that is, soft constraints on the maximum distortion allowed, to Docent. We also investigate cleaning of the noisy Common Crawl corpus. We show that we can use alignment-based filtering for cleaning with good results. Finally we investigate effects of corpus selection for recasing.",

keywords = "machine translation, document-level decoding, corpus cleaning, alignment-based filtering, recasing",

author = "Sara Stymne and Christian Hardmeier and J{\"o}rg Tiedemann and Joakim Nivre",

year = "2013",

month = aug,

day = "9",

language = "English",

isbn = "978-1-937284-57-2",

booktitle = "Proceedings of the Eighth Workshop on Statistical Machine Translation",

}

TY - GEN

T1 - Tunable Distortion Limits and Corpus Cleaning for SMT

AU - Stymne, Sara

AU - Hardmeier, Christian

AU - Tiedemann, Jörg

AU - Nivre, Joakim

PY - 2013/8/9

Y1 - 2013/8/9

N2 - We describe the Uppsala University system for WMT13, for English-to-German translation. We use the Docent decoder, a local search decoder that translates at the document level. We add tunable distortion limits, that is, soft constraints on the maximum distortion allowed, to Docent. We also investigate cleaning of the noisy Common Crawl corpus. We show that we can use alignment-based filtering for cleaning with good results. Finally we investigate effects of corpus selection for recasing.

AB - We describe the Uppsala University system for WMT13, for English-to-German translation. We use the Docent decoder, a local search decoder that translates at the document level. We add tunable distortion limits, that is, soft constraints on the maximum distortion allowed, to Docent. We also investigate cleaning of the noisy Common Crawl corpus. We show that we can use alignment-based filtering for cleaning with good results. Finally we investigate effects of corpus selection for recasing.

KW - machine translation

KW - document-level decoding

KW - corpus cleaning

KW - alignment-based filtering

KW - recasing

M3 - Article in proceedings

SN - 978-1-937284-57-2

BT - Proceedings of the Eighth Workshop on Statistical Machine Translation

ER -

Tunable Distortion Limits and Corpus Cleaning for SMT

Abstract

Keywords

Access to Document

Fingerprint

Cite this