Exploiting morphology and local word reordering in English-to-Turkish phrase-based statistical machine translation

Durgar El-Kahlout, İlknur and Oflazer, Kemal (2010) Exploiting morphology and local word reordering in English-to-Turkish phrase-based statistical machine translation. IEEE Transactions on Audio Speech and Language Processing, 18 (6). pp. 1313-1322. ISSN 1558-7916

Full text not available from this repository.

Official URL: http://dx.doi.org/10.1109/TASL.2009.2033321


In this paper, we present the results of our work on the development of a phrase-based statistical machine translation prototype from English to Turkish-an agglutinative language with very productive inflectional and derivational morphology. We experiment with different morpheme-level representations for English-Turkish parallel texts. Additionally, to help with word alignment, we experiment with local word reordering on the English side, to bring the word order of specific English prepositional phrases and auxiliary verb complexes, in line with the morpheme order of the corresponding case-marked nouns and complex verbs, on the Turkish side. To alleviate the dearth of the parallel data available, we also augment the training data with sentences just with content word roots obtained from the original training data to bias root word alignment, and with highly reliable phrase-pairs from an earlier corpus alignment. We use a morpheme-based language model in decoding and a word-based language model in re-ranking the n-best lists generated by the decoder. Lastly, we present a scheme for repairing the decoder output by correcting words which have incorrect morphological structure or which are out-of-vocabulary with respect to the training data and language model, to further improve the translations. We improve from 15.53 BLEU points for our word-based baseline model to 25.17 BLEU points for an improvement of 9.64 points or about 62% relative.

Item Type:Article
Uncontrolled Keywords:Complex morphology; English; statistical machine translation (SMT); Turkish; word reordering
Subjects:T Technology > TK Electrical engineering. Electronics Nuclear engineering > TK1-4661 Electrical engineering. Electronics Nuclear engineering
ID Code:16429
Deposited By:Kemal Oflazer
Deposited On:25 Mar 2011 15:35
Last Modified:29 Jul 2019 15:02

Repository Staff Only: item control page