Poetry to Prose Conversion in Sanskrit as a Linearisation Task: A Case for Low-Resource Languages

Amrith Krishna, Vishnu Dutt Sharma, Bishal Santra, Aishik Chakraborty, Pavankumar Satuluri, Pawan Goyal

Publikation: Konference artikel i Proceeding eller bog/rapport kapitelKonferencebidrag i proceedingsForskningpeer review

Abstract

The word ordering in a Sanskrit verse is often not aligned with its corresponding prose order. Conversion of the verse to its corresponding prose helps in better comprehension of the construction. Owing to the resource constraints, we formulate this task as a word ordering (linearisation) task. In doing so, we completely ignore the word arrangement at the verse side. kāvya guru, the approach we propose, essentially consists of a pipeline of two pretraining steps followed by a seq2seq model. The first pretraining step learns task-specific token embeddings from pretrained embeddings. In the next step, we generate multiple possible hypotheses for possible word arrangements of the input %using another pretraining step. We then use them as inputs to a neural seq2seq model for the final prediction. We empirically show that the hypotheses generated by our pretraining step result in predictions that consistently outperform predictions based on the original order in the verse. Overall, kāvya guru outperforms current state of the art models in linearisation for the poetry to prose conversion task in Sanskrit.
OriginalsprogEngelsk
TitelProceedings of the 57th Annual Meeting of the Association for Computational Linguistics
Antal sider6
ForlagAssociation for Computational Linguistics
Publikationsdatojul. 2019
Sider1160–1166
DOI
StatusUdgivet - jul. 2019
Udgivet eksterntJa

Emneord

  • Sanskrit verse conversion
  • Word ordering
  • Linearisation task
  • seq2seq model
  • Pretraining steps

Fingeraftryk

Dyk ned i forskningsemnerne om 'Poetry to Prose Conversion in Sanskrit as a Linearisation Task: A Case for Low-Resource Languages'. Sammen danner de et unikt fingeraftryk.

Citationsformater