From Masked Language Modeling to Translation: Non-English Auxiliary Tasks Improve Zero-shot Spoken Language Understanding
Research output: Conference Article in Proceeding or Book/Report chapter › Article in proceedings › Research › peer-review
To tackle the challenge, we propose a joint learning approach, with English SLU training data and non-English auxiliary tasks from raw text, syntax and translation for transfer. We study two setups which differ by type and language coverage of the pre-trained embeddings. Our results show that jointly learning the main
tasks with masked language modeling is effective for slots, while machine translation works best for intent classification.
|Title of host publication||Proceedings of NAACL|
|Publisher||Association for Computational Linguistics|
|Publication status||Published - 2021|