Challenges in Annotating and Parsing Spoken, Code-switched, Frisian-Dutch Data

Research output: Conference Article in Proceeding or Book/Report chapterArticle in proceedingsResearchpeer-review

View graph of relations

While high performance have been obtained for high-resource languages, performance on low-resource languages lags behind. In this paper we focus on the parsing of the low-resource language Frisian. We use a sample of code-switched, spontaneously spoken data, which proves to be a challenging setup. We propose to train a parser specifically tailored towards the target domain, by selecting instances from multiple treebanks. Specifically, we use Latent Dirichlet Allocation (LDA), with word and character N-grams. We use a deep biaffine parser initialized with mBERT. The best single source treebank (nl_alpino) resulted in an LAS of 54.7 whereas our data selection outperformed the single best transfer treebank and led to 55.6 LAS on the test data. Additional experiments consisted of removing diacritics from our Frisian data, creating more similar training data by cropping sentences and running our best model using XLM-R. These experiments did not lead to a better performance.
Original languageEnglish
Title of host publicationProceedings of the Second Workshop on Domain Adaptation for NLP
PublisherAssociation for Computational Linguistics
Publication dateApr 2021
Publication statusPublished - Apr 2021
EventSecond Workshop on Domain Adaptation for NLP (EACL 2021) -
Duration: 20 Apr 2021 → …


WorkshopSecond Workshop on Domain Adaptation for NLP (EACL 2021)
Periode20/04/2021 → …

ID: 85929500