Recall is the Proper Evaluation Metric for Word Segmentation

Yan Shao, Christian Hardmeier, Joakim Nivre

Publikation: Konference artikel i Proceeding eller bog/rapport kapitelKonferencebidrag i proceedingsForskningpeer review

Abstract

We extensively analyse the correlations and drawbacks of conventionally employed evaluation metrics for word segmentation. Unlike in standard information retrieval, precision favours under-splitting systems and therefore can be misleading in word segmentation. Overall, based on both theoretical and experimental analysis, we propose that precision should be excluded from the standard evaluation metrics and that the evaluation score obtained by using only recall is sufficient and better correlated with the performance of word segmentation systems.
OriginalsprogEngelsk
TitelProceedings of the Eighth International Joint Conference on Natural Language Processing (Volume 2: Short Papers)
Antal sider5
Publikationsdato1 dec. 2017
Sider86–90
ISBN (Trykt)978-1-948087-01-8
StatusUdgivet - 1 dec. 2017
Udgivet eksterntJa

Fingeraftryk

Dyk ned i forskningsemnerne om 'Recall is the Proper Evaluation Metric for Word Segmentation'. Sammen danner de et unikt fingeraftryk.

Citationsformater