Automatically finding actors in texts: A performance review of multilingual named entity recognition tools for news texts

Author(s)
Paul Balluff, Hajo Boomgaarden, Annie Waldherr
Abstract

Named Entity Recognition (NER) is a crucial task in natural language processing and has a wide range of applications in communication science. However, there is a lack of systematic evaluations of available NER tools in the field. In this study, we evaluate the performance of various multilingual NER tools, including rule-based and transformer-based models. We conducted experiments on corpora containing texts in multiple languages and evaluated the F

1-score, speed, and features of each tool. Our results show that transformer-based language models outperform rule-based models and other NER tools in most languages. However, we found that the performance of the transformer-based models varies depending on the language and the corpus. Our study provides insights into the strengths and weaknesses of NER tools and their suitability for specific languages, which can inform the selection of appropriate tools for future studies and applications in communication science.

Organisation(s)
Department of Communication
Journal
Communication Methods & Measures
Volume
18
Pages
371–389
No. of pages
19
ISSN
1931-2458
DOI
https://doi.org/10.1080/19312458.2024.2324789
Publication date
03-2024
Peer reviewed
Yes
Austrian Fields of Science 2012
508007 Communication science
ASJC Scopus subject areas
Communication
Portal url
https://ucrisportal.univie.ac.at/en/publications/734bca1b-f7a6-4694-b574-70f556db6577