Automatically finding actors in texts: A performance review of multilingual named entity recognition tools for news texts

Autor(en)
Paul Balluff, Hajo Boomgaarden, Annie Waldherr
Abstrakt

Named Entity Recognition (NER) is a crucial task in natural language processing and has a wide range of applications in communication science. However, there is a lack of systematic evaluations of available NER tools in the field. In this study, we evaluate the performance of various multilingual NER tools, including rule-based and transformer-based models. We conducted experiments on corpora containing texts in multiple languages and evaluated the F

1-score, speed, and features of each tool. Our results show that transformer-based language models outperform rule-based models and other NER tools in most languages. However, we found that the performance of the transformer-based models varies depending on the language and the corpus. Our study provides insights into the strengths and weaknesses of NER tools and their suitability for specific languages, which can inform the selection of appropriate tools for future studies and applications in communication science.

Organisation(en)
Institut für Publizistik- und Kommunikationswissenschaft
Journal
Communication Methods & Measures
Band
18
Seiten
371–389
Anzahl der Seiten
19
ISSN
1931-2458
DOI
https://doi.org/10.1080/19312458.2024.2324789
Publikationsdatum
03-2024
Peer-reviewed
Ja
ÖFOS 2012
508007 Kommunikationswissenschaft
ASJC Scopus Sachgebiete
Communication
Link zum Portal
https://ucrisportal.univie.ac.at/de/publications/734bca1b-f7a6-4694-b574-70f556db6577