Capturing a News Frame - Comparing Machine-Learning Approaches to Frame Analysis with Different Degrees of Supervision

Autor(en)
Olga Eisele, Tobias Heidenreich, Olga Litvyak, Hajo Boomgaarden
Abstrakt

The empirical identification of frames drawing on automated text analysis has been discussed intensely with regard to the validity of measurements. Adding to an evolving discussion on automated frame identification, we systematically contrast different machine-learning approaches with a manually coded gold standard to shed light on the implications of using one or the other: (1) topic modeling, (2) keyword-assisted topic modeling (keyATM), and (3) supervised machine learning as three popular and/or promising approaches. Manual coding is based on the Policy Frames codebook, providing an established base that allows future research to dovetail our contribution. Analysing a large dataset of 12 Austrian newspapers’ EU coverage over 11 years (2009–2019), we contribute to addressing the methodological challenges that have emerged for social scientists interested in employing automated tools for frame analysis. While results confirm the superiority of supervised machine-learning, the semi-supervised approach (keyATM) seems unfit for frame analysis, whereas the topic model covers the middle ground. Results are extensively discussed regarding their implications for the validity of approaches.

Organisation(en)
Institut für Publizistik- und Kommunikationswissenschaft
Externe Organisation(en)
University of Amsterdam (UvA)
Journal
Communication Methods & Measures
Band
17
Seiten
205-226
Anzahl der Seiten
22
ISSN
1931-2458
DOI
https://doi.org/DOI: 10.1080/19312458.2023.2230560
Publikationsdatum
07-2023
Peer-reviewed
Ja
ÖFOS 2012
508007 Kommunikationswissenschaft, 508008 Medienanalyse
ASJC Scopus Sachgebiete
Communication
Link zum Portal
https://ucrisportal.univie.ac.at/de/publications/capturing-a-news-frame--comparing-machinelearning-approaches-to-frame-analysis-with-different-degrees-of-supervision(dae97d7d-33f4-49ca-b034-a9f8cd8175ac).html