Portal de Periódicos da CAPES

A Framework for the Unsupervised and Semi-Supervised Analysis of Visual Frames

2023; Cambridge University Press; Volume: 32; Issue: 2 Linguagem: Inglês

10.1017/pan.2023.32

1476-4989

Michelle Torres,

Computational and Text Analysis Methods

Abstract This article introduces to political science a framework to analyze the content of visual material through unsupervised and semi-supervised methods. It details the implementation of a tool from the computer vision field, the Bag of Visual Words (BoVW), for the definition and extraction of “tokens” that allow researchers to build an Image-Visual Word Matrix which emulates the Document-Term matrix in text analysis. This reduction technique is the basis for several tools familiar to social scientists, such as topic models, that permit exploratory, and semi-supervised analysis of images. The framework has gains in transparency, interpretability, and inclusion of domain knowledge with respect to other deep learning techniques. I illustrate the scope of the BoVW by conducting a novel visual structural topic model which focuses substantively on the identification of visual frames from the pictures of the migrant caravan from Central America.