Portal de Periódicos da CAPES

Design and Analysis of Cognitive Interviews for Comparative Multinational Testing

2011; SAGE Publishing; Volume: 23; Issue: 4 Linguagem: Inglês

10.1177/1525822x11414802

1552-3969

Kristen Miller, Rory Fitzgerald, José‐Luis Padilla, Stephanie Willson, Sally Widdop, Rachel Caspar, Martin Dimov, Michelle Gray, Cátia Nunes, Peter Prüfer, Nicole Schöbi, Alisú Schoua‐Glusberg,

Evaluation and Performance Assessment

This article summarizes the work of the Comparative Cognitive Testing Workgroup, an international coalition of survey methodologists interested in developing an evidence-based methodology for examining the comparability of survey questions within cross-cultural or multinational contexts. To meet this objective, it was necessary to ensure that the cognitive interviewing (CI) method itself did not introduce method bias. Therefore, the workgroup first identified specific characteristics inherent in CI methodology that could undermine the comparability of CI evidence. The group then developed and implemented a protocol addressing those issues. In total, 135 cognitive interviews were conducted by participating countries. Through the process, the group identified various interpretive patterns resulting from sociocultural and language-related differences among countries as well as other patterns of error that would impede comparability of survey data.