The Limits of Studying Networks with Event Data: Evidence from the ICEWS Dataset
Journal of Global Security Studies, Vol. 3, No. 4, October 2018, pp. 498-511
36 Pages Posted: 2 May 2019
Date Written: 2018
Abstract
Machine-coded event datasets have become popular in conflict research. I argue that systematic media biases render news-based event data unsuitable for studying anti-government networks of insurgents and political parties. Insurgent networks are too secretive to be captured by media reports, whereas alliances among regular political parties are too constant to be considered newsworthy. I analyze the data accuracy of Metternich et al.’s (2013) network study of insurgents and political parties in Thailand, which is based on the most comprehensive event dataset currently available – the ICEWS project. Based on simple evaluation criteria, I show that most of the network data entries are incorrect, leading to a depiction of the networks that is unrelated to real-world cleavages in Thailand. While my hand-coded event dataset captures relatively more network-relevant information than ICEWS, the comparison confirms that journalists specifically underreport cooperative events among insurgents and parties. In addition, the ICEWS project provides unreliable counts of conflictual events in Thailand. Using alternative conflict measurements from the Deep South Watch dataset, and a dummy variable based on established periods of unrest, I show that violent activities in Thailand’s Deep South declined during periods of conflict between pro- and anti-Thaksin groups. Conflicts were unrelated to network fragmentation, contradicting Metternich et al.’s primary finding.
Keywords: Event Data, Media Bias, Machine Coding, Network Analysis, ICEWS, Intra-State Conflict, Thailand
Suggested Citation: Suggested Citation