Data Sources

The OSRx uses a combination of the PeaceTech Lab's own risk indices, open data sets related to conflict, and results from monitors developed in third party tools, whose results are then sent via application programming interface (API) to the OSRx. This page lists the sources used:

Realtime Event Data

Global Database of Events,
Language and Tone (GDELT)
 

The GDELT Event Database - one of the largest worldwide open datasets - is available in Google BigQuery and is updated daily. This database contains over a quarter-billion records organized into a set of tab-delimited files by date, and incorporates local media reports as well as international sources worldwide about events. Due to the massive volume and real-time nature of this dataset, errors in both location and topic do occur. 

Armed Conflict Location and
Events Database (ACLED) 

ACLED (Armed Conflict Location & Event Data Project) is the most comprehensive public collection of political violence data for developing states. This data project produces information on the specific dates and locations of political violence, the types of event, the groups involved, fatalities, and changes in territorial control. Information is recorded on the battles, killings, riots, and recruitment activities of rebels, governments, militias, armed groups, protesters and civilians. The data can be used for medium- and long-term analysis and mapping of political violence across developing countries through use of historical data from 1997, as well as informing humanitarian and development work in crisis and conflict-affected contexts through real-time data updates and reports.

 

Social Media

Crimson Hexagon ForSight™ platform 

Crimson Hexagon is an enterprise big data company providing social media analytics to leading brands and agencies. The company’s ForSight™ platform is powered by patented technology developed at Harvard University’s Institute for Quantitative Social Science, and provides a real-time view of the online conversation. The visualizations in the OSRx are drawn from monitors developed in the platform, and include Twitter and Facebook conversations related to violence and instability worldwide in English, French, Arabic, and Spanish. 

 

Structured Indices

 Center for Systemic Peace,
Integrated Network for Societal
Conflict Research (INSCR) State
Fragility Index
 

State Fragility Index and Matrix (1995-2014) provides annual state fragility, effectiveness, and legitimacy indices and the eight component indicators for the world's 167 countries with populations greater than 500,000 in 2014. Technical information on the sources and construction of the indices and indicators is provided with the State Fragility Matrix 2014 and in Global Report 2014.

Worldwide Governance
Indicators (WGI)

The Worldwide Governance Indicators (WGI) project reports aggregate and individual governance indicators for 215 economies over the period 1996–2014, for six dimensions of governance: Voice and Accountability, Political Stability and Absence of Violence, Government Effectiveness, Regulatory Quality, Rule of Law, and Control of Corruption. These aggregate indicators combine the views of a large number of enterprise, citizen and expert survey respondents in industrial and developing countries. They are based on over 30 individual data sources produced by a variety of survey institutes, think tanks, non-governmental organizations, international organizations, and private sector firms.

International
Telecommunications Union (ITU)
Information and Communication Technologies (ICT) Statistics

The ICT Data and Statistics (IDS) Division is part of ITU's Project Support and Knowledge Management Department within the Telecommunication Development Bureau (BDT). One of the core activities of the Division is the collection, verification and harmonization of telecommunication/ICT statistics for about 200 economies worldwide. There are two key sets of telecommunication/ICT data that ITU collects directly from countries: 

  • Telecommunication/ICT data collected from national telecommunication/ICT ministries and regulatory authorities: these include data on the fixed-telephone network, mobile-cellular services, Internet/broadband, traffic, revenues and investment; and prices of ICT services.
  • Household ICT data collected from national statistical offices (NSOs"): these include data on household access to ICTs and individual use of ICTs.

 

WomanStats.org, Physical
Security of Women

The WomanStats Project is the most comprehensive database on the status of women cross-nationally (available at http://womanstats.org). Containing over 170,000 data points and growing every day, it covers over 350 variables for 175 nations with populations greater than 200,000 persons. Variables include those relating to nine aspects of women’s situation and security. 

UCDP/PRIO Armed Conflict
Dataset (Uppsala University) 

The Uppsala Conflict Data Program (UCDP) offers a number of datasets on organised violence and peacemaking. The UCDP/PRIO Armed Conflict Dataset v.4-2015, 1946-2014 is a conflict-year dataset with information on armed conflict where at least one party is the government of a state. The most recent is version 4-2015. 

Polity IV Project, Political Regime
Characteristics and Transitions

This dataset includes annual, cross-national, time-series and polity-case formats coding democratic and autocratic "patterns of authority" and regime changes in all independent countries with total population greater than 500,000 in 2014 (167 countries in 2014).

The Nonviolent and Violent Campaigns and Outcomes 2.0 (NAVCO 2.0) The Nonviolent and Violent Campaigns and Outcomes (NAVCO) 2.0 dataset compiles annual data on 250 nonviolent and violent mass movements for regime change, anti-occupation, and secession from 1945 to 2006. NAVCO 2.0 also includes features of each campaign, such as participation size and diversity, the behavior of regime elites, repression and its effects on the campaign, support (or lack thereof) from external actors, and progress toward the campaign outcomes.