Skip to content

stu99a/global-terrorism-intelligence-analytics

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

33 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Global Terrorism Intelligence Analytics

Overview

This project analyzes over 200,000 terrorist incidents recorded between 1970 and 2020 using Python, SQL, SQLite, and Power BI.

The objective was to transform raw terrorism incident data into actionable intelligence through data cleaning, feature engineering, exploratory analysis, geospatial intelligence, SQL analytics, and interactive dashboard development.

This project demonstrates an end-to-end analytics workflow, from raw data processing to executive-level intelligence reporting.


Technologies Used

  • Python
  • Pandas
  • NumPy
  • Matplotlib
  • Seaborn
  • SQLite
  • SQL
  • Power BI
  • Jupyter Notebook

Project Workflow

1. Data Cleaning

  • Missing value treatment
  • Data standardization
  • Date formatting
  • Feature creation

2. Feature Engineering

Created analytical features including:

  • Casualties
  • Attack Success
  • Suicide Attack Indicator
  • Decade
  • High Casualty Incidents

3. Exploratory Data Analysis

Analyzed:

  • Incident trends over time
  • Geographic distribution
  • Attack methods
  • Weapon types
  • Target sectors
  • Terrorist group activity

4. Advanced Intelligence Analytics

Performed:

  • Correlation analysis
  • Decade-based trend analysis
  • High-casualty incident analysis
  • Fatality analysis
  • Group activity analysis

5. Geospatial Intelligence

Analyzed:

  • Terrorism hotspots
  • Regional distribution
  • City-level incident concentration
  • Geographic patterns

6. SQL Analytics

Built a SQLite database and executed intelligence-focused SQL queries including:

  • Top affected countries
  • Most active groups
  • Deadliest organizations
  • Regional fatality analysis
  • Historical trend analysis

7. Dashboard Development

Created an interactive Power BI dashboard consisting of:

  • Executive Overview
  • Geographic Intelligence
  • Attack Analysis
  • Organization Analysis
  • Casualty Analysis
  • Historical Trends
  • Intelligence Summary

Repository Structure

global-terrorism-intelligence-analytics
│
├── notebooks
│   ├── 01_data_cleaning.ipynb
│   ├── 02_feature_engineering_and_eda.ipynb
│   ├── 03_advanced_intelligence_analytics.ipynb
│   ├── 04_geospatial_intelligence.ipynb
│   └── 05_sql_database_creation.ipynb
│
├── screenshots
│
├── sql
│   └── intelligence_queries.sql
│
├──.gitignore
│
├── README.md
│
└── requirements.txt

Dashboard Pages

Executive Overview

Executive Overview

Provides a high-level summary of terrorism incidents, fatalities, affected countries, and regional distribution.


Geographic Intelligence

Geographic Intelligence

Highlights regional hotspots, city-level concentration of incidents, and geographic distribution patterns.


Attack Analysis

Attack Analysis

Examines:

  • Most common attack methods
  • Weapon types used
  • Target sectors
  • Attack patterns

Organization Analysis

Organization Analysis

Identifies:

  • Most active terrorist groups
  • Deadliest organizations
  • Organizational activity trends

Casualty Analysis

Casualty Analysis

Analyzes:

  • Fatalities by country
  • Suicide attacks
  • Attack success rates
  • High-casualty incidents

Historical Trends

Historical Trends

Shows how terrorism activity evolved over time and identifies periods of increased activity.


Intelligence Summary

Intelligence Summary

Provides an executive briefing highlighting key intelligence findings from the analysis.


Key Findings

  • Iraq experienced the highest number of terrorist incidents.
  • The Taliban emerged as the most active and deadliest terrorist organization.
  • Bombings and explosions represented the most common attack method.
  • Explosives were the most frequently used weapon type.
  • Private Citizens & Property were the most frequently targeted sector.
  • The Middle East & North Africa recorded the highest number of fatalities.
  • Terrorism activity peaked during the mid-2010s.

Skills Demonstrated

Data Analysis

  • Exploratory Data Analysis (EDA)
  • Statistical Analysis
  • Trend Analysis
  • Intelligence Analysis

Data Engineering

  • Data Cleaning
  • Feature Engineering
  • Data Transformation
  • Database Creation

SQL

  • Query Writing
  • Aggregations
  • Filtering
  • Ranking
  • Trend Analysis

Data Visualization

  • Matplotlib
  • Seaborn
  • Power BI
  • Dashboard Design

Data Availability

The Global Terrorism Database (GTD), SQLite database, and Power BI dashboard file are excluded from this repository due to file size limitations and data licensing considerations.

The complete dataset can be obtained from START (National Consortium for the Study of Terrorism and Responses to Terrorism). https://www.start.umd.edu/data-tools/GTD

Screenshots and the complete analytical workflow are provided to demonstrate the project methodology and findings.


Future Improvements

  • Forecast terrorism trends using machine learning models.
  • Build an interactive Streamlit application.
  • Develop country-level terrorism risk scores.
  • Integrate near real-time incident data sources.
  • Create predictive threat intelligence dashboards.

Author

Josiah Mathew

Data Analyst | Data Engineer | Power BI Developer | CBRNe Professional

LinkedIn: https://www.linkedin.com/in/josiah-mathew-17547628b

GitHub: https://github.com/stu99a

About

End-to-end intelligence analytics project analyzing 200K+ terrorism incidents using Python, SQL, SQLite, and Power BI.

Topics

Resources

Stars

Watchers

Forks

Releases

Packages

Contributors

Languages