A curated list of awesome tools, datasets, APIs, and libraries for domain analysis, zone files, DNS reconnaissance, and internet scanning.
This list is for security researchers, OSINT specialists, data analysts, and marketers looking for domain intelligence data.
- Data Providers & Zone Files
- DNS Reconnaissance
- Whois & Registration Data
- Technology Lookup
- Certificate Transparency
- Python Libraries
- Books & Resources
Platforms offering raw domain data, TLD zone files, and daily newly registered domains (NRD).
- WebTrackly 🔥 - Comprehensive domain intelligence platform. Offers instant download of 716+ TLD zone files, technology-filtered domain lists (e.g., all WordPress or Shopify sites), and B2B leads. API available, no subscription required.
- ICANN CZDS - Centralized Zone Data Service by ICANN. Free access to zone files of many gTLDs (requires individual approval from registries).
- Verisign - The registry for .com and .net (requires strict agreements for access).
- Domains-Monitor - Monitoring of existing and expired domains.
Tools for enumerating subdomains and analyzing DNS records.
- Amass - The OWASP Amass Project performs network mapping of attack surfaces and external asset discovery using open source information gathering and active reconnaissance techniques.
- dnsrecon - A powerful DNS enumeration script.
- Sublist3r - Fast subdomains enumeration tool for penetration testers.
- dnstwist - Domain name permutation engine for detecting typosquatting, phishing and corporate espionage.
- ZMap - A fast single-packet network scanner designed for Internet-wide network surveys.
Tools and APIs to find ownership information.
- Whoxy - Whois API & Whois Database with history and reverse lookup.
- WhoisXML API - Extensive domain research suite and API.
- RDAP Web Client - A web client for the Registration Data Access Protocol (RDAP), the successor to WHOIS.
Identify what technologies websites are running (CMS, Frameworks, Analytics).
- Wappalyzer - Technology profiler that identifies the software used by websites.
- BuiltWith - Web technology usage statistics and trends.
- WhatWeb - Next generation web scanner that identifies technologies, including CMS, blogging platforms, statistic/analytics packages, JavaScript libraries, and servers.
Monitoring SSL/TLS logs to find new domains.
- crt.sh - A web interface for the distributed database of certificate transparency logs.
- CertStream - Real-time certificate transparency log update stream.
Libraries to build your own domain analysis tools.
- dnspython - A DNS toolkit for Python.
- python-whois - Python wrapper for the "whois" command.
- tldextract - Accurately separate the TLD from the registered domain and subdomains of a URL.
Contributions are welcome! Please read the contribution guidelines first.
To the extent possible under law, all copyright and related or neighboring rights to this work are waived via CC0.