#

perplexitybot

Here are 7 public repositories matching this topic...

henu-wang / ai-crawlers-reference

Complete database of AI search engine crawler user-agents (GPTBot, PerplexityBot, ClaudeBot) with robots.txt configuration examples

database user-agent reference seo geo robots-txt ai-search user-agents web-crawlers chatgpt gptbot ai-seo llms-txt generative-engine-optimization ai-crawlers perplexitybot geoscore

Updated Mar 9, 2026
HTML

BraedenBDev / crawl-sim

Agent-native multi-bot web crawler simulator. See your site through the eyes of Googlebot, GPTBot, ClaudeBot, and PerplexityBot.

bash open-source crawler seo googlebot gptbot llms-txt claude-code ai-visibility claude-code-skill perplexitybot claudebot

Updated May 6, 2026
Shell

robots-txt-validator

northbridge-systems / robots-txt-validator

Validates whether GPTBot, ClaudeBot, PerplexityBot and other LLM crawlers are allowed by a robots.txt file.

python geo robots-txt rfc-9309 gptbot generative-engine-optimization perplexitybot claudebot crawler-policy compliance-geo llm-crawlers

Updated May 10, 2026
Python

metawhisp / best-aeo-skill

The best AEO/GEO skill for Claude Code. Audit, fix, and monitor your website's visibility across ChatGPT, Claude, Perplexity, Gemini, and Google AI Overviews. 100+ optimization techniques, 33 evidence collectors, 4-vector GEO Score. Built on Princeton KDD 2024 paper. Free, MIT.

Updated May 1, 2026
Python

agent-reachability-probe

northbridge-systems / agent-reachability-probe

User-agent simulator for major LLM crawlers: measures response code, content length, and JS-dependency

user-agent geo robots-txt gptbot generative-engine-optimization agent-detection perplexitybot claudebot compliance-geo llm-crawlers

Updated May 10, 2026
Python

sharozdawa / robotstxt-ai

Visual robots.txt manager for the AI era. Block or allow GPTBot, ClaudeBot, PerplexityBot, and 20+ AI crawlers with one click.

open-source nextjs seo robots-txt robots-txt-generator ai-crawler gptbot perplexitybot claudebot ai-bot-blocker

Updated Mar 22, 2026
TypeScript

Turner-Levey / ai-crawler-robots-builder

Free no-tracking browser utility for drafting and auditing AI crawler robots.txt rules.

open-source static-site robots-txt bot-management seo-tools no-tracking web-crawlers robots-txt-generator llms gptbot ai-seo llms-txt claude-bot ai-crawlers perplexitybot claudebot google-extended crawler-rules

Updated May 14, 2026
JavaScript

Improve this page

Add a description, image, and links to the perplexitybot topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the perplexitybot topic, visit your repo's landing page and select "manage topics."