MCP Connector

[Msameim181]

• Is your feature request related to a problem? Please describe.

I am looking for a self-hosted alternative to Firecrawl for powering AI agents and LLMs with web content. I would like to use DeepCrawl for this purpose, but it currently lacks a standardized interface for connecting directly to AI desktop apps and agentic workflows.

• Describe the solution you'd like

It would be great to add MCP (Model Context Protocol) connectors/support to this project. Implementing an MCP server would allow DeepCrawl to be easily used as a tool by AI assistants (like Claude Desktop or other MCP-compliant clients), effectively making it a drop-in, open-source replacement for Firecrawl in AI workflows.

• Describe alternatives you've considered

I am currently using Firecrawl, but I prefer an open-source solution like DeepCrawl. The alternative would be writing a custom API wrapper, but native MCP support would be much more standardized and easier to integrate.

[lumpinif]

Thank you for choosing Deepcrawl.dev as an open-source alternative. Although Deepcrawl is not yet suitable for large-scale, production-ready projects, it currently meets the requirements for high-frequency, free, and fast use-case public page scraping scenarios.

Moreover, all the code belongs to you, so you are free to extend it as you wish.

Unfortunately, I currently don't have the time to develop native MCP support. I will try my best to add MCP support in the next iteration.

[20Youssef10]

Hello!
I've built a simple MCP for DeepCrawl. It still needs some improvement, but you can try it out.
MCP URL is: https://deepcrawl-mcp.shinzero.workers.dev/mcp
Also my self-hosted deepcrawl URL is: https://deepcrawl-dev.vercel.app
It's completely free and no need to any API Key or OAuth.

[lumpinif]

Hello! I've built a simple MCP for DeepCrawl. It still needs some improvement, but you can try it out. MCP URL is: https://deepcrawl-mcp.shinzero.workers.dev/mcp Also my self-hosted deepcrawl URL is: https//deepcrawl-dev.vercel.app It's completely free and no need to any API Key or OAuth.

hope you've enjoyed!