- Cloudflare Worker: Hosts the Discord bot and WebSocket server
- Discord Bot: Manages
/monitorcommands and stores requests in D1 database - WebSocket Server: Pushes database changes to connected clients
- Discord Bot: Manages
- Local Job Scheduler: Executes scrapers on cron schedules, syncing with the database via WebSocket
-
Copy
.env.exampleto.envand fill in your credentials -
Deploy the worker and add the URL to
.envbunx wrangler deploy -
Initialize the database
bun run setup:db -
Install Python dependencies
uv sync
-
Start the job scheduler
bun run worker
If you have a mobile data connection with RFC 4941 SLAAC, you may have noticed that you're assigned an entire /64 IPv6 block. If you run a hotspot, each device will have a unique IPv6 address from the same prefix.
You can run sudo uv run runner/ndppd.py to setup
- AnyIP to send from any address within your block
ndppdto receive the response back
While its running, a IPV6_SUBNET key will be added to your .env and be used to choose a source interface in scrapers/utils/base.py
This effectively turns your mobile data connection into a free-ish rotating IPv6 mobile proxy. Some like Cloudflare and Akamai may aggregate by /64 or /48, but others don't.
TLDR: Do whatever. Modify, sell, marry it. As long as you open-source your changes under the same license.
