35 AI providers in one engine: how profClaw handles multi-provider routing #38
thegdsks
started this conversation in
Show and tell
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
profClaw ships a smart router that picks the cheapest model for each query.
It scores message complexity on signals like: multi-step reasoning, code generation, tool orchestration, image analysis. Then routes to the right tier.
Simple question ('what is 2+2') goes to Haiku or Groq. Complex architecture question goes to Opus or GPT-4o. You don't pick manually unless you want to.
The savings add up. On a test workload of 100 messages/day:
That is 60% savings with zero quality loss on the simple stuff.
Supported providers: Anthropic, OpenAI, Google, Ollama, Groq, DeepSeek, Azure, xAI, Mistral, Cerebras, Fireworks, Together, and 23 more.
Local models (Ollama) are always /bin/zsh. The router prefers them for trivial queries when available.
38 tests cover the routing logic. Complexity scoring, tier boundaries, provider availability, cost comparison.
Beta Was this translation helpful? Give feedback.
All reactions