Add support for different models?

[kanishkave]

Is there a way to use LiteLLM to add support for the lower cost models?

[Tempaccnt]

it would also be great to be able to run it locally using Ollama.

thank you for your tool

[Simsk8er]

I was just curious about the same thing, I use Ollama, but I also use Gemini, can this be used with Gemini API? Or Claude?

[alx]

• Gemini API: https://docs.litellm.ai/docs/providers/gemini
• Claude: https://docs.litellm.ai/docs/providers/anthropic
• (from the docs, havn't check) Ollama doesn't support function calling: https://docs.litellm.ai/docs/completion/function_call#checking-if-a-model-supports-function-calling

[Denzelwashingmachine]

https://ollama.com/blog/tool-support looks like ollama does support function calling hopefully someone can get this up and running

[dobkun]

^^^^^ why no one is implementing