use local llama models instead of openai API?

[arjuns2020]

can we use local llama models ?

[mNandhu]

Yes, You need to change ~line 55 in main.py to, result = generate_text_completion("ollama/llama3.1").
Check LiteLLM Docs for more info.