Why do we need to use OpenAI?

[ealione]

Is there a plan to be able to run some local LLM?

[rabiaedayilmaz]

I think it should be able to. To use models from another repos, maybe this might help you: https://www.kaggle.com/code/hinepo/q-a-chatbot-with-llms-harry-potter?scriptVersionId=138627642