Problem Statement
Ollama while convenient is a corporate entity that has raised VC funding and thus we run the risk of vendor lock-in some time in the future as the company ramps up revenue generation.
Proposed Solution
Ollama uses llama.cpp under the hood (and until recently had not been providing the appropriate credit). Propose to use llama.cpp directly and eliminate the ollama dependency and associated risk.
Problem Statement
Ollama while convenient is a corporate entity that has raised VC funding and thus we run the risk of vendor lock-in some time in the future as the company ramps up revenue generation.
Proposed Solution
Ollama uses llama.cpp under the hood (and until recently had not been providing the appropriate credit). Propose to use llama.cpp directly and eliminate the ollama dependency and associated risk.