- When using a remote server - say, a large-scale vllm deployment like most companies and universities do - one sees itself looking for the model list.
The command
curl --header "Authorization: Bearer $OPENAI_COMPAT_API_KEY" $OPENAI_COMPAT_BASEURL/v1/models
would easily come out with such a JSON list.
Providers change models all the time - and one should not need to configure this by hand, when a simple model selection tool would suffice.
Check how opencode and hermes do it.
The command
would easily come out with such a JSON list.
Providers change models all the time - and one should not need to configure this by hand, when a simple model selection tool would suffice.
Check how opencode and hermes do it.