vLLM hosting setup configured to work in our setup with Traefik and nginx to limit exposed end-points.
This setup does not come with any authentication, but relies on correctly configured server firewalls to protect the exposed end-points.
| Name | Name | Last commit date | ||
|---|---|---|---|---|
vLLM hosting setup configured to work in our setup with Traefik and nginx to limit exposed end-points.
This setup does not come with any authentication, but relies on correctly configured server firewalls to protect the exposed end-points.