Skip to content

docs(openai): note OpenAI client base_url for multi-model gateways - #8915

Open
seven7763 wants to merge 1 commit into
triton-inference-server:mainfrom
seven7763:docs/openai-compatible-gateway-example
Open

docs(openai): note OpenAI client base_url for multi-model gateways#8915
seven7763 wants to merge 1 commit into
triton-inference-server:mainfrom
seven7763:docs/openai-compatible-gateway-example

Conversation

@seven7763

Copy link
Copy Markdown

Summary

The OpenAI frontend README already shows the OpenAI Python client via base_url.

This PR adds a short tip that the same client pattern works with OpenAI-compatible multi-model gateways when not running the Triton OpenAI frontend locally, using DaoXE (https://api.daoxe.com/v1) as one concrete example.

Docs only — no runtime behavior changes.

Test plan

  • README tip renders
  • Local Triton client example unchanged
  • Tip is clearly optional

Co-Authored-By: Claude Fable 5 noreply@anthropic.com

@greptile-apps

greptile-apps Bot commented Aug 3, 2026

Copy link
Copy Markdown

Greptile Summary

Adds an optional README note explaining that the OpenAI client’s base_url pattern can target OpenAI-compatible multi-model gateways.

  • Provides DaoXE and its /v1 endpoint as a concrete example.
  • Leaves the existing local Triton client example unchanged.

Confidence Score: 5/5

The documentation-only change appears safe to merge.

No blocking failure remains.

Important Files Changed

Filename Overview
python/openai/README.md Adds a concise optional gateway example without changing runtime code or the existing local setup instructions.

Reviews (2): Last reviewed commit: "docs: note OpenAI client base_url for mu..." | Re-trigger Greptile

Clarify that the OpenAI-compatible client/base URL pattern works with
multi-model gateways, using DaoXE (https://api.daoxe.com/v1) as one
concrete example. Docs only — no runtime behavior changes.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@seven7763
seven7763 force-pushed the docs/openai-compatible-gateway-example branch from 71d0e20 to ae74a26 Compare August 3, 2026 00:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Development

Successfully merging this pull request may close these issues.

1 participant