Skip to content

fix(providers): make Test probe chat completions, not just /models - #448

Open
HaoChiBao wants to merge 2 commits into
andrewyng:mainfrom
HaoChiBao:fix/431-provider-test-completions
Open

fix(providers): make Test probe chat completions, not just /models#448
HaoChiBao wants to merge 2 commits into
andrewyng:mainfrom
HaoChiBao:fix/431-provider-test-completions

Conversation

@HaoChiBao

@HaoChiBao HaoChiBao commented Aug 5, 2026

Copy link
Copy Markdown
Contributor

Summary

Fixes #431: provider Test only hit GET /models, so a base URL missing /v1 could look fine while real chat calls 404 and hang.

OpenAI-compatible Test now also probes POST /chat/completions. A 404 fails with a hint to add /v1.

Test plan

  • pytest tests/test_provider_verify.py
  • Manual: endpoint without /v1 fails Test; with /v1 succeeds

Closes #431

OpenAI-compatible verify can pass on a base missing /v1 if GET /models works; probing /chat/completions fails Test instead of hanging later turns.
Drop the extra helper and trim verify/test noise around the andrewyng#431 completions check.
@Jk16777

Jk16777 commented Aug 6, 2026

Copy link
Copy Markdown

go fuck yourself

@HaoChiBao

HaoChiBao commented Aug 6, 2026

Copy link
Copy Markdown
Contributor Author

go fuck yourself

what I do

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Provider "Test" reports success for an endpoint that can't serve completions — every task then hangs silently

2 participants