Repository navigation
Python: Temporarily skip OpenAI integration tests - #14517
SergeyMenshykh merged 3 commits into
Conversation
…tials Disable failing OpenAI integration and sample cases while the CI API key returns HTTP 401. Keep other providers and OpenAPI cross-language coverage enabled. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
GitHub Actions
Inactive
GitHub Actions
Inactive
semantic-kernel-automation
Bot
added
the
python
GitHub Actions
Inactive
There was a problem hiding this comment.
Copilot review overview
🟡 Changes recommended
Live OpenAI agent and multimodality cases still use the same invalid CI credential and can fail the aggregate integration check.
Review effort: Balanced
Findings: 1
What changed in this PR
Temporarily disables OpenAI-dependent Python integration and sample tests while the CI credential returns HTTP 401.
Changes:
- Skips OpenAI parameter rows while preserving other providers.
- Disables affected OpenAI sample and cross-language tests.
- Leaves OpenAPI cross-language tests enabled.
| File | Description |
|---|---|
python/tests/samples/test_getting_started.py |
Skips two OpenAI notebooks. |
python/tests/samples/test_concepts.py |
Skips affected OpenAI samples. |
python/tests/integration/embeddings/test_embedding_service.py |
Skips OpenAI embedding coverage. |
python/tests/integration/embeddings/test_embedding_service_with_memory.py |
Skips OpenAI memory embedding coverage. |
python/tests/integration/cross_language/test_cross_language.py |
Skips OpenAI-backed prompt tests. |
python/tests/integration/completions/test_text_completion.py |
Skips OpenAI text completion. |
python/tests/integration/completions/test_conversation_summary_plugin.py |
Skips the OpenAI summary test. |
python/tests/integration/completions/test_chat_completions.py |
Skips OpenAI chat cases. |
python/tests/integration/completions/test_chat_completion_with_image_input_text_output.py |
Skips OpenAI image-input cases. |
python/tests/integration/completions/test_chat_completion_with_function_calling.py |
Skips OpenAI function-calling cases. |
💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.
![semantic-kernel-automation[bot]](https://avatars.githubusercontent.com/u/189665073?s=60&v=4){kind=small}
There was a problem hiding this comment.
MAF Automated Review — Iteration 1
Result: Findings reported
Scope: full PR (1 commit(s)): 8480934558f1
Model: gpt-5.6-sol
Overview
This PR adds targeted unconditional pytest skips around OpenAI-backed integration and sample cases while preserving Azure, other-provider, mocked OpenAPI, and unit coverage. Provider-specific parametrization and mock-backed tests constrain the blast radius. However, the memory sample gate still executes an OpenAI embedding sample without the new skip, so the same HTTP 401 can continue breaking the intended CI workflow.
Reviewed the supplied pull-request change set across correctness, security/reliability, architecture, and failure behavior.
1 verified finding remained after source verification (1 high) across 1 file. Details are attached to the affected lines below.
Affected areas: python/tests/samples/test_concepts.py
Extend the temporary invalid-credential skips to all remaining OpenAI agent and audio/image cases while preserving Azure parameters and existing expected-failure marks. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
GitHub Actions
Inactive
The memory merge gate enables this sample, which uses OpenAI embeddings and fails with HTTP 401. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
GitHub Actions
Inactive
Disable failing OpenAI integration and sample cases while the CI API key returns HTTP 401. Keep other providers and OpenAPI cross-language coverage enabled.
Motivation and Context
Description
Contribution Checklist