Skip to content

Fix CI pipeline failures across all workflows - #2620

Open
Ilya Matiach (imatiach-msft) wants to merge 1 commit into
mainfrom
fix-ci-pipeline-failures
Open

Fix CI pipeline failures across all workflows#2620
Ilya Matiach (imatiach-msft) wants to merge 1 commit into
mainfrom
fix-ci-pipeline-failures

Conversation

@imatiach-msft

@imatiach-msft Ilya Matiach (imatiach-msft) commented Mar 25, 2026

Copy link
Copy Markdown
Collaborator

Description

This pull request focuses on improving CI reliability and compatibility across platforms and environments. The main changes include workarounds for dependency issues with zope packages, a fix for Node.js path handling on macOS CI jobs, and updates to end-to-end test scripts to improve UI interaction robustness. Additionally, it replaces the deprecated deptree tool with pipdeptree for dependency checks.

CI/CD Workflow Improvements:

  • Added a step to force-reinstall zope.event and zope.interface with pip to resolve conda/pip compatibility issues in notebook and vision notebook CI workflows (.github/workflows/CI-e2e-notebooks.yml, .github/workflows/CI-e2e-notebooks-text-vision.yml). [1] [2]
  • For macOS in the raiwidgets pytest workflow, added a step to fix the Node.js PATH in login shells, ensuring the correct Node.js version is used for subsequent steps. Also, simplified the yarn installation steps by removing custom PATH overrides (.github/workflows/CI-raiwidgets-pytest.yml).

End-to-End Test Robustness:

  • Updated chart interaction steps in ensureChartsPivot and ensureNewCohortsShowUpInCharts to use .scrollIntoView() and { force: true } options, making UI tests more reliable by ensuring elements are visible and clickable (libs/e2e/src/lib/describer/modelAssessment/modelOverview/charts.ts, libs/e2e/src/lib/describer/modelAssessment/modelOverview/ensureNewCohortsShowUpInCharts.ts). [1] [2]

Dependency Management:

  • Replaced the deprecated deptree tool with pipdeptree in both the development requirements and the dependency tree test, aligning with current best practices (responsibleai/requirements-dev.txt, responsibleai/tests/test_dependencies.py). [1] [2]

Checklist

  • I have added screenshots above for all UI changes.
  • I have added e2e tests for all UI changes.
  • Documentation was updated if it was needed.

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Fixes CI instability/failures by pinning Python tooling, adjusting macOS Node.js PATH behavior for login shells, and de-flaking Cypress model overview E2E interactions.

Changes:

  • Pin setuptools<82 across release/CI workflows to avoid breakages from pkg_resources removal.
  • Add zope.event and zope.interface to rai_core_flask runtime requirements.
  • Stabilize E2E interactions by scrolling elements into view and using forced clicks; add a macOS Node PATH fix for CI-raiwidgets-pytest.

Reviewed changes

Copilot reviewed 21 out of 21 changed files in this pull request and generated 5 comments.

Show a summary per file
File Description
rai_core_flask/requirements.txt Adds zope.* dependencies for Flask core runtime.
libs/e2e/src/lib/describer/modelAssessment/modelOverview/ensureNewCohortsShowUpInCharts.ts Makes the cohort view button interaction more robust in Cypress.
libs/e2e/src/lib/describer/modelAssessment/modelOverview/charts.ts Makes chart pivot interactions more robust in Cypress.
.github/workflows/release-raiutils.yml Pins setuptools<82 during release tooling setup.
.github/workflows/release-rai-vision.yml Pins setuptools<82 during release tooling setup.
.github/workflows/release-rai-text.yml Pins setuptools<82 during release tooling setup.
.github/workflows/release-rai-test-utils.yml Pins setuptools<82 during release tooling setup.
.github/workflows/release-rai-tabular.yml Pins setuptools<82 during release tooling setup.
.github/workflows/release-nlp-feature-extractors.yml Pins setuptools<82 during release tooling setup.
.github/workflows/release-flask.yml Pins setuptools<82 during release tooling setup.
.github/workflows/release-erroranalysis.yml Pins setuptools<82 during release tooling setup.
.github/workflows/CI-responsibleai-text-vision-pytest.yml Pins setuptools<82 for CI tool bootstrap.
.github/workflows/CI-raiwidgets-pytest.yml Pins setuptools<82 and changes macOS Node PATH handling for login shells.
.github/workflows/CI-rai_core_flask-pytest.yml Pins setuptools<82 for CI tool bootstrap.
.github/workflows/CI-python.yml Pins setuptools<82 for CI tool bootstrap.
.github/workflows/CI-notebook.yml Pins setuptools<82 for CI tool bootstrap.
.github/workflows/CI-notebook-vision.yml Pins setuptools<82 for CI tool bootstrap.
.github/workflows/CI-notebook-text.yml Pins setuptools<82 for CI tool bootstrap.
.github/workflows/CI-e2e-notebooks.yml Pins setuptools<82 for CI tool bootstrap.
.github/workflows/CI-e2e-notebooks-text-vision.yml Pins setuptools<82 for CI tool bootstrap.
.github/workflows/CD.yml Pins setuptools<82 during CD tool bootstrap.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread rai_core_flask/requirements.txt Outdated
Comment thread .github/workflows/CI-raiwidgets-pytest.yml Outdated
Comment thread libs/e2e/src/lib/describer/modelAssessment/modelOverview/charts.ts
Comment thread libs/e2e/src/lib/describer/modelAssessment/modelOverview/charts.ts
@codecov-commenter

Codecov Comments Bot (codecov-commenter) commented Mar 25, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 70.18%. Comparing base (d3222db) to head (3e04185).
⚠️ Report is 3 commits behind head on main.

Additional details and impacted files
@@           Coverage Diff           @@
##             main    #2620   +/-   ##
=======================================
  Coverage   70.18%   70.18%           
=======================================
  Files          18       18           
  Lines        1278     1278           
=======================================
  Hits          897      897           
  Misses        381      381           
Flag Coverage Δ
unittests 70.18% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

- Replace deptree with pipdeptree (compatible with setuptools 82+)
- Fix zope package metadata in e2e notebook CIs (conda/pip conflict)
- Fix macOS Node.js PATH in CI-raiwidgets-pytest via bash_profile export
- Fix flaky Cypress model overview test with scrollIntoView and force click
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants