ci: let the report gate warn on flaky instead of failing

3585110

Select commit

Loading

Failed to load commit list.

Uh oh!

There was an error while loading. Please reload this page.

Codecov

codecov/patch

codecov/project/Backend Components

codecov/project/backend

codecov/project/frontend

codecov/project/lfx

Label PRs with Conventional Commits on: pull_request_target 1

Validate PR

Label PR

Frontend Unit Test Results

Ruff Style Check on: pull_request

Ruff Style Check (3.13)

autofix.ci on: pull_request

autofix

Cross-Bundle Test on: pull_request 22

Discover bundles

src/bundles/amazon (py3.10)

src/bundles/amazon (py3.13)

src/bundles/anthropic (py3.10)

src/bundles/anthropic (py3.13)

src/bundles/arxiv (py3.10)

src/bundles/arxiv (py3.13)

src/bundles/azure (py3.10)

src/bundles/azure (py3.13)

src/bundles/cohere (py3.10)

src/bundles/cohere (py3.13)

src/bundles/datastax (py3.10)

src/bundles/datastax (py3.13)

src/bundles/docling (py3.10)

src/bundles/docling (py3.13)

src/bundles/duckduckgo (py3.10)

src/bundles/duckduckgo (py3.13)

src/bundles/empiriolabs (py3.10)

src/bundles/empiriolabs (py3.13)

src/bundles/exa (py3.10)

src/bundles/exa (py3.13)

src/bundles/firecrawl (py3.10)

src/bundles/firecrawl (py3.13)

src/bundles/google (py3.10)

src/bundles/google (py3.13)

src/bundles/ibm (py3.10)

src/bundles/ibm (py3.13)

src/bundles/lfx-bundles (py3.10)

src/bundles/lfx-bundles (py3.13)

src/bundles/nextplaid (py3.10)

src/bundles/nextplaid (py3.13)

src/bundles/ollama (py3.10)

src/bundles/ollama (py3.13)

src/bundles/openai (py3.10)

src/bundles/openai (py3.13)

src/bundles/openai-compatible (py3.10)

src/bundles/openai-compatible (py3.13)

src/bundles/oracle (py3.10)

src/bundles/oracle (py3.13)

src/bundles/paddle (py3.10)

src/bundles/paddle (py3.13)

src/bundles/toolguard (py3.10)

src/bundles/toolguard (py3.13)

src/bundles/valkey (py3.10)

src/bundles/valkey (py3.13)

src/bundles/vllm (py3.10)

src/bundles/vllm (py3.13)

Mend on: pull_request 1

mend-scan

CI Scripts Tests on: pull_request

Test CI release scripts

Smoke Tests on: pull_request

Backend Smoke Tests

LFX Smoke Tests

Frontend Smoke Tests

Comment Results

A11y / Component Unit Tests on: pull_request

jest-axe

Extension Migration Checks on: pull_request

Bundle release plan - version and metadata consistency

Migration table - bare-name uniqueness

Migration table - append-only

BUNDLE_API.md changelog gate

Router trust - no install/uninstall under /api/v1/extensions

Freeze lfx/components

No process-global os.environ writes in components

autofix.ci on: pull_request 2

Run Ruff Check and Format

Update Starter Projects

Update Component Index

Template Tests on: pull_request 3

test-starter-projects

A11y / IBM Equal Access Scans on: pull_request

Playwright scan runner

Test Coverage Advisor on: pull_request

Test Coverage Advisor

GP Backend Auto-update Strings on: pull_request

Auto-regenerate locales/en.json on PR branch

Database Migration Validation on: pull_request 3

Model/Migration Consistency

Background Execution Real-Service Tests (real Postgres + Redis)

Migration Pattern Validation

Pull Request Docs Draft on: pull_request

build-and-deploy

CI on: pull_request 147

Echo Inputs

Validate PR Title

Check PyPI Version Update

Should Run CI

Filter Paths

Run Backend Tests / Unit Tests - Python 3.10 - Group 1

Run Backend Tests / Unit Tests - Python 3.10 - Group 2

Run Backend Tests / Unit Tests - Python 3.10 - Group 3

Run Backend Tests / Unit Tests - Python 3.10 - Group 4

Run Backend Tests / Unit Tests - Python 3.10 - Group 5

Run Backend Tests / Unit Tests - Python 3.14 - Group 1

Run Backend Tests / Unit Tests - Python 3.14 - Group 2

Run Backend Tests / Unit Tests - Python 3.14 - Group 3

Run Backend Tests / Unit Tests - Python 3.14 - Group 4

Run Backend Tests / Unit Tests - Python 3.14 - Group 5

Run Backend Tests / Unit Tests (bundles installed) - Python 3.10

Run Backend Tests / Unit Tests (bundles installed) - Python 3.14

Run Backend Tests / Integration Tests - Python 3.10

Run Backend Tests / Integration Tests - Python 3.14

Run Backend Tests / LFX Tests - Python 3.10

Run Backend Tests / LFX Tests - Python 3.14

Run Backend Tests / Test CLI - Python 3.10

Run Backend Tests / Test CLI - Python 3.14

Lint Frontend / Run Biome

Run Frontend Unit Tests / Frontend Jest Unit Tests

Run Frontend Tests / Determine Test Suites and Shard Distribution

Run Frontend Tests / Live provider smoke tests

Run Frontend Tests / Live Store UI tests

Run Frontend Tests / Playwright Tests - Shard 1/70

Run Frontend Tests / Playwright Tests - Shard 2/70

Run Frontend Tests / Playwright Tests - Shard 3/70

Run Frontend Tests / Playwright Tests - Shard 4/70

Run Frontend Tests / Playwright Tests - Shard 5/70

Run Frontend Tests / Playwright Tests - Shard 6/70

Run Frontend Tests / Playwright Tests - Shard 7/70

Run Frontend Tests / Playwright Tests - Shard 8/70

Run Frontend Tests / Playwright Tests - Shard 9/70

Run Frontend Tests / Playwright Tests - Shard 10/70

Run Frontend Tests / Playwright Tests - Shard 11/70

Run Frontend Tests / Playwright Tests - Shard 12/70

Run Frontend Tests / Playwright Tests - Shard 13/70

Run Frontend Tests / Playwright Tests - Shard 14/70

Run Frontend Tests / Playwright Tests - Shard 15/70

Run Frontend Tests / Playwright Tests - Shard 16/70

Run Frontend Tests / Playwright Tests - Shard 17/70

Run Frontend Tests / Playwright Tests - Shard 18/70

Run Frontend Tests / Playwright Tests - Shard 19/70

Run Frontend Tests / Playwright Tests - Shard 20/70

Run Frontend Tests / Playwright Tests - Shard 21/70

Run Frontend Tests / Playwright Tests - Shard 22/70

Run Frontend Tests / Playwright Tests - Shard 23/70

Run Frontend Tests / Playwright Tests - Shard 24/70

Run Frontend Tests / Playwright Tests - Shard 25/70

Run Frontend Tests / Playwright Tests - Shard 26/70

Run Frontend Tests / Playwright Tests - Shard 27/70

Run Frontend Tests / Playwright Tests - Shard 28/70

Run Frontend Tests / Playwright Tests - Shard 29/70

Run Frontend Tests / Playwright Tests - Shard 30/70

Run Frontend Tests / Playwright Tests - Shard 31/70

Run Frontend Tests / Playwright Tests - Shard 32/70

Run Frontend Tests / Playwright Tests - Shard 33/70

Run Frontend Tests / Playwright Tests - Shard 34/70

Run Frontend Tests / Playwright Tests - Shard 35/70

Run Frontend Tests / Playwright Tests - Shard 36/70

Run Frontend Tests / Playwright Tests - Shard 37/70

Run Frontend Tests / Playwright Tests - Shard 38/70

Run Frontend Tests / Playwright Tests - Shard 39/70

Run Frontend Tests / Playwright Tests - Shard 40/70

Run Frontend Tests / Playwright Tests - Shard 41/70

Run Frontend Tests / Playwright Tests - Shard 42/70

Run Frontend Tests / Playwright Tests - Shard 43/70

Run Frontend Tests / Playwright Tests - Shard 44/70

Run Frontend Tests / Playwright Tests - Shard 45/70

Run Frontend Tests / Playwright Tests - Shard 46/70

Run Frontend Tests / Playwright Tests - Shard 47/70

Run Frontend Tests / Playwright Tests - Shard 48/70

Run Frontend Tests / Playwright Tests - Shard 49/70

Run Frontend Tests / Playwright Tests - Shard 50/70

Run Frontend Tests / Playwright Tests - Shard 51/70

Run Frontend Tests / Playwright Tests - Shard 52/70

Run Frontend Tests / Playwright Tests - Shard 53/70

Run Frontend Tests / Playwright Tests - Shard 54/70

Run Frontend Tests / Playwright Tests - Shard 55/70

Run Frontend Tests / Playwright Tests - Shard 56/70

Run Frontend Tests / Playwright Tests - Shard 57/70

Run Frontend Tests / Playwright Tests - Shard 58/70

Run Frontend Tests / Playwright Tests - Shard 59/70

Run Frontend Tests / Playwright Tests - Shard 60/70

Run Frontend Tests / Playwright Tests - Shard 61/70

Run Frontend Tests / Playwright Tests - Shard 62/70

Run Frontend Tests / Playwright Tests - Shard 63/70

Run Frontend Tests / Playwright Tests - Shard 64/70

Run Frontend Tests / Playwright Tests - Shard 65/70

Run Frontend Tests / Playwright Tests - Shard 66/70

Run Frontend Tests / Playwright Tests - Shard 67/70

Run Frontend Tests / Playwright Tests - Shard 68/70

Run Frontend Tests / Playwright Tests - Shard 69/70

Run Frontend Tests / Playwright Tests - Shard 70/70

Run Frontend Tests / Validate Playwright reports

Test Docs Build

Test Starter Templates

Test Docker Images / Test Docker images (first attempt)

Test Docker Images / Test Docker images (verify or retry)

Lint DESIGN.md

Merge Frontend Jest + Playwright Coverage Reports

CI Success

Select a check to view from the sidebar