Skip to content

ci: allow selecting exact PR E2E tests#1817

Open
jesseturner21 wants to merge 1 commit into
mainfrom
feat/pr-e2e-test-selection
Open

ci: allow selecting exact PR E2E tests#1817
jesseturner21 wants to merge 1 commit into
mainfrom
feat/pr-e2e-test-selection

Conversation

@jesseturner21

Copy link
Copy Markdown
Contributor

Description

Allow maintainers to manually run a specific E2E test against a PR head.

  • Add pr_number, test_selector, and test_name_pattern workflow-dispatch inputs.
  • Support Vitest file.test.ts:line selectors for an exact test declaration.
  • Validate selectors against tracked E2E test files and safely construct Vitest arguments as Bash arrays.
  • Route selected tests to the existing GA or harness runner while preserving automatic baseline and changed-file behavior.
  • Document the PR test-selection workflow.

Related Issue

Closes #1816

Documentation PR

N/A - documentation is included in this PR.

Type of Change

  • Bug fix
  • New feature
  • Breaking change
  • Documentation update
  • Other (please describe):

Testing

  • Parsed the workflow as YAML.

  • Parsed every embedded workflow run block with bash -n.

  • Verified formatting with Prettier.

  • Exercised GA and harness selector routing, invalid selector rejection, orphan name-pattern rejection, PR checkout resolution, and invalid PR-number rejection.

  • Verified Vitest file:line behavior with a two-test smoke fixture: the selected test passed and the deliberately failing unselected test was skipped.

  • I ran npm run test:unit and npm run test:integ

  • I ran npm run typecheck

  • I ran npm run lint

  • If I modified src/assets/, I ran npm run test:update-snapshots and committed the updated snapshots

Checklist

  • I have read the CONTRIBUTING document
  • I have added any necessary tests that prove my fix is effective or my feature works
  • I have updated the documentation accordingly
  • I have added an appropriate example to the documentation to outline the feature, or no new docs are needed
  • My changes generate no new warnings
  • Any dependent changes have been merged and published

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the
terms of your choice.

@jesseturner21
jesseturner21 requested a review from a team July 23, 2026 18:18
@github-actions github-actions Bot added size/m PR size: M agentcore-harness-reviewing AgentCore Harness review in progress and removed agentcore-harness-reviewing AgentCore Harness review in progress labels Jul 23, 2026
@agentcore-devx-automation agentcore-devx-automation Bot added the claude-security-reviewing Claude Code /security-review in progress label Jul 23, 2026
@github-actions

Copy link
Copy Markdown
Contributor

Package Tarball

aws-agentcore-0.24.1.tgz

How to install

gh release download pr-1817-tarball --repo aws/agentcore-cli --pattern "*.tgz" --dir /tmp/pr-tarball
npm install -g /tmp/pr-tarball/aws-agentcore-0.24.1.tgz

@agentcore-devx-automation

Copy link
Copy Markdown
Contributor

Claude Security Review: no high-confidence findings. (run)

@agentcore-devx-automation agentcore-devx-automation Bot removed the claude-security-reviewing Claude Code /security-review in progress label Jul 23, 2026
@github-actions

Copy link
Copy Markdown
Contributor

Coverage Report

Status Category Percentage Covered / Total
🔵 Lines 40.3% 15047 / 37333
🔵 Statements 39.56% 16037 / 40535
🔵 Functions 34.42% 2567 / 7457
🔵 Branches 33.71% 10016 / 29710
Generated in workflow #4187 for commit df1dccb by the Vitest Coverage Report Action

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

size/m PR size: M

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Allow selecting an exact E2E test for PR workflows

1 participant