Skip to content

[codex] Rename result row manifest to run_manifest#1563

Merged
christso merged 2 commits into
mainfrom
results-run-manifest
Jun 29, 2026
Merged

[codex] Rename result row manifest to run_manifest#1563
christso merged 2 commits into
mainfrom
results-run-manifest

Conversation

@christso

@christso christso commented Jun 29, 2026

Copy link
Copy Markdown
Collaborator

Summary

  • Rename new AgentV result row manifests from index.jsonl to run_manifest.jsonl while keeping RESULT_INDEX_FILENAME as a compatibility alias for existing callers.
  • Add manifest_path: "run_manifest.jsonl" to new summary.json artifacts and route shared readers through summary pointer, canonical manifest, then legacy index.jsonl.
  • Update CLI/dashboard/results/inspect/rerun/compare/trend/remote listing paths, docs, help text, and fixtures so new writes are canonical and legacy bundles remain readable without double-counting.

Validation

  • bun --filter @agentv/core build && bun --filter @agentv/sdk build
  • bun test apps/cli/test/commands/eval/result-layout.test.ts apps/cli/test/commands/eval/aggregate.test.ts apps/cli/test/commands/eval/artifact-writer.test.ts
  • bun test packages/core/test/evaluation/results-repo.test.ts packages/core/src/evaluation/results-repo-cache.test.ts packages/core/test/evaluation/evaluate-programmatic-api.test.ts packages/core/test/evaluation/orchestrator.test.ts
  • bun test apps/cli/test/commands/results/validate.test.ts apps/cli/test/commands/results/export.test.ts apps/cli/test/commands/results/export-e2e-providers.test.ts apps/cli/test/commands/results/report.test.ts apps/cli/test/commands/results/shared.test.ts apps/cli/test/commands/results/remote-auto-export.test.ts
  • bun test apps/cli/test/commands/compare/compare.test.ts apps/cli/test/commands/trend/trend.test.ts apps/cli/test/commands/runs/rerun.test.ts
  • bun run lint
  • bun run typecheck
  • Live dogfood with real Azure target and real Azure LLM grader: 1/1 pass, mean score 100%.

Evidence

  • Private evidence branch: EntityProcess/agentv-private:evidence/av-lxje-run-manifest
  • Evidence commit: 8d6ac2c
  • Captured bundle confirms summary.json has manifest_path: "run_manifest.jsonl", run_manifest.jsonl exists, and no new index.jsonl was written.
  • agentv results validate <target-bundle> exited 0 with one non-blocking warning because the validated target leaf directory is named azure rather than an ISO timestamp.

@cloudflare-workers-and-pages

cloudflare-workers-and-pages Bot commented Jun 29, 2026

Copy link
Copy Markdown

Deploying agentv with  Cloudflare Pages  Cloudflare Pages

Latest commit: a6ba0be
Status: ✅  Deploy successful!
Preview URL: https://c8f1b4e3.agentv.pages.dev
Branch Preview URL: https://results-run-manifest.agentv.pages.dev

View logs

@christso christso marked this pull request as ready for review June 29, 2026 08:55
@christso christso merged commit 681ee78 into main Jun 29, 2026
8 checks passed
@christso christso deleted the results-run-manifest branch June 29, 2026 09:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant