Skip to content

[TypeSpec Authoring][Benchmark] Adopt SDK evaluation pipeline framework #16269

Description

@haolingdong-msft

Parent epic: #15726

Adopt the SDK evaluation pipeline framework for the TypeSpec authoring benchmark so evaluation runs use the shared/standard SDK eval pipeline infrastructure rather than a bespoke setup.

Scope

  • Onboard the TypeSpec authoring benchmark onto the SDK evaluation pipeline framework.
  • Align eval execution, result collection, and reporting with the shared framework conventions.
  • Reduce custom pipeline glue by reusing the framework's standard building blocks.

Created as a sub-issue of the "[Epic][TypeSpec Authoring][Benchmark] Continuous improvement" epic (#15726).

Metadata

Metadata

Labels

AzSDK Tools AgentIssue related to the AzSDK Tools Agent.dev inner loopIssues related to our project to enable agentic workflows for the dev inner loop.

Type

No type

Fields

No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions