Skip to content

[Vally] Collect Vally issues encountered by Cloud Apps & Tools team #16303

Description

@haolingdong-msft

Purpose

A shared, living list of Vally (and related microsoft/evaluate) issues our team has encountered — created so we have one clear place to track them and bring a consolidated picture to the Vally team.

We first ran into these while adopting Vally for the TypeSpec Authoring skill/benchmark, but most are likely not specific to our skill — we just hit them earlier because of the benchmark's scale and its use of some of Vally's more advanced features.

How to contribute 🙏

  • If you've hit something similar, please 👍 or comment on the linked upstream issue
  • If you've already filed your own Vally/evaluate issues, link them so we can consolidate rather than duplicate.

Vally / evaluate issues

Related: #14667

Metadata

Metadata

Assignees

No one assigned

    Labels

    AzSDK Tools AgentIssue related to the AzSDK Tools Agent.Epicdev inner loopIssues related to our project to enable agentic workflows for the dev inner loop.

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions