Purpose
A shared, living list of Vally (and related microsoft/evaluate) issues our team has encountered — created so we have one clear place to track them and bring a consolidated picture to the Vally team.
We first ran into these while adopting Vally for the TypeSpec Authoring skill/benchmark, but most are likely not specific to our skill — we just hit them earlier because of the benchmark's scale and its use of some of Vally's more advanced features.
How to contribute 🙏
- If you've hit something similar, please 👍 or comment on the linked upstream issue
- If you've already filed your own Vally/evaluate issues, link them so we can consolidate rather than duplicate.
Vally / evaluate issues
Related: #14667
Purpose
A shared, living list of Vally (and related
microsoft/evaluate) issues our team has encountered — created so we have one clear place to track them and bring a consolidated picture to the Vally team.We first ran into these while adopting Vally for the TypeSpec Authoring skill/benchmark, but most are likely not specific to our skill — we just hit them earlier because of the benchmark's scale and its use of some of Vally's more advanced features.
How to contribute 🙏
Vally / evaluate issues
Related: #14667