Commit eeae910
Qwen3.6-27B + Kimi K2.6 evals complete, judge batch 2 submitted
Qwen3.6-27B and Kimi K2.6 both finished: 36/36 files, 1800/1800
records, 0 errors each. Kimi concurrency bumped to 20 after balance
refill resolved persistent 429s.
Sonnet 4.6 at 64%, DeepSeek V4 Pro at 44% — still running.
Judge batch 2 submitted via Vertex AI for 15,500 new completions
(Qwen full, Kimi full, Sonnet/DeepSeek partial).
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>1 parent 2bbe6cd commit eeae910
33 files changed
Lines changed: 16953 additions & 1 deletion
File tree
- completions
- c_sharp
- api_usage
- code2NL_NL2code
- code_purpose_understanding
- low_context
- pattern_matching
- syntax_completion
- cpp
- pattern_matching
- syntax_completion
- javascript/syntax_completion
- java
- api_usage
- code2NL_NL2code
- code_purpose_understanding
- low_context
- pattern_matching
- typescript
- api_usage
- code2NL_NL2code
- code_purpose_understanding
- low_context
- pattern_matching
- syntax_completion
Large diffs are not rendered by default.
Lines changed: 50 additions & 0 deletions
Large diffs are not rendered by default.
Lines changed: 50 additions & 0 deletions
Large diffs are not rendered by default.
Lines changed: 50 additions & 0 deletions
Large diffs are not rendered by default.
Lines changed: 50 additions & 0 deletions
Large diffs are not rendered by default.
Lines changed: 50 additions & 0 deletions
Large diffs are not rendered by default.
Lines changed: 50 additions & 0 deletions
Large diffs are not rendered by default.
Lines changed: 50 additions & 0 deletions
Large diffs are not rendered by default.
Lines changed: 50 additions & 0 deletions
Large diffs are not rendered by default.
Lines changed: 50 additions & 0 deletions
Large diffs are not rendered by default.
0 commit comments