Daily AI model performance comparison across code generation, translation, and long-context summarization. Data is automatically generated and updated daily at 03:00 UTC+8.
(Auto-updated daily from our Benchmark script)
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 3.87s | 4.65s | 2.58s |
| deepseek-v4-pro-202606 | 4.73s | 3.84s | 2.88s |
| qwen3.5-flash | 1.44s | 11.03s | 12.02s |
| qwen3.6-flash | 6.25s | 13.34s | 4.18s |
| qwen3.5-plus | 4.21s | 22.87s | 40.69s |
| qwen3.7-plus | 25.32s | 7.33s | 29.39s |
| qwen3.7-plus-1m | 24.97s | 7.59s | 30.97s |
| qwq-plus | 297.23s | 90.31s | 52.5s |
| qwen3-vl-plus | 3.04s | 0.49s | 1.37s |
| dola-Seed-2.0-mini | 8.34s | 4.37s | 2.86s |
| dola-Seed-2.0-lite | 16.79s | 9.84s | 8.22s |
| dola-Seed-2.0-pro | 10.59s | 6.78s | 3.54s |
| dola-Seed-2.1-turbo | 30.99s | 33.25s | 32.34s |
| hy3 | 3.81s | 1.23s | 1.88s |
| kimi-k3 | 6.07s | 4.04s | 3.48s |
| glm-5.1 | 10.03s | 6.44s | 5.61s |
| glm-5.2 | 3.12s | 2.24s | 1.86s |
| glm-5-turbo | 3.02s | 2.12s | 2.14s |
| glm-5v-turbo | 3.72s | 1.48s | 1.34s |
| hy-mt2-plus | 2.0s | 0.71s | 1.16s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.29s | 2.66s | 2.29s |
| deepseek-v4-pro-202606 | 4.96s | 3.62s | 2.9s |
| qwen3.5-flash | 1.64s | 6.31s | 3.71s |
| qwen3.6-flash | 10.23s | 6.84s | 6.28s |
| qwen3.5-plus | 4.12s | 19.3s | 8.92s |
| qwen3.7-plus | 25.05s | 8.11s | 16.98s |
| qwen3.7-plus-1m | 22.24s | 8.44s | 28.09s |
| qwq-plus | 67.52s | 23.39s | 12.4s |
| qwen3-vl-plus | 2.68s | 0.71s | 1.22s |
| dola-Seed-2.0-mini | 8.63s | 3.06s | 2.82s |
| dola-Seed-2.0-lite | 17.5s | 9.39s | 5.32s |
| dola-Seed-2.0-pro | 12.83s | 4.38s | 5.1s |
| dola-Seed-2.1-turbo | 33.92s | 30.49s | 17.85s |
| hy3 | 3.3s | 1.22s | 1.92s |
| kimi-k3 | 6.65s | 4.74s | 3.92s |
| glm-5.1 | 8.78s | 8.19s | 7.14s |
| glm-5.2 | 3.44s | 2.1s | 2.36s |
| glm-5-turbo | 3.95s | 1.78s | 18.16s |
| glm-5v-turbo | 3.22s | 1.35s | 1.31s |
| hy-mt2-plus | 1.96s | 0.72s | 1.14s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.05s | 2.53s | 2.65s |
| deepseek-v4-pro-202606 | 4.49s | 3.3s | 2.85s |
| qwen3.5-flash | 1.68s | 9.11s | 4.3s |
| qwen3.6-flash | 9.72s | 7.38s | 9.52s |
| qwen3.5-plus | 4.8s | 26.79s | 45.46s |
| qwen3.7-plus | 32.4s | 7.46s | 26.4s |
| qwen3.7-plus-1m | 32.28s | 7.39s | 31.99s |
| qwq-plus | 51.5s | 16.61s | 17.21s |
| qwen3-vl-plus | 3.45s | 0.42s | 1.17s |
| dola-Seed-2.0-mini | 6.52s | 4.51s | 2.47s |
| dola-Seed-2.0-lite | 19.74s | 14.0s | 9.41s |
| dola-Seed-2.0-pro | 12.36s | 5.12s | 3.42s |
| dola-Seed-2.1-turbo | 31.77s | 24.94s | 22.81s |
| hy3 | 3.05s | 1.19s | 2.65s |
| kimi-k3 | 5.85s | 3.92s | 3.16s |
| glm-5.1 | 8.46s | 7.44s | 6.26s |
| glm-5.2 | 5.23s | 3.58s | 2.05s |
| glm-5-turbo | 3.52s | 2.11s | 1.47s |
| glm-5v-turbo | 2.18s | 1.86s | 1.52s |
| hy-mt2-plus | 1.78s | 0.63s | 1.16s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.33s | 5.61s | 2.16s |
| deepseek-v4-pro-202606 | 4.13s | 3.49s | 2.62s |
| qwen3.5-flash | 1.49s | 6.35s | 4.32s |
| qwen3.6-flash | 11.6s | 18.37s | 10.03s |
| qwen3.5-plus | 4.52s | 22.99s | 54.36s |
| qwen3.7-plus | 26.25s | 8.0s | 21.62s |
| qwen3.7-plus-1m | 23.46s | 8.3s | 21.86s |
| qwq-plus | 64.99s | 22.66s | 13.61s |
| qwen3-vl-plus | 2.94s | 0.45s | 1.84s |
| dola-Seed-2.0-mini | 7.08s | 3.57s | 2.73s |
| dola-Seed-2.0-lite | 24.58s | 15.52s | 10.07s |
| dola-Seed-2.0-pro | 13.9s | 6.89s | 3.7s |
| dola-Seed-2.1-turbo | 29.89s | 23.05s | 16.78s |
| hy3 | 3.14s | 1.19s | 1.96s |
| kimi-k3 | 7.74s | 4.53s | 3.42s |
| glm-5.1 | 8.57s | 7.2s | 5.84s |
| glm-5.2 | 5.52s | 2.31s | 1.9s |
| glm-5-turbo | 5.1s | 1.6s | 1.71s |
| glm-5v-turbo | 2.58s | 2.37s | 1.99s |
| hy-mt2-plus | 2.07s | 0.76s | 1.15s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.31s | 8.72s | 2.61s |
| deepseek-v4-pro-202606 | 6.22s | 4.1s | 3.07s |
| qwen3.5-flash | 1.48s | 6.39s | 13.99s |
| qwen3.6-flash | 14.77s | 18.81s | 8.15s |
| qwen3.5-plus | 5.03s | 59.66s | 33.72s |
| qwen3.7-plus | 21.97s | 8.55s | 14.33s |
| qwen3.7-plus-1m | 25.3s | 8.52s | 35.1s |
| qwq-plus | 61.6s | 17.43s | 17.77s |
| qwen3-vl-plus | 3.49s | 0.42s | 1.44s |
| dola-Seed-2.0-mini | 5.74s | 3.75s | 2.84s |
| dola-Seed-2.0-lite | 19.17s | 10.21s | 7.62s |
| dola-Seed-2.0-pro | 10.9s | 6.22s | 3.42s |
| dola-Seed-2.1-turbo | 46.02s | 21.48s | 21.11s |
| hy3 | 3.09s | 1.17s | 2.17s |
| kimi-k3 | 6.18s | 4.17s | 3.34s |
| glm-5.1 | 11.03s | 7.31s | 6.54s |
| glm-5.2 | 3.63s | 3.94s | 2.13s |
| glm-5-turbo | 6.11s | 3.06s | 2.25s |
| glm-5v-turbo | 2.12s | 1.97s | 2.04s |
| hy-mt2-plus | 1.93s | 0.79s | 1.18s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.36s | 2.69s | 2.27s |
| deepseek-v4-pro-202606 | 4.7s | 3.32s | 2.7s |
| qwen3.5-flash | 1.75s | 6.43s | 11.84s |
| qwen3.6-flash | 15.72s | 7.74s | 10.26s |
| qwen3.5-plus | 4.51s | 29.52s | 23.11s |
| qwen3.7-plus | 26.17s | 11.11s | 21.65s |
| qwen3.7-plus-1m | 24.21s | 8.37s | 25.66s |
| qwq-plus | 61.78s | 16.73s | 15.31s |
| qwen3-vl-plus | 4.42s | 0.95s | 1.49s |
| dola-Seed-2.0-mini | 6.0s | 4.67s | 2.83s |
| dola-Seed-2.0-lite | 28.12s | 21.41s | 12.92s |
| dola-Seed-2.0-pro | 9.76s | 5.89s | 4.43s |
| dola-Seed-2.1-turbo | 28.31s | 42.22s | 14.33s |
| hy3 | 3.25s | 1.2s | 1.94s |
| kimi-k3 | 6.77s | 3.57s | 3.34s |
| glm-5.1 | 9.38s | 6.08s | 7.0s |
| glm-5.2 | 5.0s | 2.41s | 2.13s |
| glm-5-turbo | 3.68s | 1.66s | 103.86s |
| glm-5v-turbo | 2.32s | 1.68s | 1.67s |
| hy-mt2-plus | 2.04s | 0.67s | 1.19s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.72s | 3.18s | 2.37s |
| deepseek-v4-pro-202606 | 4.42s | 3.36s | 2.91s |
| qwen3.5-flash | 1.44s | 6.64s | 3.76s |
| qwen3.6-flash | 13.99s | 9.34s | 7.85s |
| qwen3.5-plus | 4.88s | 34.38s | 20.43s |
| qwen3.7-plus | 24.02s | 7.68s | 51.08s |
| qwen3.7-plus-1m | 23.97s | 11.16s | 17.44s |
| qwq-plus | 61.61s | 62.35s | 16.32s |
| qwen3-vl-plus | 3.76s | 0.94s | 1.64s |
| dola-Seed-2.0-mini | 5.47s | 3.87s | 3.09s |
| dola-Seed-2.0-lite | 21.52s | 11.18s | 6.76s |
| dola-Seed-2.0-pro | 14.13s | 5.78s | 3.24s |
| dola-Seed-2.1-turbo | 46.55s | 30.1s | 18.12s |
| hy3 | 3.27s | 1.25s | 2.05s |
| kimi-k3 | 6.41s | 4.99s | 3.85s |
| glm-5.1 | 9.07s | 5.53s | 6.69s |
| glm-5.2 | 3.38s | 2.4s | 2.42s |
| glm-5-turbo | 3.12s | 1.63s | 1.69s |
| glm-5v-turbo | 2.14s | 1.34s | 1.43s |
| hy-mt2-plus | 1.92s | 0.6s | 1.17s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.32s | 2.84s | 2.32s |
| deepseek-v4-pro-202606 | 4.46s | 3.65s | 2.45s |
| qwen3.5-flash | 1.67s | 8.21s | 8.37s |
| qwen3.6-flash | 14.23s | 12.41s | 10.48s |
| qwen3.5-plus | 4.05s | 26.85s | 39.14s |
| qwen3.7-plus | 25.21s | 8.35s | 29.7s |
| qwen3.7-plus-1m | 25.1s | 8.12s | 29.58s |
| qwq-plus | 102.14s | 26.32s | 21.09s |
| qwen3-vl-plus | 4.24s | 0.52s | 1.64s |
| dola-Seed-2.0-mini | 8.23s | 5.05s | 3.02s |
| dola-Seed-2.0-lite | 20.08s | 13.96s | 7.79s |
| dola-Seed-2.0-pro | 11.21s | 5.33s | 3.27s |
| dola-Seed-2.1-turbo | 43.95s | 24.45s | 17.34s |
| hy3 | 3.17s | 1.27s | 1.9s |
| kimi-k3 | 5.39s | 4.57s | 3.51s |
| glm-5.1 | 10.24s | 5.07s | 5.57s |
| glm-5.2 | 3.39s | 2.13s | 2.43s |
| glm-5-turbo | 4.16s | 2.82s | 1.75s |
| glm-5v-turbo | 2.34s | 1.28s | 1.52s |
| hy-mt2-plus | 1.93s | 0.75s | 1.14s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 3.9s | 2.16s | 2.07s |
| deepseek-v4-pro-202606 | 3.98s | 3.26s | 3.25s |
| qwen3.5-flash | 1.5s | 9.28s | 3.75s |
| qwen3.6-flash | 8.12s | 28.36s | 14.57s |
| qwen3.5-plus | 4.16s | 53.95s | 28.05s |
| qwen3.7-plus | 25.02s | 8.53s | 33.89s |
| qwen3.7-plus-1m | 27.39s | 9.74s | 36.1s |
| qwq-plus | 85.84s | 54.54s | 16.66s |
| qwen3-vl-plus | 3.2s | 0.48s | 1.09s |
| dola-Seed-2.0-mini | 5.47s | 3.77s | 2.95s |
| dola-Seed-2.0-lite | 23.65s | 11.19s | 9.1s |
| dola-Seed-2.0-pro | 11.89s | 4.34s | 10.27s |
| dola-Seed-2.1-turbo | 23.57s | 16.17s | 14.57s |
| hy3 | 3.18s | 1.31s | 1.95s |
| kimi-k3 | 7.45s | 4.23s | 3.63s |
| glm-5.1 | 14.09s | 13.44s | 11.74s |
| glm-5.2 | 3.13s | 2.58s | 1.9s |
| glm-5-turbo | 2.54s | 1.93s | 4.97s |
| glm-5v-turbo | 2.33s | 1.46s | 1.36s |
| hy-mt2-plus | 2.06s | 0.79s | 1.25s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 12.91s | 2.25s | 2.05s |
| deepseek-v4-pro-202606 | 3.9s | 2.91s | 2.28s |
| qwen3.5-flash | 1.47s | 13.9s | 8.09s |
| qwen3.6-flash | 13.05s | 11.09s | 5.29s |
| qwen3.5-plus | 5.65s | 31.76s | 44.37s |
| qwen3.7-plus | 20.77s | 8.18s | 26.55s |
| qwen3.7-plus-1m | 33.04s | 8.53s | 25.91s |
| qwq-plus | 112.2s | 88.26s | 76.18s |
| qwen3-vl-plus | 4.34s | 0.52s | 1.59s |
| dola-Seed-2.0-mini | 5.74s | 4.68s | 2.96s |
| dola-Seed-2.0-lite | 14.79s | 10.29s | 6.39s |
| dola-Seed-2.0-pro | 11.48s | 5.13s | 4.32s |
| dola-Seed-2.1-turbo | 35.11s | 17.11s | 10.46s |
| hy3 | 3.02s | 1.13s | 1.99s |
| kimi-k3 | 7.56s | 4.53s | 3.6s |
| glm-5.1 | 9.47s | 14.16s | 14.62s |
| glm-5.2 | 3.38s | 2.39s | 2.03s |
| glm-5-turbo | 4.41s | 2.41s | 2.06s |
| glm-5v-turbo | 2.63s | 2.82s | 1.93s |
| hy-mt2-plus | 1.93s | 0.84s | 1.14s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | FAIL | FAIL | FAIL |
| deepseek-v4-pro-202606 | FAIL | FAIL | FAIL |
| qwen3.5-flash | 1.86s | 6.37s | 3.79s |
| qwen3.6-flash | 9.63s | 9.84s | 9.69s |
| qwen3.5-plus | 5.66s | 36.67s | 24.95s |
| qwen3.7-plus | 18.85s | 9.5s | 26.64s |
| qwen3.7-plus-1m | 26.0s | 9.35s | 19.36s |
| qwq-plus | 76.71s | 44.41s | 26.73s |
| qwen3-vl-plus | 3.74s | 0.47s | 1.35s |
| dola-Seed-2.0-mini | 5.94s | 3.58s | 2.73s |
| dola-Seed-2.0-lite | 20.43s | 9.75s | 7.18s |
| dola-Seed-2.0-pro | 12.99s | 5.9s | 4.3s |
| dola-Seed-2.1-turbo | 34.55s | 25.85s | 19.21s |
| hy3 | FAIL | FAIL | FAIL |
| kimi-k3 | FAIL | FAIL | FAIL |
| glm-5.1 | FAIL | FAIL | FAIL |
| glm-5.2 | FAIL | FAIL | FAIL |
| glm-5-turbo | FAIL | FAIL | FAIL |
| glm-5v-turbo | FAIL | FAIL | FAIL |
| hy-mt2-plus | FAIL | FAIL | FAIL |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.29s | 2.34s | 2.02s |
| deepseek-v4-pro-202606 | 4.24s | 2.96s | 2.48s |
| qwen3.5-flash | 4.87s | 9.07s | 3.7s |
| qwen3.6-flash | 17.22s | 9.3s | 9.6s |
| qwen3.5-plus | 6.02s | 18.12s | 23.8s |
| qwen3.7-plus | 19.39s | 8.37s | 34.55s |
| qwen3.7-plus-1m | 21.12s | 8.84s | 18.56s |
| qwq-plus | 30.5s | 24.66s | 13.12s |
| qwen3-vl-plus | 3.65s | 0.66s | 1.38s |
| dola-Seed-2.0-mini | 8.03s | 4.93s | 2.68s |
| dola-Seed-2.0-lite | 15.55s | 13.15s | 8.7s |
| dola-Seed-2.0-pro | 16.16s | 13.17s | 4.12s |
| dola-Seed-2.1-turbo | 41.36s | 17.68s | 11.5s |
| hy3 | 3.07s | 1.26s | 2.0s |
| kimi-k3 | 38.2s | 37.13s | 22.2s |
| glm-5.1 | FAIL | FAIL | FAIL |
| glm-5.2 | FAIL | FAIL | FAIL |
| glm-5-turbo | FAIL | FAIL | FAIL |
| glm-5v-turbo | FAIL | FAIL | FAIL |
| hy-mt2-plus | FAIL | FAIL | FAIL |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.88s | 2.32s | 2.24s |
| deepseek-v4-pro-202606 | 3.99s | 3.26s | 2.31s |
| qwen3.5-flash | 1.47s | 9.13s | 3.72s |
| qwen3.6-flash | 9.23s | 6.47s | 6.84s |
| qwen3.5-plus | 5.88s | 61.86s | 28.59s |
| qwen3.7-plus | 24.98s | 7.06s | 31.29s |
| qwen3.7-plus-1m | 23.15s | 9.28s | 34.05s |
| qwq-plus | 33.14s | 24.48s | 19.42s |
| qwen3-vl-plus | 3.46s | 0.49s | 1.15s |
| dola-Seed-2.0-mini | 6.22s | 6.47s | 3.39s |
| dola-Seed-2.0-lite | 20.0s | 9.42s | 8.3s |
| dola-Seed-2.0-pro | 14.43s | 5.56s | 4.44s |
| dola-Seed-2.1-turbo | 36.55s | 24.19s | 14.33s |
| hy3 | 3.49s | 1.2s | 2.0s |
| kimi-k3 | 8.65s | 6.03s | 4.04s |
| glm-5.1 | 2.96s | 2.27s | 1.86s |
| glm-5.2 | 3.34s | 2.67s | 1.92s |
| glm-5-turbo | 4.69s | 1.91s | 1.37s |
| glm-5v-turbo | 2.56s | 1.23s | 1.41s |
| hy-mt2-plus | 1.8s | 0.72s | 1.02s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.48s | 2.33s | 2.09s |
| deepseek-v4-pro-202606 | 4.96s | 3.0s | 2.3s |
| qwen3.5-flash | 15.11s | 7.1s | 3.78s |
| qwen3.6-flash | 9.46s | 16.49s | 4.84s |
| qwen3.5-plus | 5.42s | 32.95s | 49.8s |
| qwen3.7-plus | 28.04s | 10.1s | 33.96s |
| qwen3.7-plus-1m | 25.18s | 9.06s | 31.48s |
| qwq-plus | 45.38s | 51.72s | 21.03s |
| qwen3-vl-plus | 3.22s | 1.06s | 1.58s |
| dola-Seed-2.0-mini | 9.06s | 4.76s | 2.88s |
| dola-Seed-2.0-lite | 19.72s | 12.12s | 7.17s |
| dola-Seed-2.0-pro | 12.61s | 4.16s | 4.65s |
| dola-Seed-2.1-turbo | 37.6s | 13.45s | 13.44s |
| hy3 | 3.38s | 1.15s | 2.04s |
| kimi-k3 | 9.39s | 4.77s | 4.2s |
| glm-5.1 | 8.4s | 6.07s | 4.45s |
| glm-5.2 | 3.69s | 3.47s | 2.06s |
| glm-5-turbo | 3.55s | 2.33s | 2.11s |
| glm-5v-turbo | 2.66s | 1.52s | 1.48s |
| hy-mt2-plus | 1.88s | 0.68s | 1.11s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 3.79s | 2.21s | 1.87s |
| deepseek-v4-pro-202606 | 4.16s | 2.1s | 2.18s |
| qwen3.5-flash | 1.46s | 10.2s | 3.78s |
| qwen3.6-flash | 12.66s | 9.14s | 5.56s |
| qwen3.5-plus | 6.2s | 30.35s | 26.33s |
| qwen3.7-plus | 23.78s | 8.48s | 28.53s |
| qwen3.7-plus-1m | 23.58s | 8.8s | 28.8s |
| qwq-plus | 67.47s | 23.62s | 19.0s |
| qwen3-vl-plus | 4.49s | 0.56s | 1.39s |
| dola-Seed-2.0-mini | 8.8s | 5.77s | 3.92s |
| dola-Seed-2.0-lite | 17.91s | 10.71s | 6.76s |
| dola-Seed-2.0-pro | 10.01s | 5.53s | 3.47s |
| dola-Seed-2.1-turbo | 14.65s | 14.92s | 14.15s |
| hy3 | 3.2s | 1.29s | 1.99s |
| kimi-k3 | 7.74s | 5.16s | 4.39s |
| glm-5.1 | 10.24s | 5.76s | 5.84s |
| glm-5.2 | 3.87s | 3.18s | 1.88s |
| glm-5-turbo | 2.65s | 2.63s | 3.65s |
| glm-5v-turbo | 2.58s | 1.69s | 1.37s |
| hy-mt2-plus | 1.93s | 0.59s | 1.03s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 3.82s | 1.9s | 1.96s |
| deepseek-v4-pro-202606 | 4.34s | 2.88s | 2.25s |
| qwen3.5-flash | 1.43s | 6.32s | 4.03s |
| qwen3.6-flash | 8.06s | 11.17s | 7.53s |
| qwen3.5-plus | 6.19s | 45.46s | 40.85s |
| qwen3.7-plus | 34.42s | 9.71s | 31.63s |
| qwen3.7-plus-1m | 34.54s | 9.03s | 32.93s |
| qwq-plus | 31.69s | 38.59s | 13.36s |
| qwen3-vl-plus | 3.29s | 0.6s | 1.79s |
| dola-Seed-2.0-mini | 9.01s | 5.74s | 2.5s |
| dola-Seed-2.0-lite | 19.23s | 12.16s | 7.73s |
| dola-Seed-2.0-pro | 12.76s | 4.86s | 4.28s |
| dola-Seed-2.1-turbo | 31.06s | 15.94s | 7.01s |
| hy3 | 3.15s | 1.33s | 1.88s |
| kimi-k3 | 7.83s | 5.06s | 4.57s |
| glm-5.1 | 7.21s | 2.45s | 2.38s |
| glm-5.2 | 3.71s | 3.01s | 2.07s |
| glm-5-turbo | 63.9s | 2.48s | 2.05s |
| glm-5v-turbo | 2.34s | 1.74s | 1.37s |
| hy-mt2-plus | 2.03s | 0.61s | 1.05s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 3.3s | 2.18s | 1.96s |
| deepseek-v4-pro-202606 | 3.54s | 2.55s | 2.39s |
| qwen3.5-flash | 1.48s | 11.54s | 6.26s |
| qwen3.6-flash | 9.12s | 13.52s | 8.92s |
| qwen3.5-plus | 6.09s | 36.04s | 29.87s |
| qwen3.7-plus | 24.08s | 9.11s | 31.14s |
| qwen3.7-plus-1m | 33.2s | 8.76s | 33.75s |
| qwq-plus | 81.39s | 21.82s | 15.86s |
| qwen3-vl-plus | 4.11s | 0.51s | 1.49s |
| dola-Seed-2.0-mini | 6.04s | 4.01s | 2.82s |
| dola-Seed-2.0-lite | 16.01s | 15.51s | 8.77s |
| dola-Seed-2.0-pro | 11.79s | 4.97s | 3.66s |
| dola-Seed-2.1-turbo | 23.57s | 17.14s | 14.87s |
| hy3 | 3.24s | 1.23s | 1.78s |
| kimi-k3 | 7.76s | 5.26s | 4.13s |
| glm-5.1 | 7.16s | 6.75s | 1.86s |
| glm-5.2 | 3.35s | 2.68s | 1.89s |
| glm-5-turbo | 4.71s | 10.85s | 1.8s |
| glm-5v-turbo | 3.06s | 1.69s | 1.36s |
| hy-mt2-plus | 1.88s | 0.75s | 1.06s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.12s | 2.26s | 2.0s |
| deepseek-v4-pro-202606 | 4.02s | 2.07s | 2.3s |
| qwen3.5-flash | 1.72s | 8.48s | 8.04s |
| qwen3.6-flash | 8.63s | 10.71s | 7.38s |
| qwen3.5-plus | 5.97s | 25.86s | 31.74s |
| qwen3.7-plus | 23.9s | 8.88s | 23.26s |
| dola-Seed-2.0-lite | 19.27s | 9.96s | 7.75s |
| dola-Seed-2.0-mini | 8.07s | 4.94s | 3.48s |
| dola-Seed-2.0-pro | 12.22s | 3.59s | 4.49s |
| dola-Seed-2.1-turbo | 27.35s | 13.0s | 12.9s |
| hy3 | 3.04s | 1.29s | 1.84s |
| kimi-k3 | 6.71s | 4.94s | 4.55s |
| glm-5.2 | 10.86s | 3.07s | 2.27s |
| hy-mt2-plus | 2.16s | 0.71s | 1.01s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 24.45s | 2.18s | 1.82s |
| deepseek-v4-pro-202606 | 4.08s | 2.78s | 2.51s |
| qwen3.5-flash | 1.83s | 6.46s | 3.9s |
| qwen3.6-flash | 13.56s | 11.21s | 12.73s |
| qwen3.5-plus | 6.49s | 47.3s | 23.84s |
| qwen3.7-plus | 25.95s | 9.31s | 22.43s |
| dola-Seed-2.0-lite | 20.09s | 10.42s | 7.84s |
| dola-Seed-2.0-mini | 8.24s | 8.91s | 2.98s |
| dola-Seed-2.0-pro | 11.55s | 5.26s | 4.81s |
| dola-Seed-2.1-turbo | 46.41s | 23.68s | 12.16s |
| hy3 | 4.24s | 1.23s | 1.73s |
| kimi-k3 | 15.29s | 5.82s | 4.07s |
| glm-5.2 | 4.65s | 3.52s | 2.48s |
| hy-mt2-plus | 2.02s | 0.62s | 1.06s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.96s | 1.96s | 1.91s |
| deepseek-v4-pro-202606 | 4.28s | 2.57s | 2.27s |
| qwen3.5-flash | 1.45s | 12.9s | 3.75s |
| qwen3.6-flash | 16.59s | 10.06s | 7.16s |
| qwen3.5-plus | 5.23s | 34.73s | 22.06s |
| qwen3.7-plus | 20.23s | 9.63s | 30.57s |
| dola-Seed-2.0-lite | 16.95s | 12.2s | 7.31s |
| dola-Seed-2.0-mini | 12.86s | 5.12s | 3.98s |
| dola-Seed-2.0-pro | 13.94s | 3.92s | 4.98s |
| dola-Seed-2.1-turbo | 32.08s | 10.9s | 5.35s |
| hy3 | 3.23s | 1.24s | 1.91s |
| kimi-k3 | FAIL | FAIL | FAIL |
| glm-5.2 | 3.38s | 2.55s | 2.61s |
| hy-mt2-plus | 2.04s | 0.71s | 0.89s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 3.85s | 2.25s | 1.87s |
| deepseek-v4-pro-202606 | 4.16s | 2.78s | 2.33s |
| qwen3.5-flash | 1.48s | 8.93s | 10.1s |
| qwen3.6-flash | 11.91s | 16.2s | 10.54s |
| qwen3.5-plus | 6.09s | 51.01s | 62.1s |
| qwen3.7-plus | 27.05s | 8.3s | 22.04s |
| dola-Seed-2.0-lite | 18.71s | 11.52s | 6.51s |
| dola-Seed-2.0-mini | 6.9s | 6.37s | 3.21s |
| dola-Seed-2.0-pro | 13.33s | 5.52s | 4.32s |
| dola-Seed-2.1-turbo | 33.95s | 18.11s | 16.04s |
| hy3 | 3.06s | 1.26s | 1.99s |
| kimi-k3 | FAIL | FAIL | FAIL |
| glm-5.2 | 4.67s | 2.43s | 2.87s |
| hy-mt2-plus | 1.99s | 0.67s | 0.97s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 3.52s | 1.99s | 1.72s |
| deepseek-v4-pro-202606 | 3.3s | 2.56s | 1.93s |
| qwen3.5-flash | 17.61s | 10.28s | 11.49s |
| qwen3.6-flash | 14.81s | 9.36s | 7.37s |
| qwen3.5-plus | 4.76s | 37.24s | 23.9s |
| qwen3.7-plus | 27.62s | 11.94s | 32.49s |
| dola-Seed-2.0-lite | 15.9s | 9.36s | 6.14s |
| dola-Seed-2.0-mini | 6.08s | 2.85s | 2.76s |
| dola-Seed-2.0-pro | 12.02s | 6.82s | 4.3s |
| glm-5.2 | 4.53s | 3.3s | 2.9s |
| hy-mt2-plus | 1.9s | 0.6s | 1.16s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 3.87s | 4.65s | 2.58s |
| deepseek-v4-pro-202606 | 4.73s | 3.84s | 2.88s |
| qwen3.5-flash | 1.44s | 11.03s | 12.02s |
| qwen3.6-flash | 6.25s | 13.34s | 4.18s |
| qwen3.5-plus | 4.21s | 22.87s | 40.69s |
| qwen3.7-plus | 25.32s | 7.33s | 29.39s |
| qwen3.7-plus-1m | 24.97s | 7.59s | 30.97s |
| qwq-plus | 297.23s | 90.31s | 52.5s |
| qwen3-vl-plus | 3.04s | 0.49s | 1.37s |
| dola-Seed-2.0-mini | 8.34s | 4.37s | 2.86s |
| dola-Seed-2.0-lite | 16.79s | 9.84s | 8.22s |
| dola-Seed-2.0-pro | 10.59s | 6.78s | 3.54s |
| dola-Seed-2.1-turbo | 30.99s | 33.25s | 32.34s |
| hy3 | 3.81s | 1.23s | 1.88s |
| kimi-k3 | 6.07s | 4.04s | 3.48s |
| glm-5.1 | 10.03s | 6.44s | 5.61s |
| glm-5.2 | 3.12s | 2.24s | 1.86s |
| glm-5-turbo | 3.02s | 2.12s | 2.14s |
| glm-5v-turbo | 3.72s | 1.48s | 1.34s |
| hy-mt2-plus | 2.0s | 0.71s | 1.16s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.29s | 2.66s | 2.29s |
| deepseek-v4-pro-202606 | 4.96s | 3.62s | 2.9s |
| qwen3.5-flash | 1.64s | 6.31s | 3.71s |
| qwen3.6-flash | 10.23s | 6.84s | 6.28s |
| qwen3.5-plus | 4.12s | 19.3s | 8.92s |
| qwen3.7-plus | 25.05s | 8.11s | 16.98s |
| qwen3.7-plus-1m | 22.24s | 8.44s | 28.09s |
| qwq-plus | 67.52s | 23.39s | 12.4s |
| qwen3-vl-plus | 2.68s | 0.71s | 1.22s |
| dola-Seed-2.0-mini | 8.63s | 3.06s | 2.82s |
| dola-Seed-2.0-lite | 17.5s | 9.39s | 5.32s |
| dola-Seed-2.0-pro | 12.83s | 4.38s | 5.1s |
| dola-Seed-2.1-turbo | 33.92s | 30.49s | 17.85s |
| hy3 | 3.3s | 1.22s | 1.92s |
| kimi-k3 | 6.65s | 4.74s | 3.92s |
| glm-5.1 | 8.78s | 8.19s | 7.14s |
| glm-5.2 | 3.44s | 2.1s | 2.36s |
| glm-5-turbo | 3.95s | 1.78s | 18.16s |
| glm-5v-turbo | 3.22s | 1.35s | 1.31s |
| hy-mt2-plus | 1.96s | 0.72s | 1.14s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.05s | 2.53s | 2.65s |
| deepseek-v4-pro-202606 | 4.49s | 3.3s | 2.85s |
| qwen3.5-flash | 1.68s | 9.11s | 4.3s |
| qwen3.6-flash | 9.72s | 7.38s | 9.52s |
| qwen3.5-plus | 4.8s | 26.79s | 45.46s |
| qwen3.7-plus | 32.4s | 7.46s | 26.4s |
| qwen3.7-plus-1m | 32.28s | 7.39s | 31.99s |
| qwq-plus | 51.5s | 16.61s | 17.21s |
| qwen3-vl-plus | 3.45s | 0.42s | 1.17s |
| dola-Seed-2.0-mini | 6.52s | 4.51s | 2.47s |
| dola-Seed-2.0-lite | 19.74s | 14.0s | 9.41s |
| dola-Seed-2.0-pro | 12.36s | 5.12s | 3.42s |
| dola-Seed-2.1-turbo | 31.77s | 24.94s | 22.81s |
| hy3 | 3.05s | 1.19s | 2.65s |
| kimi-k3 | 5.85s | 3.92s | 3.16s |
| glm-5.1 | 8.46s | 7.44s | 6.26s |
| glm-5.2 | 5.23s | 3.58s | 2.05s |
| glm-5-turbo | 3.52s | 2.11s | 1.47s |
| glm-5v-turbo | 2.18s | 1.86s | 1.52s |
| hy-mt2-plus | 1.78s | 0.63s | 1.16s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.33s | 5.61s | 2.16s |
| deepseek-v4-pro-202606 | 4.13s | 3.49s | 2.62s |
| qwen3.5-flash | 1.49s | 6.35s | 4.32s |
| qwen3.6-flash | 11.6s | 18.37s | 10.03s |
| qwen3.5-plus | 4.52s | 22.99s | 54.36s |
| qwen3.7-plus | 26.25s | 8.0s | 21.62s |
| qwen3.7-plus-1m | 23.46s | 8.3s | 21.86s |
| qwq-plus | 64.99s | 22.66s | 13.61s |
| qwen3-vl-plus | 2.94s | 0.45s | 1.84s |
| dola-Seed-2.0-mini | 7.08s | 3.57s | 2.73s |
| dola-Seed-2.0-lite | 24.58s | 15.52s | 10.07s |
| dola-Seed-2.0-pro | 13.9s | 6.89s | 3.7s |
| dola-Seed-2.1-turbo | 29.89s | 23.05s | 16.78s |
| hy3 | 3.14s | 1.19s | 1.96s |
| kimi-k3 | 7.74s | 4.53s | 3.42s |
| glm-5.1 | 8.57s | 7.2s | 5.84s |
| glm-5.2 | 5.52s | 2.31s | 1.9s |
| glm-5-turbo | 5.1s | 1.6s | 1.71s |
| glm-5v-turbo | 2.58s | 2.37s | 1.99s |
| hy-mt2-plus | 2.07s | 0.76s | 1.15s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.31s | 8.72s | 2.61s |
| deepseek-v4-pro-202606 | 6.22s | 4.1s | 3.07s |
| qwen3.5-flash | 1.48s | 6.39s | 13.99s |
| qwen3.6-flash | 14.77s | 18.81s | 8.15s |
| qwen3.5-plus | 5.03s | 59.66s | 33.72s |
| qwen3.7-plus | 21.97s | 8.55s | 14.33s |
| qwen3.7-plus-1m | 25.3s | 8.52s | 35.1s |
| qwq-plus | 61.6s | 17.43s | 17.77s |
| qwen3-vl-plus | 3.49s | 0.42s | 1.44s |
| dola-Seed-2.0-mini | 5.74s | 3.75s | 2.84s |
| dola-Seed-2.0-lite | 19.17s | 10.21s | 7.62s |
| dola-Seed-2.0-pro | 10.9s | 6.22s | 3.42s |
| dola-Seed-2.1-turbo | 46.02s | 21.48s | 21.11s |
| hy3 | 3.09s | 1.17s | 2.17s |
| kimi-k3 | 6.18s | 4.17s | 3.34s |
| glm-5.1 | 11.03s | 7.31s | 6.54s |
| glm-5.2 | 3.63s | 3.94s | 2.13s |
| glm-5-turbo | 6.11s | 3.06s | 2.25s |
| glm-5v-turbo | 2.12s | 1.97s | 2.04s |
| hy-mt2-plus | 1.93s | 0.79s | 1.18s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.36s | 2.69s | 2.27s |
| deepseek-v4-pro-202606 | 4.7s | 3.32s | 2.7s |
| qwen3.5-flash | 1.75s | 6.43s | 11.84s |
| qwen3.6-flash | 15.72s | 7.74s | 10.26s |
| qwen3.5-plus | 4.51s | 29.52s | 23.11s |
| qwen3.7-plus | 26.17s | 11.11s | 21.65s |
| qwen3.7-plus-1m | 24.21s | 8.37s | 25.66s |
| qwq-plus | 61.78s | 16.73s | 15.31s |
| qwen3-vl-plus | 4.42s | 0.95s | 1.49s |
| dola-Seed-2.0-mini | 6.0s | 4.67s | 2.83s |
| dola-Seed-2.0-lite | 28.12s | 21.41s | 12.92s |
| dola-Seed-2.0-pro | 9.76s | 5.89s | 4.43s |
| dola-Seed-2.1-turbo | 28.31s | 42.22s | 14.33s |
| hy3 | 3.25s | 1.2s | 1.94s |
| kimi-k3 | 6.77s | 3.57s | 3.34s |
| glm-5.1 | 9.38s | 6.08s | 7.0s |
| glm-5.2 | 5.0s | 2.41s | 2.13s |
| glm-5-turbo | 3.68s | 1.66s | 103.86s |
| glm-5v-turbo | 2.32s | 1.68s | 1.67s |
| hy-mt2-plus | 2.04s | 0.67s | 1.19s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.72s | 3.18s | 2.37s |
| deepseek-v4-pro-202606 | 4.42s | 3.36s | 2.91s |
| qwen3.5-flash | 1.44s | 6.64s | 3.76s |
| qwen3.6-flash | 13.99s | 9.34s | 7.85s |
| qwen3.5-plus | 4.88s | 34.38s | 20.43s |
| qwen3.7-plus | 24.02s | 7.68s | 51.08s |
| qwen3.7-plus-1m | 23.97s | 11.16s | 17.44s |
| qwq-plus | 61.61s | 62.35s | 16.32s |
| qwen3-vl-plus | 3.76s | 0.94s | 1.64s |
| dola-Seed-2.0-mini | 5.47s | 3.87s | 3.09s |
| dola-Seed-2.0-lite | 21.52s | 11.18s | 6.76s |
| dola-Seed-2.0-pro | 14.13s | 5.78s | 3.24s |
| dola-Seed-2.1-turbo | 46.55s | 30.1s | 18.12s |
| hy3 | 3.27s | 1.25s | 2.05s |
| kimi-k3 | 6.41s | 4.99s | 3.85s |
| glm-5.1 | 9.07s | 5.53s | 6.69s |
| glm-5.2 | 3.38s | 2.4s | 2.42s |
| glm-5-turbo | 3.12s | 1.63s | 1.69s |
| glm-5v-turbo | 2.14s | 1.34s | 1.43s |
| hy-mt2-plus | 1.92s | 0.6s | 1.17s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.32s | 2.84s | 2.32s |
| deepseek-v4-pro-202606 | 4.46s | 3.65s | 2.45s |
| qwen3.5-flash | 1.67s | 8.21s | 8.37s |
| qwen3.6-flash | 14.23s | 12.41s | 10.48s |
| qwen3.5-plus | 4.05s | 26.85s | 39.14s |
| qwen3.7-plus | 25.21s | 8.35s | 29.7s |
| qwen3.7-plus-1m | 25.1s | 8.12s | 29.58s |
| qwq-plus | 102.14s | 26.32s | 21.09s |
| qwen3-vl-plus | 4.24s | 0.52s | 1.64s |
| dola-Seed-2.0-mini | 8.23s | 5.05s | 3.02s |
| dola-Seed-2.0-lite | 20.08s | 13.96s | 7.79s |
| dola-Seed-2.0-pro | 11.21s | 5.33s | 3.27s |
| dola-Seed-2.1-turbo | 43.95s | 24.45s | 17.34s |
| hy3 | 3.17s | 1.27s | 1.9s |
| kimi-k3 | 5.39s | 4.57s | 3.51s |
| glm-5.1 | 10.24s | 5.07s | 5.57s |
| glm-5.2 | 3.39s | 2.13s | 2.43s |
| glm-5-turbo | 4.16s | 2.82s | 1.75s |
| glm-5v-turbo | 2.34s | 1.28s | 1.52s |
| hy-mt2-plus | 1.93s | 0.75s | 1.14s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 3.9s | 2.16s | 2.07s |
| deepseek-v4-pro-202606 | 3.98s | 3.26s | 3.25s |
| qwen3.5-flash | 1.5s | 9.28s | 3.75s |
| qwen3.6-flash | 8.12s | 28.36s | 14.57s |
| qwen3.5-plus | 4.16s | 53.95s | 28.05s |
| qwen3.7-plus | 25.02s | 8.53s | 33.89s |
| qwen3.7-plus-1m | 27.39s | 9.74s | 36.1s |
| qwq-plus | 85.84s | 54.54s | 16.66s |
| qwen3-vl-plus | 3.2s | 0.48s | 1.09s |
| dola-Seed-2.0-mini | 5.47s | 3.77s | 2.95s |
| dola-Seed-2.0-lite | 23.65s | 11.19s | 9.1s |
| dola-Seed-2.0-pro | 11.89s | 4.34s | 10.27s |
| dola-Seed-2.1-turbo | 23.57s | 16.17s | 14.57s |
| hy3 | 3.18s | 1.31s | 1.95s |
| kimi-k3 | 7.45s | 4.23s | 3.63s |
| glm-5.1 | 14.09s | 13.44s | 11.74s |
| glm-5.2 | 3.13s | 2.58s | 1.9s |
| glm-5-turbo | 2.54s | 1.93s | 4.97s |
| glm-5v-turbo | 2.33s | 1.46s | 1.36s |
| hy-mt2-plus | 2.06s | 0.79s | 1.25s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 12.91s | 2.25s | 2.05s |
| deepseek-v4-pro-202606 | 3.9s | 2.91s | 2.28s |
| qwen3.5-flash | 1.47s | 13.9s | 8.09s |
| qwen3.6-flash | 13.05s | 11.09s | 5.29s |
| qwen3.5-plus | 5.65s | 31.76s | 44.37s |
| qwen3.7-plus | 20.77s | 8.18s | 26.55s |
| qwen3.7-plus-1m | 33.04s | 8.53s | 25.91s |
| qwq-plus | 112.2s | 88.26s | 76.18s |
| qwen3-vl-plus | 4.34s | 0.52s | 1.59s |
| dola-Seed-2.0-mini | 5.74s | 4.68s | 2.96s |
| dola-Seed-2.0-lite | 14.79s | 10.29s | 6.39s |
| dola-Seed-2.0-pro | 11.48s | 5.13s | 4.32s |
| dola-Seed-2.1-turbo | 35.11s | 17.11s | 10.46s |
| hy3 | 3.02s | 1.13s | 1.99s |
| kimi-k3 | 7.56s | 4.53s | 3.6s |
| glm-5.1 | 9.47s | 14.16s | 14.62s |
| glm-5.2 | 3.38s | 2.39s | 2.03s |
| glm-5-turbo | 4.41s | 2.41s | 2.06s |
| glm-5v-turbo | 2.63s | 2.82s | 1.93s |
| hy-mt2-plus | 1.93s | 0.84s | 1.14s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | FAIL | FAIL | FAIL |
| deepseek-v4-pro-202606 | FAIL | FAIL | FAIL |
| qwen3.5-flash | 1.86s | 6.37s | 3.79s |
| qwen3.6-flash | 9.63s | 9.84s | 9.69s |
| qwen3.5-plus | 5.66s | 36.67s | 24.95s |
| qwen3.7-plus | 18.85s | 9.5s | 26.64s |
| qwen3.7-plus-1m | 26.0s | 9.35s | 19.36s |
| qwq-plus | 76.71s | 44.41s | 26.73s |
| qwen3-vl-plus | 3.74s | 0.47s | 1.35s |
| dola-Seed-2.0-mini | 5.94s | 3.58s | 2.73s |
| dola-Seed-2.0-lite | 20.43s | 9.75s | 7.18s |
| dola-Seed-2.0-pro | 12.99s | 5.9s | 4.3s |
| dola-Seed-2.1-turbo | 34.55s | 25.85s | 19.21s |
| hy3 | FAIL | FAIL | FAIL |
| kimi-k3 | FAIL | FAIL | FAIL |
| glm-5.1 | FAIL | FAIL | FAIL |
| glm-5.2 | FAIL | FAIL | FAIL |
| glm-5-turbo | FAIL | FAIL | FAIL |
| glm-5v-turbo | FAIL | FAIL | FAIL |
| hy-mt2-plus | FAIL | FAIL | FAIL |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.29s | 2.34s | 2.02s |
| deepseek-v4-pro-202606 | 4.24s | 2.96s | 2.48s |
| qwen3.5-flash | 4.87s | 9.07s | 3.7s |
| qwen3.6-flash | 17.22s | 9.3s | 9.6s |
| qwen3.5-plus | 6.02s | 18.12s | 23.8s |
| qwen3.7-plus | 19.39s | 8.37s | 34.55s |
| qwen3.7-plus-1m | 21.12s | 8.84s | 18.56s |
| qwq-plus | 30.5s | 24.66s | 13.12s |
| qwen3-vl-plus | 3.65s | 0.66s | 1.38s |
| dola-Seed-2.0-mini | 8.03s | 4.93s | 2.68s |
| dola-Seed-2.0-lite | 15.55s | 13.15s | 8.7s |
| dola-Seed-2.0-pro | 16.16s | 13.17s | 4.12s |
| dola-Seed-2.1-turbo | 41.36s | 17.68s | 11.5s |
| hy3 | 3.07s | 1.26s | 2.0s |
| kimi-k3 | 38.2s | 37.13s | 22.2s |
| glm-5.1 | FAIL | FAIL | FAIL |
| glm-5.2 | FAIL | FAIL | FAIL |
| glm-5-turbo | FAIL | FAIL | FAIL |
| glm-5v-turbo | FAIL | FAIL | FAIL |
| hy-mt2-plus | FAIL | FAIL | FAIL |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.88s | 2.32s | 2.24s |
| deepseek-v4-pro-202606 | 3.99s | 3.26s | 2.31s |
| qwen3.5-flash | 1.47s | 9.13s | 3.72s |
| qwen3.6-flash | 9.23s | 6.47s | 6.84s |
| qwen3.5-plus | 5.88s | 61.86s | 28.59s |
| qwen3.7-plus | 24.98s | 7.06s | 31.29s |
| qwen3.7-plus-1m | 23.15s | 9.28s | 34.05s |
| qwq-plus | 33.14s | 24.48s | 19.42s |
| qwen3-vl-plus | 3.46s | 0.49s | 1.15s |
| dola-Seed-2.0-mini | 6.22s | 6.47s | 3.39s |
| dola-Seed-2.0-lite | 20.0s | 9.42s | 8.3s |
| dola-Seed-2.0-pro | 14.43s | 5.56s | 4.44s |
| dola-Seed-2.1-turbo | 36.55s | 24.19s | 14.33s |
| hy3 | 3.49s | 1.2s | 2.0s |
| kimi-k3 | 8.65s | 6.03s | 4.04s |
| glm-5.1 | 2.96s | 2.27s | 1.86s |
| glm-5.2 | 3.34s | 2.67s | 1.92s |
| glm-5-turbo | 4.69s | 1.91s | 1.37s |
| glm-5v-turbo | 2.56s | 1.23s | 1.41s |
| hy-mt2-plus | 1.8s | 0.72s | 1.02s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.48s | 2.33s | 2.09s |
| deepseek-v4-pro-202606 | 4.96s | 3.0s | 2.3s |
| qwen3.5-flash | 15.11s | 7.1s | 3.78s |
| qwen3.6-flash | 9.46s | 16.49s | 4.84s |
| qwen3.5-plus | 5.42s | 32.95s | 49.8s |
| qwen3.7-plus | 28.04s | 10.1s | 33.96s |
| qwen3.7-plus-1m | 25.18s | 9.06s | 31.48s |
| qwq-plus | 45.38s | 51.72s | 21.03s |
| qwen3-vl-plus | 3.22s | 1.06s | 1.58s |
| dola-Seed-2.0-mini | 9.06s | 4.76s | 2.88s |
| dola-Seed-2.0-lite | 19.72s | 12.12s | 7.17s |
| dola-Seed-2.0-pro | 12.61s | 4.16s | 4.65s |
| dola-Seed-2.1-turbo | 37.6s | 13.45s | 13.44s |
| hy3 | 3.38s | 1.15s | 2.04s |
| kimi-k3 | 9.39s | 4.77s | 4.2s |
| glm-5.1 | 8.4s | 6.07s | 4.45s |
| glm-5.2 | 3.69s | 3.47s | 2.06s |
| glm-5-turbo | 3.55s | 2.33s | 2.11s |
| glm-5v-turbo | 2.66s | 1.52s | 1.48s |
| hy-mt2-plus | 1.88s | 0.68s | 1.11s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 3.79s | 2.21s | 1.87s |
| deepseek-v4-pro-202606 | 4.16s | 2.1s | 2.18s |
| qwen3.5-flash | 1.46s | 10.2s | 3.78s |
| qwen3.6-flash | 12.66s | 9.14s | 5.56s |
| qwen3.5-plus | 6.2s | 30.35s | 26.33s |
| qwen3.7-plus | 23.78s | 8.48s | 28.53s |
| qwen3.7-plus-1m | 23.58s | 8.8s | 28.8s |
| qwq-plus | 67.47s | 23.62s | 19.0s |
| qwen3-vl-plus | 4.49s | 0.56s | 1.39s |
| dola-Seed-2.0-mini | 8.8s | 5.77s | 3.92s |
| dola-Seed-2.0-lite | 17.91s | 10.71s | 6.76s |
| dola-Seed-2.0-pro | 10.01s | 5.53s | 3.47s |
| dola-Seed-2.1-turbo | 14.65s | 14.92s | 14.15s |
| hy3 | 3.2s | 1.29s | 1.99s |
| kimi-k3 | 7.74s | 5.16s | 4.39s |
| glm-5.1 | 10.24s | 5.76s | 5.84s |
| glm-5.2 | 3.87s | 3.18s | 1.88s |
| glm-5-turbo | 2.65s | 2.63s | 3.65s |
| glm-5v-turbo | 2.58s | 1.69s | 1.37s |
| hy-mt2-plus | 1.93s | 0.59s | 1.03s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 3.82s | 1.9s | 1.96s |
| deepseek-v4-pro-202606 | 4.34s | 2.88s | 2.25s |
| qwen3.5-flash | 1.43s | 6.32s | 4.03s |
| qwen3.6-flash | 8.06s | 11.17s | 7.53s |
| qwen3.5-plus | 6.19s | 45.46s | 40.85s |
| qwen3.7-plus | 34.42s | 9.71s | 31.63s |
| qwen3.7-plus-1m | 34.54s | 9.03s | 32.93s |
| qwq-plus | 31.69s | 38.59s | 13.36s |
| qwen3-vl-plus | 3.29s | 0.6s | 1.79s |
| dola-Seed-2.0-mini | 9.01s | 5.74s | 2.5s |
| dola-Seed-2.0-lite | 19.23s | 12.16s | 7.73s |
| dola-Seed-2.0-pro | 12.76s | 4.86s | 4.28s |
| dola-Seed-2.1-turbo | 31.06s | 15.94s | 7.01s |
| hy3 | 3.15s | 1.33s | 1.88s |
| kimi-k3 | 7.83s | 5.06s | 4.57s |
| glm-5.1 | 7.21s | 2.45s | 2.38s |
| glm-5.2 | 3.71s | 3.01s | 2.07s |
| glm-5-turbo | 63.9s | 2.48s | 2.05s |
| glm-5v-turbo | 2.34s | 1.74s | 1.37s |
| hy-mt2-plus | 2.03s | 0.61s | 1.05s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 3.3s | 2.18s | 1.96s |
| deepseek-v4-pro-202606 | 3.54s | 2.55s | 2.39s |
| qwen3.5-flash | 1.48s | 11.54s | 6.26s |
| qwen3.6-flash | 9.12s | 13.52s | 8.92s |
| qwen3.5-plus | 6.09s | 36.04s | 29.87s |
| qwen3.7-plus | 24.08s | 9.11s | 31.14s |
| qwen3.7-plus-1m | 33.2s | 8.76s | 33.75s |
| qwq-plus | 81.39s | 21.82s | 15.86s |
| qwen3-vl-plus | 4.11s | 0.51s | 1.49s |
| dola-Seed-2.0-mini | 6.04s | 4.01s | 2.82s |
| dola-Seed-2.0-lite | 16.01s | 15.51s | 8.77s |
| dola-Seed-2.0-pro | 11.79s | 4.97s | 3.66s |
| dola-Seed-2.1-turbo | 23.57s | 17.14s | 14.87s |
| hy3 | 3.24s | 1.23s | 1.78s |
| kimi-k3 | 7.76s | 5.26s | 4.13s |
| glm-5.1 | 7.16s | 6.75s | 1.86s |
| glm-5.2 | 3.35s | 2.68s | 1.89s |
| glm-5-turbo | 4.71s | 10.85s | 1.8s |
| glm-5v-turbo | 3.06s | 1.69s | 1.36s |
| hy-mt2-plus | 1.88s | 0.75s | 1.06s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.12s | 2.26s | 2.0s |
| deepseek-v4-pro-202606 | 4.02s | 2.07s | 2.3s |
| qwen3.5-flash | 1.72s | 8.48s | 8.04s |
| qwen3.6-flash | 8.63s | 10.71s | 7.38s |
| qwen3.5-plus | 5.97s | 25.86s | 31.74s |
| qwen3.7-plus | 23.9s | 8.88s | 23.26s |
| dola-Seed-2.0-lite | 19.27s | 9.96s | 7.75s |
| dola-Seed-2.0-mini | 8.07s | 4.94s | 3.48s |
| dola-Seed-2.0-pro | 12.22s | 3.59s | 4.49s |
| dola-Seed-2.1-turbo | 27.35s | 13.0s | 12.9s |
| hy3 | 3.04s | 1.29s | 1.84s |
| kimi-k3 | 6.71s | 4.94s | 4.55s |
| glm-5.2 | 10.86s | 3.07s | 2.27s |
| hy-mt2-plus | 2.16s | 0.71s | 1.01s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 24.45s | 2.18s | 1.82s |
| deepseek-v4-pro-202606 | 4.08s | 2.78s | 2.51s |
| qwen3.5-flash | 1.83s | 6.46s | 3.9s |
| qwen3.6-flash | 13.56s | 11.21s | 12.73s |
| qwen3.5-plus | 6.49s | 47.3s | 23.84s |
| qwen3.7-plus | 25.95s | 9.31s | 22.43s |
| dola-Seed-2.0-lite | 20.09s | 10.42s | 7.84s |
| dola-Seed-2.0-mini | 8.24s | 8.91s | 2.98s |
| dola-Seed-2.0-pro | 11.55s | 5.26s | 4.81s |
| dola-Seed-2.1-turbo | 46.41s | 23.68s | 12.16s |
| hy3 | 4.24s | 1.23s | 1.73s |
| kimi-k3 | 15.29s | 5.82s | 4.07s |
| glm-5.2 | 4.65s | 3.52s | 2.48s |
| hy-mt2-plus | 2.02s | 0.62s | 1.06s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.96s | 1.96s | 1.91s |
| deepseek-v4-pro-202606 | 4.28s | 2.57s | 2.27s |
| qwen3.5-flash | 1.45s | 12.9s | 3.75s |
| qwen3.6-flash | 16.59s | 10.06s | 7.16s |
| qwen3.5-plus | 5.23s | 34.73s | 22.06s |
| qwen3.7-plus | 20.23s | 9.63s | 30.57s |
| dola-Seed-2.0-lite | 16.95s | 12.2s | 7.31s |
| dola-Seed-2.0-mini | 12.86s | 5.12s | 3.98s |
| dola-Seed-2.0-pro | 13.94s | 3.92s | 4.98s |
| dola-Seed-2.1-turbo | 32.08s | 10.9s | 5.35s |
| hy3 | 3.23s | 1.24s | 1.91s |
| kimi-k3 | FAIL | FAIL | FAIL |
| glm-5.2 | 3.38s | 2.55s | 2.61s |
| hy-mt2-plus | 2.04s | 0.71s | 0.89s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 3.85s | 2.25s | 1.87s |
| deepseek-v4-pro-202606 | 4.16s | 2.78s | 2.33s |
| qwen3.5-flash | 1.48s | 8.93s | 10.1s |
| qwen3.6-flash | 11.91s | 16.2s | 10.54s |
| qwen3.5-plus | 6.09s | 51.01s | 62.1s |
| qwen3.7-plus | 27.05s | 8.3s | 22.04s |
| dola-Seed-2.0-lite | 18.71s | 11.52s | 6.51s |
| dola-Seed-2.0-mini | 6.9s | 6.37s | 3.21s |
| dola-Seed-2.0-pro | 13.33s | 5.52s | 4.32s |
| dola-Seed-2.1-turbo | 33.95s | 18.11s | 16.04s |
| hy3 | 3.06s | 1.26s | 1.99s |
| kimi-k3 | FAIL | FAIL | FAIL |
| glm-5.2 | 4.67s | 2.43s | 2.87s |
| hy-mt2-plus | 1.99s | 0.67s | 0.97s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 3.52s | 1.99s | 1.72s |
| deepseek-v4-pro-202606 | 3.3s | 2.56s | 1.93s |
| qwen3.5-flash | 17.61s | 10.28s | 11.49s |
| qwen3.6-flash | 14.81s | 9.36s | 7.37s |
| qwen3.5-plus | 4.76s | 37.24s | 23.9s |
| qwen3.7-plus | 27.62s | 11.94s | 32.49s |
| dola-Seed-2.0-lite | 15.9s | 9.36s | 6.14s |
| dola-Seed-2.0-mini | 6.08s | 2.85s | 2.76s |
| dola-Seed-2.0-pro | 12.02s | 6.82s | 4.3s |
| glm-5.2 | 4.53s | 3.3s | 2.9s |
| hy-mt2-plus | 1.9s | 0.6s | 1.16s |
| deepseek-v4-flash-202605 | 4.31s | 9.83s | 2.08s | | deepseek-v4-pro-202606 | 4.25s | 2.85s | 2.4s | | qwen3.7-plus | 25.13s | 8.93s | 34.01s | | dola-Seed-2.0-lite | 18.66s | 8.71s | 5.73s | | dola-Seed-2.0-mini | 4.77s | 3.66s | 2.66s | | dola-Seed-2.0-pro | 10.99s | 6.66s | 4.34s | | glm-5.2 | 3.55s | 2.94s | 2.5s | | hy-mt2-plus | 2.02s | 0.71s | 1.13s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 5.4s | 2.47s | 2.31s |
| deepseek-v4-pro-202606 | 4.37s | 3.23s | 2.75s |
| qwen3.7-plus | 20.95s | 8.87s | 22.47s |
| dola-Seed-2.0-lite | 21.22s | 8.94s | 11.12s |
| dola-Seed-2.0-mini | 6.36s | 3.69s | 2.75s |
| dola-Seed-2.0-pro | 10.44s | 4.83s | 5.23s |
| glm-5.2 | 3.43s | 2.61s | 1.94s |
| hy-mt2-plus | 2.02s | 0.59s | 1.27s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.15s | 2.3s | 2.16s |
| deepseek-v4-pro-202606 | 4.39s | 2.67s | 2.39s |
| qwen3.7-plus | 29.76s | 8.8s | 16.27s |
| dola-Seed-2.0-lite | 17.39s | 8.48s | 7.98s |
| dola-Seed-2.0-mini | 6.15s | 3.8s | 2.71s |
| dola-Seed-2.0-pro | 12.73s | 4.93s | 4.78s |
| glm-5.2 | 4.64s | 2.84s | 2.5s |
| hy-mt2-plus | 1.94s | 0.76s | 1.0s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 3.95s | 2.17s | 2.11s |
| deepseek-v4-pro-202606 | 4.08s | 2.97s | 2.67s |
| qwen3.7-plus | 21.89s | 10.4s | 22.37s |
| dola-Seed-2.0-lite | 22.78s | 7.87s | 6.87s |
| dola-Seed-2.0-mini | 7.76s | 3.74s | 2.84s |
| dola-Seed-2.0-pro | 14.22s | 6.03s | 5.05s |
| glm-5.2 | 4.32s | 3.24s | 2.17s |
| hy-mt2-plus | 1.91s | 0.48s | 1.13s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 3.77s | 2.22s | 2.02s |
| deepseek-v4-pro-202606 | 3.91s | 2.55s | 2.24s |
| qwen3.7-plus | 26.67s | 7.17s | 33.76s |
| dola-Seed-2.0-lite | 16.47s | 12.03s | 7.9s |
| dola-Seed-2.0-mini | 8.52s | 4.74s | 2.98s |
| dola-Seed-2.0-pro | 12.27s | 4.55s | 6.84s |
| glm-5.2 | 4.63s | 2.51s | 2.67s |
| hy-mt2-plus | 1.94s | 0.79s | 1.01s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 3.85s | 2.24s | 1.99s |
| deepseek-v4-pro-202606 | 3.59s | 2.83s | 2.18s |
| qwen3.7-plus | 23.8s | 9.22s | 24.17s |
| dola-Seed-2.0-lite | 22.61s | 12.72s | 8.4s |
| dola-Seed-2.0-mini | 5.62s | 2.21s | 2.79s |
| dola-Seed-2.0-pro | 12.11s | 6.61s | 4.49s |
| glm-5.2 | 5.43s | 3.23s | 6.34s |
| hy-mt2-plus | 2.02s | 0.57s | 1.02s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 3.85s | 2.26s | 2.02s |
| qwen3.7-plus | 25.42s | 9.89s | 32.35s |
| dola-Seed-2.0-lite | 14.58s | 10.09s | 6.41s |
| glm-5.2 | 5.03s | 2.28s | 2.25s |
| hy-mt2-plus | 2.02s | 0.71s | 1.0s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.39s | 2.54s | 2.05s |
| qwen3.7-plus | 29.0s | 10.73s | 33.78s |
| dola-Seed-2.0-lite | 17.84s | 9.24s | 8.84s |
| glm-5.2 | 3.78s | 2.91s | 2.32s |
| hy-mt2-plus | 2.18s | 0.72s | 1.1s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.12s | 2.63s | 2.14s |
| qwen3.7-plus | 26.48s | 8.34s | 23.71s |
| dola-Seed-2.0-lite | 21.94s | 10.63s | 8.3s |
| glm-5.2 | 4.03s | 3.39s | 2.33s |
| hy-mt2-plus | 1.99s | 0.9s | 1.11s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.86s | 2.51s | 2.19s |
| qwen3.7-plus | 25.46s | 8.73s | 25.63s |
| dola-Seed-2.0-lite | 18.2s | 9.94s | 66.48s |
| glm-5.2 | 4.25s | 3.05s | 4.62s |
| hy-mt2-plus | 1.99s | 0.92s | 1.17s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.05s | 2.49s | 14.6s |
| qwen3.7-plus | 21.8s | 9.13s | 27.26s |
| dola-Seed-2.0-lite | 16.67s | 11.84s | 5.93s |
| glm-5.2 | 4.49s | 2.74s | 2.38s |
| hy-mt2-plus | 2.14s | 1.09s | 1.28s |
| Model | 💻 Code Generation | 🌐 Translation | 📄 Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | ✅ 12.87s | ✅ 2.43s | ✅ 2.05s |
| qwen3.7-plus | ✅ 33.68s | ✅ 10.23s | ✅ 45.83s |
| dola-Seed-2.0-lite | ✅ 16.37s | ✅ 13.86s | ✅ 8.16s |
| glm-5.2 | ✅ 4.26s | ✅ 2.4s | ✅ 2.82s |
| hy-mt2-plus | ✅ 2.13s | ✅ 0.94s | ✅ 1.1s |
| Model | 💻 Code Generation | 🌐 Translation | 📄 Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | ✅ 3.73s | ✅ 2.07s | ✅ 1.94s |
| qwen3.7-plus | ✅ 24.87s | ✅ 7.76s | ✅ 27.28s |
| dola-Seed-2.0-lite | ✅ 17.83s | ✅ 9.25s | ✅ 5.91s |
| glm-5.2 | ✅ 4.98s | ✅ 4.04s | ✅ 2.32s |
| hy-mt2-plus | ✅ 2.19s | ✅ 0.91s | ✅ 1.46s |