Daily AI model performance comparison across code generation, translation, and long-context summarization. Data is automatically generated and updated daily at 03:00 UTC+8.
(Auto-updated daily from our Benchmark script)
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.86s | 2.33s | 1.93s |
| deepseek-v4-pro-202606 | 6.97s | 1.48s | 3.72s |
| qwen3.5-flash | 2.38s | 17.6s | 19.82s |
| qwen3.6-flash | 12.4s | 11.68s | 5.17s |
| qwen3.5-plus | 8.01s | 26.82s | 26.79s |
| qwen3.7-plus | 21.23s | 6.93s | 31.76s |
| qwen3.7-plus-1m | 21.06s | 8.25s | 22.97s |
| qwq-plus | 48.28s | 33.74s | 13.61s |
| qwen3-vl-plus | 3.96s | 0.62s | 1.83s |
| dola-Seed-2.0-mini | 8.19s | 4.48s | 2.71s |
| dola-Seed-2.0-lite | 23.86s | 12.47s | 11.1s |
| dola-Seed-2.0-pro | 14.17s | 5.47s | 3.92s |
| dola-Seed-2.1-turbo | 33.5s | 22.61s | 11.78s |
| hy3 | 2.28s | 1.79s | 1.59s |
| kimi-k3 | 4.62s | 2.51s | 2.62s |
| glm-5.1 | 10.35s | 5.84s | 6.34s |
| glm-5.2 | 3.73s | 2.31s | 1.81s |
| glm-5-turbo | 9.77s | 7.99s | 6.32s |
| glm-5v-turbo | 3.62s | 1.59s | 1.83s |
| hy-mt2-plus | 1.86s | 0.55s | 0.89s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 3.03s | 3.01s | 1.33s |
| deepseek-v4-pro-202606 | 8.78s | 8.0s | 2.81s |
| qwen3.5-flash | 1.57s | 6.74s | 8.88s |
| qwen3.6-flash | 7.99s | 8.88s | 3.83s |
| qwen3.5-plus | 8.04s | 40.22s | 44.52s |
| qwen3.7-plus | 20.08s | 7.28s | 16.45s |
| qwen3.7-plus-1m | 21.27s | 7.83s | 21.7s |
| qwq-plus | 33.49s | 13.72s | 19.13s |
| qwen3-vl-plus | 4.37s | 1.05s | 2.06s |
| dola-Seed-2.0-mini | 7.68s | 4.43s | 2.63s |
| dola-Seed-2.0-lite | 20.06s | 13.06s | 8.55s |
| dola-Seed-2.0-pro | 12.18s | 4.9s | 4.43s |
| dola-Seed-2.1-turbo | 41.42s | 16.22s | 13.82s |
| hy3 | 2.5s | 1.73s | 1.53s |
| kimi-k3 | 4.83s | 2.87s | 2.74s |
| glm-5.1 | 8.89s | 7.78s | 7.95s |
| glm-5.2 | 3.19s | 2.19s | 1.75s |
| glm-5-turbo | 8.99s | 6.75s | 7.26s |
| glm-5v-turbo | 2.72s | 1.78s | 1.58s |
| hy-mt2-plus | 1.97s | 0.46s | 0.97s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.14s | 2.96s | 2.71s |
| deepseek-v4-pro-202606 | 7.2s | 4.2s | 2.02s |
| qwen3.5-flash | 1.48s | 8.82s | 7.63s |
| qwen3.6-flash | 11.04s | 7.34s | 7.56s |
| qwen3.5-plus | 6.87s | 112.54s | 55.55s |
| qwen3.7-plus | 18.3s | 7.8s | 39.18s |
| qwen3.7-plus-1m | 18.78s | 7.25s | 27.54s |
| qwq-plus | 57.93s | 28.98s | 13.68s |
| qwen3-vl-plus | 3.56s | 1.27s | 1.38s |
| dola-Seed-2.0-mini | 6.41s | 4.38s | 2.48s |
| dola-Seed-2.0-lite | 23.66s | 41.94s | FAIL |
| dola-Seed-2.0-pro | FAIL | FAIL | FAIL |
| dola-Seed-2.1-turbo | FAIL | FAIL | FAIL |
| hy3 | 2.45s | 1.87s | 1.76s |
| kimi-k3 | 6.88s | 5.87s | 3.4s |
| glm-5.1 | 10.5s | 5.95s | 6.03s |
| glm-5.2 | 3.51s | 2.26s | 1.89s |
| glm-5-turbo | 9.05s | 8.45s | 4.83s |
| glm-5v-turbo | 2.78s | 1.28s | 1.59s |
| hy-mt2-plus | 1.86s | 0.49s | 0.97s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.98s | 2.72s | 1.7s |
| deepseek-v4-pro-202606 | 6.49s | 5.57s | 3.68s |
| qwen3.5-flash | 1.47s | 9.25s | 12.42s |
| qwen3.6-flash | 12.35s | 14.73s | 5.8s |
| qwen3.5-plus | 7.31s | 43.93s | 28.84s |
| qwen3.7-plus | 21.27s | 9.46s | 28.87s |
| qwen3.7-plus-1m | 30.12s | 7.6s | 24.36s |
| qwq-plus | 31.78s | 11.33s | 14.69s |
| qwen3-vl-plus | 3.6s | 0.65s | 1.59s |
| dola-Seed-2.0-mini | 5.56s | 6.41s | 2.88s |
| dola-Seed-2.0-lite | 16.17s | 13.15s | 7.59s |
| dola-Seed-2.0-pro | 11.68s | 5.43s | 5.11s |
| dola-Seed-2.1-turbo | 25.36s | 27.15s | 8.74s |
| hy3 | 2.64s | 1.8s | 1.71s |
| kimi-k3 | 7.9s | 3.47s | 2.98s |
| glm-5.1 | 8.28s | 6.37s | 7.3s |
| glm-5.2 | 3.53s | 2.19s | 1.91s |
| glm-5-turbo | 6.3s | 9.53s | 13.07s |
| glm-5v-turbo | 3.26s | 1.38s | 1.58s |
| hy-mt2-plus | 1.87s | 0.58s | 0.88s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.15s | 4.05s | 3.28s |
| deepseek-v4-pro-202606 | 6.34s | 3.72s | 3.67s |
| qwen3.5-flash | 1.55s | 10.42s | 17.72s |
| qwen3.6-flash | 10.04s | 6.37s | 2.9s |
| qwen3.5-plus | 7.1s | 108.35s | 54.99s |
| qwen3.7-plus | 19.39s | 8.81s | 21.54s |
| qwen3.7-plus-1m | 21.31s | 8.94s | 27.88s |
| qwq-plus | 118.02s | 55.58s | 33.44s |
| qwen3-vl-plus | 5.19s | 1.05s | 2.09s |
| dola-Seed-2.0-mini | 6.59s | 3.93s | 3.04s |
| dola-Seed-2.0-lite | 24.17s | 15.98s | 14.19s |
| dola-Seed-2.0-pro | 12.43s | 4.2s | 3.87s |
| dola-Seed-2.1-turbo | 40.1s | 13.79s | 9.55s |
| hy3 | 2.24s | 2.02s | 1.73s |
| kimi-k3 | 5.2s | 3.59s | 3.03s |
| glm-5.1 | 4.05s | 2.69s | 3.38s |
| glm-5.2 | 3.54s | 2.17s | 1.73s |
| glm-5-turbo | 68.78s | 18.03s | 14.23s |
| glm-5v-turbo | 4.18s | 2.14s | 1.47s |
| hy-mt2-plus | 1.86s | 0.53s | 0.89s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 6.29s | 2.69s | 4.39s |
| deepseek-v4-pro-202606 | 6.21s | 5.48s | 2.25s |
| qwen3.5-flash | 2.23s | 15.34s | 10.57s |
| qwen3.6-flash | 7.88s | 8.19s | 2.89s |
| qwen3.5-plus | 6.56s | 55.72s | 51.24s |
| qwen3.7-plus | 21.38s | 7.04s | 23.18s |
| qwen3.7-plus-1m | 18.5s | 7.4s | 26.45s |
| qwq-plus | 173.11s | 43.31s | 12.09s |
| qwen3-vl-plus | 3.41s | 0.47s | 1.96s |
| dola-Seed-2.0-mini | 6.98s | 5.0s | 2.91s |
| dola-Seed-2.0-lite | 18.11s | 10.84s | 8.58s |
| dola-Seed-2.0-pro | 11.66s | 8.03s | 4.21s |
| dola-Seed-2.1-turbo | 47.18s | 27.68s | 11.13s |
| hy3 | 2.24s | 2.21s | 1.69s |
| kimi-k3 | 7.2s | 4.69s | 5.55s |
| glm-5.1 | 4.71s | 2.72s | 2.19s |
| glm-5.2 | 3.38s | 2.0s | 1.84s |
| glm-5-turbo | 9.05s | 12.97s | 11.54s |
| glm-5v-turbo | 2.77s | 1.47s | 1.55s |
| hy-mt2-plus | 1.87s | 0.54s | 0.96s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 5.75s | 2.6s | 2.12s |
| deepseek-v4-pro-202606 | 5.32s | 5.0s | 7.48s |
| qwen3.5-flash | 1.47s | 6.48s | 16.17s |
| qwen3.6-flash | 10.31s | 26.33s | 2.94s |
| qwen3.5-plus | 8.74s | 44.91s | 181.34s |
| qwen3.7-plus | 21.14s | 8.81s | 15.25s |
| qwen3.7-plus-1m | 24.83s | 8.78s | 37.3s |
| qwq-plus | 109.17s | 28.29s | 16.77s |
| qwen3-vl-plus | 2.89s | 0.46s | 1.84s |
| dola-Seed-2.0-mini | 10.51s | 4.61s | 3.18s |
| dola-Seed-2.0-lite | 28.19s | 15.58s | 12.03s |
| dola-Seed-2.0-pro | 9.98s | 2.93s | 5.84s |
| dola-Seed-2.1-turbo | 38.88s | 15.48s | 11.46s |
| hy3 | 2.21s | 1.66s | 1.61s |
| kimi-k3 | 5.48s | 3.58s | 3.36s |
| glm-5.1 | 4.12s | 2.47s | 2.01s |
| glm-5.2 | 3.19s | 2.05s | 2.11s |
| glm-5-turbo | 8.51s | 16.99s | 19.54s |
| glm-5v-turbo | 2.38s | 1.31s | 1.53s |
| hy-mt2-plus | 1.92s | 0.35s | 0.94s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 7.6s | 4.84s | 2.97s |
| deepseek-v4-pro-202606 | 7.0s | 4.59s | 3.23s |
| qwen3.5-flash | 1.83s | 14.84s | 8.44s |
| qwen3.6-flash | 14.95s | 11.14s | 4.05s |
| qwen3.5-plus | 6.8s | 42.32s | 33.62s |
| qwen3.7-plus | 28.06s | 7.74s | 33.06s |
| qwen3.7-plus-1m | 25.73s | 7.09s | 33.12s |
| qwq-plus | 54.83s | 33.02s | 22.61s |
| qwen3-vl-plus | 3.02s | 0.43s | 1.85s |
| dola-Seed-2.0-mini | 8.1s | 3.43s | 2.77s |
| dola-Seed-2.0-lite | 18.64s | 13.96s | 7.73s |
| dola-Seed-2.0-pro | 12.31s | 3.57s | 5.01s |
| dola-Seed-2.1-turbo | 38.64s | 15.86s | 7.84s |
| hy3 | 2.03s | 1.87s | 1.55s |
| kimi-k3 | 5.19s | 4.82s | 4.56s |
| glm-5.1 | 3.92s | 2.43s | 2.17s |
| glm-5.2 | 3.55s | 2.19s | 1.8s |
| glm-5-turbo | 5.96s | 11.22s | 10.28s |
| glm-5v-turbo | 2.34s | 1.29s | 1.89s |
| hy-mt2-plus | 1.88s | 0.65s | 1.03s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 3.95s | 4.04s | 3.14s |
| deepseek-v4-pro-202606 | 6.8s | 1.6s | 3.16s |
| qwen3.5-flash | 1.79s | 8.62s | 13.56s |
| qwen3.6-flash | 11.82s | 8.39s | 6.06s |
| qwen3.5-plus | 7.63s | 31.05s | 33.99s |
| qwen3.7-plus | 34.1s | 8.09s | 25.28s |
| qwen3.7-plus-1m | 21.71s | 7.8s | 23.43s |
| qwq-plus | 103.94s | 28.64s | 17.95s |
| qwen3-vl-plus | 3.62s | 1.13s | 1.92s |
| dola-Seed-2.0-mini | 6.11s | 4.01s | 2.14s |
| dola-Seed-2.0-lite | 16.63s | 9.88s | 9.81s |
| dola-Seed-2.0-pro | 10.04s | 5.55s | 4.16s |
| dola-Seed-2.1-turbo | 46.33s | 18.88s | 24.49s |
| hy3 | 1.7s | 1.73s | 1.5s |
| kimi-k3 | 8.11s | 4.92s | 3.59s |
| glm-5.1 | 3.86s | 2.44s | 2.19s |
| glm-5.2 | 3.6s | 2.12s | 1.91s |
| glm-5-turbo | 10.25s | 8.32s | 15.8s |
| glm-5v-turbo | 3.14s | 1.38s | 1.21s |
| hy-mt2-plus | 1.97s | 0.58s | 1.12s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 6.85s | 2.35s | 3.31s |
| deepseek-v4-pro-202606 | 4.83s | 1.47s | 3.73s |
| qwen3.5-flash | 1.64s | 6.5s | 6.66s |
| qwen3.6-flash | 13.02s | 7.32s | 8.51s |
| qwen3.5-plus | 7.7s | 38.56s | 17.33s |
| qwen3.7-plus | 17.86s | 7.76s | 21.06s |
| qwen3.7-plus-1m | 25.56s | 8.35s | 23.63s |
| qwq-plus | 46.38s | 25.76s | 22.95s |
| qwen3-vl-plus | 4.72s | 0.44s | 1.72s |
| dola-Seed-2.0-mini | 7.24s | 3.55s | 2.93s |
| dola-Seed-2.0-lite | 20.91s | 16.9s | 7.78s |
| dola-Seed-2.0-pro | 12.9s | 9.9s | 4.39s |
| dola-Seed-2.1-turbo | 30.34s | 19.85s | 10.75s |
| hy3 | 3.92s | 1.82s | 1.85s |
| kimi-k3 | 11.33s | 6.46s | 3.17s |
| glm-5.1 | 4.11s | 2.49s | 2.07s |
| glm-5.2 | 4.39s | 2.13s | 1.87s |
| glm-5-turbo | 6.43s | 12.99s | 17.32s |
| glm-5v-turbo | 2.34s | 1.79s | 1.55s |
| hy-mt2-plus | 1.91s | 0.46s | 0.92s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 2.52s | 2.57s | 1.95s |
| deepseek-v4-pro-202606 | 5.41s | 2.16s | 3.44s |
| qwen3.5-flash | 1.68s | 10.13s | 17.45s |
| qwen3.6-flash | 10.9s | 10.1s | 5.7s |
| qwen3.5-plus | 6.93s | 51.91s | 87.6s |
| qwen3.7-plus | 22.57s | 8.76s | 31.42s |
| qwen3.7-plus-1m | 19.03s | 7.71s | 26.63s |
| qwq-plus | 94.41s | 13.78s | 13.42s |
| qwen3-vl-plus | 3.0s | 0.6s | 1.31s |
| dola-Seed-2.0-mini | 7.29s | 3.61s | 3.05s |
| dola-Seed-2.0-lite | 19.1s | 10.64s | 10.7s |
| dola-Seed-2.0-pro | 16.59s | 4.47s | 5.02s |
| dola-Seed-2.1-turbo | 50.1s | 29.65s | 8.9s |
| hy3 | 4.07s | 2.21s | 1.85s |
| kimi-k3 | 17.11s | 7.64s | 7.58s |
| glm-5.1 | 4.2s | 2.41s | 2.13s |
| glm-5.2 | 3.4s | 2.19s | 1.84s |
| glm-5-turbo | 10.02s | 17.36s | 13.27s |
| glm-5v-turbo | 2.51s | 1.55s | 1.29s |
| hy-mt2-plus | 1.95s | 0.55s | 0.82s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 5.78s | 2.17s | 1.69s |
| deepseek-v4-pro-202606 | 3.29s | 2.07s | 2.91s |
| qwen3.5-flash | 2.0s | 13.38s | 14.16s |
| qwen3.6-flash | 12.13s | 8.76s | 10.66s |
| qwen3.5-plus | 6.44s | 51.92s | 32.0s |
| qwen3.7-plus | 23.98s | 8.8s | 31.82s |
| qwen3.7-plus-1m | 25.23s | 8.22s | 36.71s |
| qwq-plus | 176.5s | 23.39s | 21.77s |
| qwen3-vl-plus | 3.83s | 1.14s | 1.93s |
| dola-Seed-2.0-mini | 8.56s | 3.06s | 2.92s |
| dola-Seed-2.0-lite | 18.94s | 15.63s | 9.56s |
| dola-Seed-2.0-pro | 14.23s | 5.32s | 4.57s |
| dola-Seed-2.1-turbo | 34.14s | 22.92s | 14.7s |
| hy3 | 4.14s | 2.31s | 1.76s |
| kimi-k3 | 11.69s | 6.7s | 4.55s |
| glm-5.1 | 4.52s | 2.74s | 2.17s |
| glm-5.2 | 3.98s | 2.41s | 2.09s |
| glm-5-turbo | 9.89s | 14.41s | 13.99s |
| glm-5v-turbo | 2.62s | 1.84s | 1.39s |
| hy-mt2-plus | 2.18s | 0.87s | 1.38s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 5.53s | 2.48s | 2.43s |
| deepseek-v4-pro-202606 | 5.95s | 1.29s | 2.79s |
| qwen3.5-flash | 1.63s | 8.91s | 6.8s |
| qwen3.6-flash | 9.54s | 13.91s | 4.26s |
| qwen3.5-plus | 3.55s | 28.04s | 9.61s |
| qwen3.7-plus | 22.86s | 7.75s | 22.02s |
| qwen3.7-plus-1m | 23.3s | 7.92s | 39.29s |
| qwq-plus | 46.15s | 41.43s | 20.77s |
| qwen3-vl-plus | 3.13s | 0.64s | 2.17s |
| dola-Seed-2.0-mini | 6.95s | 4.53s | 2.88s |
| dola-Seed-2.0-lite | 20.39s | 9.81s | 7.56s |
| dola-Seed-2.0-pro | 12.31s | 4.89s | 4.86s |
| dola-Seed-2.1-turbo | 44.37s | 18.38s | 10.82s |
| hy3 | 3.15s | 1.23s | 1.83s |
| kimi-k3 | 8.13s | 3.49s | 3.13s |
| glm-5.1 | 5.98s | 4.88s | 4.07s |
| glm-5.2 | 3.63s | 2.69s | 1.95s |
| glm-5-turbo | 7.39s | 9.77s | 13.14s |
| glm-5v-turbo | 2.28s | 1.49s | 1.21s |
| hy-mt2-plus | 2.14s | 0.81s | 1.18s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.84s | 2.98s | 2.04s |
| deepseek-v4-pro-202606 | 4.49s | 1.88s | 2.74s |
| qwen3.5-flash | 1.67s | 7.73s | 10.33s |
| qwen3.6-flash | 7.17s | 7.0s | 3.98s |
| qwen3.5-plus | 3.51s | 30.26s | 11.17s |
| qwen3.7-plus | 25.48s | 8.06s | 27.77s |
| qwen3.7-plus-1m | 26.18s | 7.76s | 34.45s |
| qwq-plus | 39.61s | 41.25s | 21.61s |
| qwen3-vl-plus | 3.04s | 0.74s | 1.52s |
| dola-Seed-2.0-mini | 8.84s | 2.55s | 3.02s |
| dola-Seed-2.0-lite | 19.66s | 12.76s | 8.33s |
| dola-Seed-2.0-pro | 13.13s | 4.81s | 4.87s |
| dola-Seed-2.1-turbo | 47.5s | 21.43s | 17.45s |
| hy3 | 2.12s | 1.02s | 1.74s |
| kimi-k3 | 6.63s | 4.57s | 3.9s |
| glm-5.1 | 4.1s | 2.78s | 2.27s |
| glm-5.2 | 3.56s | 2.32s | 2.23s |
| glm-5-turbo | 7.14s | 15.74s | 15.08s |
| glm-5v-turbo | 2.98s | 1.39s | 1.22s |
| hy-mt2-plus | 2.27s | 0.88s | 1.12s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.21s | 2.57s | 2.07s |
| deepseek-v4-pro-202606 | 5.48s | 4.91s | 4.26s |
| qwen3.5-flash | 1.45s | 14.6s | 5.96s |
| qwen3.6-flash | 10.07s | 12.46s | 9.27s |
| qwen3.5-plus | 2.82s | 23.4s | 11.34s |
| qwen3.7-plus | 21.21s | 7.89s | 28.31s |
| qwen3.7-plus-1m | 30.79s | 8.0s | 29.37s |
| qwq-plus | 230.22s | 27.2s | 14.28s |
| qwen3-vl-plus | 3.16s | 0.47s | 1.51s |
| dola-Seed-2.0-mini | 4.91s | 4.71s | 3.79s |
| dola-Seed-2.0-lite | 16.37s | 9.99s | 10.47s |
| dola-Seed-2.0-pro | 9.95s | 4.53s | 3.73s |
| dola-Seed-2.1-turbo | 22.07s | 28.63s | 9.71s |
| hy3 | 3.06s | 1.12s | 1.68s |
| kimi-k3 | 4.64s | 5.21s | 2.85s |
| glm-5.1 | 4.18s | 2.51s | 2.14s |
| glm-5.2 | 3.35s | 2.22s | 1.96s |
| glm-5-turbo | 8.73s | 15.77s | 16.52s |
| glm-5v-turbo | 2.42s | 1.67s | 1.31s |
| hy-mt2-plus | 2.18s | 0.72s | 1.21s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 6.32s | 2.21s | 2.05s |
| deepseek-v4-pro-202606 | 10.15s | 3.56s | 5.9s |
| qwen3.5-flash | 1.84s | 7.52s | 15.39s |
| qwen3.6-flash | 8.1s | 11.19s | 7.25s |
| qwen3.5-plus | 3.06s | 24.35s | 28.96s |
| qwen3.7-plus | 21.22s | 7.49s | 31.43s |
| qwen3.7-plus-1m | 25.08s | 7.87s | 31.22s |
| qwq-plus | 104.83s | 36.7s | 11.95s |
| qwen3-vl-plus | 3.69s | 1.19s | 1.46s |
| dola-Seed-2.0-mini | 6.21s | 3.62s | 2.99s |
| dola-Seed-2.0-lite | 14.83s | 7.39s | 6.29s |
| dola-Seed-2.0-pro | 11.43s | 4.94s | 4.7s |
| dola-Seed-2.1-turbo | 34.03s | 30.32s | 9.96s |
| hy3 | 2.85s | 1.16s | 1.87s |
| kimi-k3 | 4.51s | 4.83s | 3.68s |
| glm-5.1 | 7.49s | 2.99s | 2.46s |
| glm-5.2 | 3.84s | 2.32s | 2.07s |
| glm-5-turbo | 7.23s | 20.31s | 18.35s |
| glm-5v-turbo | 3.22s | 1.65s | 1.52s |
| hy-mt2-plus | 2.24s | 0.7s | 1.24s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.92s | 3.92s | 2.15s |
| deepseek-v4-pro-202606 | 22.72s | 18.07s | 17.54s |
| qwen3.5-flash | 2.45s | 15.31s | 12.48s |
| qwen3.6-flash | 13.46s | 13.43s | 4.39s |
| qwen3.5-plus | 3.44s | 42.03s | 12.99s |
| qwen3.7-plus | 21.16s | 7.47s | 35.17s |
| qwen3.7-plus-1m | 16.58s | 8.5s | 24.26s |
| qwq-plus | 117.42s | 45.22s | 18.09s |
| qwen3-vl-plus | 2.87s | 0.98s | 1.65s |
| dola-Seed-2.0-mini | 7.18s | 3.27s | 3.13s |
| dola-Seed-2.0-lite | 16.25s | 12.22s | 8.2s |
| dola-Seed-2.0-pro | 12.55s | 4.23s | 5.53s |
| dola-Seed-2.1-turbo | 102.93s | 20.26s | 10.49s |
| hy3 | 2.75s | 1.06s | 1.67s |
| kimi-k3 | 6.96s | 5.7s | 11.92s |
| glm-5.1 | 10.54s | 6.23s | 5.82s |
| glm-5.2 | 3.82s | 2.52s | 2.09s |
| glm-5-turbo | 9.98s | 15.78s | 18.41s |
| glm-5v-turbo | 3.36s | 1.68s | 1.25s |
| hy-mt2-plus | 2.26s | 1.03s | 1.09s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 3.16s | 1.98s | 1.81s |
| deepseek-v4-pro-202606 | 7.36s | 9.8s | 4.88s |
| qwen3.5-flash | 1.65s | 8.72s | 7.82s |
| qwen3.6-flash | 7.37s | 5.47s | 3.94s |
| qwen3.5-plus | 3.77s | 47.26s | 13.18s |
| qwen3.7-plus | 23.43s | 8.05s | 18.54s |
| qwen3.7-plus-1m | 19.49s | 7.84s | 29.89s |
| qwq-plus | 51.07s | 17.85s | 14.83s |
| qwen3-vl-plus | 3.87s | 0.66s | 2.69s |
| dola-Seed-2.0-mini | 6.63s | 4.74s | 2.78s |
| dola-Seed-2.0-lite | 15.99s | 11.76s | 7.23s |
| dola-Seed-2.0-pro | 12.41s | 6.05s | 3.64s |
| dola-Seed-2.1-turbo | 31.18s | 25.67s | 9.65s |
| hy3 | 2.72s | 1.13s | 1.74s |
| kimi-k3 | 6.71s | 4.5s | 3.99s |
| glm-5.1 | 10.13s | 4.58s | 5.5s |
| glm-5.2 | 3.69s | 2.5s | 2.03s |
| glm-5-turbo | 9.53s | 13.19s | 18.34s |
| glm-5v-turbo | 3.05s | 1.51s | 1.62s |
| hy-mt2-plus | 1.95s | 0.68s | 1.06s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 2.82s | 2.17s | 1.57s |
| deepseek-v4-pro-202606 | 5.24s | 3.88s | 4.61s |
| qwen3.5-flash | 1.93s | 9.61s | 6.54s |
| qwen3.6-flash | 8.28s | 6.69s | 8.16s |
| qwen3.5-plus | 2.96s | 14.03s | 23.34s |
| qwen3.7-plus | 35.63s | 8.29s | 24.09s |
| qwen3.7-plus-1m | 27.13s | 8.77s | 24.74s |
| qwq-plus | 175.27s | 31.33s | 15.17s |
| qwen3-vl-plus | 4.22s | 1.29s | 1.41s |
| dola-Seed-2.0-mini | 6.34s | 5.54s | 3.05s |
| dola-Seed-2.0-lite | 20.21s | 10.24s | 9.0s |
| dola-Seed-2.0-pro | 13.51s | 5.57s | 6.26s |
| dola-Seed-2.1-turbo | 34.35s | 24.54s | 16.36s |
| hy3 | 1.96s | 1.08s | 1.81s |
| kimi-k3 | 6.38s | 4.16s | 4.02s |
| glm-5.1 | 9.75s | 9.8s | 6.85s |
| glm-5.2 | 3.49s | 2.19s | 1.83s |
| glm-5-turbo | 9.33s | 2.75s | 1.77s |
| glm-5v-turbo | 3.05s | 1.33s | 1.23s |
| hy-mt2-plus | 1.99s | 0.71s | 1.12s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.14s | 2.36s | 2.17s |
| deepseek-v4-pro-202606 | 4.44s | 2.47s | 2.94s |
| qwen3.5-flash | 1.53s | 12.23s | 6.28s |
| qwen3.6-flash | 13.1s | 10.77s | 5.6s |
| qwen3.5-plus | 3.17s | 23.67s | 17.91s |
| qwen3.7-plus | 19.81s | 11.0s | 23.8s |
| qwen3.7-plus-1m | 19.97s | 8.12s | 23.87s |
| qwq-plus | 30.21s | 22.66s | 14.44s |
| qwen3-vl-plus | 3.1s | 0.45s | 1.88s |
| dola-Seed-2.0-mini | 10.03s | 4.1s | 2.44s |
| dola-Seed-2.0-lite | 19.71s | 11.89s | 7.94s |
| dola-Seed-2.0-pro | 12.51s | 5.15s | 3.92s |
| dola-Seed-2.1-turbo | 55.76s | 24.61s | 10.04s |
| hy3 | 2.24s | 0.94s | 1.68s |
| kimi-k3 | 6.6s | 4.52s | 3.99s |
| glm-5.1 | 12.24s | 5.31s | 9.03s |
| glm-5.2 | 3.33s | 2.12s | 1.9s |
| glm-5-turbo | 4.35s | 2.46s | 2.33s |
| glm-5v-turbo | 3.54s | 1.28s | 1.4s |
| hy-mt2-plus | 1.93s | 0.73s | 1.08s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 3.25s | 2.06s | 1.58s |
| deepseek-v4-pro-202606 | 3.73s | 2.27s | 1.97s |
| qwen3.5-flash | 1.69s | 15.77s | 16.46s |
| qwen3.6-flash | 9.16s | 20.26s | 10.22s |
| qwen3.5-plus | 2.89s | 18.28s | 31.51s |
| qwen3.7-plus | 22.66s | 7.12s | 31.77s |
| qwen3.7-plus-1m | 22.89s | 7.11s | 31.78s |
| qwq-plus | 42.6s | 15.37s | 21.21s |
| qwen3-vl-plus | 3.9s | 0.45s | 1.84s |
| dola-Seed-2.0-mini | 8.13s | 5.29s | 3.08s |
| dola-Seed-2.0-lite | 18.92s | 11.3s | 7.58s |
| dola-Seed-2.0-pro | 11.99s | 4.4s | 4.43s |
| dola-Seed-2.1-turbo | 40.05s | 22.01s | 9.18s |
| hy3 | 1.86s | 1.06s | 1.77s |
| kimi-k3 | 6.06s | 3.02s | 4.04s |
| glm-5.1 | 8.22s | 5.56s | 5.0s |
| glm-5.2 | 2.89s | 2.31s | 1.84s |
| glm-5-turbo | 4.02s | 2.05s | 1.62s |
| glm-5v-turbo | 2.64s | 1.45s | 1.91s |
| hy-mt2-plus | 1.91s | 0.77s | 1.12s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 2.79s | 1.89s | 1.83s |
| deepseek-v4-pro-202606 | 3.11s | 2.16s | 1.8s |
| qwen3.5-flash | 2.69s | 13.15s | 16.13s |
| qwen3.6-flash | 13.04s | 5.94s | 6.06s |
| qwen3.5-plus | 2.85s | 25.05s | 32.64s |
| qwen3.7-plus | 25.57s | 8.31s | 17.69s |
| qwen3.7-plus-1m | 28.78s | 7.14s | 31.7s |
| qwq-plus | 46.36s | 19.99s | 33.29s |
| qwen3-vl-plus | 4.81s | 1.13s | 1.52s |
| dola-Seed-2.0-mini | 7.68s | 4.81s | 2.78s |
| dola-Seed-2.0-lite | 20.89s | 9.89s | 8.84s |
| dola-Seed-2.0-pro | 12.74s | 7.01s | 4.0s |
| dola-Seed-2.1-turbo | 43.64s | 21.77s | 11.01s |
| hy3 | 1.75s | 1.08s | 1.81s |
| kimi-k3 | 5.69s | 3.42s | 2.91s |
| glm-5.1 | 9.37s | 6.36s | 4.27s |
| glm-5.2 | 3.31s | 2.3s | 2.15s |
| glm-5-turbo | 4.48s | 2.99s | 2.64s |
| glm-5v-turbo | 2.54s | 1.7s | 1.56s |
| hy-mt2-plus | 2.05s | 0.71s | 1.18s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.19s | 2.5s | 2.35s |
| deepseek-v4-pro-202606 | 3.45s | 2.15s | 2.24s |
| qwen3.5-flash | 1.63s | 8.0s | 3.76s |
| qwen3.6-flash | 15.42s | 11.99s | 4.07s |
| qwen3.5-plus | 2.75s | 20.55s | 16.64s |
| qwen3.7-plus | 24.2s | 6.64s | 28.39s |
| qwen3.7-plus-1m | 24.25s | 6.52s | 21.62s |
| qwq-plus | 54.45s | 16.2s | 18.46s |
| qwen3-vl-plus | 3.81s | 0.61s | 1.82s |
| dola-Seed-2.0-mini | 5.84s | 4.15s | 2.63s |
| dola-Seed-2.0-lite | 19.01s | 8.15s | 8.46s |
| dola-Seed-2.0-pro | 13.5s | 8.33s | 4.02s |
| dola-Seed-2.1-turbo | 55.01s | 32.13s | 21.82s |
| hy3 | 3.55s | 1.22s | 1.71s |
| kimi-k3 | 6.14s | 4.44s | 3.76s |
| glm-5.1 | 8.38s | 5.5s | 6.28s |
| glm-5.2 | 3.71s | 5.44s | 2.28s |
| glm-5-turbo | 2.86s | 5.0s | 1.47s |
| glm-5v-turbo | 3.49s | 1.42s | 1.39s |
| hy-mt2-plus | 1.95s | 0.95s | 1.08s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.02s | 2.44s | 2.36s |
| deepseek-v4-pro-202606 | 4.66s | 2.71s | 3.15s |
| qwen3.5-flash | 1.49s | 13.46s | 3.69s |
| qwen3.6-flash | 14.11s | 17.83s | 3.99s |
| qwen3.5-plus | 3.64s | 19.27s | 11.03s |
| qwen3.7-plus | 22.83s | 7.31s | 23.09s |
| qwen3.7-plus-1m | 25.09s | 7.9s | 31.0s |
| qwq-plus | 45.52s | 48.74s | 20.87s |
| qwen3-vl-plus | 3.93s | 0.77s | 1.23s |
| dola-Seed-2.0-mini | 6.07s | 5.0s | 2.98s |
| dola-Seed-2.0-lite | 23.14s | 12.52s | 8.84s |
| dola-Seed-2.0-pro | 12.38s | 4.63s | 3.55s |
| dola-Seed-2.1-turbo | 22.39s | 17.06s | 12.49s |
| hy3 | 2.86s | 1.2s | 2.05s |
| kimi-k3 | 7.19s | 4.55s | 3.93s |
| glm-5.1 | 10.03s | 4.87s | 7.91s |
| glm-5.2 | 3.34s | 2.28s | 2.2s |
| glm-5-turbo | 3.01s | 2.06s | 1.98s |
| glm-5v-turbo | 3.72s | 1.41s | 1.37s |
| hy-mt2-plus | 1.94s | 0.75s | 1.13s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.15s | 2.73s | 2.5s |
| deepseek-v4-pro-202606 | 4.38s | 3.44s | 2.7s |
| qwen3.5-flash | 1.71s | 19.53s | 9.69s |
| qwen3.6-flash | 10.51s | 6.64s | 5.89s |
| qwen3.5-plus | 3.31s | 26.91s | 13.18s |
| qwen3.7-plus | 19.56s | 7.96s | 37.84s |
| qwen3.7-plus-1m | 17.91s | 14.3s | 28.1s |
| qwq-plus | 74.18s | 13.35s | 21.57s |
| qwen3-vl-plus | 3.35s | 0.51s | 1.28s |
| dola-Seed-2.0-mini | 6.15s | 4.3s | 2.8s |
| dola-Seed-2.0-lite | 20.51s | 10.36s | 7.87s |
| dola-Seed-2.0-pro | 13.63s | 5.58s | 14.74s |
| dola-Seed-2.1-turbo | 38.55s | 22.63s | 19.56s |
| hy3 | 2.89s | 1.26s | 1.77s |
| kimi-k3 | 6.46s | 6.82s | 4.51s |
| glm-5.1 | 9.18s | 7.35s | 4.74s |
| glm-5.2 | 3.59s | 2.53s | 2.2s |
| glm-5-turbo | 9.15s | 2.19s | 1.82s |
| glm-5v-turbo | 2.43s | 1.41s | 1.81s |
| hy-mt2-plus | 1.84s | 0.74s | 1.17s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 5.03s | 2.76s | 2.21s |
| deepseek-v4-pro-202606 | 4.11s | 3.53s | 2.67s |
| qwen3.5-flash | 1.65s | 9.74s | 16.32s |
| qwen3.6-flash | 5.22s | 10.61s | 3.44s |
| qwen3.5-plus | 4.08s | 24.78s | 14.2s |
| qwen3.7-plus | 24.13s | 8.02s | 29.22s |
| qwen3.7-plus-1m | 24.26s | 8.13s | 28.6s |
| qwq-plus | 57.21s | 32.84s | 11.53s |
| qwen3-vl-plus | 3.49s | 0.54s | 1.38s |
| dola-Seed-2.0-mini | 8.03s | 2.96s | 2.96s |
| dola-Seed-2.0-lite | 19.48s | 13.64s | 5.83s |
| dola-Seed-2.0-pro | 12.99s | 10.7s | 3.75s |
| dola-Seed-2.1-turbo | 47.0s | 22.66s | 18.91s |
| hy3 | 2.81s | 1.22s | 1.8s |
| kimi-k3 | 6.36s | 3.43s | 3.23s |
| glm-5.1 | 7.72s | 7.82s | 6.83s |
| glm-5.2 | 3.57s | 2.52s | 2.17s |
| glm-5-turbo | 4.35s | 1.98s | 1.94s |
| glm-5v-turbo | 2.45s | 1.43s | 1.25s |
| hy-mt2-plus | 2.04s | 0.77s | 1.07s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 3.87s | 4.65s | 2.58s |
| deepseek-v4-pro-202606 | 4.73s | 3.84s | 2.88s |
| qwen3.5-flash | 1.44s | 11.03s | 12.02s |
| qwen3.6-flash | 6.25s | 13.34s | 4.18s |
| qwen3.5-plus | 4.21s | 22.87s | 40.69s |
| qwen3.7-plus | 25.32s | 7.33s | 29.39s |
| qwen3.7-plus-1m | 24.97s | 7.59s | 30.97s |
| qwq-plus | 297.23s | 90.31s | 52.5s |
| qwen3-vl-plus | 3.04s | 0.49s | 1.37s |
| dola-Seed-2.0-mini | 8.34s | 4.37s | 2.86s |
| dola-Seed-2.0-lite | 16.79s | 9.84s | 8.22s |
| dola-Seed-2.0-pro | 10.59s | 6.78s | 3.54s |
| dola-Seed-2.1-turbo | 30.99s | 33.25s | 32.34s |
| hy3 | 3.81s | 1.23s | 1.88s |
| kimi-k3 | 6.07s | 4.04s | 3.48s |
| glm-5.1 | 10.03s | 6.44s | 5.61s |
| glm-5.2 | 3.12s | 2.24s | 1.86s |
| glm-5-turbo | 3.02s | 2.12s | 2.14s |
| glm-5v-turbo | 3.72s | 1.48s | 1.34s |
| hy-mt2-plus | 2.0s | 0.71s | 1.16s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.29s | 2.66s | 2.29s |
| deepseek-v4-pro-202606 | 4.96s | 3.62s | 2.9s |
| qwen3.5-flash | 1.64s | 6.31s | 3.71s |
| qwen3.6-flash | 10.23s | 6.84s | 6.28s |
| qwen3.5-plus | 4.12s | 19.3s | 8.92s |
| qwen3.7-plus | 25.05s | 8.11s | 16.98s |
| qwen3.7-plus-1m | 22.24s | 8.44s | 28.09s |
| qwq-plus | 67.52s | 23.39s | 12.4s |
| qwen3-vl-plus | 2.68s | 0.71s | 1.22s |
| dola-Seed-2.0-mini | 8.63s | 3.06s | 2.82s |
| dola-Seed-2.0-lite | 17.5s | 9.39s | 5.32s |
| dola-Seed-2.0-pro | 12.83s | 4.38s | 5.1s |
| dola-Seed-2.1-turbo | 33.92s | 30.49s | 17.85s |
| hy3 | 3.3s | 1.22s | 1.92s |
| kimi-k3 | 6.65s | 4.74s | 3.92s |
| glm-5.1 | 8.78s | 8.19s | 7.14s |
| glm-5.2 | 3.44s | 2.1s | 2.36s |
| glm-5-turbo | 3.95s | 1.78s | 18.16s |
| glm-5v-turbo | 3.22s | 1.35s | 1.31s |
| hy-mt2-plus | 1.96s | 0.72s | 1.14s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.05s | 2.53s | 2.65s |
| deepseek-v4-pro-202606 | 4.49s | 3.3s | 2.85s |
| qwen3.5-flash | 1.68s | 9.11s | 4.3s |
| qwen3.6-flash | 9.72s | 7.38s | 9.52s |
| qwen3.5-plus | 4.8s | 26.79s | 45.46s |
| qwen3.7-plus | 32.4s | 7.46s | 26.4s |
| qwen3.7-plus-1m | 32.28s | 7.39s | 31.99s |
| qwq-plus | 51.5s | 16.61s | 17.21s |
| qwen3-vl-plus | 3.45s | 0.42s | 1.17s |
| dola-Seed-2.0-mini | 6.52s | 4.51s | 2.47s |
| dola-Seed-2.0-lite | 19.74s | 14.0s | 9.41s |
| dola-Seed-2.0-pro | 12.36s | 5.12s | 3.42s |
| dola-Seed-2.1-turbo | 31.77s | 24.94s | 22.81s |
| hy3 | 3.05s | 1.19s | 2.65s |
| kimi-k3 | 5.85s | 3.92s | 3.16s |
| glm-5.1 | 8.46s | 7.44s | 6.26s |
| glm-5.2 | 5.23s | 3.58s | 2.05s |
| glm-5-turbo | 3.52s | 2.11s | 1.47s |
| glm-5v-turbo | 2.18s | 1.86s | 1.52s |
| hy-mt2-plus | 1.78s | 0.63s | 1.16s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.33s | 5.61s | 2.16s |
| deepseek-v4-pro-202606 | 4.13s | 3.49s | 2.62s |
| qwen3.5-flash | 1.49s | 6.35s | 4.32s |
| qwen3.6-flash | 11.6s | 18.37s | 10.03s |
| qwen3.5-plus | 4.52s | 22.99s | 54.36s |
| qwen3.7-plus | 26.25s | 8.0s | 21.62s |
| qwen3.7-plus-1m | 23.46s | 8.3s | 21.86s |
| qwq-plus | 64.99s | 22.66s | 13.61s |
| qwen3-vl-plus | 2.94s | 0.45s | 1.84s |
| dola-Seed-2.0-mini | 7.08s | 3.57s | 2.73s |
| dola-Seed-2.0-lite | 24.58s | 15.52s | 10.07s |
| dola-Seed-2.0-pro | 13.9s | 6.89s | 3.7s |
| dola-Seed-2.1-turbo | 29.89s | 23.05s | 16.78s |
| hy3 | 3.14s | 1.19s | 1.96s |
| kimi-k3 | 7.74s | 4.53s | 3.42s |
| glm-5.1 | 8.57s | 7.2s | 5.84s |
| glm-5.2 | 5.52s | 2.31s | 1.9s |
| glm-5-turbo | 5.1s | 1.6s | 1.71s |
| glm-5v-turbo | 2.58s | 2.37s | 1.99s |
| hy-mt2-plus | 2.07s | 0.76s | 1.15s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.31s | 8.72s | 2.61s |
| deepseek-v4-pro-202606 | 6.22s | 4.1s | 3.07s |
| qwen3.5-flash | 1.48s | 6.39s | 13.99s |
| qwen3.6-flash | 14.77s | 18.81s | 8.15s |
| qwen3.5-plus | 5.03s | 59.66s | 33.72s |
| qwen3.7-plus | 21.97s | 8.55s | 14.33s |
| qwen3.7-plus-1m | 25.3s | 8.52s | 35.1s |
| qwq-plus | 61.6s | 17.43s | 17.77s |
| qwen3-vl-plus | 3.49s | 0.42s | 1.44s |
| dola-Seed-2.0-mini | 5.74s | 3.75s | 2.84s |
| dola-Seed-2.0-lite | 19.17s | 10.21s | 7.62s |
| dola-Seed-2.0-pro | 10.9s | 6.22s | 3.42s |
| dola-Seed-2.1-turbo | 46.02s | 21.48s | 21.11s |
| hy3 | 3.09s | 1.17s | 2.17s |
| kimi-k3 | 6.18s | 4.17s | 3.34s |
| glm-5.1 | 11.03s | 7.31s | 6.54s |
| glm-5.2 | 3.63s | 3.94s | 2.13s |
| glm-5-turbo | 6.11s | 3.06s | 2.25s |
| glm-5v-turbo | 2.12s | 1.97s | 2.04s |
| hy-mt2-plus | 1.93s | 0.79s | 1.18s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.36s | 2.69s | 2.27s |
| deepseek-v4-pro-202606 | 4.7s | 3.32s | 2.7s |
| qwen3.5-flash | 1.75s | 6.43s | 11.84s |
| qwen3.6-flash | 15.72s | 7.74s | 10.26s |
| qwen3.5-plus | 4.51s | 29.52s | 23.11s |
| qwen3.7-plus | 26.17s | 11.11s | 21.65s |
| qwen3.7-plus-1m | 24.21s | 8.37s | 25.66s |
| qwq-plus | 61.78s | 16.73s | 15.31s |
| qwen3-vl-plus | 4.42s | 0.95s | 1.49s |
| dola-Seed-2.0-mini | 6.0s | 4.67s | 2.83s |
| dola-Seed-2.0-lite | 28.12s | 21.41s | 12.92s |
| dola-Seed-2.0-pro | 9.76s | 5.89s | 4.43s |
| dola-Seed-2.1-turbo | 28.31s | 42.22s | 14.33s |
| hy3 | 3.25s | 1.2s | 1.94s |
| kimi-k3 | 6.77s | 3.57s | 3.34s |
| glm-5.1 | 9.38s | 6.08s | 7.0s |
| glm-5.2 | 5.0s | 2.41s | 2.13s |
| glm-5-turbo | 3.68s | 1.66s | 103.86s |
| glm-5v-turbo | 2.32s | 1.68s | 1.67s |
| hy-mt2-plus | 2.04s | 0.67s | 1.19s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.72s | 3.18s | 2.37s |
| deepseek-v4-pro-202606 | 4.42s | 3.36s | 2.91s |
| qwen3.5-flash | 1.44s | 6.64s | 3.76s |
| qwen3.6-flash | 13.99s | 9.34s | 7.85s |
| qwen3.5-plus | 4.88s | 34.38s | 20.43s |
| qwen3.7-plus | 24.02s | 7.68s | 51.08s |
| qwen3.7-plus-1m | 23.97s | 11.16s | 17.44s |
| qwq-plus | 61.61s | 62.35s | 16.32s |
| qwen3-vl-plus | 3.76s | 0.94s | 1.64s |
| dola-Seed-2.0-mini | 5.47s | 3.87s | 3.09s |
| dola-Seed-2.0-lite | 21.52s | 11.18s | 6.76s |
| dola-Seed-2.0-pro | 14.13s | 5.78s | 3.24s |
| dola-Seed-2.1-turbo | 46.55s | 30.1s | 18.12s |
| hy3 | 3.27s | 1.25s | 2.05s |
| kimi-k3 | 6.41s | 4.99s | 3.85s |
| glm-5.1 | 9.07s | 5.53s | 6.69s |
| glm-5.2 | 3.38s | 2.4s | 2.42s |
| glm-5-turbo | 3.12s | 1.63s | 1.69s |
| glm-5v-turbo | 2.14s | 1.34s | 1.43s |
| hy-mt2-plus | 1.92s | 0.6s | 1.17s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.32s | 2.84s | 2.32s |
| deepseek-v4-pro-202606 | 4.46s | 3.65s | 2.45s |
| qwen3.5-flash | 1.67s | 8.21s | 8.37s |
| qwen3.6-flash | 14.23s | 12.41s | 10.48s |
| qwen3.5-plus | 4.05s | 26.85s | 39.14s |
| qwen3.7-plus | 25.21s | 8.35s | 29.7s |
| qwen3.7-plus-1m | 25.1s | 8.12s | 29.58s |
| qwq-plus | 102.14s | 26.32s | 21.09s |
| qwen3-vl-plus | 4.24s | 0.52s | 1.64s |
| dola-Seed-2.0-mini | 8.23s | 5.05s | 3.02s |
| dola-Seed-2.0-lite | 20.08s | 13.96s | 7.79s |
| dola-Seed-2.0-pro | 11.21s | 5.33s | 3.27s |
| dola-Seed-2.1-turbo | 43.95s | 24.45s | 17.34s |
| hy3 | 3.17s | 1.27s | 1.9s |
| kimi-k3 | 5.39s | 4.57s | 3.51s |
| glm-5.1 | 10.24s | 5.07s | 5.57s |
| glm-5.2 | 3.39s | 2.13s | 2.43s |
| glm-5-turbo | 4.16s | 2.82s | 1.75s |
| glm-5v-turbo | 2.34s | 1.28s | 1.52s |
| hy-mt2-plus | 1.93s | 0.75s | 1.14s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 3.9s | 2.16s | 2.07s |
| deepseek-v4-pro-202606 | 3.98s | 3.26s | 3.25s |
| qwen3.5-flash | 1.5s | 9.28s | 3.75s |
| qwen3.6-flash | 8.12s | 28.36s | 14.57s |
| qwen3.5-plus | 4.16s | 53.95s | 28.05s |
| qwen3.7-plus | 25.02s | 8.53s | 33.89s |
| qwen3.7-plus-1m | 27.39s | 9.74s | 36.1s |
| qwq-plus | 85.84s | 54.54s | 16.66s |
| qwen3-vl-plus | 3.2s | 0.48s | 1.09s |
| dola-Seed-2.0-mini | 5.47s | 3.77s | 2.95s |
| dola-Seed-2.0-lite | 23.65s | 11.19s | 9.1s |
| dola-Seed-2.0-pro | 11.89s | 4.34s | 10.27s |
| dola-Seed-2.1-turbo | 23.57s | 16.17s | 14.57s |
| hy3 | 3.18s | 1.31s | 1.95s |
| kimi-k3 | 7.45s | 4.23s | 3.63s |
| glm-5.1 | 14.09s | 13.44s | 11.74s |
| glm-5.2 | 3.13s | 2.58s | 1.9s |
| glm-5-turbo | 2.54s | 1.93s | 4.97s |
| glm-5v-turbo | 2.33s | 1.46s | 1.36s |
| hy-mt2-plus | 2.06s | 0.79s | 1.25s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 12.91s | 2.25s | 2.05s |
| deepseek-v4-pro-202606 | 3.9s | 2.91s | 2.28s |
| qwen3.5-flash | 1.47s | 13.9s | 8.09s |
| qwen3.6-flash | 13.05s | 11.09s | 5.29s |
| qwen3.5-plus | 5.65s | 31.76s | 44.37s |
| qwen3.7-plus | 20.77s | 8.18s | 26.55s |
| qwen3.7-plus-1m | 33.04s | 8.53s | 25.91s |
| qwq-plus | 112.2s | 88.26s | 76.18s |
| qwen3-vl-plus | 4.34s | 0.52s | 1.59s |
| dola-Seed-2.0-mini | 5.74s | 4.68s | 2.96s |
| dola-Seed-2.0-lite | 14.79s | 10.29s | 6.39s |
| dola-Seed-2.0-pro | 11.48s | 5.13s | 4.32s |
| dola-Seed-2.1-turbo | 35.11s | 17.11s | 10.46s |
| hy3 | 3.02s | 1.13s | 1.99s |
| kimi-k3 | 7.56s | 4.53s | 3.6s |
| glm-5.1 | 9.47s | 14.16s | 14.62s |
| glm-5.2 | 3.38s | 2.39s | 2.03s |
| glm-5-turbo | 4.41s | 2.41s | 2.06s |
| glm-5v-turbo | 2.63s | 2.82s | 1.93s |
| hy-mt2-plus | 1.93s | 0.84s | 1.14s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | FAIL | FAIL | FAIL |
| deepseek-v4-pro-202606 | FAIL | FAIL | FAIL |
| qwen3.5-flash | 1.86s | 6.37s | 3.79s |
| qwen3.6-flash | 9.63s | 9.84s | 9.69s |
| qwen3.5-plus | 5.66s | 36.67s | 24.95s |
| qwen3.7-plus | 18.85s | 9.5s | 26.64s |
| qwen3.7-plus-1m | 26.0s | 9.35s | 19.36s |
| qwq-plus | 76.71s | 44.41s | 26.73s |
| qwen3-vl-plus | 3.74s | 0.47s | 1.35s |
| dola-Seed-2.0-mini | 5.94s | 3.58s | 2.73s |
| dola-Seed-2.0-lite | 20.43s | 9.75s | 7.18s |
| dola-Seed-2.0-pro | 12.99s | 5.9s | 4.3s |
| dola-Seed-2.1-turbo | 34.55s | 25.85s | 19.21s |
| hy3 | FAIL | FAIL | FAIL |
| kimi-k3 | FAIL | FAIL | FAIL |
| glm-5.1 | FAIL | FAIL | FAIL |
| glm-5.2 | FAIL | FAIL | FAIL |
| glm-5-turbo | FAIL | FAIL | FAIL |
| glm-5v-turbo | FAIL | FAIL | FAIL |
| hy-mt2-plus | FAIL | FAIL | FAIL |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.29s | 2.34s | 2.02s |
| deepseek-v4-pro-202606 | 4.24s | 2.96s | 2.48s |
| qwen3.5-flash | 4.87s | 9.07s | 3.7s |
| qwen3.6-flash | 17.22s | 9.3s | 9.6s |
| qwen3.5-plus | 6.02s | 18.12s | 23.8s |
| qwen3.7-plus | 19.39s | 8.37s | 34.55s |
| qwen3.7-plus-1m | 21.12s | 8.84s | 18.56s |
| qwq-plus | 30.5s | 24.66s | 13.12s |
| qwen3-vl-plus | 3.65s | 0.66s | 1.38s |
| dola-Seed-2.0-mini | 8.03s | 4.93s | 2.68s |
| dola-Seed-2.0-lite | 15.55s | 13.15s | 8.7s |
| dola-Seed-2.0-pro | 16.16s | 13.17s | 4.12s |
| dola-Seed-2.1-turbo | 41.36s | 17.68s | 11.5s |
| hy3 | 3.07s | 1.26s | 2.0s |
| kimi-k3 | 38.2s | 37.13s | 22.2s |
| glm-5.1 | FAIL | FAIL | FAIL |
| glm-5.2 | FAIL | FAIL | FAIL |
| glm-5-turbo | FAIL | FAIL | FAIL |
| glm-5v-turbo | FAIL | FAIL | FAIL |
| hy-mt2-plus | FAIL | FAIL | FAIL |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.88s | 2.32s | 2.24s |
| deepseek-v4-pro-202606 | 3.99s | 3.26s | 2.31s |
| qwen3.5-flash | 1.47s | 9.13s | 3.72s |
| qwen3.6-flash | 9.23s | 6.47s | 6.84s |
| qwen3.5-plus | 5.88s | 61.86s | 28.59s |
| qwen3.7-plus | 24.98s | 7.06s | 31.29s |
| qwen3.7-plus-1m | 23.15s | 9.28s | 34.05s |
| qwq-plus | 33.14s | 24.48s | 19.42s |
| qwen3-vl-plus | 3.46s | 0.49s | 1.15s |
| dola-Seed-2.0-mini | 6.22s | 6.47s | 3.39s |
| dola-Seed-2.0-lite | 20.0s | 9.42s | 8.3s |
| dola-Seed-2.0-pro | 14.43s | 5.56s | 4.44s |
| dola-Seed-2.1-turbo | 36.55s | 24.19s | 14.33s |
| hy3 | 3.49s | 1.2s | 2.0s |
| kimi-k3 | 8.65s | 6.03s | 4.04s |
| glm-5.1 | 2.96s | 2.27s | 1.86s |
| glm-5.2 | 3.34s | 2.67s | 1.92s |
| glm-5-turbo | 4.69s | 1.91s | 1.37s |
| glm-5v-turbo | 2.56s | 1.23s | 1.41s |
| hy-mt2-plus | 1.8s | 0.72s | 1.02s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.48s | 2.33s | 2.09s |
| deepseek-v4-pro-202606 | 4.96s | 3.0s | 2.3s |
| qwen3.5-flash | 15.11s | 7.1s | 3.78s |
| qwen3.6-flash | 9.46s | 16.49s | 4.84s |
| qwen3.5-plus | 5.42s | 32.95s | 49.8s |
| qwen3.7-plus | 28.04s | 10.1s | 33.96s |
| qwen3.7-plus-1m | 25.18s | 9.06s | 31.48s |
| qwq-plus | 45.38s | 51.72s | 21.03s |
| qwen3-vl-plus | 3.22s | 1.06s | 1.58s |
| dola-Seed-2.0-mini | 9.06s | 4.76s | 2.88s |
| dola-Seed-2.0-lite | 19.72s | 12.12s | 7.17s |
| dola-Seed-2.0-pro | 12.61s | 4.16s | 4.65s |
| dola-Seed-2.1-turbo | 37.6s | 13.45s | 13.44s |
| hy3 | 3.38s | 1.15s | 2.04s |
| kimi-k3 | 9.39s | 4.77s | 4.2s |
| glm-5.1 | 8.4s | 6.07s | 4.45s |
| glm-5.2 | 3.69s | 3.47s | 2.06s |
| glm-5-turbo | 3.55s | 2.33s | 2.11s |
| glm-5v-turbo | 2.66s | 1.52s | 1.48s |
| hy-mt2-plus | 1.88s | 0.68s | 1.11s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 3.79s | 2.21s | 1.87s |
| deepseek-v4-pro-202606 | 4.16s | 2.1s | 2.18s |
| qwen3.5-flash | 1.46s | 10.2s | 3.78s |
| qwen3.6-flash | 12.66s | 9.14s | 5.56s |
| qwen3.5-plus | 6.2s | 30.35s | 26.33s |
| qwen3.7-plus | 23.78s | 8.48s | 28.53s |
| qwen3.7-plus-1m | 23.58s | 8.8s | 28.8s |
| qwq-plus | 67.47s | 23.62s | 19.0s |
| qwen3-vl-plus | 4.49s | 0.56s | 1.39s |
| dola-Seed-2.0-mini | 8.8s | 5.77s | 3.92s |
| dola-Seed-2.0-lite | 17.91s | 10.71s | 6.76s |
| dola-Seed-2.0-pro | 10.01s | 5.53s | 3.47s |
| dola-Seed-2.1-turbo | 14.65s | 14.92s | 14.15s |
| hy3 | 3.2s | 1.29s | 1.99s |
| kimi-k3 | 7.74s | 5.16s | 4.39s |
| glm-5.1 | 10.24s | 5.76s | 5.84s |
| glm-5.2 | 3.87s | 3.18s | 1.88s |
| glm-5-turbo | 2.65s | 2.63s | 3.65s |
| glm-5v-turbo | 2.58s | 1.69s | 1.37s |
| hy-mt2-plus | 1.93s | 0.59s | 1.03s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 3.82s | 1.9s | 1.96s |
| deepseek-v4-pro-202606 | 4.34s | 2.88s | 2.25s |
| qwen3.5-flash | 1.43s | 6.32s | 4.03s |
| qwen3.6-flash | 8.06s | 11.17s | 7.53s |
| qwen3.5-plus | 6.19s | 45.46s | 40.85s |
| qwen3.7-plus | 34.42s | 9.71s | 31.63s |
| qwen3.7-plus-1m | 34.54s | 9.03s | 32.93s |
| qwq-plus | 31.69s | 38.59s | 13.36s |
| qwen3-vl-plus | 3.29s | 0.6s | 1.79s |
| dola-Seed-2.0-mini | 9.01s | 5.74s | 2.5s |
| dola-Seed-2.0-lite | 19.23s | 12.16s | 7.73s |
| dola-Seed-2.0-pro | 12.76s | 4.86s | 4.28s |
| dola-Seed-2.1-turbo | 31.06s | 15.94s | 7.01s |
| hy3 | 3.15s | 1.33s | 1.88s |
| kimi-k3 | 7.83s | 5.06s | 4.57s |
| glm-5.1 | 7.21s | 2.45s | 2.38s |
| glm-5.2 | 3.71s | 3.01s | 2.07s |
| glm-5-turbo | 63.9s | 2.48s | 2.05s |
| glm-5v-turbo | 2.34s | 1.74s | 1.37s |
| hy-mt2-plus | 2.03s | 0.61s | 1.05s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 3.3s | 2.18s | 1.96s |
| deepseek-v4-pro-202606 | 3.54s | 2.55s | 2.39s |
| qwen3.5-flash | 1.48s | 11.54s | 6.26s |
| qwen3.6-flash | 9.12s | 13.52s | 8.92s |
| qwen3.5-plus | 6.09s | 36.04s | 29.87s |
| qwen3.7-plus | 24.08s | 9.11s | 31.14s |
| qwen3.7-plus-1m | 33.2s | 8.76s | 33.75s |
| qwq-plus | 81.39s | 21.82s | 15.86s |
| qwen3-vl-plus | 4.11s | 0.51s | 1.49s |
| dola-Seed-2.0-mini | 6.04s | 4.01s | 2.82s |
| dola-Seed-2.0-lite | 16.01s | 15.51s | 8.77s |
| dola-Seed-2.0-pro | 11.79s | 4.97s | 3.66s |
| dola-Seed-2.1-turbo | 23.57s | 17.14s | 14.87s |
| hy3 | 3.24s | 1.23s | 1.78s |
| kimi-k3 | 7.76s | 5.26s | 4.13s |
| glm-5.1 | 7.16s | 6.75s | 1.86s |
| glm-5.2 | 3.35s | 2.68s | 1.89s |
| glm-5-turbo | 4.71s | 10.85s | 1.8s |
| glm-5v-turbo | 3.06s | 1.69s | 1.36s |
| hy-mt2-plus | 1.88s | 0.75s | 1.06s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.12s | 2.26s | 2.0s |
| deepseek-v4-pro-202606 | 4.02s | 2.07s | 2.3s |
| qwen3.5-flash | 1.72s | 8.48s | 8.04s |
| qwen3.6-flash | 8.63s | 10.71s | 7.38s |
| qwen3.5-plus | 5.97s | 25.86s | 31.74s |
| qwen3.7-plus | 23.9s | 8.88s | 23.26s |
| dola-Seed-2.0-lite | 19.27s | 9.96s | 7.75s |
| dola-Seed-2.0-mini | 8.07s | 4.94s | 3.48s |
| dola-Seed-2.0-pro | 12.22s | 3.59s | 4.49s |
| dola-Seed-2.1-turbo | 27.35s | 13.0s | 12.9s |
| hy3 | 3.04s | 1.29s | 1.84s |
| kimi-k3 | 6.71s | 4.94s | 4.55s |
| glm-5.2 | 10.86s | 3.07s | 2.27s |
| hy-mt2-plus | 2.16s | 0.71s | 1.01s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 24.45s | 2.18s | 1.82s |
| deepseek-v4-pro-202606 | 4.08s | 2.78s | 2.51s |
| qwen3.5-flash | 1.83s | 6.46s | 3.9s |
| qwen3.6-flash | 13.56s | 11.21s | 12.73s |
| qwen3.5-plus | 6.49s | 47.3s | 23.84s |
| qwen3.7-plus | 25.95s | 9.31s | 22.43s |
| dola-Seed-2.0-lite | 20.09s | 10.42s | 7.84s |
| dola-Seed-2.0-mini | 8.24s | 8.91s | 2.98s |
| dola-Seed-2.0-pro | 11.55s | 5.26s | 4.81s |
| dola-Seed-2.1-turbo | 46.41s | 23.68s | 12.16s |
| hy3 | 4.24s | 1.23s | 1.73s |
| kimi-k3 | 15.29s | 5.82s | 4.07s |
| glm-5.2 | 4.65s | 3.52s | 2.48s |
| hy-mt2-plus | 2.02s | 0.62s | 1.06s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.96s | 1.96s | 1.91s |
| deepseek-v4-pro-202606 | 4.28s | 2.57s | 2.27s |
| qwen3.5-flash | 1.45s | 12.9s | 3.75s |
| qwen3.6-flash | 16.59s | 10.06s | 7.16s |
| qwen3.5-plus | 5.23s | 34.73s | 22.06s |
| qwen3.7-plus | 20.23s | 9.63s | 30.57s |
| dola-Seed-2.0-lite | 16.95s | 12.2s | 7.31s |
| dola-Seed-2.0-mini | 12.86s | 5.12s | 3.98s |
| dola-Seed-2.0-pro | 13.94s | 3.92s | 4.98s |
| dola-Seed-2.1-turbo | 32.08s | 10.9s | 5.35s |
| hy3 | 3.23s | 1.24s | 1.91s |
| kimi-k3 | FAIL | FAIL | FAIL |
| glm-5.2 | 3.38s | 2.55s | 2.61s |
| hy-mt2-plus | 2.04s | 0.71s | 0.89s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 3.85s | 2.25s | 1.87s |
| deepseek-v4-pro-202606 | 4.16s | 2.78s | 2.33s |
| qwen3.5-flash | 1.48s | 8.93s | 10.1s |
| qwen3.6-flash | 11.91s | 16.2s | 10.54s |
| qwen3.5-plus | 6.09s | 51.01s | 62.1s |
| qwen3.7-plus | 27.05s | 8.3s | 22.04s |
| dola-Seed-2.0-lite | 18.71s | 11.52s | 6.51s |
| dola-Seed-2.0-mini | 6.9s | 6.37s | 3.21s |
| dola-Seed-2.0-pro | 13.33s | 5.52s | 4.32s |
| dola-Seed-2.1-turbo | 33.95s | 18.11s | 16.04s |
| hy3 | 3.06s | 1.26s | 1.99s |
| kimi-k3 | FAIL | FAIL | FAIL |
| glm-5.2 | 4.67s | 2.43s | 2.87s |
| hy-mt2-plus | 1.99s | 0.67s | 0.97s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 3.52s | 1.99s | 1.72s |
| deepseek-v4-pro-202606 | 3.3s | 2.56s | 1.93s |
| qwen3.5-flash | 17.61s | 10.28s | 11.49s |
| qwen3.6-flash | 14.81s | 9.36s | 7.37s |
| qwen3.5-plus | 4.76s | 37.24s | 23.9s |
| qwen3.7-plus | 27.62s | 11.94s | 32.49s |
| dola-Seed-2.0-lite | 15.9s | 9.36s | 6.14s |
| dola-Seed-2.0-mini | 6.08s | 2.85s | 2.76s |
| dola-Seed-2.0-pro | 12.02s | 6.82s | 4.3s |
| glm-5.2 | 4.53s | 3.3s | 2.9s |
| hy-mt2-plus | 1.9s | 0.6s | 1.16s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.02s | 2.44s | 2.36s |
| deepseek-v4-pro-202606 | 4.66s | 2.71s | 3.15s |
| qwen3.5-flash | 1.49s | 13.46s | 3.69s |
| qwen3.6-flash | 14.11s | 17.83s | 3.99s |
| qwen3.5-plus | 3.64s | 19.27s | 11.03s |
| qwen3.7-plus | 22.83s | 7.31s | 23.09s |
| qwen3.7-plus-1m | 25.09s | 7.9s | 31.0s |
| qwq-plus | 45.52s | 48.74s | 20.87s |
| qwen3-vl-plus | 3.93s | 0.77s | 1.23s |
| dola-Seed-2.0-mini | 6.07s | 5.0s | 2.98s |
| dola-Seed-2.0-lite | 23.14s | 12.52s | 8.84s |
| dola-Seed-2.0-pro | 12.38s | 4.63s | 3.55s |
| dola-Seed-2.1-turbo | 22.39s | 17.06s | 12.49s |
| hy3 | 2.86s | 1.2s | 2.05s |
| kimi-k3 | 7.19s | 4.55s | 3.93s |
| glm-5.1 | 10.03s | 4.87s | 7.91s |
| glm-5.2 | 3.34s | 2.28s | 2.2s |
| glm-5-turbo | 3.01s | 2.06s | 1.98s |
| glm-5v-turbo | 3.72s | 1.41s | 1.37s |
| hy-mt2-plus | 1.94s | 0.75s | 1.13s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.15s | 2.73s | 2.5s |
| deepseek-v4-pro-202606 | 4.38s | 3.44s | 2.7s |
| qwen3.5-flash | 1.71s | 19.53s | 9.69s |
| qwen3.6-flash | 10.51s | 6.64s | 5.89s |
| qwen3.5-plus | 3.31s | 26.91s | 13.18s |
| qwen3.7-plus | 19.56s | 7.96s | 37.84s |
| qwen3.7-plus-1m | 17.91s | 14.3s | 28.1s |
| qwq-plus | 74.18s | 13.35s | 21.57s |
| qwen3-vl-plus | 3.35s | 0.51s | 1.28s |
| dola-Seed-2.0-mini | 6.15s | 4.3s | 2.8s |
| dola-Seed-2.0-lite | 20.51s | 10.36s | 7.87s |
| dola-Seed-2.0-pro | 13.63s | 5.58s | 14.74s |
| dola-Seed-2.1-turbo | 38.55s | 22.63s | 19.56s |
| hy3 | 2.89s | 1.26s | 1.77s |
| kimi-k3 | 6.46s | 6.82s | 4.51s |
| glm-5.1 | 9.18s | 7.35s | 4.74s |
| glm-5.2 | 3.59s | 2.53s | 2.2s |
| glm-5-turbo | 9.15s | 2.19s | 1.82s |
| glm-5v-turbo | 2.43s | 1.41s | 1.81s |
| hy-mt2-plus | 1.84s | 0.74s | 1.17s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 5.03s | 2.76s | 2.21s |
| deepseek-v4-pro-202606 | 4.11s | 3.53s | 2.67s |
| qwen3.5-flash | 1.65s | 9.74s | 16.32s |
| qwen3.6-flash | 5.22s | 10.61s | 3.44s |
| qwen3.5-plus | 4.08s | 24.78s | 14.2s |
| qwen3.7-plus | 24.13s | 8.02s | 29.22s |
| qwen3.7-plus-1m | 24.26s | 8.13s | 28.6s |
| qwq-plus | 57.21s | 32.84s | 11.53s |
| qwen3-vl-plus | 3.49s | 0.54s | 1.38s |
| dola-Seed-2.0-mini | 8.03s | 2.96s | 2.96s |
| dola-Seed-2.0-lite | 19.48s | 13.64s | 5.83s |
| dola-Seed-2.0-pro | 12.99s | 10.7s | 3.75s |
| dola-Seed-2.1-turbo | 47.0s | 22.66s | 18.91s |
| hy3 | 2.81s | 1.22s | 1.8s |
| kimi-k3 | 6.36s | 3.43s | 3.23s |
| glm-5.1 | 7.72s | 7.82s | 6.83s |
| glm-5.2 | 3.57s | 2.52s | 2.17s |
| glm-5-turbo | 4.35s | 1.98s | 1.94s |
| glm-5v-turbo | 2.45s | 1.43s | 1.25s |
| hy-mt2-plus | 2.04s | 0.77s | 1.07s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 3.87s | 4.65s | 2.58s |
| deepseek-v4-pro-202606 | 4.73s | 3.84s | 2.88s |
| qwen3.5-flash | 1.44s | 11.03s | 12.02s |
| qwen3.6-flash | 6.25s | 13.34s | 4.18s |
| qwen3.5-plus | 4.21s | 22.87s | 40.69s |
| qwen3.7-plus | 25.32s | 7.33s | 29.39s |
| qwen3.7-plus-1m | 24.97s | 7.59s | 30.97s |
| qwq-plus | 297.23s | 90.31s | 52.5s |
| qwen3-vl-plus | 3.04s | 0.49s | 1.37s |
| dola-Seed-2.0-mini | 8.34s | 4.37s | 2.86s |
| dola-Seed-2.0-lite | 16.79s | 9.84s | 8.22s |
| dola-Seed-2.0-pro | 10.59s | 6.78s | 3.54s |
| dola-Seed-2.1-turbo | 30.99s | 33.25s | 32.34s |
| hy3 | 3.81s | 1.23s | 1.88s |
| kimi-k3 | 6.07s | 4.04s | 3.48s |
| glm-5.1 | 10.03s | 6.44s | 5.61s |
| glm-5.2 | 3.12s | 2.24s | 1.86s |
| glm-5-turbo | 3.02s | 2.12s | 2.14s |
| glm-5v-turbo | 3.72s | 1.48s | 1.34s |
| hy-mt2-plus | 2.0s | 0.71s | 1.16s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.29s | 2.66s | 2.29s |
| deepseek-v4-pro-202606 | 4.96s | 3.62s | 2.9s |
| qwen3.5-flash | 1.64s | 6.31s | 3.71s |
| qwen3.6-flash | 10.23s | 6.84s | 6.28s |
| qwen3.5-plus | 4.12s | 19.3s | 8.92s |
| qwen3.7-plus | 25.05s | 8.11s | 16.98s |
| qwen3.7-plus-1m | 22.24s | 8.44s | 28.09s |
| qwq-plus | 67.52s | 23.39s | 12.4s |
| qwen3-vl-plus | 2.68s | 0.71s | 1.22s |
| dola-Seed-2.0-mini | 8.63s | 3.06s | 2.82s |
| dola-Seed-2.0-lite | 17.5s | 9.39s | 5.32s |
| dola-Seed-2.0-pro | 12.83s | 4.38s | 5.1s |
| dola-Seed-2.1-turbo | 33.92s | 30.49s | 17.85s |
| hy3 | 3.3s | 1.22s | 1.92s |
| kimi-k3 | 6.65s | 4.74s | 3.92s |
| glm-5.1 | 8.78s | 8.19s | 7.14s |
| glm-5.2 | 3.44s | 2.1s | 2.36s |
| glm-5-turbo | 3.95s | 1.78s | 18.16s |
| glm-5v-turbo | 3.22s | 1.35s | 1.31s |
| hy-mt2-plus | 1.96s | 0.72s | 1.14s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.05s | 2.53s | 2.65s |
| deepseek-v4-pro-202606 | 4.49s | 3.3s | 2.85s |
| qwen3.5-flash | 1.68s | 9.11s | 4.3s |
| qwen3.6-flash | 9.72s | 7.38s | 9.52s |
| qwen3.5-plus | 4.8s | 26.79s | 45.46s |
| qwen3.7-plus | 32.4s | 7.46s | 26.4s |
| qwen3.7-plus-1m | 32.28s | 7.39s | 31.99s |
| qwq-plus | 51.5s | 16.61s | 17.21s |
| qwen3-vl-plus | 3.45s | 0.42s | 1.17s |
| dola-Seed-2.0-mini | 6.52s | 4.51s | 2.47s |
| dola-Seed-2.0-lite | 19.74s | 14.0s | 9.41s |
| dola-Seed-2.0-pro | 12.36s | 5.12s | 3.42s |
| dola-Seed-2.1-turbo | 31.77s | 24.94s | 22.81s |
| hy3 | 3.05s | 1.19s | 2.65s |
| kimi-k3 | 5.85s | 3.92s | 3.16s |
| glm-5.1 | 8.46s | 7.44s | 6.26s |
| glm-5.2 | 5.23s | 3.58s | 2.05s |
| glm-5-turbo | 3.52s | 2.11s | 1.47s |
| glm-5v-turbo | 2.18s | 1.86s | 1.52s |
| hy-mt2-plus | 1.78s | 0.63s | 1.16s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.33s | 5.61s | 2.16s |
| deepseek-v4-pro-202606 | 4.13s | 3.49s | 2.62s |
| qwen3.5-flash | 1.49s | 6.35s | 4.32s |
| qwen3.6-flash | 11.6s | 18.37s | 10.03s |
| qwen3.5-plus | 4.52s | 22.99s | 54.36s |
| qwen3.7-plus | 26.25s | 8.0s | 21.62s |
| qwen3.7-plus-1m | 23.46s | 8.3s | 21.86s |
| qwq-plus | 64.99s | 22.66s | 13.61s |
| qwen3-vl-plus | 2.94s | 0.45s | 1.84s |
| dola-Seed-2.0-mini | 7.08s | 3.57s | 2.73s |
| dola-Seed-2.0-lite | 24.58s | 15.52s | 10.07s |
| dola-Seed-2.0-pro | 13.9s | 6.89s | 3.7s |
| dola-Seed-2.1-turbo | 29.89s | 23.05s | 16.78s |
| hy3 | 3.14s | 1.19s | 1.96s |
| kimi-k3 | 7.74s | 4.53s | 3.42s |
| glm-5.1 | 8.57s | 7.2s | 5.84s |
| glm-5.2 | 5.52s | 2.31s | 1.9s |
| glm-5-turbo | 5.1s | 1.6s | 1.71s |
| glm-5v-turbo | 2.58s | 2.37s | 1.99s |
| hy-mt2-plus | 2.07s | 0.76s | 1.15s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.31s | 8.72s | 2.61s |
| deepseek-v4-pro-202606 | 6.22s | 4.1s | 3.07s |
| qwen3.5-flash | 1.48s | 6.39s | 13.99s |
| qwen3.6-flash | 14.77s | 18.81s | 8.15s |
| qwen3.5-plus | 5.03s | 59.66s | 33.72s |
| qwen3.7-plus | 21.97s | 8.55s | 14.33s |
| qwen3.7-plus-1m | 25.3s | 8.52s | 35.1s |
| qwq-plus | 61.6s | 17.43s | 17.77s |
| qwen3-vl-plus | 3.49s | 0.42s | 1.44s |
| dola-Seed-2.0-mini | 5.74s | 3.75s | 2.84s |
| dola-Seed-2.0-lite | 19.17s | 10.21s | 7.62s |
| dola-Seed-2.0-pro | 10.9s | 6.22s | 3.42s |
| dola-Seed-2.1-turbo | 46.02s | 21.48s | 21.11s |
| hy3 | 3.09s | 1.17s | 2.17s |
| kimi-k3 | 6.18s | 4.17s | 3.34s |
| glm-5.1 | 11.03s | 7.31s | 6.54s |
| glm-5.2 | 3.63s | 3.94s | 2.13s |
| glm-5-turbo | 6.11s | 3.06s | 2.25s |
| glm-5v-turbo | 2.12s | 1.97s | 2.04s |
| hy-mt2-plus | 1.93s | 0.79s | 1.18s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.36s | 2.69s | 2.27s |
| deepseek-v4-pro-202606 | 4.7s | 3.32s | 2.7s |
| qwen3.5-flash | 1.75s | 6.43s | 11.84s |
| qwen3.6-flash | 15.72s | 7.74s | 10.26s |
| qwen3.5-plus | 4.51s | 29.52s | 23.11s |
| qwen3.7-plus | 26.17s | 11.11s | 21.65s |
| qwen3.7-plus-1m | 24.21s | 8.37s | 25.66s |
| qwq-plus | 61.78s | 16.73s | 15.31s |
| qwen3-vl-plus | 4.42s | 0.95s | 1.49s |
| dola-Seed-2.0-mini | 6.0s | 4.67s | 2.83s |
| dola-Seed-2.0-lite | 28.12s | 21.41s | 12.92s |
| dola-Seed-2.0-pro | 9.76s | 5.89s | 4.43s |
| dola-Seed-2.1-turbo | 28.31s | 42.22s | 14.33s |
| hy3 | 3.25s | 1.2s | 1.94s |
| kimi-k3 | 6.77s | 3.57s | 3.34s |
| glm-5.1 | 9.38s | 6.08s | 7.0s |
| glm-5.2 | 5.0s | 2.41s | 2.13s |
| glm-5-turbo | 3.68s | 1.66s | 103.86s |
| glm-5v-turbo | 2.32s | 1.68s | 1.67s |
| hy-mt2-plus | 2.04s | 0.67s | 1.19s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.72s | 3.18s | 2.37s |
| deepseek-v4-pro-202606 | 4.42s | 3.36s | 2.91s |
| qwen3.5-flash | 1.44s | 6.64s | 3.76s |
| qwen3.6-flash | 13.99s | 9.34s | 7.85s |
| qwen3.5-plus | 4.88s | 34.38s | 20.43s |
| qwen3.7-plus | 24.02s | 7.68s | 51.08s |
| qwen3.7-plus-1m | 23.97s | 11.16s | 17.44s |
| qwq-plus | 61.61s | 62.35s | 16.32s |
| qwen3-vl-plus | 3.76s | 0.94s | 1.64s |
| dola-Seed-2.0-mini | 5.47s | 3.87s | 3.09s |
| dola-Seed-2.0-lite | 21.52s | 11.18s | 6.76s |
| dola-Seed-2.0-pro | 14.13s | 5.78s | 3.24s |
| dola-Seed-2.1-turbo | 46.55s | 30.1s | 18.12s |
| hy3 | 3.27s | 1.25s | 2.05s |
| kimi-k3 | 6.41s | 4.99s | 3.85s |
| glm-5.1 | 9.07s | 5.53s | 6.69s |
| glm-5.2 | 3.38s | 2.4s | 2.42s |
| glm-5-turbo | 3.12s | 1.63s | 1.69s |
| glm-5v-turbo | 2.14s | 1.34s | 1.43s |
| hy-mt2-plus | 1.92s | 0.6s | 1.17s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.32s | 2.84s | 2.32s |
| deepseek-v4-pro-202606 | 4.46s | 3.65s | 2.45s |
| qwen3.5-flash | 1.67s | 8.21s | 8.37s |
| qwen3.6-flash | 14.23s | 12.41s | 10.48s |
| qwen3.5-plus | 4.05s | 26.85s | 39.14s |
| qwen3.7-plus | 25.21s | 8.35s | 29.7s |
| qwen3.7-plus-1m | 25.1s | 8.12s | 29.58s |
| qwq-plus | 102.14s | 26.32s | 21.09s |
| qwen3-vl-plus | 4.24s | 0.52s | 1.64s |
| dola-Seed-2.0-mini | 8.23s | 5.05s | 3.02s |
| dola-Seed-2.0-lite | 20.08s | 13.96s | 7.79s |
| dola-Seed-2.0-pro | 11.21s | 5.33s | 3.27s |
| dola-Seed-2.1-turbo | 43.95s | 24.45s | 17.34s |
| hy3 | 3.17s | 1.27s | 1.9s |
| kimi-k3 | 5.39s | 4.57s | 3.51s |
| glm-5.1 | 10.24s | 5.07s | 5.57s |
| glm-5.2 | 3.39s | 2.13s | 2.43s |
| glm-5-turbo | 4.16s | 2.82s | 1.75s |
| glm-5v-turbo | 2.34s | 1.28s | 1.52s |
| hy-mt2-plus | 1.93s | 0.75s | 1.14s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 3.9s | 2.16s | 2.07s |
| deepseek-v4-pro-202606 | 3.98s | 3.26s | 3.25s |
| qwen3.5-flash | 1.5s | 9.28s | 3.75s |
| qwen3.6-flash | 8.12s | 28.36s | 14.57s |
| qwen3.5-plus | 4.16s | 53.95s | 28.05s |
| qwen3.7-plus | 25.02s | 8.53s | 33.89s |
| qwen3.7-plus-1m | 27.39s | 9.74s | 36.1s |
| qwq-plus | 85.84s | 54.54s | 16.66s |
| qwen3-vl-plus | 3.2s | 0.48s | 1.09s |
| dola-Seed-2.0-mini | 5.47s | 3.77s | 2.95s |
| dola-Seed-2.0-lite | 23.65s | 11.19s | 9.1s |
| dola-Seed-2.0-pro | 11.89s | 4.34s | 10.27s |
| dola-Seed-2.1-turbo | 23.57s | 16.17s | 14.57s |
| hy3 | 3.18s | 1.31s | 1.95s |
| kimi-k3 | 7.45s | 4.23s | 3.63s |
| glm-5.1 | 14.09s | 13.44s | 11.74s |
| glm-5.2 | 3.13s | 2.58s | 1.9s |
| glm-5-turbo | 2.54s | 1.93s | 4.97s |
| glm-5v-turbo | 2.33s | 1.46s | 1.36s |
| hy-mt2-plus | 2.06s | 0.79s | 1.25s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 12.91s | 2.25s | 2.05s |
| deepseek-v4-pro-202606 | 3.9s | 2.91s | 2.28s |
| qwen3.5-flash | 1.47s | 13.9s | 8.09s |
| qwen3.6-flash | 13.05s | 11.09s | 5.29s |
| qwen3.5-plus | 5.65s | 31.76s | 44.37s |
| qwen3.7-plus | 20.77s | 8.18s | 26.55s |
| qwen3.7-plus-1m | 33.04s | 8.53s | 25.91s |
| qwq-plus | 112.2s | 88.26s | 76.18s |
| qwen3-vl-plus | 4.34s | 0.52s | 1.59s |
| dola-Seed-2.0-mini | 5.74s | 4.68s | 2.96s |
| dola-Seed-2.0-lite | 14.79s | 10.29s | 6.39s |
| dola-Seed-2.0-pro | 11.48s | 5.13s | 4.32s |
| dola-Seed-2.1-turbo | 35.11s | 17.11s | 10.46s |
| hy3 | 3.02s | 1.13s | 1.99s |
| kimi-k3 | 7.56s | 4.53s | 3.6s |
| glm-5.1 | 9.47s | 14.16s | 14.62s |
| glm-5.2 | 3.38s | 2.39s | 2.03s |
| glm-5-turbo | 4.41s | 2.41s | 2.06s |
| glm-5v-turbo | 2.63s | 2.82s | 1.93s |
| hy-mt2-plus | 1.93s | 0.84s | 1.14s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | FAIL | FAIL | FAIL |
| deepseek-v4-pro-202606 | FAIL | FAIL | FAIL |
| qwen3.5-flash | 1.86s | 6.37s | 3.79s |
| qwen3.6-flash | 9.63s | 9.84s | 9.69s |
| qwen3.5-plus | 5.66s | 36.67s | 24.95s |
| qwen3.7-plus | 18.85s | 9.5s | 26.64s |
| qwen3.7-plus-1m | 26.0s | 9.35s | 19.36s |
| qwq-plus | 76.71s | 44.41s | 26.73s |
| qwen3-vl-plus | 3.74s | 0.47s | 1.35s |
| dola-Seed-2.0-mini | 5.94s | 3.58s | 2.73s |
| dola-Seed-2.0-lite | 20.43s | 9.75s | 7.18s |
| dola-Seed-2.0-pro | 12.99s | 5.9s | 4.3s |
| dola-Seed-2.1-turbo | 34.55s | 25.85s | 19.21s |
| hy3 | FAIL | FAIL | FAIL |
| kimi-k3 | FAIL | FAIL | FAIL |
| glm-5.1 | FAIL | FAIL | FAIL |
| glm-5.2 | FAIL | FAIL | FAIL |
| glm-5-turbo | FAIL | FAIL | FAIL |
| glm-5v-turbo | FAIL | FAIL | FAIL |
| hy-mt2-plus | FAIL | FAIL | FAIL |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.29s | 2.34s | 2.02s |
| deepseek-v4-pro-202606 | 4.24s | 2.96s | 2.48s |
| qwen3.5-flash | 4.87s | 9.07s | 3.7s |
| qwen3.6-flash | 17.22s | 9.3s | 9.6s |
| qwen3.5-plus | 6.02s | 18.12s | 23.8s |
| qwen3.7-plus | 19.39s | 8.37s | 34.55s |
| qwen3.7-plus-1m | 21.12s | 8.84s | 18.56s |
| qwq-plus | 30.5s | 24.66s | 13.12s |
| qwen3-vl-plus | 3.65s | 0.66s | 1.38s |
| dola-Seed-2.0-mini | 8.03s | 4.93s | 2.68s |
| dola-Seed-2.0-lite | 15.55s | 13.15s | 8.7s |
| dola-Seed-2.0-pro | 16.16s | 13.17s | 4.12s |
| dola-Seed-2.1-turbo | 41.36s | 17.68s | 11.5s |
| hy3 | 3.07s | 1.26s | 2.0s |
| kimi-k3 | 38.2s | 37.13s | 22.2s |
| glm-5.1 | FAIL | FAIL | FAIL |
| glm-5.2 | FAIL | FAIL | FAIL |
| glm-5-turbo | FAIL | FAIL | FAIL |
| glm-5v-turbo | FAIL | FAIL | FAIL |
| hy-mt2-plus | FAIL | FAIL | FAIL |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.88s | 2.32s | 2.24s |
| deepseek-v4-pro-202606 | 3.99s | 3.26s | 2.31s |
| qwen3.5-flash | 1.47s | 9.13s | 3.72s |
| qwen3.6-flash | 9.23s | 6.47s | 6.84s |
| qwen3.5-plus | 5.88s | 61.86s | 28.59s |
| qwen3.7-plus | 24.98s | 7.06s | 31.29s |
| qwen3.7-plus-1m | 23.15s | 9.28s | 34.05s |
| qwq-plus | 33.14s | 24.48s | 19.42s |
| qwen3-vl-plus | 3.46s | 0.49s | 1.15s |
| dola-Seed-2.0-mini | 6.22s | 6.47s | 3.39s |
| dola-Seed-2.0-lite | 20.0s | 9.42s | 8.3s |
| dola-Seed-2.0-pro | 14.43s | 5.56s | 4.44s |
| dola-Seed-2.1-turbo | 36.55s | 24.19s | 14.33s |
| hy3 | 3.49s | 1.2s | 2.0s |
| kimi-k3 | 8.65s | 6.03s | 4.04s |
| glm-5.1 | 2.96s | 2.27s | 1.86s |
| glm-5.2 | 3.34s | 2.67s | 1.92s |
| glm-5-turbo | 4.69s | 1.91s | 1.37s |
| glm-5v-turbo | 2.56s | 1.23s | 1.41s |
| hy-mt2-plus | 1.8s | 0.72s | 1.02s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.48s | 2.33s | 2.09s |
| deepseek-v4-pro-202606 | 4.96s | 3.0s | 2.3s |
| qwen3.5-flash | 15.11s | 7.1s | 3.78s |
| qwen3.6-flash | 9.46s | 16.49s | 4.84s |
| qwen3.5-plus | 5.42s | 32.95s | 49.8s |
| qwen3.7-plus | 28.04s | 10.1s | 33.96s |
| qwen3.7-plus-1m | 25.18s | 9.06s | 31.48s |
| qwq-plus | 45.38s | 51.72s | 21.03s |
| qwen3-vl-plus | 3.22s | 1.06s | 1.58s |
| dola-Seed-2.0-mini | 9.06s | 4.76s | 2.88s |
| dola-Seed-2.0-lite | 19.72s | 12.12s | 7.17s |
| dola-Seed-2.0-pro | 12.61s | 4.16s | 4.65s |
| dola-Seed-2.1-turbo | 37.6s | 13.45s | 13.44s |
| hy3 | 3.38s | 1.15s | 2.04s |
| kimi-k3 | 9.39s | 4.77s | 4.2s |
| glm-5.1 | 8.4s | 6.07s | 4.45s |
| glm-5.2 | 3.69s | 3.47s | 2.06s |
| glm-5-turbo | 3.55s | 2.33s | 2.11s |
| glm-5v-turbo | 2.66s | 1.52s | 1.48s |
| hy-mt2-plus | 1.88s | 0.68s | 1.11s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 3.79s | 2.21s | 1.87s |
| deepseek-v4-pro-202606 | 4.16s | 2.1s | 2.18s |
| qwen3.5-flash | 1.46s | 10.2s | 3.78s |
| qwen3.6-flash | 12.66s | 9.14s | 5.56s |
| qwen3.5-plus | 6.2s | 30.35s | 26.33s |
| qwen3.7-plus | 23.78s | 8.48s | 28.53s |
| qwen3.7-plus-1m | 23.58s | 8.8s | 28.8s |
| qwq-plus | 67.47s | 23.62s | 19.0s |
| qwen3-vl-plus | 4.49s | 0.56s | 1.39s |
| dola-Seed-2.0-mini | 8.8s | 5.77s | 3.92s |
| dola-Seed-2.0-lite | 17.91s | 10.71s | 6.76s |
| dola-Seed-2.0-pro | 10.01s | 5.53s | 3.47s |
| dola-Seed-2.1-turbo | 14.65s | 14.92s | 14.15s |
| hy3 | 3.2s | 1.29s | 1.99s |
| kimi-k3 | 7.74s | 5.16s | 4.39s |
| glm-5.1 | 10.24s | 5.76s | 5.84s |
| glm-5.2 | 3.87s | 3.18s | 1.88s |
| glm-5-turbo | 2.65s | 2.63s | 3.65s |
| glm-5v-turbo | 2.58s | 1.69s | 1.37s |
| hy-mt2-plus | 1.93s | 0.59s | 1.03s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 3.82s | 1.9s | 1.96s |
| deepseek-v4-pro-202606 | 4.34s | 2.88s | 2.25s |
| qwen3.5-flash | 1.43s | 6.32s | 4.03s |
| qwen3.6-flash | 8.06s | 11.17s | 7.53s |
| qwen3.5-plus | 6.19s | 45.46s | 40.85s |
| qwen3.7-plus | 34.42s | 9.71s | 31.63s |
| qwen3.7-plus-1m | 34.54s | 9.03s | 32.93s |
| qwq-plus | 31.69s | 38.59s | 13.36s |
| qwen3-vl-plus | 3.29s | 0.6s | 1.79s |
| dola-Seed-2.0-mini | 9.01s | 5.74s | 2.5s |
| dola-Seed-2.0-lite | 19.23s | 12.16s | 7.73s |
| dola-Seed-2.0-pro | 12.76s | 4.86s | 4.28s |
| dola-Seed-2.1-turbo | 31.06s | 15.94s | 7.01s |
| hy3 | 3.15s | 1.33s | 1.88s |
| kimi-k3 | 7.83s | 5.06s | 4.57s |
| glm-5.1 | 7.21s | 2.45s | 2.38s |
| glm-5.2 | 3.71s | 3.01s | 2.07s |
| glm-5-turbo | 63.9s | 2.48s | 2.05s |
| glm-5v-turbo | 2.34s | 1.74s | 1.37s |
| hy-mt2-plus | 2.03s | 0.61s | 1.05s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 3.3s | 2.18s | 1.96s |
| deepseek-v4-pro-202606 | 3.54s | 2.55s | 2.39s |
| qwen3.5-flash | 1.48s | 11.54s | 6.26s |
| qwen3.6-flash | 9.12s | 13.52s | 8.92s |
| qwen3.5-plus | 6.09s | 36.04s | 29.87s |
| qwen3.7-plus | 24.08s | 9.11s | 31.14s |
| qwen3.7-plus-1m | 33.2s | 8.76s | 33.75s |
| qwq-plus | 81.39s | 21.82s | 15.86s |
| qwen3-vl-plus | 4.11s | 0.51s | 1.49s |
| dola-Seed-2.0-mini | 6.04s | 4.01s | 2.82s |
| dola-Seed-2.0-lite | 16.01s | 15.51s | 8.77s |
| dola-Seed-2.0-pro | 11.79s | 4.97s | 3.66s |
| dola-Seed-2.1-turbo | 23.57s | 17.14s | 14.87s |
| hy3 | 3.24s | 1.23s | 1.78s |
| kimi-k3 | 7.76s | 5.26s | 4.13s |
| glm-5.1 | 7.16s | 6.75s | 1.86s |
| glm-5.2 | 3.35s | 2.68s | 1.89s |
| glm-5-turbo | 4.71s | 10.85s | 1.8s |
| glm-5v-turbo | 3.06s | 1.69s | 1.36s |
| hy-mt2-plus | 1.88s | 0.75s | 1.06s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.12s | 2.26s | 2.0s |
| deepseek-v4-pro-202606 | 4.02s | 2.07s | 2.3s |
| qwen3.5-flash | 1.72s | 8.48s | 8.04s |
| qwen3.6-flash | 8.63s | 10.71s | 7.38s |
| qwen3.5-plus | 5.97s | 25.86s | 31.74s |
| qwen3.7-plus | 23.9s | 8.88s | 23.26s |
| dola-Seed-2.0-lite | 19.27s | 9.96s | 7.75s |
| dola-Seed-2.0-mini | 8.07s | 4.94s | 3.48s |
| dola-Seed-2.0-pro | 12.22s | 3.59s | 4.49s |
| dola-Seed-2.1-turbo | 27.35s | 13.0s | 12.9s |
| hy3 | 3.04s | 1.29s | 1.84s |
| kimi-k3 | 6.71s | 4.94s | 4.55s |
| glm-5.2 | 10.86s | 3.07s | 2.27s |
| hy-mt2-plus | 2.16s | 0.71s | 1.01s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 24.45s | 2.18s | 1.82s |
| deepseek-v4-pro-202606 | 4.08s | 2.78s | 2.51s |
| qwen3.5-flash | 1.83s | 6.46s | 3.9s |
| qwen3.6-flash | 13.56s | 11.21s | 12.73s |
| qwen3.5-plus | 6.49s | 47.3s | 23.84s |
| qwen3.7-plus | 25.95s | 9.31s | 22.43s |
| dola-Seed-2.0-lite | 20.09s | 10.42s | 7.84s |
| dola-Seed-2.0-mini | 8.24s | 8.91s | 2.98s |
| dola-Seed-2.0-pro | 11.55s | 5.26s | 4.81s |
| dola-Seed-2.1-turbo | 46.41s | 23.68s | 12.16s |
| hy3 | 4.24s | 1.23s | 1.73s |
| kimi-k3 | 15.29s | 5.82s | 4.07s |
| glm-5.2 | 4.65s | 3.52s | 2.48s |
| hy-mt2-plus | 2.02s | 0.62s | 1.06s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.96s | 1.96s | 1.91s |
| deepseek-v4-pro-202606 | 4.28s | 2.57s | 2.27s |
| qwen3.5-flash | 1.45s | 12.9s | 3.75s |
| qwen3.6-flash | 16.59s | 10.06s | 7.16s |
| qwen3.5-plus | 5.23s | 34.73s | 22.06s |
| qwen3.7-plus | 20.23s | 9.63s | 30.57s |
| dola-Seed-2.0-lite | 16.95s | 12.2s | 7.31s |
| dola-Seed-2.0-mini | 12.86s | 5.12s | 3.98s |
| dola-Seed-2.0-pro | 13.94s | 3.92s | 4.98s |
| dola-Seed-2.1-turbo | 32.08s | 10.9s | 5.35s |
| hy3 | 3.23s | 1.24s | 1.91s |
| kimi-k3 | FAIL | FAIL | FAIL |
| glm-5.2 | 3.38s | 2.55s | 2.61s |
| hy-mt2-plus | 2.04s | 0.71s | 0.89s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 3.85s | 2.25s | 1.87s |
| deepseek-v4-pro-202606 | 4.16s | 2.78s | 2.33s |
| qwen3.5-flash | 1.48s | 8.93s | 10.1s |
| qwen3.6-flash | 11.91s | 16.2s | 10.54s |
| qwen3.5-plus | 6.09s | 51.01s | 62.1s |
| qwen3.7-plus | 27.05s | 8.3s | 22.04s |
| dola-Seed-2.0-lite | 18.71s | 11.52s | 6.51s |
| dola-Seed-2.0-mini | 6.9s | 6.37s | 3.21s |
| dola-Seed-2.0-pro | 13.33s | 5.52s | 4.32s |
| dola-Seed-2.1-turbo | 33.95s | 18.11s | 16.04s |
| hy3 | 3.06s | 1.26s | 1.99s |
| kimi-k3 | FAIL | FAIL | FAIL |
| glm-5.2 | 4.67s | 2.43s | 2.87s |
| hy-mt2-plus | 1.99s | 0.67s | 0.97s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 3.52s | 1.99s | 1.72s |
| deepseek-v4-pro-202606 | 3.3s | 2.56s | 1.93s |
| qwen3.5-flash | 17.61s | 10.28s | 11.49s |
| qwen3.6-flash | 14.81s | 9.36s | 7.37s |
| qwen3.5-plus | 4.76s | 37.24s | 23.9s |
| qwen3.7-plus | 27.62s | 11.94s | 32.49s |
| dola-Seed-2.0-lite | 15.9s | 9.36s | 6.14s |
| dola-Seed-2.0-mini | 6.08s | 2.85s | 2.76s |
| dola-Seed-2.0-pro | 12.02s | 6.82s | 4.3s |
| glm-5.2 | 4.53s | 3.3s | 2.9s |
| hy-mt2-plus | 1.9s | 0.6s | 1.16s |
| deepseek-v4-flash-202605 | 4.31s | 9.83s | 2.08s | | deepseek-v4-pro-202606 | 4.25s | 2.85s | 2.4s | | qwen3.7-plus | 25.13s | 8.93s | 34.01s | | dola-Seed-2.0-lite | 18.66s | 8.71s | 5.73s | | dola-Seed-2.0-mini | 4.77s | 3.66s | 2.66s | | dola-Seed-2.0-pro | 10.99s | 6.66s | 4.34s | | glm-5.2 | 3.55s | 2.94s | 2.5s | | hy-mt2-plus | 2.02s | 0.71s | 1.13s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 5.4s | 2.47s | 2.31s |
| deepseek-v4-pro-202606 | 4.37s | 3.23s | 2.75s |
| qwen3.7-plus | 20.95s | 8.87s | 22.47s |
| dola-Seed-2.0-lite | 21.22s | 8.94s | 11.12s |
| dola-Seed-2.0-mini | 6.36s | 3.69s | 2.75s |
| dola-Seed-2.0-pro | 10.44s | 4.83s | 5.23s |
| glm-5.2 | 3.43s | 2.61s | 1.94s |
| hy-mt2-plus | 2.02s | 0.59s | 1.27s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.15s | 2.3s | 2.16s |
| deepseek-v4-pro-202606 | 4.39s | 2.67s | 2.39s |
| qwen3.7-plus | 29.76s | 8.8s | 16.27s |
| dola-Seed-2.0-lite | 17.39s | 8.48s | 7.98s |
| dola-Seed-2.0-mini | 6.15s | 3.8s | 2.71s |
| dola-Seed-2.0-pro | 12.73s | 4.93s | 4.78s |
| glm-5.2 | 4.64s | 2.84s | 2.5s |
| hy-mt2-plus | 1.94s | 0.76s | 1.0s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 3.95s | 2.17s | 2.11s |
| deepseek-v4-pro-202606 | 4.08s | 2.97s | 2.67s |
| qwen3.7-plus | 21.89s | 10.4s | 22.37s |
| dola-Seed-2.0-lite | 22.78s | 7.87s | 6.87s |
| dola-Seed-2.0-mini | 7.76s | 3.74s | 2.84s |
| dola-Seed-2.0-pro | 14.22s | 6.03s | 5.05s |
| glm-5.2 | 4.32s | 3.24s | 2.17s |
| hy-mt2-plus | 1.91s | 0.48s | 1.13s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 3.77s | 2.22s | 2.02s |
| deepseek-v4-pro-202606 | 3.91s | 2.55s | 2.24s |
| qwen3.7-plus | 26.67s | 7.17s | 33.76s |
| dola-Seed-2.0-lite | 16.47s | 12.03s | 7.9s |
| dola-Seed-2.0-mini | 8.52s | 4.74s | 2.98s |
| dola-Seed-2.0-pro | 12.27s | 4.55s | 6.84s |
| glm-5.2 | 4.63s | 2.51s | 2.67s |
| hy-mt2-plus | 1.94s | 0.79s | 1.01s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 3.85s | 2.24s | 1.99s |
| deepseek-v4-pro-202606 | 3.59s | 2.83s | 2.18s |
| qwen3.7-plus | 23.8s | 9.22s | 24.17s |
| dola-Seed-2.0-lite | 22.61s | 12.72s | 8.4s |
| dola-Seed-2.0-mini | 5.62s | 2.21s | 2.79s |
| dola-Seed-2.0-pro | 12.11s | 6.61s | 4.49s |
| glm-5.2 | 5.43s | 3.23s | 6.34s |
| hy-mt2-plus | 2.02s | 0.57s | 1.02s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 3.85s | 2.26s | 2.02s |
| qwen3.7-plus | 25.42s | 9.89s | 32.35s |
| dola-Seed-2.0-lite | 14.58s | 10.09s | 6.41s |
| glm-5.2 | 5.03s | 2.28s | 2.25s |
| hy-mt2-plus | 2.02s | 0.71s | 1.0s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.39s | 2.54s | 2.05s |
| qwen3.7-plus | 29.0s | 10.73s | 33.78s |
| dola-Seed-2.0-lite | 17.84s | 9.24s | 8.84s |
| glm-5.2 | 3.78s | 2.91s | 2.32s |
| hy-mt2-plus | 2.18s | 0.72s | 1.1s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.12s | 2.63s | 2.14s |
| qwen3.7-plus | 26.48s | 8.34s | 23.71s |
| dola-Seed-2.0-lite | 21.94s | 10.63s | 8.3s |
| glm-5.2 | 4.03s | 3.39s | 2.33s |
| hy-mt2-plus | 1.99s | 0.9s | 1.11s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.86s | 2.51s | 2.19s |
| qwen3.7-plus | 25.46s | 8.73s | 25.63s |
| dola-Seed-2.0-lite | 18.2s | 9.94s | 66.48s |
| glm-5.2 | 4.25s | 3.05s | 4.62s |
| hy-mt2-plus | 1.99s | 0.92s | 1.17s |
| Model | Code Generation | Translation | Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | 4.05s | 2.49s | 14.6s |
| qwen3.7-plus | 21.8s | 9.13s | 27.26s |
| dola-Seed-2.0-lite | 16.67s | 11.84s | 5.93s |
| glm-5.2 | 4.49s | 2.74s | 2.38s |
| hy-mt2-plus | 2.14s | 1.09s | 1.28s |
| Model | 💻 Code Generation | 🌐 Translation | 📄 Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | ✅ 12.87s | ✅ 2.43s | ✅ 2.05s |
| qwen3.7-plus | ✅ 33.68s | ✅ 10.23s | ✅ 45.83s |
| dola-Seed-2.0-lite | ✅ 16.37s | ✅ 13.86s | ✅ 8.16s |
| glm-5.2 | ✅ 4.26s | ✅ 2.4s | ✅ 2.82s |
| hy-mt2-plus | ✅ 2.13s | ✅ 0.94s | ✅ 1.1s |
| Model | 💻 Code Generation | 🌐 Translation | 📄 Long Context Summary |
|---|---|---|---|
| deepseek-v4-flash-202605 | ✅ 3.73s | ✅ 2.07s | ✅ 1.94s |
| qwen3.7-plus | ✅ 24.87s | ✅ 7.76s | ✅ 27.28s |
| dola-Seed-2.0-lite | ✅ 17.83s | ✅ 9.25s | ✅ 5.91s |
| glm-5.2 | ✅ 4.98s | ✅ 4.04s | ✅ 2.32s |
| hy-mt2-plus | ✅ 2.19s | ✅ 0.91s | ✅ 1.46s |