Leaderboard
- reasoning off
- hollow
- reasoning on
- filled; high effort where the model has levels
- dimmed
- closed weights
- whisker
- ± 1 sd over the 5 runs (none for single-run models)
- reas. tok
- median, reasoning on
0.00.20.40.60.81.0
off
on
Δ
reas. tok
OpenRouter · closed · 1 run
–
0.93
–
12.3k
OpenRouter · closed · 1 run
0.80
0.84
+0.04
5.9k
OpenRouter · FP4 (BaseTen) · 1 run
–
0.83
–
8.0k
OpenRouter · closed · 1 run
–
0.82
–
2.5k
e-INFRA · as served
0.40
0.76
+0.37
32.0k
OpenRouter · as served (Mistral) · 1 run
–
0.36
–
18.8k
e-INFRA · as served
0.10
0.30
+0.20
12.4k
e-INFRA · MXFP4
–
0.19
–
32.0k
e-INFRA · FP8
0.01
0.09
+0.08
32.0k
e-INFRA · as served
0.00
0.03
+0.02
10.3k
local vLLM · FP8 (on load)
0.00
0.02
+0.02
1.0k
local vLLM · FP8
0.00
0.01
+0.01
20.6k
e-INFRA · FP8
0.01
0.00
0.00
32.0k
local vLLM · FP8
0.00
0.00
0.00
13.3k
local vLLM · FP8 (on load)
0.00
–
–
–
0.00.20.40.60.81.0
off
on
Δ
reas. tok
OpenRouter · closed · 1 run
–
0.92
–
12.3k
OpenRouter · closed · 1 run
0.90
0.92
+0.02
5.9k
OpenRouter · FP4 (BaseTen) · 1 run
–
0.90
–
8.0k
OpenRouter · closed · 1 run
–
0.91
–
2.5k
e-INFRA · as served
0.38
0.81
+0.43
32.0k
OpenRouter · as served (Mistral) · 1 run
–
0.52
–
18.8k
e-INFRA · as served
0.10
0.38
+0.29
12.4k
e-INFRA · MXFP4
–
0.38
–
32.0k
e-INFRA · FP8
0.02
0.16
+0.14
32.0k
e-INFRA · as served
0.00
0.07
+0.07
10.3k
local vLLM · FP8 (on load)
0.01
0.04
+0.03
1.0k
local vLLM · FP8
0.00
0.03
+0.03
20.6k
e-INFRA · FP8
0.01
0.00
-0.01
32.0k
local vLLM · FP8
0.00
0.00
0.00
13.3k
local vLLM · FP8 (on load)
0.00
–
–
–
0.00.20.40.60.81.0
off
on
Δ
reas. tok
OpenRouter · closed · 1 run
–
0.94
–
12.3k
OpenRouter · closed · 1 run
0.73
0.78
+0.05
5.9k
OpenRouter · FP4 (BaseTen) · 1 run
–
0.77
–
8.0k
OpenRouter · closed · 1 run
–
0.75
–
2.5k
e-INFRA · as served
0.48
0.73
+0.25
32.0k
OpenRouter · as served (Mistral) · 1 run
–
0.27
–
18.8k
e-INFRA · as served
0.12
0.26
+0.14
12.4k
e-INFRA · MXFP4
–
0.14
–
32.0k
e-INFRA · FP8
0.01
0.07
+0.06
32.0k
e-INFRA · as served
0.00
0.02
+0.01
10.3k
local vLLM · FP8 (on load)
0.00
0.01
+0.01
1.0k
local vLLM · FP8
0.00
0.00
0.00
20.6k
e-INFRA · FP8
0.00
0.00
0.00
32.0k
local vLLM · FP8
0.00
0.00
0.00
13.3k
local vLLM · FP8 (on load)
0.00
–
–
–
0.00.20.40.60.81.0
off
on
Δ
reas. tok
OpenRouter · closed · 1 run
–
0.99
–
12.3k
OpenRouter · closed · 1 run
0.99
1.00
+0.01
5.9k
OpenRouter · FP4 (BaseTen) · 1 run
–
0.97
–
8.0k
OpenRouter · closed · 1 run
–
1.00
–
2.5k
e-INFRA · as served
0.47
0.92
+0.45
32.0k
OpenRouter · as served (Mistral) · 1 run
–
0.64
–
18.8k
e-INFRA · as served
0.10
0.44
+0.33
12.4k
e-INFRA · MXFP4
–
0.44
–
32.0k
e-INFRA · FP8
0.02
0.19
+0.17
32.0k
e-INFRA · as served
0.00
0.07
+0.07
10.3k
local vLLM · FP8 (on load)
0.01
0.04
+0.03
1.0k
local vLLM · FP8
0.00
0.03
+0.03
20.6k
e-INFRA · FP8
0.01
0.00
-0.01
32.0k
local vLLM · FP8
0.00
0.00
0.00
13.3k
local vLLM · FP8 (on load)
0.00
–
–
–
What reasoning costs
Each dot is one reasoning-on run, rings are model means; reasoning tokens on a log scale.
- run
- one reasoning-on run
- model mean
- geometric mean of tokens, mean F1
- dimmed
- closed weights
- forced
- reasoning cut at the 32k cap, then made to answer
- ×no answer
- no parseable JSON (F1 = 0)
Unlabelled rings near F1 = 0 (hover a dot for its model): Gemma-4-26B-A4B, Gemma-4-31B, Gemma-4-E4B, Qwen3.6-35B-A3B, Qwen3.8-27B.
What each model knows
Recall per letter and for the proper names (mean over runs), or every gold item against every setting.
| b12 | l17 | m19 | p18 | s13 | v16 | z4 | names15 | |
|---|---|---|---|---|---|---|---|---|
| on | 1.00 | 1.00 | 1.00 | 0.94 | 0.85 | 0.81 | 1.00 | 0.80 |
| on | 0.83 | 0.76 | 0.74 | 0.78 | 0.85 | 0.69 | 1.00 | 0.40 |
| off | 0.58 | 0.76 | 0.74 | 0.67 | 0.85 | 0.69 | 1.00 | 0.20 |
| on | 0.58 | 0.65 | 0.74 | 0.94 | 0.85 | 0.75 | 1.00 | 0.40 |
| on | 0.58 | 0.76 | 0.74 | 0.72 | 0.85 | 0.75 | 1.00 | 0.20 |
| on | 0.72 | 0.80 | 0.75 | 0.77 | 0.74 | 0.60 | 0.75 | 0.23 |
| off | 0.57 | 0.46 | 0.52 | 0.43 | 0.65 | 0.42 | 0.05 | 0.21 |
| on | 0.17 | 0.35 | 0.37 | 0.17 | 0.38 | 0.19 | 0.25 | 0.00 |
| on | 0.25 | 0.15 | 0.31 | 0.33 | 0.48 | 0.14 | 0.00 | 0.01 |
| off | 0.18 | 0.08 | 0.13 | 0.10 | 0.23 | 0.07 | 0.00 | 0.00 |
| on | 0.18 | 0.11 | 0.14 | 0.13 | 0.26 | 0.06 | 0.00 | 0.00 |
| on | 0.12 | 0.05 | 0.04 | 0.12 | 0.03 | 0.07 | 0.00 | 0.05 |
| off | 0.02 | 0.00 | 0.01 | 0.00 | 0.02 | 0.00 | 0.00 | 0.00 |
| on | 0.02 | 0.00 | 0.03 | 0.02 | 0.03 | 0.00 | 0.00 | 0.00 |
| off | 0.00 | 0.00 | 0.00 | 0.01 | 0.00 | 0.00 | 0.00 | 0.00 |
| on | 0.00 | 0.00 | 0.02 | 0.01 | 0.03 | 0.01 | 0.00 | 0.00 |
| off | 0.00 | 0.00 | 0.01 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 |
| on | 0.00 | 0.00 | 0.02 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 |
| off | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 |
| on | 0.00 | 0.00 | 0.00 | 0.00 | 0.02 | 0.00 | 0.00 | 0.00 |
| off | 0.00 | 0.00 | 0.00 | 0.00 | 0.03 | 0.00 | 0.00 | 0.00 |
| on | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 |
| off | 0.02 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 |
| off | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 |
- 0 of 5 runs
- never listed
- 5 of 5
- listed every time; shades in between (single-run models: 0 or 1)
- last column
- settings that listed the word at least once
| Gemini 4 Argon · on | GPT-6.1 Terra · on | GPT-6.1 Terra · off | Muse Spark Open · on | Claude Opus 5.5 · on | DeepSeek V4.1 Flash · on | DeepSeek V4.1 Flash · off | Mistral Large 4 · on | Kimi K3.1-Pro · on | Kimi K3.1-Pro · off | GPT-OSS-120B · on | Qwen3.8-Flash-Next · on | Qwen3.8-Flash-Next · off | Gemma-4-31B · on | Gemma-4-31B · off | Gemma-4-E4B · on | Gemma-4-E4B · off | Gemma-4-26B-A4B · on | Gemma-4-26B-A4B · off | Qwen3.8-27B · on | Qwen3.8-27B · off | Qwen3.6-35B-A3B · on | Qwen3.6-35B-A3B · off | Tiny Aya Global · off | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| B | |||||||||||||||||||||||||
| být | 15/24 | ||||||||||||||||||||||||
| obyčej | 7/24 | ||||||||||||||||||||||||
| bystrý | 11/24 | ||||||||||||||||||||||||
| bylina | 11/24 | ||||||||||||||||||||||||
| kobyla | 8/24 | ||||||||||||||||||||||||
| býk | 11/24 | ||||||||||||||||||||||||
| babyka | 5/24 | ||||||||||||||||||||||||
| Bydžov name | 6/24 | ||||||||||||||||||||||||
| Přibyslav name | 7/24 | ||||||||||||||||||||||||
| Bylany name | 3/24 | ||||||||||||||||||||||||
| Hrabyně name | 2/24 | ||||||||||||||||||||||||
| Zbyněk name | 2/24 | ||||||||||||||||||||||||
| L | |||||||||||||||||||||||||
| slyšet | 8/24 | ||||||||||||||||||||||||
| mlýn | 8/24 | ||||||||||||||||||||||||
| blýskat | 8/24 | ||||||||||||||||||||||||
| polykat | 7/24 | ||||||||||||||||||||||||
| vzlykat | 7/24 | ||||||||||||||||||||||||
| plynout | 7/24 | ||||||||||||||||||||||||
| plýtvat | 7/24 | ||||||||||||||||||||||||
| lysý | 11/24 | ||||||||||||||||||||||||
| lýtko | 10/24 | ||||||||||||||||||||||||
| lýko | 10/24 | ||||||||||||||||||||||||
| lyže | 9/24 | ||||||||||||||||||||||||
| pelyněk | 8/24 | ||||||||||||||||||||||||
| plyš | 8/24 | ||||||||||||||||||||||||
| slynout | 3/24 | ||||||||||||||||||||||||
| plytký | 3/24 | ||||||||||||||||||||||||
| vlys | 2/24 | ||||||||||||||||||||||||
| Volyně name | 1/24 | ||||||||||||||||||||||||
| M | |||||||||||||||||||||||||
| my | 11/24 | ||||||||||||||||||||||||
| mýt | 14/24 | ||||||||||||||||||||||||
| myslit | 11/24 | ||||||||||||||||||||||||
| mýlit | 11/24 | ||||||||||||||||||||||||
| hmyz | 8/24 | ||||||||||||||||||||||||
| myš | 11/24 | ||||||||||||||||||||||||
| hlemýžď | 8/24 | ||||||||||||||||||||||||
| mýtit | 9/24 | ||||||||||||||||||||||||
| zamykat | 6/24 | ||||||||||||||||||||||||
| smýkat | 7/24 | ||||||||||||||||||||||||
| dmýchat | 7/24 | ||||||||||||||||||||||||
| chmýří | 6/24 | ||||||||||||||||||||||||
| nachomýtnout | 7/24 | ||||||||||||||||||||||||
| mýto | 8/24 | ||||||||||||||||||||||||
| mykat | 5/24 | ||||||||||||||||||||||||
| mys | 5/24 | ||||||||||||||||||||||||
| sumýš | 1/24 | ||||||||||||||||||||||||
| Litomyšl name | 7/24 | ||||||||||||||||||||||||
| Kamýk name | 1/24 | ||||||||||||||||||||||||
| P | |||||||||||||||||||||||||
| pýcha | 14/24 | ||||||||||||||||||||||||
| pytel | 12/24 | ||||||||||||||||||||||||
| pysk | 10/24 | ||||||||||||||||||||||||
| netopýr | 6/24 | ||||||||||||||||||||||||
| slepýš | 6/24 | ||||||||||||||||||||||||
| pyl | 10/24 | ||||||||||||||||||||||||
| kopyto | 6/24 | ||||||||||||||||||||||||
| klopýtat | 7/24 | ||||||||||||||||||||||||
| třpytit | 7/24 | ||||||||||||||||||||||||
| zpytovat | 7/24 | ||||||||||||||||||||||||
| pykat | 8/24 | ||||||||||||||||||||||||
| pýr | 11/24 | ||||||||||||||||||||||||
| pýří | 5/24 | ||||||||||||||||||||||||
| pýřit | 11/24 | ||||||||||||||||||||||||
| pyj | 5/24 | ||||||||||||||||||||||||
| Chropyně name | 2/24 | ||||||||||||||||||||||||
| Pyšely name | 5/24 | ||||||||||||||||||||||||
| Spytihněv name | 3/24 | ||||||||||||||||||||||||
| S | |||||||||||||||||||||||||
| syn | 13/24 | ||||||||||||||||||||||||
| sytý | 10/24 | ||||||||||||||||||||||||
| sýr | 15/24 | ||||||||||||||||||||||||
| syrový | 11/24 | ||||||||||||||||||||||||
| syrý | 1/24 | ||||||||||||||||||||||||
| sychravý | 10/24 | ||||||||||||||||||||||||
| usychat | 7/24 | ||||||||||||||||||||||||
| sýkora | 10/24 | ||||||||||||||||||||||||
| sýček | 9/24 | ||||||||||||||||||||||||
| sysel | 10/24 | ||||||||||||||||||||||||
| syčet | 9/24 | ||||||||||||||||||||||||
| sypat | 12/24 | ||||||||||||||||||||||||
| Bosyně name | 0/24 | ||||||||||||||||||||||||
| V | |||||||||||||||||||||||||
| vy | 10/24 | ||||||||||||||||||||||||
| vykat | 3/24 | ||||||||||||||||||||||||
| vysoký | 10/24 | ||||||||||||||||||||||||
| výt | 9/24 | ||||||||||||||||||||||||
| výskat | 8/24 | ||||||||||||||||||||||||
| zvykat | 7/24 | ||||||||||||||||||||||||
| žvýkat | 7/24 | ||||||||||||||||||||||||
| vydra | 10/24 | ||||||||||||||||||||||||
| výr | 11/24 | ||||||||||||||||||||||||
| vyžle | 7/24 | ||||||||||||||||||||||||
| povyk | 7/24 | ||||||||||||||||||||||||
| výheň | 8/24 | ||||||||||||||||||||||||
| cavyky | 2/24 | ||||||||||||||||||||||||
| vyza | 2/24 | ||||||||||||||||||||||||
| Vyškov name | 3/24 | ||||||||||||||||||||||||
| Výtoň name | 1/24 | ||||||||||||||||||||||||
| Z | |||||||||||||||||||||||||
| brzy | 6/24 | ||||||||||||||||||||||||
| jazyk | 8/24 | ||||||||||||||||||||||||
| nazývat | 6/24 | ||||||||||||||||||||||||
| Ruzyně name | 6/24 | ||||||||||||||||||||||||
Most common wrong words
Listed words that aren't gold items, ranked by how many settings produced them (top 80).
- derived
- derived word (in brackets in ÚJČ)
- near
- one edit from a gold word
- misplaced
- gold word under the wrong letter
- other
- not a listed word
| word | key | label | settings | runs | listed by |
|---|---|---|---|---|---|
| byt | b | derived | 12 | 22 | Claude Opus 5.5 on, DeepSeek V4.1 Flash on, GPT-6.1 Terra off, GPT-6.1 Terra on, GPT-OSS-120B on, Gemini 4 Argon on, Kimi K3.1-Pro off, Kimi K3.1-Pro on, Mistral Large 4 on, Muse Spark Open on, Qwen3.8-27B on, Qwen3.8-Flash-Next on |
| bydlit | b | derived | 12 | 20 | Claude Opus 5.5 on, DeepSeek V4.1 Flash off, DeepSeek V4.1 Flash on, GPT-6.1 Terra off, GPT-6.1 Terra on, GPT-OSS-120B on, Gemini 4 Argon on, Kimi K3.1-Pro off, Kimi K3.1-Pro on, Mistral Large 4 on, Muse Spark Open on, Qwen3.8-Flash-Next on |
| obyvatel | b | derived | 8 | 16 | Claude Opus 5.5 on, DeepSeek V4.1 Flash off, DeepSeek V4.1 Flash on, GPT-6.1 Terra off, GPT-6.1 Terra on, Gemini 4 Argon on, Mistral Large 4 on, Muse Spark Open on |
| příbytek | b | derived | 8 | 12 | Claude Opus 5.5 on, DeepSeek V4.1 Flash off, DeepSeek V4.1 Flash on, GPT-6.1 Terra off, GPT-6.1 Terra on, Gemini 4 Argon on, Mistral Large 4 on, Muse Spark Open on |
| fyzika | f | other | 7 | 12 | DeepSeek V4.1 Flash off, DeepSeek V4.1 Flash on, GPT-OSS-120B on, Gemma-4-31B off, Kimi K3.1-Pro off, Kimi K3.1-Pro on, Qwen3.8-27B off |
| dobytek | b | derived | 7 | 11 | Claude Opus 5.5 on, DeepSeek V4.1 Flash on, GPT-6.1 Terra off, GPT-6.1 Terra on, Gemini 4 Argon on, Mistral Large 4 on, Muse Spark Open on |
| nábytek | b | derived | 7 | 11 | Claude Opus 5.5 on, DeepSeek V4.1 Flash on, GPT-6.1 Terra off, GPT-6.1 Terra on, Gemini 4 Argon on, Mistral Large 4 on, Muse Spark Open on |
| mýdlo | m | derived | 6 | 12 | DeepSeek V4.1 Flash off, DeepSeek V4.1 Flash on, GPT-OSS-120B on, Gemma-4-E4B on, Kimi K3.1-Pro off, Kimi K3.1-Pro on |
| pyšný | p | derived | 6 | 11 | DeepSeek V4.1 Flash off, GPT-OSS-120B on, Gemma-4-E4B on, Kimi K3.1-Pro off, Kimi K3.1-Pro on, Qwen3.8-Flash-Next on |
| lysá | l | derived | 6 | 9 | DeepSeek V4.1 Flash off, DeepSeek V4.1 Flash on, GPT-OSS-120B on, Gemma-4-26B-A4B on, Kimi K3.1-Pro on, Qwen3.8-Flash-Next on |
| bůh | b | other | 6 | 8 | Gemma-4-26B-A4B off, Gemma-4-26B-A4B on, Gemma-4-31B on, Kimi K3.1-Pro on, Qwen3.8-27B on, Qwen3.8-Flash-Next on |
| bydlet | b | derived | 5 | 11 | DeepSeek V4.1 Flash off, DeepSeek V4.1 Flash on, Kimi K3.1-Pro off, Kimi K3.1-Pro on, Qwen3.8-Flash-Next on |
| dým | d | other | 5 | 10 | GPT-OSS-120B on, Kimi K3.1-Pro off, Kimi K3.1-Pro on, Qwen3.8-27B on, Qwen3.8-Flash-Next on |
| pyžamo | p | other | 5 | 8 | DeepSeek V4.1 Flash off, DeepSeek V4.1 Flash on, GPT-OSS-120B on, Kimi K3.1-Pro off, Kimi K3.1-Pro on |
| gymnázium | g | other | 5 | 7 | DeepSeek V4.1 Flash off, GPT-OSS-120B on, Kimi K3.1-Pro off, Qwen3.8-27B off, Qwen3.8-27B on |
| háj | h | other | 5 | 6 | Gemma-4-26B-A4B off, Gemma-4-26B-A4B on, Gemma-4-31B on, Gemma-4-E4B off, Qwen3.8-27B on |
| kůň | k | other | 5 | 6 | Gemma-4-26B-A4B off, Gemma-4-31B off, Gemma-4-31B on, Qwen3.8-27B off, Qwen3.8-27B on |
| rýč | r | other | 5 | 5 | DeepSeek V4.1 Flash on, Kimi K3.1-Pro off, Kimi K3.1-Pro on, Mistral Large 4 on, Qwen3.6-35B-A3B on |
| čepýřit | p | derived | 5 | 5 | Claude Opus 5.5 on, DeepSeek V4.1 Flash off, GPT-6.1 Terra off, GPT-6.1 Terra on, Gemini 4 Argon on |
| sýrie | s | other | 4 | 10 | DeepSeek V4.1 Flash off, DeepSeek V4.1 Flash on, Kimi K3.1-Pro off, Kimi K3.1-Pro on |
| mýtus | m | other | 4 | 9 | GPT-OSS-120B on, Kimi K3.1-Pro off, Kimi K3.1-Pro on, Qwen3.8-Flash-Next on |
| mysl | m | derived | 4 | 8 | DeepSeek V4.1 Flash off, GPT-OSS-120B on, Gemma-4-E4B on, Kimi K3.1-Pro on |
| dýchat | d | near | 4 | 7 | GPT-OSS-120B on, Kimi K3.1-Pro off, Kimi K3.1-Pro on, Qwen3.6-35B-A3B off |
| zvyk | z | derived | 4 | 7 | DeepSeek V4.1 Flash off, GPT-OSS-120B on, Kimi K3.1-Pro off, Kimi K3.1-Pro on |
| byl | b | near | 4 | 6 | DeepSeek V4.1 Flash off, Kimi K3.1-Pro off, Qwen3.8-27B off, Qwen3.8-Flash-Next off |
| bystřice | b | derived | 4 | 6 | DeepSeek V4.1 Flash off, DeepSeek V4.1 Flash on, Kimi K3.1-Pro on, Qwen3.8-Flash-Next on |
| běh | b | other | 4 | 6 | Gemma-4-31B off, Gemma-4-31B on, Gemma-4-E4B off, Gemma-4-E4B on |
| cypřiš | c | other | 4 | 6 | DeepSeek V4.1 Flash off, GPT-OSS-120B on, Kimi K3.1-Pro off, Kimi K3.1-Pro on |
| lyžovat | l | derived | 4 | 6 | DeepSeek V4.1 Flash off, GPT-OSS-120B on, Kimi K3.1-Pro off, Mistral Large 4 on |
| nůž | n | other | 4 | 6 | Gemma-4-31B off, Gemma-4-31B on, Gemma-4-E4B on, Qwen3.8-27B on |
| ryba | r | other | 4 | 6 | GPT-OSS-120B on, Kimi K3.1-Pro off, Mistral Large 4 on, Qwen3.8-27B off |
| rád | r | other | 4 | 6 | Gemma-4-E4B off, Gemma-4-E4B on, Qwen3.6-35B-A3B off, Qwen3.6-35B-A3B on |
| rýma | r | other | 4 | 6 | GPT-OSS-120B on, Gemma-4-31B on, Kimi K3.1-Pro off, Kimi K3.1-Pro on |
| synonymum | s | other | 4 | 6 | DeepSeek V4.1 Flash off, DeepSeek V4.1 Flash on, Kimi K3.1-Pro off, Kimi K3.1-Pro on |
| systém | s | other | 4 | 6 | DeepSeek V4.1 Flash off, GPT-OSS-120B on, Kimi K3.1-Pro off, Kimi K3.1-Pro on |
| bývalý | b | derived | 4 | 5 | DeepSeek V4.1 Flash off, Gemma-4-31B off, Gemma-4-31B on, Kimi K3.1-Pro off |
| cizinec | c | other | 4 | 5 | Qwen3.6-35B-A3B on, Qwen3.8-27B off, Qwen3.8-27B on, Tiny Aya Global off |
| cizí | c | other | 4 | 5 | Gemma-4-26B-A4B on, Qwen3.6-35B-A3B on, Qwen3.8-27B on, Qwen3.8-Flash-Next on |
| cyklus | c | other | 4 | 5 | DeepSeek V4.1 Flash off, GPT-OSS-120B on, Kimi K3.1-Pro off, Kimi K3.1-Pro on |
| gymnastika | g | other | 4 | 5 | DeepSeek V4.1 Flash off, GPT-OSS-120B on, Kimi K3.1-Pro off, Qwen3.8-27B off |
| máma | m | other | 4 | 5 | Gemma-4-31B on, Gemma-4-E4B off, Qwen3.6-35B-A3B on, Qwen3.8-Flash-Next on |
| nýt | n | near | 4 | 5 | GPT-OSS-120B on, Kimi K3.1-Pro off, Kimi K3.1-Pro on, Qwen3.6-35B-A3B off |
| rýže | r | other | 4 | 5 | GPT-OSS-120B on, Gemma-4-31B off, Gemma-4-31B on, Kimi K3.1-Pro off |
| týden | t | other | 4 | 5 | GPT-OSS-120B on, Kimi K3.1-Pro off, Kimi K3.1-Pro on, Tiny Aya Global off |
| břeh | b | other | 4 | 4 | Gemma-4-31B on, Gemma-4-E4B on, Kimi K3.1-Pro on, Qwen3.6-35B-A3B on |
| kyj | k | near | 4 | 4 | Kimi K3.1-Pro off, Kimi K3.1-Pro on, Qwen3.8-Flash-Next off, Qwen3.8-Flash-Next on |
| lít | l | other | 4 | 4 | Gemma-4-31B off, Gemma-4-E4B off, Qwen3.6-35B-A3B off, Qwen3.6-35B-A3B on |
| pád | p | other | 4 | 4 | Gemma-4-31B off, Gemma-4-E4B off, Gemma-4-E4B on, Qwen3.8-Flash-Next on |
| sůl | s | other | 4 | 4 | Gemma-4-31B off, Gemma-4-31B on, Gemma-4-E4B on, Qwen3.8-27B on |
| vysoké mýto | v | other | 4 | 4 | DeepSeek V4.1 Flash off, DeepSeek V4.1 Flash on, Kimi K3.1-Pro on, Mistral Large 4 on |
| babička | b | other | 3 | 9 | Gemma-4-31B off, Gemma-4-31B on, Qwen3.8-Flash-Next on |
| hřbet | h | other | 3 | 7 | Gemma-4-31B off, Gemma-4-31B on, Gemma-4-E4B on |
| mýval | m | derived | 3 | 7 | DeepSeek V4.1 Flash off, DeepSeek V4.1 Flash on, Kimi K3.1-Pro on |
| sytit | s | other | 3 | 7 | DeepSeek V4.1 Flash off, Kimi K3.1-Pro off, Kimi K3.1-Pro on |
| batoh | b | other | 3 | 6 | Gemma-4-31B off, Gemma-4-31B on, Qwen3.8-Flash-Next on |
| hymna | h | other | 3 | 6 | DeepSeek V4.1 Flash off, GPT-OSS-120B on, Kimi K3.1-Pro off |
| lýdie | l | other | 3 | 6 | DeepSeek V4.1 Flash off, DeepSeek V4.1 Flash on, Kimi K3.1-Pro on |
| pytlák | p | derived | 3 | 6 | DeepSeek V4.1 Flash off, Kimi K3.1-Pro off, Kimi K3.1-Pro on |
| cyril | c | other | 3 | 5 | DeepSeek V4.1 Flash off, GPT-OSS-120B on, Qwen3.8-Flash-Next on |
| had | h | other | 3 | 5 | Gemma-4-31B off, Qwen3.6-35B-A3B on, Qwen3.8-Flash-Next on |
| hýbat | h | other | 3 | 5 | GPT-OSS-120B on, Kimi K3.1-Pro off, Qwen3.6-35B-A3B off |
| kyselý | k | other | 3 | 5 | GPT-OSS-120B on, Kimi K3.1-Pro off, Qwen3.8-Flash-Next on |
| lyra | l | other | 3 | 5 | DeepSeek V4.1 Flash off, GPT-OSS-120B on, Kimi K3.1-Pro on |
| lyrika | l | other | 3 | 5 | DeepSeek V4.1 Flash off, Kimi K3.1-Pro off, Kimi K3.1-Pro on |
| vyšehrad | v | derived | 3 | 5 | DeepSeek V4.1 Flash off, DeepSeek V4.1 Flash on, Qwen3.8-Flash-Next on |
| výživa | v | other | 3 | 5 | DeepSeek V4.1 Flash off, GPT-OSS-120B on, Kimi K3.1-Pro off |
| zývat | z | other | 3 | 5 | DeepSeek V4.1 Flash off, DeepSeek V4.1 Flash on, GPT-OSS-120B on |
| bytost | b | derived | 3 | 4 | Kimi K3.1-Pro off, Kimi K3.1-Pro on, Qwen3.8-Flash-Next on |
| bílý | b | other | 3 | 4 | Gemma-4-31B off, Gemma-4-31B on, Qwen3.8-27B on |
| chytrý | c | other | 3 | 4 | GPT-OSS-120B on, Gemma-4-26B-A4B on, Kimi K3.1-Pro on |
| cyklista | c | other | 3 | 4 | DeepSeek V4.1 Flash off, Kimi K3.1-Pro off, Kimi K3.1-Pro on |
| cynik | c | other | 3 | 4 | GPT-OSS-120B on, Kimi K3.1-Pro off, Kimi K3.1-Pro on |
| dýka | d | other | 3 | 4 | GPT-OSS-120B on, Kimi K3.1-Pro off, Qwen3.8-27B on |
| fialka | f | other | 3 | 4 | Gemma-4-31B off, Gemma-4-31B on, Qwen3.8-Flash-Next on |
| myjava | m | other | 3 | 4 | DeepSeek V4.1 Flash off, DeepSeek V4.1 Flash on, Kimi K3.1-Pro on |
| rys | r | near | 3 | 4 | GPT-OSS-120B on, Kimi K3.1-Pro off, Kimi K3.1-Pro on |
| rýt | r | near | 3 | 4 | DeepSeek V4.1 Flash on, GPT-OSS-120B on, Kimi K3.1-Pro on |
| týkat | t | other | 3 | 4 | GPT-OSS-120B on, Kimi K3.1-Pro off, Kimi K3.1-Pro on |
| zvyk | v | derived | 3 | 4 | DeepSeek V4.1 Flash off, DeepSeek V4.1 Flash on, Mistral Large 4 on |
| abeceda | a | other | 3 | 3 | Gemma-4-E4B on, Qwen3.6-35B-A3B on, Qwen3.8-27B off |
Every run
Pick a run to open its answer, the gold items it missed and its reasoning trace (← → to step).