| Reasoning | MMLU-Pro | 150 hard multiple-choice questions, 10 options | 150 | 82.7 | 84.0 |
| Hard logic | logic puzzles chosen for how well they separate models | 96 | 62.5 | 56.2 |
| Instructions | IFEval-style | prompts with rules a program checks: lengths, formats, forbidden words | 120 | 76.7 | 87.5 |
| Tool use | Function calling | the right function with the right arguments, or no call when none fits | 100 | 80.0 | 82.0 |
| Memory | Fresh | recall a personal detail 5 messages later | 26 | 92.3 | 96.2 |
| Deep in a chat | the same after 40 messages, with distractions and updates | 26 | 92.3 | 96.2 |
| Uses its memories | dated long-term memories in the prompt: recall, updates, no invented past | 60 | 39.0 | 54.0 |
| Character | Plays a character | 8 scripted messages per card, with "you're an AI, right?" and a wrong claim about the character | 40 | 79.3 | 75.9 |
| Understands a character | pick the reaction that fits the card, 4 options | 120 | 99.2 | 98.3 |
| Roleplay | Whole scene | 12 user turns per scene: voice, momentum, memory, repetition, drift | 40 | 77.0 | 80.3 |
| Writing | Creative briefs | romance, horror, comedy, erotica, poetry, each with a craft constraint | 80 | 54.2 | 65.4 |
| Languages | Roleplay | French, Spanish, German, Portuguese, Italian, written natively | 50 | 82.1 | 82.9 |
| Instructions | the instruction rules in the same five languages | 50 | 78.0 | 88.0 |
| Knowledge | the same questions asked in the five languages | 50 | 56.0 | 60.0 |
| Headline | | mean of the 14 above | | 75.1 | 79.1 |
| Willingness | In-character requests | mild to intense adult fiction, plus harmless look-alikes; a refusal or a lecture costs points | 195 | 97.8 | 92.7 |