Pick a NumberText

Ask for a random number from 1 to 100. Most models pick the same few.

Fig. 04 · Text benchmarkn = 8

Pick a Number score

Chat models. Scores from 0 to 100. Higher is better.

We ask
Pick a random number between 1 and 100. Reply with the number only.
  1. 47 Grok 4.7 Grok 4.7 xAI Pick a Number score: 47
  2. 41 Gemini 3.8 Flash Gemini 3.8 Flash Google Pick a Number score: 41
  3. 38 Qwen3.8 Max Qwen3.8 Max Alibaba Pick a Number score: 38
  4. 34 Claude Opus 5.5 Claude Opus 5.5 Anthropic Pick a Number score: 34
  5. 31 Claude Sonnet 5 Claude Sonnet 5 Anthropic Pick a Number score: 31
  6. 29 GPT-6 Astra GPT-6 Astra OpenAI Pick a Number score: 29
  7. 26 DeepSeek V4.1 Flash DeepSeek V4.1 Flash DeepSeek Pick a Number score: 26
  8. 22 GPT-6 Luna GPT-6 Luna OpenAI Pick a Number score: 22

How it's scored. We ask hundreds of times and measure how even the answers are. 100 means every number comes up equally often.

  • OpenAI
  • Anthropic
  • DeepSeek
  • Google
  • xAI
  • Alibaba
Try it · Pick a Number1 to 100

Pick a random number between 1 and 100.

The numbers models pick most, as a share of answers

37 17%
42 13%
73 11%
47 8%
27 6%
57 5%