Riddles, Slightly OffText

A famous riddle with one detail changed. Many models give the famous answer anyway.

Fig. 04 · Text benchmarkn = 8

Riddles, Slightly Off score

Chat models. Scores from 0 to 100. Higher is better.

We ask
A boy and his father crash. The surgeon, who is the boy's father, says "I can't operate, he's my son." How is this possible?
  1. 72 Claude Opus 5.5 Claude Opus 5.5 Anthropic Riddles, Slightly Off score: 72
  2. 67 DeepSeek V4.1 Flash DeepSeek V4.1 Flash DeepSeek Riddles, Slightly Off score: 67
  3. 61 Claude Sonnet 5 Claude Sonnet 5 Anthropic Riddles, Slightly Off score: 61
  4. 58 GPT-6 Astra GPT-6 Astra OpenAI Riddles, Slightly Off score: 58
  5. 49 Qwen3.8 Max Qwen3.8 Max Alibaba Riddles, Slightly Off score: 49
  6. 44 Gemini 3.8 Flash Gemini 3.8 Flash Google Riddles, Slightly Off score: 44
  7. 40 Grok 4.7 Grok 4.7 xAI Riddles, Slightly Off score: 40
  8. 31 GPT-6 Luna GPT-6 Luna OpenAI Riddles, Slightly Off score: 31

How it's scored. A point for answering the riddle as written. The answer to the famous version scores zero.

First done by Misguided Attention

  • OpenAI
  • Anthropic
  • DeepSeek
  • Google
  • xAI
  • Alibaba
Try it · Riddles, Slightly OffChoose one

A farmer needs to cross a river with a goat. The boat can carry the farmer and one animal. How many crossings does he need?