BENCHMAXXING ✦ THE OTHER STUFF ✦ EST. 2026 ✦ xx benchmaxxing Rate yourself

Five-Legged DogVision

A photo of a dog with five legs. Many models count four.

Fig. 04 · Vision benchmarkn = 7

Five-Legged Dog score

Chat models. Scores from 0 to 100. Higher is better.

We ask
How many legs does this dog have? Reply with a number.
  1. 80 GPT-6 Astra GPT-6 Astra OpenAI Five-Legged Dog score: 80
  2. 74 Gemini 3.8 Flash Gemini 3.8 Flash Google Five-Legged Dog score: 74
  3. 64 Claude Opus 5.5 Claude Opus 5.5 Anthropic Five-Legged Dog score: 64
  4. 57 Claude Sonnet 5 Claude Sonnet 5 Anthropic Five-Legged Dog score: 57
  5. 53 Qwen3.8 Max Qwen3.8 Max Alibaba Five-Legged Dog score: 53
  6. 49 GPT-6 Luna GPT-6 Luna OpenAI Five-Legged Dog score: 49
  7. 38 Grok 4.7 Grok 4.7 xAI Five-Legged Dog score: 38

DeepSeek V4.1 Flash can't see images, so they skip this one.

How it's scored. Photos edited to add a leg, a finger or a stripe. The score is how often the model counts what is really there.

  • OpenAI
  • Anthropic
  • DeepSeek
  • Google
  • xAI
  • Alibaba