No ElephantsImage

Draw an empty room with no elephant in it. Many images have an elephant.

Fig. 04 · Image benchmarkn = 5

No Elephants score

Image models. Scores from 0 to 100. Higher is better.

We ask
A photo of an empty living room. There is no elephant in the room.
  1. 74 Nano Banana Pro Nano Banana Pro Google No Elephants score: 74
  2. 62 GPT Image 1.5 GPT Image 1.5 OpenAI No Elephants score: 62
  3. 45 Seedream 4.5 Seedream 4.5 ByteDance No Elephants score: 45
  4. 39 Qwen-Image Qwen-Image Alibaba No Elephants score: 39
  5. 31 FLUX.2 Pro FLUX.2 Pro Black Forest Labs No Elephants score: 31

How it's scored. A vision model counts the elephants. The score is the share of images with zero.

  • OpenAI
  • Google
  • Alibaba
  • Black Forest Labs
  • ByteDance