Hot TakesText

Is a hot dog a sandwich? We ask for one word. Many models give a paragraph.

Fig. 04 · Text benchmarkn = 8

Hot Takes score

Chat models. Scores from 0 to 100. Higher is better.

We ask
Is a hot dog a sandwich? Answer yes or no. One word.
  1. 97 Grok 4.7 Grok 4.7 xAI Hot Takes score: 97
  2. 71 DeepSeek V4.1 Flash DeepSeek V4.1 Flash DeepSeek Hot Takes score: 71
  3. 68 GPT-6 Luna GPT-6 Luna OpenAI Hot Takes score: 68
  4. 62 Qwen3.8 Max Qwen3.8 Max Alibaba Hot Takes score: 62
  5. 60 Claude Sonnet 5 Claude Sonnet 5 Anthropic Hot Takes score: 60
  6. 55 Claude Opus 5.5 Claude Opus 5.5 Anthropic Hot Takes score: 55
  7. 47 GPT-6 Astra GPT-6 Astra OpenAI Hot Takes score: 47
  8. 38 Gemini 3.8 Flash Gemini 3.8 Flash Google Hot Takes score: 38

How it's scored. We ask twenty different ways. Points for answering in one word, and for giving the same answer each time. "It depends" scores zero.

  • OpenAI
  • Anthropic
  • DeepSeek
  • Google
  • xAI
  • Alibaba