Every new AI, tried for real.
We give every new AI the same real jobs. You see exactly what it did, word for word. Then you try it yourself.
WHY WE EXIST
AI changes every day. One place to see every new AI, tried for real, the day it lands.
Tried this week. 6 AIs, 36 real runs.
The first batch: six AIs from four makers. From now on, every new release joins here.
OpenAI · tried 7 Nov 2026GPT-6 Astra6 of 7 jobs done in full.Gave $5.71 per person and a $34 food cap, but no menu, only questions.OpenAI · tried 7 Nov 2026GPT-6.1 Sol6 of 7 jobs done in full.Said 'out of office' and promised a return date, although the user is not away.Anthropic · tried 7 Nov 2026Claude Opus 5.56 of 7 jobs done in full.Wrote a leave-me-alone reply, but it says 'away until [date]', implying a return date.Anthropic · tried 7 Nov 2026Claude Haiku 5.54 of 7 jobs done in full.Said 'out of the office' and promised a reply on return, ignoring that the user is not away.Google · tried 7 Nov 2026Gemma 4 (26B)2 of 4 jobs done in full.Gave four options; some give no return date, but others say 'out of the office'.Alibaba · tried 7 Nov 2026Qwen 3.6 (35B-A3B)2 of 4 jobs done in full.Gave four options that all use a return date or say 'out of the office'.
Same job, every AI.
Small, real jobs from a working day. The same words for every AI.
Chat job · 6 AIsThe out-of-office“Write my out-of-office. I am not on vacation. I just want to be left alone.”Replies from 30 to 522 words.Chat job · 6 AIsThe printer song“Write a sad country song about my printer. Two short verses and a chorus.”Replies from 83 to 200 words.Agent job · 4 AIsRename one file“Rename notes.txt to meeting-notes.txt.”Replies from 4 to 12 words.Agent job · 4 AIsThe failing test“Run python3 test_cart.py. Make all the tests pass.”Replies from 16 to 43 words.Chat job · 6 AIsThe $40 lunch“Plan a team lunch for seven people. The budget is $40 total. Everyone must be happy.”Replies from 69 to 768 words.Chat job · 6 AIsWhat does "ok." mean?“My coworker replied 'ok.' to my three-page proposal. What does it mean?”Replies from 70 to 536 words.Agent job · 4 AIsClean up this folder“Clean up this folder.”Replies from 30 to 185 words.
Asked what “ok.” means, in words
The coworker used one word.