How we test them
Twelve answers before it goes up.
We run every prompt on three invented examples and one empty start, through GPT, Claude and Gemini: 12 answers. Each answer is checked against a written list, once by us and once by a second AI that never sees our verdict. If anything misses, we change the prompt and run all 12 again. If we publish a prompt with misses, its page says exactly how many.
The rota is the hard one. Its three misses got someone’s hours wrong, booked a double shift, or suggested hiring cover nobody mentioned. That is why the rota page tells you to check every rota yourself.
Which AI did best
Tested 3 October 2026 on our three prompts, through each maker's own connection, which may not be the exact model a free app gives you. Each prompt gets three examples and one empty start; an answer counts only if both checkers passed it (Claude Opus 5.5 and GPT-5.5, each blind to the other).
Answers passed by each AI model, per prompt
| AI model | Reviews | Rota | Stock | Total |
| Gemini 3.5 Flash | 4 of 4 | 3 of 4 | 4 of 4 | 11 of 12 |
| Claude Sonnet 5.5 | 4 of 4 | 3 of 4 | 3 of 4 | 10 of 12 |
| GPT-5.5 (through codex, house instructions loaded) | 4 of 4 | 2 of 4 | 4 of 4 | 10 of 12 |
| Qwen 3.6 27B (free, runs on our own machine) | 4 of 4 | 2 of 4 | 4 of 4 | 10 of 12 |
| Claude Opus 5.5 | 3 of 4 | 2 of 4 | 4 of 4 | 9 of 12 |
| Gemini 3.1 Pro (preview) | 3 of 4 | 3 of 4 | 3 of 4 | 9 of 12 |
| Claude Haiku 4.5 | 2 of 4 | 1 of 4 | 1 of 4 | 4 of 12 |
| Gemini 3.1 Flash-Lite | 1 of 4 | 1 of 4 | 1 of 4 | 3 of 12 |
The biggest model was not the best. Gemini 3.5 Flash got 11 of 12 right, ahead of Claude Opus 5.5 and Gemini 3.1 Pro on 9.
The smallest, cheapest models struggled: Claude Haiku 4.5 got 4 of 12 and Gemini 3.1 Flash-Lite 3 of 12, often skipping the rota table or inventing figures.
A free model running on our own machine, Qwen 3.6, got 10 of 12, level with GPT-5.5 and Claude Sonnet 5.5.
Every model got at least one rota wrong, so whichever AI you use, check the rota yourself.
Test your own in five minutes
- Write down what a good answer must do, in three to five lines. Ours for review replies: under 80 words, no refund promised, no staff named.
- Run your prompt three times on a real example, and once with nothing pasted.
- Check each answer against your list. One miss means you change the prompt, then run all four again.
- Keep the version that passes, and write the date on it.