Skip to content AI News: Claude Duet: Anthropic's agent that messages you first →
PH-1081 · Text prompt

Prompt Test Set Builder

Builds a small test set for a prompt you keep fixing, with the cases split so the ones you tune on are not the ones you judge by. Works in ChatGPT, Claude or Gemini.

What you get

Builds a small test set for a prompt you keep fixing, with the cases split so the ones you tune on are not the ones you judge by.

What you need
  • 2 blanks to fill in: paste the prompt and one sentence on… paste them, or describe them
Best inChatGPTAlso works in Claude, Gemini
195 words
Prompt · October 27, 2026
I have a prompt I keep adjusting. Each time it fails on an example, I fix it for that example, and I'm not sure it is actually getting better. Help me build a test set so I can tell.

Here is the prompt and what it is supposed to do:
[paste the prompt and one sentence on its job]

Here are the examples I've been using:
[paste them, or describe them]

Do this:
1. List the kinds of input this prompt will meet in real use: typical, short, long, messy, off-topic, tricky edge cases. Name at least six kinds.
2. Write 12 test inputs that cover those kinds. Make them realistic, not cartoonish.
3. For each, write what a good answer must contain and what would count as a failure, in one line each.
4. Split them into two groups: 6 "tuning" cases I may look at while I edit the prompt, and 6 "held-out" cases I only run at the end. Put my existing examples in the tuning group.
5. Give me a simple score sheet: case, pass or fail, note.

Do not rewrite my prompt. The point is to judge it fairly first.
Productivity ChatGPT

How to use it

  1. Fill the blanks under «Make it yours» — the prompt updates as you type.
  2. Copy the prompt and paste it into ChatGPT.
  3. Not quite right? Reply with what to change — the model keeps the rest.

More Useful ChatGPT Prompts

PH-1033Marketing

X Trend Briefing

Ask Grok what people on X are saying about a topic in a set time window, with links to the posts, the main camps and what is still unverified.

You fill in topiclast 24 hours, last 7 days

Grok
PH-1032Productivity

X Thread Explainer

Paste an X post link and Grok explains the thread: the context you are missing, who is who, what is claimed and what is actually shown.

You fill in paste the X linkoptional: what confuses you

Grok
PH-1008Marketing

Brand Mention Monitor

Have Grok read recent X posts about your brand or product and sort them into praise, complaints, questions and risks, with links to every post.

You fill in brandother names@handle+1 more

Grok
PH-1013Business

Competitor Watch

Give Grok a list of competitor accounts and a date range and get a digest of their launches, pricing changes, hires and how people reacted.

You fill in @handle1, @handle2, @handle3start dateend date+1 more

Grok
PH-1009Productivity

Breaking News Checker

Paste a claim going around X and Grok traces it to its first source, checks it against primary sources and gives a confirmed…

You fill in paste the claim, post link or…

Grok
PH-1020Marketing

Niche Expert Finder

Ask Grok to find the accounts on X that post real substance about your niche, with an example post for each and why they are worth following.

You fill in nichelearn X, find clients…

Grok
Weekly

New prompts in your inbox

One email a week: the best new prompts and one short guide. Confirm by email and get the free Prompt Cheat Sheet (PDF). Unsubscribe any time. Privacy policy