Foundation kata · start on any device
Change the instructions
One task. Two prompts. Find out what clearer instructions change, using evidence you can check.
First, see the result
A checked report from messy data
For this fictional dataset, the four complete, unique sales total $22. Two rows need review; one exact duplicate is removed.
4 complete sales
2 exceptions
7 units · $22
Check it yourself: (2 × $3) + (1 × $4) + (3 × $3) + (1 × $3) = $22. This is the Dojo’s expected answer, not a claim about an AI model’s performance.
Open the exact practice CSV · See the original data-rescue kata
The input is a synthetic Dojo exercise. No model output, cost, timing, or winner is pre-recorded here; your two runs are your own evidence.
Your turn
Run the same task twice
- Choose one assistant in an app or browser, or a CLI harness you trust. Record the harness, model and versions if visible. Use the same choice, settings and tools for both runs.
- Start a fresh conversation. Copy prompt A, including its data, and save the response.
- Start another fresh conversation. Copy prompt B and save the response. Only the instruction changes; the dataset and requested report are the same.
- Check both against the answer and rubric below. A leaves the data-handling rules unspecified; a difference demonstrates the effects of this particular brief, not a universal model ranking.
Ingredients: one chosen harness and its available model, the synthetic CSV embedded below, one assistant, and you as the reviewer. No skill, CLI, MCP, plugin or connector is required for the basic chat version. Phone, Windows, macOS and Linux options.
Account availability, model access and usage charges depend on your provider and plan. If a version or cost is unavailable, record “not shown”; never paste credentials or private customer data into a prompt.
Prompt B · a clear contract
Verify independently
Five checks, for each response
- Reports seven input rows, one exact duplicate removed and four complete unique sales.
- Flags S104 and S105 as exceptions without guessing missing or invalid values.
- Groups “Basil” and “basil” together and counts seven units across complete sales.
- Shows complete revenue as $22 with arithmetic that can be inspected.
- Does not invent transactions, customers or missing values.
Mark each check pass, fail or not assessable for A and B. Prompt A does not specify all the rules, so an apparently different answer is not necessarily an instruction-following failure. Investigate the input and assumptions before drawing conclusions.
Check your three numbers
This checks the numbers for the fictional seed dataset. You still need to inspect the rows and the explanation.
Google: missing values and duplicates · Anthropic: define success and build evaluations
Keep the evidence
Record what actually happened
Edit this record with your own observations. It stays in this page until you copy it; nothing is submitted or saved by the Dojo. Do not include secrets or personal data. A single pair of responses can vary with sampling, hidden settings and service changes.
Compare measured costs and checks in Budget Boss · Explore the Arena
Adapt · Randori
Try an unfamiliar dataset
Use the same rules on the rows below without changing your assistant’s answer to match the first dataset. Predict the valid sales, exceptions and revenue before you reveal the check.
id,item,quantity,unit_price_usd
T1,Rose,2,5
T1,Rose,2,5
T2,Mint,1,3
T3,Mint,,3Reveal the independent check
Four rows contain one exact duplicate, two complete unique sales and one exception. The complete sales total is (2 × $5) + (1 × $3) = $13. T3 needs review.
Next, apply the same method to a design brief, a set of customer notes or a 3D model checklist. Those are transfer ideas, not demonstrations of tested integrations or professional approval.
Explore other controlled changes
After this exercise, change only one factor: a model, harness, instruction, reviewed skill, permitted integration or agent delegation. Keep the input and rubric stable, record actual configurations and compare results with appropriate review. These variants are ideas for your own tests, not published benchmarks.
Try a context-trust experiment · Explore more katas · Practice Randori · Explore belts



