Handbook
Prompt 05 — Problem, solution, and benchmark builder
Create a typed problem object and, only when allowed by the target partition, separate solution and verification objects.
Updated
Inputs
TARGET_PARTITION: {{TARGET_PARTITION}}
PROBLEM_SOURCE: {{PROBLEM_SOURCE_JSON_OR_TEXT}}
DOMAIN_CONTEXT: {{DOMAIN_CONTEXT_JSON}}
CONCEPT_INDEX: {{CONCEPT_INDEX_JSON}}
DIFFICULTY_POLICY: {{DIFFICULTY_POLICY_JSON}}
CLEAN_ROOM_POLICY: {{CLEAN_ROOM_POLICY_JSON}}
Task
Create a typed problem object and, only when allowed by the target partition, separate solution and verification objects.
Problem object
Include:
- exact problem statement;
- givens, unknowns, goal, and allowed operations;
- domain and representation;
- explicit and implicit assumptions;
- well-posedness assessment;
- expected answer type;
- deterministic verifier interface;
- difficulty and prerequisite concepts;
- common ambiguity traps;
- parameterized variants;
- concept-pressure tags describing the kind of reusable distinction the problem rewards without naming hidden target concepts in learner-visible fields.
Solution object
When solutions are allowed, include:
- method family;
- concise derivation certificate;
- intermediate artifacts;
- final result;
- substitution/residual/proof checks;
- alternative valid methods;
- failure modes and invalid shortcuts.
Benchmark object
Include normal, edge, adversarial, degenerate, and transfer cases. Define pass criteria and partial-credit signals without revealing the solution to learner agents.
Clean-room rules
curriculumreceives problem and verifier objects only.- Hidden answer keys must use
visible_to_learner: falseand reside in a historian/evaluator-only location. - Remove canonical theorem and algorithm names when they would leak the target abstraction.
- Do not add hints derived from modern textbook organization unless explicitly requested.
Return a library-batch object with explicit visibility metadata.
Return JSON matching schemas/library-batch.schema.json.