Forge Intelligence

Prompt 05 — Problem, solution, and benchmark builder

Create a typed problem object and, only when allowed by the target partition, separate solution and verification objects.

Updated

Inputs

TARGET_PARTITION: {{TARGET_PARTITION}}
PROBLEM_SOURCE: {{PROBLEM_SOURCE_JSON_OR_TEXT}}
DOMAIN_CONTEXT: {{DOMAIN_CONTEXT_JSON}}
CONCEPT_INDEX: {{CONCEPT_INDEX_JSON}}
DIFFICULTY_POLICY: {{DIFFICULTY_POLICY_JSON}}
CLEAN_ROOM_POLICY: {{CLEAN_ROOM_POLICY_JSON}}

Task

Create a typed problem object and, only when allowed by the target partition, separate solution and verification objects.

Problem object

Include:

  • exact problem statement;
  • givens, unknowns, goal, and allowed operations;
  • domain and representation;
  • explicit and implicit assumptions;
  • well-posedness assessment;
  • expected answer type;
  • deterministic verifier interface;
  • difficulty and prerequisite concepts;
  • common ambiguity traps;
  • parameterized variants;
  • concept-pressure tags describing the kind of reusable distinction the problem rewards without naming hidden target concepts in learner-visible fields.

Solution object

When solutions are allowed, include:

  • method family;
  • concise derivation certificate;
  • intermediate artifacts;
  • final result;
  • substitution/residual/proof checks;
  • alternative valid methods;
  • failure modes and invalid shortcuts.

Benchmark object

Include normal, edge, adversarial, degenerate, and transfer cases. Define pass criteria and partial-credit signals without revealing the solution to learner agents.

Clean-room rules

  • curriculum receives problem and verifier objects only.
  • Hidden answer keys must use visible_to_learner: false and reside in a historian/evaluator-only location.
  • Remove canonical theorem and algorithm names when they would leak the target abstraction.
  • Do not add hints derived from modern textbook organization unless explicitly requested.

Return a library-batch object with explicit visibility metadata.

Return JSON matching schemas/library-batch.schema.json.