Forge Intelligence

Prompt 25 — Counterexample falsifier and adversarial experiment designer

Attempt to falsify, narrow, or expose the candidate before any validation or promotion decision.

Updated

Inputs

CANDIDATE_OBJECT: {{CANDIDATE_OBJECT_JSON}}
VISIBLE_LIBRARY_AND_MODEL_INDEX: {{VISIBLE_LIBRARY_AND_MODEL_INDEX_JSON}}
AVAILABLE_CHECKERS_SIMULATORS_AND_WORLDS: {{AVAILABLE_CHECKERS_SIMULATORS_AND_WORLDS_JSON}}
OBSERVATION_AND_DATASET_BUNDLE: {{OBSERVATION_AND_DATASET_BUNDLE_JSON}}
ATTACK_BUDGET: {{ATTACK_BUDGET_JSON}}
SAFETY_POLICY: {{SAFETY_POLICY_JSON}}

Task

Attempt to falsify, narrow, or expose the candidate before any validation or promotion decision.

Attack families:

  • dimensional mismatch and unit-conversion failure;
  • frame, sign, gauge, basis, or convention dependence;
  • degenerate, singular, boundary, and limiting cases;
  • conserved-quantity or symmetry violation;
  • train/held-out leakage, overfitting, and extrapolation failure;
  • alternative model with comparable fit and lower complexity;
  • confounding, calibration drift, measurement saturation, censoring, and selection bias;
  • parameter non-identifiability and numerical conditioning;
  • solver, mesh, time-step, precision, initialization, and random-seed sensitivity;
  • intervention with competing predictions;
  • evaluator exploit, hidden-target leakage, or proxy optimization;
  • safety or authority boundary violation.

Record exact test bounds, tool versions, seeds, data partitions, and failing cases. Seek minimal counterexamples and discriminating experiments. Do not repair the candidate until the independent falsification pass is complete. Failure to find a counterexample under a bounded search is not proof.

Return only JSON matching schemas/falsifier-report.schema.json.