Do this only if the format matches
Confirm the round with recruiting first. This is an original practice exercise, not a claim that a specific company uses this exact prompt.
Protocol
- State the capability, prohibited behavior, state, action space, and terminal condition.
- Run tests and identify how outcome quality hides process violations.
- Implement hard disqualification gates and bounded component scores.
- Add adversarial episodes for reward hacking and grader blind spots.
- Separate deterministic checks, model-graded judgments, and human review.
- Explain grader versioning, drift, and online validation.
Deliverables
- A repaired structured grader.
- Two new adversarial episodes.
- An environment and coverage specification.
- A decision rule for whether the training intervention helped.
Graduation gates
Unsafe process cannot be offset by final-answer quality.
Evidence accompanies every gate and penalty.
The environment has explicit reset, timeout, and terminal semantics.
Grader and environment versions are part of every result.
Starter files
Assignment READMEEnvironment and grader contract.Open file →Broken graderScalar reward hides unsafe process.Open file →Public testsPolicy gates and component behavior.Open file →