Lesson overview

Errors, evals and final harness

Errors, evals and final harness — OpenAI tools and agents without paid execution. 429 has several meanings; Offline evals check invariants; Acceptance without hidden API execution. Practical assignment: Practice: Errors, evals and final harness.

Demo edition. The materials are undergoing editorial review.

Topics covered

  • 429 has several meanings
  • Offline evals check invariants
  • Acceptance without hidden API execution

Practical assignment

Practice: Errors, evals and final harness

The full lesson is available as part of the course.

Continue to learning

Course outline

  1. Architecture and API budget
  2. Function calling and server-side dispatch
  3. Tool loop and call_id
  4. Structured responses and business rules
  5. Approval and side-effect boundaries
  6. Errors, evals and final harness