Lesson overview

Compare models with a tiny test set

Compare models with a tiny test set — Local AI with Ollama. Freeze the evaluation inputs; Compare under the same conditions; Make a bounded selection. Practical assignment: Lab evidence.

Demo edition. The materials are undergoing editorial review.

Topics covered

  • Freeze the evaluation inputs
  • Compare under the same conditions
  • Make a bounded selection

Practical assignment

Lab evidence

The full lesson is available as part of the course.

Continue to learning

Course outline

  1. Choose a model and a private boundary
  2. Download and inspect one local model
  3. Make and inspect the first API call
  4. Control context and generation limits
  5. Compare models with a tiny test set
  6. Recover and document a repeatable setup