epochs

Paths · 7 modules · 43 lessons · 3 projects · about 13 hours

ML Platform Engineer

Run the systems models live on: inference, training infrastructure, reliability and cost.

Who it's for

Backend and infrastructure engineers moving into ML systems.

By the end, you can
  • Explain where inference time and money go, and how to cut both
  • Size training and serving hardware from first principles
  • Design reliable, observable AI services with budgets and fallbacks

The route

Modules in order, with a project after the lessons it builds on. Mark lessons as done and tick project steps, and this page tracks your progress. Sign in to keep it on every device.

  1. Module 06 · 6 lessons · about 26 minTransformersAttention, the full architecture, and how the next token is chosen.Not started
  2. Module 12 · 6 lessons · about 19 minInference and servingWhere the time goes, and how to make models fast and cheap.Not started
  3. Module 07 · 8 lessons · about 29 minTraining and fine-tuningPretraining, LoRA, preference tuning and the data behind them.Not started
  4. Module 13 · 7 lessons · about 21 minProduction AI and MLOpsRouting, fallbacks, budgets, monitoring and safety in real systems.Not started
  5. Project · Intermediate · 2–3 hours · ProPut your project onlineTurn the notes search engine into a tested web API, package it with Docker, and give it a public address.6 steps
  6. Module 11 · 5 lessons · about 16 minEvaluationDecide what good means, then measure it without fooling yourself.Not started
  7. Project · Intermediate · 3–4 hours · ProAn evaluation harnessBuild the tool every AI team needs: run a fixed test set, see what passed, and know whether a change really helped.5 steps
  8. Module 10 · 6 lessons · about 20 minAgentsThe agent loop, memory, tools, and how agents fail.Not started
  9. Project · Advanced · 4–6 hours · ProA tool-using agentBuild the agent loop yourself: tools, a step limit, a trace of every action, and tests that don't need an API.5 steps
  10. Module 14 · 5 lessons · about 16 minML system designA repeatable way to design recommenders, search and LLM products.Not started