Inference Engineering
From app developer to inference engineer in 13 weeks, following roadmap.sh/inference-engineering.
This week
Loading the schedule…
Lessons
New lessons appear here as your teacher writes them, one at a time.
Course pages
Syllabus30 lessons in 8 parts, and how they cover the roadmap's 136 topics.
ScheduleWeek by week, with checkpoints and milestones.
Latency metricsTTFT, ITL, decode TPS, E2E and throughput on one page.
MissionThe goal, success criteria and constraints.
ResourcesThe checked sources each lesson cites.
My notesOne Markdown file per lesson. Edit on GitHub from any device; each lesson shows its notes at the bottom.
Lab logYour measured results and takeaways, lesson by lesson.
Lab guideWhere each lab runs, the models we use, setup and gotchas.
stream_probe.pyLesson 1's measuring tool, for reading. Run labs from your Mac copy.
load_test.pyLesson 2's load tester: percentiles and throughput under concurrent load.
Notes and progress
Your notes live in this course's GitHub repo, so they follow you to any device. Edit them on GitHub, and your teacher reads them before writing your next lesson. Exercise answers and "lesson complete" marks are saved in each browser separately.