rohitg00/ai-engineering-from-scratchPublic

Learn AI Engineering! Learn it. Build it. Ship it for others.

AI summary: A comprehensive, code-first curriculum to master AI engineering and build production-ready LLM applications.

Stars
79.6K
+553 today
Forks
14.2K
Watchers
464
Open issues
15
Open PRs
49
Contributors
~32
Commits
2.7K
Branches
14
Views (30d)
12

PythonMITCreated Mar 18, 2026Last push 2d agoLatest release v2026.11.2+1K stars this week+7.8K this month

Quick answers

What is ai-engineering-from-scratch?
A comprehensive, code-first curriculum to master AI engineering and build production-ready LLM applications.
What does ai-engineering-from-scratch do?
This repository provides a highly structured, open-source curriculum dedicated to taking developers from basic programming to advanced AI engineering. It focuses heavily on practical implementation, guiding learners through the process of building scalable, production-ready applications powered by Large Language Models. The course covers foundational concepts like prompt engineering and RAG, before progressing to complex topics such as agentic workflows, model evaluation, and deployment strategies. By emphasizing hands-on projects and real-world architectural patterns over pure theory, it equips developers with the concrete skills needed to construct robust AI systems.
Who is ai-engineering-from-scratch for?
This curriculum is ideal for software engineers, data scientists, and technical product builders who possess basic programming skills (mainly Python). It is perfect for those transitioning into AI engineering roles from traditional software development. The repository helps learners bridge the gap between basic concepts and practical implementation.
How do I get started with ai-engineering-from-scratch?
python3 scripts/project_test.py retrieval-evaluation-lab --init learning-artifacts/retrieval-evaluation-lab && python3 scripts/project_test.py retrieval-evaluation-lab --stage 1 --path learning-artifacts/retrieval-evaluation-lab --strict && python3 scripts/project_test.py retrieval-evaluation-lab --all --path learning-artifacts/retrieval-evaluation-lab --strict
How popular is ai-engineering-from-scratch on GitHub?
rohitg00/ai-engineering-from-scratch has 79,618 stars and 14,230 forks on GitHub, and gained 1,040 stars in the last 7 days.
What license does ai-engineering-from-scratch use?
rohitg00/ai-engineering-from-scratch is released under the MIT license.

Star history

since Jul 29, 2026
020K40K60KJul 2026Sep 2026Oct 2026Nov 2026
79.6K stars as of Nov 20, 2026. Measured daily since Jul 29, 2026; GitHub no longer exposes earlier star timestamps.

Update history

5 recorded
  • Nov 12, 2026New release v2026.11.2 (previously v2026.10.5).
  • Nov 1, 2026New release v2026.10.5 (previously v2026.10.4).
  • Oct 21, 2026New release v2026.10.4 (previously v2026.10.1).
  • Oct 12, 2026Description changed from "Learn it. Build it. Ship it for others." to "Learn AI Engineering! Learn it. Build it. Ship it for others.".
  • Oct 9, 2026New release v2026.10.1 (previously v2026.09).

Contribution activity

commits per day, last 52 weeks
NovDecJanFebMarAprMayJunJulAugSepOctNovMonWedFri2025-11-16: 0 commits2025-11-17: 0 commits2025-11-18: 0 commits2025-11-19: 0 commits2025-11-20: 0 commits2025-11-21: 0 commits2025-11-22: 0 commits2025-11-23: 0 commits2025-11-24: 0 commits2025-11-25: 0 commits2025-11-26: 0 commits2025-11-27: 0 commits2025-11-28: 0 commits2025-11-29: 0 commits2025-11-30: 0 commits2025-12-01: 0 commits2025-12-02: 0 commits2025-12-03: 0 commits2025-12-04: 0 commits2025-12-05: 0 commits2025-12-06: 0 commits2025-12-07: 0 commits2025-12-08: 0 commits2025-12-09: 0 commits2025-12-10: 0 commits2025-12-11: 0 commits2025-12-12: 0 commits2025-12-13: 0 commits2025-12-14: 0 commits2025-12-15: 0 commits2025-12-16: 0 commits2025-12-17: 0 commits2025-12-18: 0 commits2025-12-19: 0 commits2025-12-20: 0 commits2025-12-21: 0 commits2025-12-22: 0 commits2025-12-23: 0 commits2025-12-24: 0 commits2025-12-25: 0 commits2025-12-26: 0 commits2025-12-27: 0 commits2025-12-28: 0 commits2025-12-29: 0 commits2025-12-30: 0 commits2025-12-31: 0 commits2026-01-01: 0 commits2026-01-02: 0 commits2026-01-03: 0 commits2026-01-04: 0 commits2026-01-05: 0 commits2026-01-06: 0 commits2026-01-07: 0 commits2026-01-08: 0 commits2026-01-09: 0 commits2026-01-10: 0 commits2026-01-11: 0 commits2026-01-12: 0 commits2026-01-13: 0 commits2026-01-14: 0 commits2026-01-15: 0 commits2026-01-16: 0 commits2026-01-17: 0 commits2026-01-18: 0 commits2026-01-19: 0 commits2026-01-20: 0 commits2026-01-21: 0 commits2026-01-22: 0 commits2026-01-23: 0 commits2026-01-24: 0 commits2026-01-25: 0 commits2026-01-26: 0 commits2026-01-27: 0 commits2026-01-28: 0 commits2026-01-29: 0 commits2026-01-30: 0 commits2026-01-31: 0 commits2026-02-01: 0 commits2026-02-02: 0 commits2026-02-03: 0 commits2026-02-04: 0 commits2026-02-05: 0 commits2026-02-06: 0 commits2026-02-07: 0 commits2026-02-08: 0 commits2026-02-09: 0 commits2026-02-10: 0 commits2026-02-11: 0 commits2026-02-12: 0 commits2026-02-13: 0 commits2026-02-14: 0 commits2026-02-15: 0 commits2026-02-16: 0 commits2026-02-17: 0 commits2026-02-18: 0 commits2026-02-19: 0 commits2026-02-20: 0 commits2026-02-21: 0 commits2026-02-22: 0 commits2026-02-23: 0 commits2026-02-24: 0 commits2026-02-25: 0 commits2026-02-26: 0 commits2026-02-27: 0 commits2026-02-28: 0 commits2026-03-01: 0 commits2026-03-02: 0 commits2026-03-03: 0 commits2026-03-04: 0 commits2026-03-05: 0 commits2026-03-06: 0 commits2026-03-07: 0 commits2026-03-08: 0 commits2026-03-09: 0 commits2026-03-10: 0 commits2026-03-11: 0 commits2026-03-12: 0 commits2026-03-13: 0 commits2026-03-14: 0 commits2026-03-15: 0 commits2026-03-16: 0 commits2026-03-17: 0 commits2026-03-18: 6 commits2026-03-19: 60 commits2026-03-20: 4 commits2026-03-21: 0 commits2026-03-22: 0 commits2026-03-23: 1 commit2026-03-24: 0 commits2026-03-25: 6 commits2026-03-26: 0 commits2026-03-27: 7 commits2026-03-28: 8 commits2026-03-29: 5 commits2026-03-30: 15 commits2026-03-31: 37 commits2026-04-01: 7 commits2026-04-02: 6 commits2026-04-03: 0 commits2026-04-04: 0 commits2026-04-05: 3 commits2026-04-06: 0 commits2026-04-07: 0 commits2026-04-08: 0 commits2026-04-09: 0 commits2026-04-10: 0 commits2026-04-11: 0 commits2026-04-12: 0 commits2026-04-13: 0 commits2026-04-14: 0 commits2026-04-15: 0 commits2026-04-16: 0 commits2026-04-17: 5 commits2026-04-18: 0 commits2026-04-19: 2 commits2026-04-20: 0 commits2026-04-21: 105 commits2026-04-22: 105 commits2026-04-23: 213 commits2026-04-24: 201 commits2026-04-25: 39 commits2026-04-26: 0 commits2026-04-27: 1 commit2026-04-28: 1 commit2026-04-29: 0 commits2026-04-30: 0 commits2026-05-01: 0 commits2026-05-02: 0 commits2026-05-03: 0 commits2026-05-04: 0 commits2026-05-05: 0 commits2026-05-06: 0 commits2026-05-07: 0 commits2026-05-08: 2 commits2026-05-09: 14 commits2026-05-10: 3 commits2026-05-11: 4 commits2026-05-12: 1 commit2026-05-13: 54 commits2026-05-14: 2 commits2026-05-15: 0 commits2026-05-16: 0 commits2026-05-17: 4 commits2026-05-18: 0 commits2026-05-19: 0 commits2026-05-20: 38 commits2026-05-21: 3 commits2026-05-22: 89 commits2026-05-23: 5 commits2026-05-24: 0 commits2026-05-25: 90 commits2026-05-26: 222 commits2026-05-27: 48 commits2026-05-28: 0 commits2026-05-29: 0 commits2026-05-30: 0 commits2026-05-31: 0 commits2026-06-01: 4 commits2026-06-02: 10 commits2026-06-03: 5 commits2026-06-04: 0 commits2026-06-05: 2 commits2026-06-06: 2 commits2026-06-07: 11 commits2026-06-08: 4 commits2026-06-09: 0 commits2026-06-10: 2 commits2026-06-11: 0 commits2026-06-12: 0 commits2026-06-13: 0 commits2026-06-14: 2 commits2026-06-15: 0 commits2026-06-16: 13 commits2026-06-17: 0 commits2026-06-18: 0 commits2026-06-19: 0 commits2026-06-20: 0 commits2026-06-21: 0 commits2026-06-22: 0 commits2026-06-23: 0 commits2026-06-24: 0 commits2026-06-25: 2 commits2026-06-26: 0 commits2026-06-27: 0 commits2026-06-28: 0 commits2026-06-29: 0 commits2026-06-30: 0 commits2026-07-01: 0 commits2026-07-02: 0 commits2026-07-03: 0 commits2026-07-04: 0 commits2026-07-05: 0 commits2026-07-06: 0 commits2026-07-07: 0 commits2026-07-08: 0 commits2026-07-09: 0 commits2026-07-10: 0 commits2026-07-11: 0 commits2026-07-12: 0 commits2026-07-13: 0 commits2026-07-14: 0 commits2026-07-15: 0 commits2026-07-16: 0 commits2026-07-17: 0 commits2026-07-18: 0 commits2026-07-19: 0 commits2026-07-20: 0 commits2026-07-21: 0 commits2026-07-22: 0 commits2026-07-23: 0 commits2026-07-24: 0 commits2026-07-25: 11 commits2026-07-26: 10 commits2026-07-27: 0 commits2026-07-28: 0 commits2026-07-29: 0 commits2026-07-30: 0 commits2026-07-31: 0 commits2026-08-01: 8 commits2026-08-02: 5 commits2026-08-03: 1 commit2026-08-04: 1 commit2026-08-05: 0 commits2026-08-06: 0 commits2026-08-07: 0 commits2026-08-08: 0 commits2026-08-09: 4 commits2026-08-10: 0 commits2026-08-11: 0 commits2026-08-12: 0 commits2026-08-13: 0 commits2026-08-14: 0 commits2026-08-15: 0 commits2026-08-16: 0 commits2026-08-17: 0 commits2026-08-18: 0 commits2026-08-19: 0 commits2026-08-20: 0 commits2026-08-21: 34 commits2026-08-22: 11 commits2026-08-23: 34 commits2026-08-24: 0 commits2026-08-25: 0 commits2026-08-26: 0 commits2026-08-27: 0 commits2026-08-28: 0 commits2026-08-29: 0 commits2026-08-30: 2 commits2026-08-31: 0 commits2026-09-01: 0 commits2026-09-02: 0 commits2026-09-03: 0 commits2026-09-04: 0 commits2026-09-05: 0 commits2026-09-06: 0 commits2026-09-07: 5 commits2026-09-08: 0 commits2026-09-09: 0 commits2026-09-10: 0 commits2026-09-11: 0 commits2026-09-12: 0 commits2026-09-13: 0 commits2026-09-14: 0 commits2026-09-15: 0 commits2026-09-16: 0 commits2026-09-17: 0 commits2026-09-18: 0 commits2026-09-19: 0 commits2026-09-20: 0 commits2026-09-21: 0 commits2026-09-22: 0 commits2026-09-23: 0 commits2026-09-24: 17 commits2026-09-25: 10 commits2026-09-26: 0 commits2026-09-27: 6 commits2026-09-28: 2 commits2026-09-29: 4 commits2026-09-30: 2 commits2026-10-01: 0 commits2026-10-02: 3 commits2026-10-03: 0 commits2026-10-04: 3 commits2026-10-05: 6 commits2026-10-06: 15 commits2026-10-07: 2 commits2026-10-08: 5 commits2026-10-09: 14 commits2026-10-10: 16 commits2026-10-11: 2 commits2026-10-12: 0 commits2026-10-13: 8 commits2026-10-14: 7 commits2026-10-15: 9 commits2026-10-16: 4 commits2026-10-17: 5 commits2026-10-18: 50 commits2026-10-19: 16 commits2026-10-20: 0 commits2026-10-21: 109 commits2026-10-22: 282 commits2026-10-23: 192 commits2026-10-24: 0 commits2026-10-25: 0 commits2026-10-26: 0 commits2026-10-27: 0 commits2026-10-28: 0 commits2026-10-29: 5 commits2026-10-30: 0 commits2026-10-31: 0 commits2026-11-01: 0 commits2026-11-02: 0 commits2026-11-03: 31 commits2026-11-04: 6 commits2026-11-05: 6 commits2026-11-06: 0 commits2026-11-07: 4 commits2026-11-08: 4 commits2026-11-09: 7 commits2026-11-10: 0 commits2026-11-11: 8 commits2026-11-12: 6 commits2026-11-13: 0 commits2026-11-14: 0 commits
2,465 commits in the last yearLessMore

Signals and awards

derived from tracked data
  • Landmark project

    79,618 stars

  • High momentum

    +553 stars today

  • Very active

    2,465 commits in 52 weeks

  • Well documented

    High community health score

  • Permissive license

    MIT

  • Continuous integration

    Automated checks passing

  • Repeat trending

    17 trending appearances

  • Top 10% tracked

    Rank 123 of 1243

What ai-engineering-from-scratch does

This repository provides a highly structured, open-source curriculum dedicated to taking developers from basic programming to advanced AI engineering. It focuses heavily on practical implementation, guiding learners through the process of building scalable, production-ready applications powered by Large Language Models. The course covers foundational concepts like prompt engineering and RAG, before progressing to complex topics such as agentic workflows, model evaluation, and deployment strategies. By emphasizing hands-on projects and real-world architectural patterns over pure theory, it equips developers with the concrete skills needed to construct robust AI systems.

This curriculum is ideal for software engineers, data scientists, and technical product builders who possess basic programming skills (mainly Python). It is perfect for those transitioning into AI engineering roles from traditional software development. The repository helps learners bridge the gap between basic concepts and practical implementation.

  • Code-First Pedagogy: Centers learning around functional, reproducible code examples and practical projects rather than abstract theory.
  • Progressive Curriculum: Structured logically from basic API usage to advanced agent orchestration and custom RAG implementations.
  • Production-Oriented Focus: Covers essential engineering practices for AI, including evaluation metrics, guardrails, and deployment CI/CD.
  • Comprehensive RAG Patterns: Details various Retrieval-Augmented Generation strategies including naive, advanced, and agentic RAG architectures.
  • Open Source Tooling Integration: Teaches the integration of popular open-source frameworks like LangChain and LlamaIndex natively.

Where teams use it

Upskilling Software Engineers

For traditional developers wanting to transition into the field of AI engineering by learning how to effectively integrate LLMs into software products.

Building RAG Applications

For teams needing to construct robust, enterprise-grade knowledge retrieval systems using advanced RAG techniques and vector databases.

Developing AI Agents

For builders looking to design autonomous agent systems capable of reasoning, using tools, and executing complex multi-step workflows.

Implementing AI Guardrails

For security-conscious engineers needing to learn how to evaluate and constrain model outputs in production environments safely.

Getting started: python3 scripts/project_test.py retrieval-evaluation-lab --init learning-artifacts/retrieval-evaluation-lab && python3 scripts/project_test.py retrieval-evaluation-lab --stage 1 --path learning-artifacts/retrieval-evaluation-lab --strict && python3 scripts/project_test.py retrieval-evaluation-lab --all --path learning-artifacts/retrieval-evaluation-lab --strict

README

main branch

AI Engineering from Scratch

Star History Rank GitHub Trending Repository of the Day

Implement model internals, retrieval pipelines, and agent runtimes. Test them, inspect failures, and keep the code and evaluation results.

Start learning · Choose a path · Try a lab · Build a project · Browse the curriculum

Free, open source, MIT. Learn on the website, with a coding agent, or by running local code.

542 lessons. 20 phases. Python, TypeScript, Rust, Julia, Go.

MIT License 542 lessons 20 phases GitHub stars Website

Read in your language

🇬🇧 English · 🇨🇳 简体中文 · 🇹🇼 繁體中文(台灣) · 🇯🇵 日本語 · 🇰🇷 한국어 · 🇵🇹 Português · 🇧🇷 Português (Brasil) · 🇪🇸 Español · 🇩🇪 Deutsch · 🇫🇷 Français · 🇮🇹 Italiano · 🇳🇱 Nederlands · 🇵🇱 Polski · 🇨🇿 Čeština · 🇷🇴 Română · 🇭🇺 Magyar · 🇬🇷 Ελληνικά · 🇸🇪 Svenska · 🇩🇰 Dansk · 🇳🇴 Norsk · 🇫🇮 Suomi · 🇷🇺 Русский · 🇺🇦 Українська · 🇹🇷 Türkçe · 🇮🇱 עברית · 🇸🇦 العربية · 🇮🇷 فارسی · 🇮🇳 हिन्दी · 🇧🇩 বাংলা · 🇵🇰 اردو · 🇹🇭 ไทย · 🇻🇳 Tiếng Việt · 🇮🇩 Bahasa Indonesia · 🇵🇭 Tagalog

Sponsors

SerpApi. Web Search API for your AI apps. Available in Markdown and JSON for any integration.

Your support keeps every lesson free and open source. See all supporters · Become a sponsor

Learning paths

Route Starting lesson
Model foundations Setup and tooling
LLM systems Prompt engineering
Agents and delivery The agent loop

Compare career paths · Prerequisites and study time

Gradient descent

Twenty starting points follow gradient descent on a quadratic loss. The graph shows their positions and mean loss after each update.

Gradient descent moves scattered starting points toward the loss minimum. The mean loss decreases with each update.

Adjust the learning rate in the lesson · Compare GD, momentum, and Adam in code

Projects

Three projects with staged starters, reference implementations, and local graders. Run commands from the repository root after setup. Starters fail until you implement the stages.

01 · Retrieval Evaluation Lab · Python · Ranking metrics and regression checks

A candidate improves mean NDCG while one query ranks its most relevant evidence lower. Build a query-by-query comparison that reports the regression and can fail a release check.

Use Python 3.10+. Review RAG and model evaluation. Implement ranking validation, precision and recall, rank-sensitive metrics, then system comparison.

python3 scripts/project_test.py retrieval-evaluation-lab \
  --init learning-artifacts/retrieval-evaluation-lab
python3 scripts/project_test.py retrieval-evaluation-lab \
  --stage 1 --path learning-artifacts/retrieval-evaluation-lab --strict
python3 scripts/project_test.py retrieval-evaluation-lab \
  --all --path learning-artifacts/retrieval-evaluation-lab --strict

Keep: a reproducible comparison with per-query deltas and the judgments used to score them. Metrics describe those judgments; they do not establish answer correctness.

Start the project · Inspect the reference · Run on your own inputs

02 · Agent Trace Debugger · TypeScript · Trace parsing and timing

A supplied trace still takes 100 ms, but total token usage rises by 200 and one span starts failing. Separate overlapping child work from parent execution time, then produce a report that exposes the change.

Use Node.js 22.18+ and Python 3 for the grader. Implement JSONL parsing, parent validation, interval arithmetic, then an inspectable timeline.

python3 scripts/project_test.py agent-trace-debugger \
  --init learning-artifacts/agent-trace-debugger
python3 scripts/project_test.py agent-trace-debugger \
  --stage 1 --path learning-artifacts/agent-trace-debugger --strict
python3 scripts/project_test.py agent-trace-debugger \
  --all --path learning-artifacts/agent-trace-debugger --strict

Keep: the input trace, an HTML timeline, and a JSON regression report. Preserve exclusive per-span token counts so parent and child usage are not counted twice.

Start the project · Inspect the reference · Explore timing interactively

03 · Tool Call Firewall · Rust · Role checks and approval receipts

A write changes after review, or an approval is replayed. Validate the call envelope, check the caller's role and path, then consume an approval bound to the exact request and content.

Use Rust and Python 3.10+. Review tool schema design and security boundaries. The caller application supplies identity; the model proposes an operation.

python3 scripts/project_test.py tool-call-firewall \
  --init learning-artifacts/tool-call-firewall
python3 scripts/project_test.py tool-call-firewall \
  --stage 1 --path learning-artifacts/tool-call-firewall --strict
python3 scripts/project_test.py tool-call-firewall \
  --all --path learning-artifacts/tool-call-firewall --strict

Keep: an audit receipt showing the requested operation and the policy decision. Approvals are single-use within one invocation; this project does not provide persistent authorization or an operating-system sandbox.

Start the project · Inspect the reference · Explore approval boundaries

Browse all projects · Career practice guide

Choose how to learn

On the website

Open any completed lesson on aiengineeringfromscratch.com or expand a phase under Contents. No setup, no cloning.

With an AI tutor

If Node.js, npx, and a skill-capable coding agent are already installed, your coding agent can become your tutor. A repository clone is not needed to install or read the tutor. Runnable focused-path labs need python3. Agent Skills host labs also need a selected host and a writable user or project skill scope.

npx skills add rohitg00/ai-engineering-from-scratch

Choose the host and scope when the installer asks. Use start-learning in Codex, /start-learning in Claude Code, or ask your host to use the skill by name.

Tutor setup and host commands

Check the local requirements first:

node --version
npx --version
python3 --version

skills writes to the host and scope selected during installation, such as .claude/skills/, .cursor/skills/, .codex/skills/, or another supported skills folder. Verify that the selected host discovers that exact destination.

Invocation syntax belongs to the host, not to the portable SKILL.md format:

Host Start the course Start Model Context Protocol (MCP) Start Agent Skills Run a phase quiz
Codex start-learning, or choose it from /skills learn-mcp, or choose it from /skills learn-agent-skills, or choose it from /skills check-understanding 13, or choose it from /skills
Claude Code /start-learning /learn-mcp /learn-agent-skills /check-understanding 13
Other compatible hosts Use start-learning to begin the course. Use learn-mcp to start the Model Context Protocol (MCP) path. Use learn-agent-skills to start the Agent Skills Engineering path. Use check-understanding to quiz me on Phase 13.

A ten-question placement quiz maps what you already know to a starting phase and saves a personalized study plan to LEARNING.md. From there, the learn skill teaches one lesson per session: concept, math, code, quiz. It streams lessons straight from this repo, and the course-guide skill jumps you to the exact lesson that covers anything you are stuck on. In Codex, invoke these skills with learn and course-guide; in Claude Code, use /learn and /course-guide; in other compatible hosts, ask to use the skill by name.

Only want Model Context Protocol (MCP)? Use the MCP invocation for your host. It creates MCP-LEARNING.md and follows one 17-lesson route through stateless requests, transports, bidirectional work, security, reliability, registry governance, and conformance evidence. The exact order and checkpoints live in the Model Context Protocol (MCP) manifest.

Only want Agent Skills? Use the Agent Skills invocation for your host. It creates AGENT-SKILLS-LEARNING.md and follows one coherent five-lesson route: contract, discovery, invocation, sandbox boundaries, then release evals and real-host portability. Start on the web with the Agent Skills path.

The installer lists the hosts it can configure and asks where to install. If you do not have Node.js, npx, python3, a supported host, or a writable scope yet, use the website or read docs/en.md manually. That path teaches the concepts, but real-host discovery, invocation, script, and uninstall evidence remains pending until the preflight is available. Read the lessons at aiengineeringfromscratch.com.

The learning skills

Skill What it does
start-learning One-time onboarding: why you're learning, placement quiz, personalized plan saved to LEARNING.md.
learn The tutor loop. Warm-up recall, then the next lesson taught interactively, then its quiz; records progress and a review queue.
course-guide Topic router. "Where do I learn attention?" or "my loss is NaN" → the exact lessons, with links.
learn-mcp Focused Model Context Protocol (MCP) tutor. Creates MCP-LEARNING.md, follows the 17-lesson manifest, and records wire, security, reliability, and conformance evidence.
learn-agent-skills Focused Agent Skills tutor. Creates AGENT-SKILLS-LEARNING.md, teaches lessons 22, 24, 25, 26, and 27, and records real-host evidence.
learn-reverse-engineering Focused Reverse Engineering tutor. Creates REVERSE-ENGINEERING-LEARNING.md, teaches Phase 13 lessons 32 to 45 on programs you build yourself, and records lab evidence.
claude-certification Certification tutor. Chooses CCAO-F, CCDV-F, CCAR-F, or CCAR-P; teaches each lesson; runs labs; reviews artifacts; administers diagnostics and mocks; saves progress.
mcpa-certification MCPA tutor. Follows the 34-lesson mcpa-f route on the 2026-07-28 protocol; teaches each lesson; runs labs and the wire checker; administers the diagnostic and three mocks; saves progress.
find-your-level Ten-question placement quiz. Maps your knowledge to a starting phase and produces a personalized path with hour estimates.
check-understanding <phase> Per-phase quiz, eight questions, with feedback and specific lessons to review. Use the Codex, Claude Code, or natural-language form in the invocation table above.

Run local code

git clone https://github.com/rohitg00/ai-engineering-from-scratch.git
cd ai-engineering-from-scratch
python3 phases/00-setup-and-tooling/01-dev-environment/code/verify.py --route beginner
python3 phases/01-math-foundations/01-linear-algebra-intuition/code/vectors.py

The preflight separates requirements needed now from tools needed later. Every required failure includes the detected reason and a corrective command. The vectors.py command is a dependency-free lesson and ends by showing that a matrix times a vector is the operation inside a neural network layer. Save that terminal output as your first evidence.

Use every lesson the same way

Use every lesson the same way

  1. Read docs/en.md and explain the core idea in your own words.
  2. Type and build the important code instead of treating the code block as decoration.
  3. Run the lesson command from the repository root, the directory containing README.md and phases/.
  4. Keep evidence: the command, working directory, exit code, meaningful output, and the artifact you changed or produced.
  5. Continue only when you can explain the output and make one small change without guessing.

Commands in lesson pages are paths from the repository root unless the lesson explicitly says to change directories. If a lesson offers several languages, run the implementation for the language you are learning.

Choose a learning path

You do not need to scan 542 lessons before beginning. Pick one goal. Each link opens the same curriculum on GitHub or the website, and both versions use the same lesson code.

Your goal Learn on GitHub Learn on the website
I am new and want the complete foundation Phase 0: Setup and Tooling Dev Environment
I know Python and want math plus ML foundations Phase 1: Math Foundations Linear Algebra Intuition
I want to build production LLM applications Phase 11: LLM Engineering Prompt Engineering
I want to build agents Phase 14: Agent Engineering The Agent Loop
I want to use coding agents on real repositories Agent-Assisted Engineering path Agent-Assisted Engineering
I want to shape the right build before implementation Product Judgment and Delivery path Product Judgment and Delivery

Not sure where you fit? Use the start-learning placement tutor or the website prerequisites guide.

Compare four core domains and six career routes in the AI Engineering Learning Paths.

Focused MCP, Agent Skills, and Reverse Engineering paths
Your goal Learn on GitHub Learn on the website
I want to build with Model Context Protocol (MCP) Model Context Protocol (MCP) route Model Context Protocol (MCP) path
I want to write and ship Agent Skills Focused Agent Skills route Agent Skills path
I want to read compiled programs Reverse Engineering route Reverse Engineering path
Prerequisites and study time

Prerequisites

  • You can write code (any language; Python helps).
  • You want to understand how AI actually works, not just call APIs.

Where to start

Background Start at Estimated time
New to programming and AI Phase 0 — Setup ~306 hours
Know Python, new to ML Phase 1 — Math Foundations ~270 hours
Know ML, new to deep learning Phase 3 — Deep Learning Core ~200 hours
Know deep learning, want LLMs and agents Phase 10 — LLMs from Scratch ~100 hours
Senior engineer, only want agent engineering Phase 14 — Agent Engineering ~60 hours
Only want to build production MCP systems Model Context Protocol (MCP) path ~23 hours 15 min
Only want to build production Agent Skills Agent Skills Engineering path ~9.5 hours
Only want to learn reverse engineering Reverse Engineering path ~32.5 hours

The shape of the curriculum

Twenty phases stack on top of each other. Math is the floor. Agents and production are the roof. Skip ahead if you already know the lower layers, but don't skip and then wonder why something at the top is breaking.

%%{init: {'theme':'base','themeVariables':{'primaryColor':'#fafaf5','primaryTextColor':'#1a1a1a','primaryBorderColor':'#3553ff','lineColor':'#3553ff','fontFamily':'JetBrains Mono','fontSize':'12px'}}}%%
flowchart TB
  P0["Phase 0 — Setup &amp; Tooling"] --> P1["Phase 1 — Math Foundations"]
  P1 --> P2["Phase 2 — ML Fundamentals"]
  P2 --> P3["Phase 3 — Deep Learning Core"]
  P3 --> P4["Phase 4 — Vision"]
  P3 --> P5["Phase 5 — NLP"]
  P3 --> P6["Phase 6 — Speech &amp; Audio"]
  P3 --> P9["Phase 9 — RL"]
  P5 --> P7["Phase 7 — Transformers"]
  P7 --> P8["Phase 8 — GenAI"]
  P7 --> P10["Phase 10 — LLMs from Scratch"]
  P10 --> P11["Phase 11 — LLM Engineering"]
  P10 --> P12["Phase 12 — Multimodal"]
  P11 --> P13["Phase 13 — Tools &amp; Protocols"]
  P13 --> P14["Phase 14 — Agent Engineering"]
  P14 --> P15["Phase 15 — Autonomous Systems"]
  P15 --> P16["Phase 16 — Multi-Agent &amp; Swarms"]
  P14 --> P17["Phase 17 — Infrastructure &amp; Production"]
  P15 --> P18["Phase 18 — Ethics &amp; Alignment"]
  P16 --> P19["Phase 19 — Capstone Projects"]
  P17 --> P19
  P18 --> P19
  classDef phase fill:#fafaf5,stroke:#3553ff,color:#1a1a1a
  class P0,P1,P2,P3,P4,P5,P6,P7,P8,P9,P10,P11,P12,P13,P14,P15,P16,P17,P18,P19 phase
Loading

Contents

Twenty phases. Click any phase to expand its lesson list.

Phase 0: Setup & Tooling 13 lessons

Get your environment ready for everything that follows.

# Lesson Type Lang
01 Dev Environment Build Python, TypeScript, Rust
02 Git & Collaboration Learn —
03 GPU Setup & Cloud Build Python
04 APIs & Keys Build Python, TypeScript
05 Jupyter Notebooks Build Python
06 Python Environments Build Shell
07 Docker for AI Build Docker
08 Editor Setup Build —
09 Data Management Build Python
10 Terminal & Shell Learn —
11 Linux for AI Learn —
12 Debugging & Profiling Build Python
13 Python for AI Engineering Build Python, TypeScript
Phase 1 — Math Foundations  22 lessons  The intuition behind every AI algorithm, through code.
# Lesson Type Lang
01 Linear Algebra Intuition Learn Python, Julia
02 Vectors, Matrices & Operations Build Python, Julia
03 Matrix Transformations & Eigenvalues Build Python, Julia
04 Calculus for ML: Derivatives & Gradients Learn Python, Julia
05 Chain Rule & Automatic Differentiation Build Python, Julia
06 Probability & Distributions Learn Python, Julia
07 Bayes' Theorem & Statistical Thinking Build Python, TypeScript
08 Optimization: Gradient Descent Family Build Python, Julia
09 Information Theory: Entropy, KL Divergence Learn Python, TypeScript
10 Dimensionality Reduction: PCA, t-SNE, UMAP Build Python, TypeScript, Julia
11 Singular Value Decomposition Build Python, Julia
12 Tensor Operations Build Python, TypeScript
13 Numerical Stability Build Python, TypeScript, Julia
14 Norms & Distances Build Python, TypeScript
15 Statistics for ML Build Python, TypeScript
16 Sampling Methods Build Python, TypeScript, Julia
17 Linear Systems Build Python, TypeScript, Julia
18 Convex Optimization Build Python, TypeScript, Julia
19 Complex Numbers for AI Learn Python, TypeScript
20 The Fourier Transform Build Python, TypeScript, Julia
21 Graph Theory for ML Build Python, TypeScript
22 Stochastic Processes Learn Python, Julia
Phase 2 — ML Fundamentals  21 lessons  Classical ML — still the backbone of most production AI.
# Lesson Type Lang
01 What Is Machine Learning Learn Python
02 Linear Regression from Scratch Build Python, Rust, Julia
03 Logistic Regression & Classification Build Python, Rust, Julia
04 Decision Trees & Random Forests Build Python, TypeScript
05 Support Vector Machines Build Python, Julia
06 KNN & Distance Metrics Build Python, TypeScript
07 Unsupervised Learning: K-Means, DBSCAN Build Python, TypeScript
08 Feature Engineering & Selection Build Python, TypeScript
09 Model Evaluation: Metrics, Cross-Validation Build Python, Julia
10 Bias, Variance & the Learning Curve Learn Python
11 Ensemble Methods: Boosting, Bagging, Stacking Build Python
12 Hyperparameter Tuning Build Python
13 ML Pipelines & Experiment Tracking Build Python
14 Naive Bayes Build Python
15 Time Series Fundamentals Build Python
16 Anomaly Detection Build Python
17 Handling Imbalanced Data Build Python
18 Feature Selection Build Python
19 ML System Design — From Problem to Deployed Model Build Python, TypeScript
20 Monitoring Models in Production — Data Drift and Concept Drift Build Python, TypeScript
21 Feature Stores and Training-Serving Skew Build Python, TypeScript
Phase 3 — Deep Learning Core  13 lessons  Neural networks from first principles. No frameworks until you build one.
# Lesson Type Lang
01 The Perceptron: Where It All Started Build Python, TypeScript, Rust, Julia
02 Multi-Layer Networks & Forward Pass Build Python, TypeScript, Julia
03 Backpropagation from Scratch Build Python, TypeScript, Rust, Julia
04 Activation Functions: ReLU, Sigmoid, GELU & Why Build Python, TypeScript, Julia
05 Loss Functions: MSE, Cross-Entropy, Contrastive Build Python, TypeScript, Julia
06 Optimizers: SGD, Momentum, Adam, AdamW Build Python, TypeScript, Julia
07 Regularization: Dropout, Weight Decay, BatchNorm Build Python, TypeScript, Julia
08 Weight Initialization & Training Stability Build Python, TypeScript, Julia
09 Learning Rate Schedules & Warmup Build Python, TypeScript, Julia
10 Build Your Own Mini Framework Build Python, TypeScript, Julia
11 Introduction to PyTorch Build Python
12 Introduction to JAX Build Python
13 Debugging Neural Networks Build Python
Phase 4 — Computer Vision  28 lessons  From pixels to understanding — image, video, 3D, VLMs, and world models.
# Lesson Type Lang
01 Image Fundamentals: Pixels, Channels, Color Spaces Learn Python, Julia
02 Convolutions from Scratch Build Python, Julia
03 CNNs: LeNet to ResNet Build Python
04 Image Classification Build Python
05 Transfer Learning & Fine-Tuning Build Python
06 Object Detection — YOLO from Scratch Build Python
07 Semantic Segmentation — U-Net Build Python
08 Instance Segmentation — Mask R-CNN Build Python
09 Image Generation — GANs Build Python
10 Image Generation — Diffusion Models Build Python
11 Stable Diffusion — Architecture & Fine-Tuning Build Python
12 Video Understanding — Temporal Modeling Build Python
13 3D Vision: Point Clouds, NeRFs Build Python
14 Vision Transformers (ViT) Build Python
15 Real-Time Vision: Edge Deployment Build Python, Rust
16 Build a Complete Vision Pipeline Build Python
17 Self-Supervised Vision — SimCLR, DINO, MAE Build Python
18 Open-Vocabulary Vision — CLIP Build Python
19 OCR & Document Understanding Build Python
20 Image Retrieval & Metric Learning Build Python
21 Keypoint Detection & Pose Estimation Build Python
22 3D Gaussian Splatting from Scratch Build Python
23 Diffusion Transformers & Rectified Flow Build Python
24 SAM 3 & Open-Vocabulary Segmentation Build Python
25 Vision-Language Models (ViT-MLP-LLM) Build Python
26 Monocular Depth & Geometry Estimation Build Python
27 Multi-Object Tracking & Video Memory Build Python, Rust
28 World Models & Video Diffusion Build Python
Phase 5 — NLP: Foundations to Advanced  29 lessons  Language is the interface to intelligence.
# Lesson Type Lang
01 Text Processing: Tokenization, Stemming, Lemmatization Build Python, TypeScript
02 Bag of Words, TF-IDF & Text Representation Build Python, TypeScript
03 Word Embeddings: Word2Vec from Scratch Build Python, Julia
04 GloVe, FastText & Subword Embeddings Build Python, TypeScript
05 Sentiment Analysis Build Python, TypeScript
06 Named Entity Recognition (NER) Build Python, TypeScript
07 POS Tagging & Syntactic Parsing Build Python, TypeScript
08 Text Classification — CNNs & RNNs for Text Build Python, TypeScript
09 Sequence-to-Sequence Models Build Python, TypeScript
10 Attention Mechanism — The Breakthrough Build Python, TypeScript
11 Machine Translation Build Python, TypeScript
12 Text Summarization Build Python, TypeScript
13 Question Answering Systems Build Python, TypeScript
14 Information Retrieval & Search Build Python, TypeScript, Rust
15 Topic Modeling: LDA, BERTopic Build Python, TypeScript, Julia
16 Text Generation Build Python, TypeScript
17 Chatbots: Rule-Based to Neural Build Python, TypeScript
18 Multilingual NLP Build Python, TypeScript
19 Subword Tokenization: BPE, WordPiece, Unigram, SentencePiece Learn Python, TypeScript, Rust
20 Structured Outputs & Constrained Decoding Build Python, TypeScript, Rust
21 NLI & Textual Entailment Learn Python, TypeScript
22 Embedding Models Deep Dive Learn Python, TypeScript
23 Chunking Strategies for RAG Build Python, TypeScript
24 Coreference Resolution Learn Python, TypeScript
25 Entity Linking & Disambiguation Build Python, TypeScript
26 Relation Extraction & Knowledge Graph Construction Build Python, TypeScript
27 LLM Evaluation: RAGAS, DeepEval, G-Eval Build Python, TypeScript
28 Long-Context Evaluation: NIAH, RULER, LongBench, MRCR Learn Python, TypeScript
29 Dialogue State Tracking Build Python, TypeScript
Phase 6 — Speech & Audio  17 lessons  Hear, understand, speak.
# Lesson Type Lang
01 Audio Fundamentals: Waveforms, Sampling, FFT Learn Python, TypeScript, Julia
02 Spectrograms, Mel Scale & Audio Features Build Python, TypeScript, Julia
03 Audio Classification Build Python, TypeScript
04 Speech Recognition (ASR) Build Python, TypeScript
05 Whisper: Architecture & Fine-Tuning Build Python, TypeScript
06 Speaker Recognition & Verification Build Python, TypeScript
07 Text-to-Speech (TTS) Build Python, TypeScript
08 Voice Cloning & Voice Conversion Build Python, TypeScript
09 Music Generation Build Python, TypeScript
10 Audio-Language Models Build Python, TypeScript
11 Real-Time Audio Processing Build Python, Rust
12 Build a Voice Assistant Pipeline Build Python, TypeScript
13 Neural Audio Codecs — EnCodec, SNAC, Mimi, DAC Learn Python, TypeScript
14 Voice Activity Detection & Turn-Taking Build Python, TypeScript, Rust
15 Streaming Speech-to-Speech — Moshi, Hibiki Learn Python, TypeScript
16 Voice Anti-Spoofing & Audio Watermarking Build Python, TypeScript
17 Audio Evaluation — WER, MOS, MMAU, Leaderboards Learn Python, TypeScript
Phase 7 — Transformers Deep Dive  16 lessons  The architecture that changed everything.
(README truncated)

View on GitHub

Recent activity

commits and pull requests

Releases and announcements

11 total
  1. Edition 2026.11.2: Lessons in Five Languagesv2026.11.2Nov 9, 20261K downloads

    Read each lesson in the language you use at work. This edition adds TypeScript ports to most lessons, and Rust, Julia and Go ports to the lessons where each of those languages is the right tool. [Start learning](https://aiengineeringfromscratch.com) · [Catalog](https://aiengineeringfromscratch.com/catalog.html) · [Interviews](https://aiengineeringfromscratch.com/interviews) ## Lessons in five languages | Language | Lessons | Where | |---|---|---| | Python | 534 | Every lesson with code | | TypeScript | 397 | Most lessons, from math foundations to the capstones | | Rust | 46 | Tokenizers, retrieval, constrained decoding, serving schedulers, KV cache, binary analysis | | Julia | 45 | Numerical math, statistics, signal processing, small networks | | Go | 16 | MCP and A2A servers, gateways, auth, worker pools, durable execution, telemetry | - Every port uses only the standard library of its language and keeps the functions and demos of the Python file. - A lesson gets a Rust, Julia or Go port only when a practitioner would pick that language for the problem. Reinforcement learning, classical ML and torch-based lessons stay in Python. - The language chips on each lesson page and the

  2. Practise for AI engineering interviews against the course itself. This edition adds an interview bank of 482 questions and 60 measured incident scenarios, a mock interview skill, and code blocks rendered at build time. [Interviews](https://aiengineeringfromscratch.com/interviews) · [Scenarios](https://aiengineeringfromscratch.com/interviews/scenarios) · [Skills](https://aiengineeringfromscratch.com/skills.html) · [Start learning](https://aiengineeringfromscratch.com) ![Browsing the interview bank](https://github.com/rohitg00/ai-engineering-from-scratch/releases/download/v2026.11.1/interview-bank.gif) ## Interview bank - **482 questions in 23 cards**, from math and classical ML to inference serving, agents, protocols, sandboxes and system design. - Each question shows the prompt first and folds the answer, so you answer before you read. A short answer, a full answer, follow-ups from L1 to L4, and the wrong answers that interviewers hear. - Every answer links to the lesson or manual section that teaches it. Every number in an answer comes from a file in the repository. - **7 role paths** pick the cards for a role, such as inference engineer or applied AI engineer. ## Incident sc

  3. Learn beside your terminal, read two new hardware manuals, and practise every lesson. This edition adds the lesson screen for agent tutors, vLLM 101 and Miles 101, 47 practice tasks, and two new inside-the-machine pages. [Start learning](https://aiengineeringfromscratch.com) · [Skills](https://aiengineeringfromscratch.com/skills.html) · [Manuals](https://aiengineeringfromscratch.com/manuals.html) · [Practice](https://aiengineeringfromscratch.com/practice) ## Lesson screen for agent tutors The new `lesson-screen` skill opens a browser tab next to the terminal while a tutor teaches. - It shows the lesson's own interactive figures, code traces with values from a real run, and clickable predictions. - The tutor can build a figure for the lesson while it teaches: a blueprint, a mechanism, an isometric machine, or a 3D model. It checks each build with screenshots before it shows it. - After the tutor's quiz, a practice page gives a brief with key-term cards, a timed drill, spaced review at 1, 3, 7, and 16 days, and links to go deeper. - Clicks are hints for the tutor. They never count as quiz answers or evidence. The certification tutors use the screen in Lesson mode only. All six l

  4. Highlight what matters, keep notes beside the text, and carry a compact reference into your next build. This edition adds a reading workspace, 154 cheat sheets, and the ready edition of SGLang 101. [Start learning](https://aiengineeringfromscratch.com) · [Cheat sheets](https://aiengineeringfromscratch.com/cheatsheets) · [SGLang 101](https://aiengineeringfromscratch.com/manual-sglang-101.html) ## Highlights and notes Select text in a lesson or manual, choose one of four colors, and add a note. Open My Highlights to search, filter, jump back to a passage, or manage several highlights together. - Export Markdown for your notes or JSON for backup and import. - Move highlights between devices with a sync file or share link. - Review uncertain matches when a passage changes. - Use the same tools on mobile, in light and dark themes, and with forced colors. Highlights stay in your browser. Use an export or share link to move them elsewhere. ![Highlight colors and notes in a lesson](https://github.com/rohitg00/ai-engineering-from-scratch/releases/download/v2026.10.4/highlights-dark.png) <details> <summary>Light theme, mobile, and accessibility screenshots</summary> ![Adding a note i

  5. Edition 2026.10.3v2026.10.3Oct 15, 20261.9K downloads

    Edition 2026.10.3 adds a reverse engineering track, a third manual, and LaTeX math in the lessons. The curriculum grows from 523 to **542 lessons across 20 phases**. ## Learn reverse engineering Fourteen new Phase 13 lessons teach how to read a compiled program you built yourself, from file bytes to evidence-backed pseudocode (#597). - The lessons cover program anatomy (ELF, Mach-O, PE), disassembly and control-flow graphs, lifting to IR and SSA, calling conventions on System V, Windows x64 and AArch64, compiler idioms, linking and stripped binaries, data and type recovery, dynamic analysis, bytecode formats (Python, JVM, .NET, WebAssembly), binary diffing and symbolic execution, and a ground-truth scorecard for AI-assisted analysis. - Each lesson runs real tools on its own fixtures: llvm-objdump, Ghidra, radare2, rizin, angr, lldb, LIEF, javap and wasm-objdump, among others. - Two graded projects: `binary-inspector` (6 stages, 91 tests) and `mini-decompiler` (8 stages, 105 tests), from an ELF loader to structured C that recompiles and compares equal. - A focused learning path and the `learn-reverse-engineering` tutor skill take a learner through the 14 lessons in order. ## Rea

Code frequency

additions and deletions
+418K-418KWeek of 2026-03-15: +51,890 linesWeek of 2026-03-15: -1,291 linesWeek of 2026-03-22: +11,988 linesWeek of 2026-03-22: -1,687 linesWeek of 2026-03-29: +54,909 linesWeek of 2026-03-29: -5,471 linesWeek of 2026-04-05: +1,021 linesWeek of 2026-04-05: -11 linesWeek of 2026-04-12: +1,493 linesWeek of 2026-04-12: -648 linesWeek of 2026-04-19: +417,971 linesWeek of 2026-04-19: -274,180 linesWeek of 2026-04-26: +148 linesWeek of 2026-04-26: -0 linesWeek of 2026-05-03: +3,903 linesWeek of 2026-05-03: -3,995 linesWeek of 2026-05-10: +6,652 linesWeek of 2026-05-10: -411 linesWeek of 2026-05-17: +41,869 linesWeek of 2026-05-17: -3,554 linesWeek of 2026-05-24: +86,199 linesWeek of 2026-05-24: -31,581 linesWeek of 2026-05-31: +1,197 linesWeek of 2026-05-31: -613 linesWeek of 2026-06-07: +8,695 linesWeek of 2026-06-07: -73 linesWeek of 2026-06-14: +201 linesWeek of 2026-06-14: -59 linesWeek of 2026-06-21: +7 linesWeek of 2026-06-21: -1 linesWeek of 2026-06-28: +0 linesWeek of 2026-06-28: -0 linesWeek of 2026-07-05: +0 linesWeek of 2026-07-05: -0 linesWeek of 2026-07-12: +0 linesWeek of 2026-07-12: -0 linesWeek of 2026-07-19: +1,882 linesWeek of 2026-07-19: -368 linesWeek of 2026-07-26: +24,997 linesWeek of 2026-07-26: -5,310 linesWeek of 2026-08-02: +19,346 linesWeek of 2026-08-02: -230 linesWeek of 2026-08-09: +54,510 linesWeek of 2026-08-09: -2,352 linesWeek of 2026-08-16: +48,623 linesWeek of 2026-08-16: -10,045 linesWeek of 2026-08-23: +51,785 linesWeek of 2026-08-23: -8,904 linesWeek of 2026-08-30: +14,734 linesWeek of 2026-08-30: -1,126 linesWeek of 2026-09-06: +1,054 linesWeek of 2026-09-06: -414 linesWeek of 2026-09-13: +0 linesWeek of 2026-09-13: -0 linesWeek of 2026-09-20: +41,679 linesWeek of 2026-09-20: -2,407 linesWeek of 2026-09-27: +86,495 linesWeek of 2026-09-27: -611 linesWeek of 2026-10-04: +258,334 linesWeek of 2026-10-04: -45,688 linesWeek of 2026-10-11: +257,335 linesWeek of 2026-10-11: -3,902 linesWeek of 2026-10-18: +278,742 linesWeek of 2026-10-18: -28,119 linesWeek of 2026-10-25: +7,871 linesWeek of 2026-10-25: -27 linesWeek of 2026-11-01: +55,836 linesWeek of 2026-11-01: -800 linesWeek of 2026-11-08: +180,535 linesWeek of 2026-11-08: -18,841 linesMar 15, 2026Nov 8, 2026
+2.1M lines added, -452.7K removed over the last year.

Commits per week

last 52 weeks
6650Week of 2025-11-16: 0 commitsWeek of 2025-11-23: 0 commitsWeek of 2025-11-30: 0 commitsWeek of 2025-12-07: 0 commitsWeek of 2025-12-14: 0 commitsWeek of 2025-12-21: 0 commitsWeek of 2025-12-28: 0 commitsWeek of 2026-01-04: 0 commitsWeek of 2026-01-11: 0 commitsWeek of 2026-01-18: 0 commitsWeek of 2026-01-25: 0 commitsWeek of 2026-02-01: 0 commitsWeek of 2026-02-08: 0 commitsWeek of 2026-02-15: 0 commitsWeek of 2026-02-22: 0 commitsWeek of 2026-03-01: 0 commitsWeek of 2026-03-08: 0 commitsWeek of 2026-03-15: 70 commitsWeek of 2026-03-22: 22 commitsWeek of 2026-03-29: 70 commitsWeek of 2026-04-05: 3 commitsWeek of 2026-04-12: 5 commitsWeek of 2026-04-19: 665 commitsWeek of 2026-04-26: 2 commitsWeek of 2026-05-03: 16 commitsWeek of 2026-05-10: 64 commitsWeek of 2026-05-17: 139 commitsWeek of 2026-05-24: 360 commitsWeek of 2026-05-31: 23 commitsWeek of 2026-06-07: 17 commitsWeek of 2026-06-14: 15 commitsWeek of 2026-06-21: 2 commitsWeek of 2026-06-28: 0 commitsWeek of 2026-07-05: 0 commitsWeek of 2026-07-12: 0 commitsWeek of 2026-07-19: 11 commitsWeek of 2026-07-26: 18 commitsWeek of 2026-08-02: 7 commitsWeek of 2026-08-09: 4 commitsWeek of 2026-08-16: 45 commitsWeek of 2026-08-23: 34 commitsWeek of 2026-08-30: 2 commitsWeek of 2026-09-06: 5 commitsWeek of 2026-09-13: 0 commitsWeek of 2026-09-20: 27 commitsWeek of 2026-09-27: 17 commitsWeek of 2026-10-04: 61 commitsWeek of 2026-10-11: 35 commitsWeek of 2026-10-18: 649 commitsWeek of 2026-10-25: 5 commitsWeek of 2026-11-01: 47 commitsWeek of 2026-11-08: 25 commitsNov 16, 2025Nov 8, 2026
2.5K commits in the last 52 weeks.

When work happens

weekday and hour
SunMonTueWedThuFriSat036912151821Sun 0:00 — 5 commitsSun 1:00 — 2 commitsSun 2:00 — 0 commitsSun 3:00 — 1 commitsSun 4:00 — 5 commitsSun 5:00 — 4 commitsSun 6:00 — 0 commitsSun 7:00 — 1 commitsSun 8:00 — 2 commitsSun 9:00 — 2 commitsSun 10:00 — 5 commitsSun 11:00 — 13 commitsSun 12:00 — 10 commitsSun 13:00 — 23 commitsSun 14:00 — 4 commitsSun 15:00 — 9 commitsSun 16:00 — 4 commitsSun 17:00 — 8 commitsSun 18:00 — 36 commitsSun 19:00 — 6 commitsSun 20:00 — 0 commitsSun 21:00 — 5 commitsSun 22:00 — 1 commitsSun 23:00 — 5 commitsMon 0:00 — 1 commitsMon 1:00 — 0 commitsMon 2:00 — 0 commitsMon 3:00 — 0 commitsMon 4:00 — 1 commitsMon 5:00 — 0 commitsMon 6:00 — 3 commitsMon 7:00 — 3 commitsMon 8:00 — 3 commitsMon 9:00 — 4 commitsMon 10:00 — 1 commitsMon 11:00 — 10 commitsMon 12:00 — 2 commitsMon 13:00 — 13 commitsMon 14:00 — 5 commitsMon 15:00 — 2 commitsMon 16:00 — 5 commitsMon 17:00 — 15 commitsMon 18:00 — 2 commitsMon 19:00 — 0 commitsMon 20:00 — 81 commitsMon 21:00 — 1 commitsMon 22:00 — 0 commitsMon 23:00 — 4 commitsTue 0:00 — 13 commitsTue 1:00 — 0 commitsTue 2:00 — 0 commitsTue 3:00 — 0 commitsTue 4:00 — 0 commitsTue 5:00 — 2 commitsTue 6:00 — 1 commitsTue 7:00 — 0 commitsTue 8:00 — 0 commitsTue 9:00 — 4 commitsTue 10:00 — 10 commitsTue 11:00 — 19 commitsTue 12:00 — 20 commitsTue 13:00 — 20 commitsTue 14:00 — 28 commitsTue 15:00 — 10 commitsTue 16:00 — 13 commitsTue 17:00 — 15 commitsTue 18:00 — 50 commitsTue 19:00 — 118 commitsTue 20:00 — 59 commitsTue 21:00 — 37 commitsTue 22:00 — 7 commitsTue 23:00 — 22 commitsWed 0:00 — 22 commitsWed 1:00 — 2 commitsWed 2:00 — 0 commitsWed 3:00 — 0 commitsWed 4:00 — 0 commitsWed 5:00 — 0 commitsWed 6:00 — 3 commitsWed 7:00 — 0 commitsWed 8:00 — 0 commitsWed 9:00 — 5 commitsWed 10:00 — 14 commitsWed 11:00 — 19 commitsWed 12:00 — 27 commitsWed 13:00 — 83 commitsWed 14:00 — 33 commitsWed 15:00 — 19 commitsWed 16:00 — 9 commitsWed 17:00 — 21 commitsWed 18:00 — 42 commitsWed 19:00 — 18 commitsWed 20:00 — 16 commitsWed 21:00 — 38 commitsWed 22:00 — 2 commitsWed 23:00 — 32 commitsThu 0:00 — 150 commitsThu 1:00 — 3 commitsThu 2:00 — 0 commitsThu 3:00 — 1 commitsThu 4:00 — 2 commitsThu 5:00 — 3 commitsThu 6:00 — 3 commitsThu 7:00 — 2 commitsThu 8:00 — 4 commitsThu 9:00 — 5 commitsThu 10:00 — 34 commitsThu 11:00 — 10 commitsThu 12:00 — 26 commitsThu 13:00 — 26 commitsThu 14:00 — 2 commitsThu 15:00 — 22 commitsThu 16:00 — 24 commitsThu 17:00 — 42 commitsThu 18:00 — 80 commitsThu 19:00 — 21 commitsThu 20:00 — 21 commitsThu 21:00 — 55 commitsThu 22:00 — 47 commitsThu 23:00 — 33 commitsFri 0:00 — 0 commitsFri 1:00 — 95 commitsFri 2:00 — 28 commitsFri 3:00 — 9 commitsFri 4:00 — 1 commitsFri 5:00 — 7 commitsFri 6:00 — 1 commitsFri 7:00 — 11 commitsFri 8:00 — 0 commitsFri 9:00 — 16 commitsFri 10:00 — 6 commitsFri 11:00 — 17 commitsFri 12:00 — 155 commitsFri 13:00 — 11 commitsFri 14:00 — 5 commitsFri 15:00 — 29 commitsFri 16:00 — 2 commitsFri 17:00 — 7 commitsFri 18:00 — 9 commitsFri 19:00 — 9 commitsFri 20:00 — 7 commitsFri 21:00 — 61 commitsFri 22:00 — 81 commitsFri 23:00 — 0 commitsSat 0:00 — 2 commitsSat 1:00 — 16 commitsSat 2:00 — 8 commitsSat 3:00 — 0 commitsSat 4:00 — 11 commitsSat 5:00 — 3 commitsSat 6:00 — 0 commitsSat 7:00 — 0 commitsSat 8:00 — 1 commitsSat 9:00 — 4 commitsSat 10:00 — 6 commitsSat 11:00 — 4 commitsSat 12:00 — 12 commitsSat 13:00 — 5 commitsSat 14:00 — 10 commitsSat 15:00 — 8 commitsSat 16:00 — 10 commitsSat 17:00 — 1 commitsSat 18:00 — 4 commitsSat 19:00 — 1 commitsSat 20:00 — 4 commitsSat 21:00 — 8 commitsSat 22:00 — 1 commitsSat 23:00 — 4 commits
Commit volume by weekday and hour (UTC). Larger dots mean more commits.

Who is committing

last 52 weeks
Maintainer commits2,399 (89%)
Community commits298 (11%)

2,697 commits in total over the last year.

# Lesson Type Lang
01 Why Transformers: The Problems with RNNs Learn Python, Julia
02 Self-Attention from Scratch Build Python, Rust, Julia
03 Multi-Head Attention Build Python, Rust
04 Positional Encoding: Sinusoidal, RoPE, ALiBi Build Python, Rust, Julia
05 The Full Transformer: Encoder + Decoder
DateListRankStars gained
Jul 27, 2026daily#22+3
Jul 23, 2026daily#18+4
Jul 21, 2026daily#15+4
Jul 20, 2026daily#7+4
Jun 16, 2026daily#22+14
Jun 6, 2026daily#22+52
Jun 1, 2026daily#12+46
May 30, 2026daily#20+65
May 29, 2026daily#23+36
May 28, 2026daily#9+74
May 27, 2026daily#6+110
May 26, 2026daily#3+146
May 25, 2026daily#4+220
May 24, 2026daily#4+310
May 23, 2026daily#5+274
  • public-apis/public-apis

    A collective list of free APIs

    500.5K stars · Python

  • morluto/rea

    Reverse engineer anything with agents, from app behavior down to native binaries.

    471.6K stars · TypeScript

  • openclaw/openclaw

    The AI that really does things. Any OS. Any Platform. The lobster way. 🦞

    394.9K stars · TypeScript

  • donnemartin/system-design-primer

    Learn how to design large-scale systems. Prep for the system design interview. Includes Anki flashcards.

    378.7K stars · Python

  • obra/superpowers

    An agentic skills framework & software development methodology that works.

    322.9K stars · Shell

  • affaan-m/ECC

    The agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Codex, Opencode, Cursor and beyond.

    307.9K stars · JavaScript