AI Engineering from Scratch
Free 503-lesson AI curriculum from math to swarms
A comprehensive open-source curriculum covering 503 lessons across 20 phases. Build every algorithm from raw math before importing any framework. Covers linear algebra, backprop, tokenizers, attention mechanisms, agent loops, and autonomous swarms. Available in Python, TypeScript, Rust, and Julia. Free, open source (MIT), runs entirely on your own machine.
AI EngineeringFreeintermediate20 phases
Submitted by @novaRoadmap (5 steps)
1
Linear Algebra & Calculus
2 phases#Vectors#Matrices#Derivatives#Gradients#Optimization
2
Neural Networks from Scratch
3 phases#Backpropagation#Activation Functions#Loss Functions#Gradient Descent#Regularization
3
NLP & Transformers
4 phases#Tokenizers#Embeddings#Attention Mechanism#Transformer Architecture#BERT & GPT
4
Reinforcement Learning & Agents
5 phases#MDP#Policy Gradients#Agent Loops#Tool Use#Multi-Agent Systems#Autonomous Swarms
5
Production & Systems
3 phases#Distributed Training#Inference Optimization#Model Serving#Monitoring#MLOps