Robotics & Embodied AI
Teach robots with data: robot learning basics, imitation learning, ACT, diffusion policies, vision-language-action models, and sim-to-real.
Before this: Reinforcement Learning. Deep Learning. Hardware: step 9 wants a recent NVIDIA GPU or a cloud GPU; step 10 needs a physical SO-101 arm, so treat it as optional and use the ACT and Diffusion Policy steps with LeRobot simulation datasets instead.
-
1h 05m
Step 1Introduction to robot learning
What makes learning for robots different from other ML.
Robot Learning 2026 – Lecture 1: Introduction to Robot Learning | ETH ZürichOier Mees
-
51 min
Step 2Imitation learning
Behavior cloning, its failure modes, and common fixes.
Robot Learning 2026 – Lecture 3: Imitation Learning | ETH ZürichOier Mees
-
56 min
Step 3ALOHA and Action Chunking Transformers
Predict chunks of actions for smooth, precise manipulation.
ALOHA and ACT: LeRobot Research Presentation #1 by Alexander SoareHugging Face
huggingface/lerobot★ 29k -
13 min
Step 4Diffusion policy
Generate robot actions with diffusion models.
Why Diffusion Policy Is Changing Robot LearningRobraintics
-
35 min
Step 5Vision-language-action models
How LLM-style models become robot controllers.
LLMs Meet Robotics: What Are Vision-Language-Action Models? (VLA Series Ep.1)Ilia
-
8 min
Step 6VLA models compared
OpenVLA, pi0, and RT-2 side by side.
Vision Language Action Models - OpenVLA, π0, RT-2, Gemini RoboticsArchitecture Bytes - AI
openvla/openvla★ 7.3k -
1h 16m
Step 7Pi0: a generalist robot policy
A flow-matching VLA trained across many robots.
Pi0 - generalist Vision Language Action policy for robots (VLA Series Ep.2)Ilia
Physical-Intelligence/openpi★ 14.7k -
1h 01m
Step 8Robot foundation models
Sergey Levine on where generalist robot models are headed.
Sergey Levine (UC Berkeley): Robot Foundation ModelsEMBER Center @ UC Berkeley
-
9 min
Step 9Reinforcement learning for robots in simulation
Train locomotion policies in Isaac Lab.
Reinforcement Learning For Robots in Python: Isaac Lab TutorialNeuralNine
isaac-sim/IsaacLab★ 8.7k -
1h 15m
Step 10Optional: train a real robot arm with LeRobot
Hardware-dependent: collect demos and train a policy on a low-cost arm.
How to Train an AI Robotic Arm With No Code (Hugging Face LeRobot + SO-101)Brogan M. Pratt
huggingface/lerobot★ 29k
Build it
Watching isn't learning. Pick one and put it on GitHub.
- Train an ACT or diffusion policy in LeRobot on a public dataset and report success rate in simulation.
- Write behavior cloning for a simulated task and show where it drifts, then add DAgger-style corrections.
- Train a quadruped to walk in Isaac Lab and compare two reward designs.