How Robots Learn New Tasks by Combining Simple Skills

Peter Bubenik · Stanford AI Lab · · Source

Step-by-Step Study Material

Step 1: The Problem — Teaching Robots New Tasks Efficiently

Industrial robots are precise but usually need detailed programming for each motion. Teaching a robot to pack many item/container combinations by writing a separate policy for every combination quickly becomes impractical.

Example: 5 item types × 5 containers can create a large space of combinations, each potentially needing its own policy.

Step 2: One-Shot Imitation Learning

One-shot imitation learning means the robot learns a new task from a single demonstration. Instead of thousands of trials or hand-coded motion scripts, a human shows the task once and the system generalizes.

Step 3: Compositionality as the Key Idea

Complex jobs can be decomposed into reusable skills:

  • picking an object
  • moving it safely
  • placing it into a container

If those skills compose, the robot can remix them for new object/container pairs without learning every combination from scratch.

Step 4: Why This Matters

Compositional one-shot learning makes robots more adaptable in warehouses, homes, and other open-ended settings where object variety is high and exhaustive programming is unrealistic.

Takeaway: Reusable subskills plus a single demonstration can unlock many new task combinations.

More to study