Robot demonstrations may contain useful behavior even when individual episodes are inefficient or unsuccessful.
Trajectory stitching offers a way to compose these behaviors into improved training data, but identifying useful connections and verifying their feasibility is difficult in high-dimensional robot data, where many prior methods rely on low-dimensional state representations.
We introduce NEEDLE
We introduce NEEDLE, an offline dataset-augmentation algorithm that addresses these challenges by adding short, verified action bridges between recorded observations in high-dimensional robot demonstrations.
First, NEEDLE identifies and creates connections that bypass suboptimal detours, broaden action coverage, and augment the original dataset with failed trajectories, using only RGB images, proprioception, and episode-level outcomes, without new environment interaction or privileged object state.
Sampling Technique
Next, we present a sampling technique that incorporates accepted bridges into policy training without synthesizing intermediate images or discarding the original demonstrations, allowing policies to learn alternative actions while retaining the original dataset's coverage.
Real-Robot Tasks
On real-robot tasks, NEEDLE improves success rate over the strongest baseline on each task by an average of 21 percentage points.
Videos and supplementary materials are on https://needle-work.github.io/.