SO-101 zero to hero GitHub ENTR

4 · Record

Goal: 120 demonstrations: you move the leader, the follower does the task, LeRobot stores both camera streams, the joint angles and your commands 30 times a second, with the task sentence attached.

The plan: 12 blocks of 10

One block = one sentence, e.g. "put the part from pocket 3 in the OK bin". Six pockets × two bins = 12 sentences, 10 episodes each. About 8 minutes per block, under two hours in total.

scripts/record.sh 1 ok          # 10 episodes, pocket 1 -> OK bin
scripts/status.sh               # what is done, and the next command to run
scripts/record.sh 1 reject      # ...

Every block is appended to the same dataset in outputs/datasets/so101-qc and pushed to your Hugging Face account (private) when the block ends, so a crash costs at most one block.

One block, step by step

  1. Put a part in the block's pocket. Arm at the start pose (gripper open, hovering between the base and the tray).
  2. Run the command. A voice says "Recording episode N": recording has started.
  3. Pick the part, drop it in the block's bin, return to the start pose.
  4. Press →. The episode ends; the voice says "Reset the environment".
  5. Nothing is recorded now. Put the next part in the pocket, hand back on the leader, arm at the start pose.
  6. Press → to start the next episode (or wait 15 s, it starts by itself). The previous one is written to disk now.
Key Does
→ End this phase now (episode done / reset done)
← Throw this episode away and record it again
Esc Stop now, save and upload. It keeps whatever was recorded so far, so press it during a reset, not mid-pick

Fumbled the grasp, bumped the tray, forgot to return? Press ←, also if you only notice during the reset. Never keep an episode "because it mostly worked".

Inside a block, change everything except the sentence

Why this matters, and the rest of the rules: data quality.

If something goes wrong

Symptom Fix
TimeoutError on a camera Wrong index (an iPhone nearby shifts them): uv run lerobot-find-cameras opencv, fix scripts/env.sh
"no status packet" from a servo Follower's 12 V supply, or a loose servo cable
Arrow keys do nothing Give the terminal Accessibility permission in macOS settings, or keep the terminal focused
Dataset refuses to resume The last run died mid-write. Delete the folder (rm -rf outputs/datasets/so101-qc) and re-download the last pushed copy: hf download fport/so101-qc --repo-type dataset --local-dir outputs/datasets/so101-qc