AlphaNIST

From AlphaGo to AlphaZero, reinforcement learning produced strategies that surprised expert players. AlphaZero learned from experience at scale, without human demonstrations.

AlphaNIST brings this philosophy to contact-rich, high-precision robotic assembly in simulation. An end-to-end policy learns how to complete the task, without prescribed manipulation stages.

Paper

Code Release soon

Narrated overview · 4:36

Play2:41

Ten-component assembly.

Close-up

Four successful ten-part runs, using a policy trained separately from the single-component policy below.

Use the video controls to watch the film. View the episode timeline.

NIST Assembly Task Board #1, shown fully assembled.

The NIST board has twenty assembly tasks, with parts as small as 4 mm. Fitting one part can take several changes of grasp and orientation. Tight clearances leave little room for error: a tilted nut can jam or cross-thread.

With several parts, the robot also has to choose an order. An installed component may block the gripper’s next move.

Trying to prescribe every maneuver means anticipating how the robot should respond as contacts and obstructions change. A two-finger gripper may also need solutions quite different from those that come naturally to a human hand.

Perhaps the answer is to stop telling the robot how we think the task should be done, and let it learn how to get there. We give it a binary task reward for success and train it through vast amounts of diverse experience. That leaves room for the robot to discover solutions we might never have thought to teach.

One policy trains across twenty heterogeneous assemblies, starting from loose parts, in-hand grasps, and partial assemblies cached in simulation.

Near-complete starts let the robot practice finishing an assembly before it can solve the whole task. The cache supplies starting states, not demonstrations.

Play0:34

Examples of diverse training starting states

Success-guided sampling

Beta sampling favors starting states the policy solves about half the time, while giving every state a chance. Progress on one state can make another solvable; its sampling weight then changes with new outcomes.

Starting states receive different amounts of practice as the policy learns. SGS project ↗

Single-component assembly experiment

Your browser does not support embedded video. Download the film.

Play1:43

One policy performs all twenty assembly tasks, with one component to assemble in each run.

Gears Nuts Rods Pegs Connectors

Use the video controls to watch the complete film.

With binary task rewards, one policy trained across all twenty tasks reaches higher training success than twenty separate specialists. Adding rewards for reaching and alignment reduces success in this experiment.

Swipe or scroll horizontally to view the full figure.Training success across varied starting states.

Emergent assembly behavior

The gripper puts down the 8 mm peg and picks it up near one end, leaving more of the peg exposed for insertion.

The gripper uses contact with the board to turn the waterproof connector before inserting it.

The D-sub connector is set down and regrasped to align it with its socket.

Held from the side, the medium gear pivots into a horizontal pose above its mounting post.

The gripper rolls the M12 nut from its edge onto a flat face before placing it on the bolt.

One-sided fingertip taps turn the M4 nut along the bolt.

A fingertip pushes the 8 mm rod across the surface before the gripper picks it up.

The gripper moves around the M16 nut, using fingertip contact to turn it along the bolt.

←

@misc{zhang2026alphanistemergentassemblyskills, title={AlphaNIST: Emergent Assembly Skills from Binary Task Rewards}, author={Octi Zhang and Iretiayo Akinola and Rosario Scalise and Mateo Guaman Castro and Patrick Yin and Tobias Widmer and Miles Macklin and Chris Amevor and Dylan Turpin and Dirk Van Gelder and Jan Carius and Ankur Handa and Gavriel State and Yunrong Guo and Yashraj Narang}, year={2026}, eprint={2610.13354}, archivePrefix={arXiv}, primaryClass={cs.AI}, url={https://arxiv.org/abs/2610.13354}, }