OpenAI, the artificial intelligence research firm founded by Elon Musk and Sam Altman, is teaching robots how to do tasks using VR.

The company showed off a new system where a human puts on an HTC Vive headset and acts out the task they want the robot to perform, using position-tracked controls. The robot records the data and imitates the process in real life. The robot has a camera with which it can see the environment.

Two neural networks work together to get the arm to move in correlation to what the robot is seeing.