Nvidia's model GR00T 2 watches humans on video, then imagines itself as the robot

Nvidia's GR00T 2 is a "world-action model" that predicts both the next movement and a short video of the near future, letting it transfer human movement sequences from video to different robot form factors instead of relying on teleoperation. Trained on over a thousand GB300 chips with about 400,000 hours of head-mounted-camera footage, it learned tasks such as lighting a match or slicing a banana from human demonstrations, with success rates between 10 and 80 percent, and a higher-level language model raised toy-car assembly success to at least 97 percent. Nvidia notes hurdles including no direct touch sensor data, missed subtle errors, and idle time of roughly a third during trash sorting while waiting on the planning model.