NVIDIA at CoRL 2024: Isaac Lab generally available, six Project GR00T workflows and the Cosmos tokenizer
In one sentence On November 6, 2024, at the Conference on Robot Learning in Munich, NVIDIA makes Isaac Lab generally available, announces six Project GR00T workflows for humanoid robots (coming soon) and open-sources the Cosmos tokenizer for images and video.
Project GR00T is NVIDIA's initiative to develop libraries, models and data pipelines for humanoid robots. At the CoRL conference in Munich in November 2024, NVIDIA presented a set of tools for people who train robots.
The main piece is Isaac Lab, the open-source framework for training robots in simulation built on Omniverse, which becomes generally available. Alongside it come six GR00T "workflows", reference blueprints for capabilities such as dexterous manipulation, whole-body control and locomotion, announced as coming soon.
NVIDIA also releases the Cosmos tokenizer, which turns images and video into compact tokens useful for training models, and announces a collaboration with Hugging Face on the open-source LeRobot project.
Companies
NVIDIA, Hugging Face
Tools
Isaac Lab, Project GR00T, Cosmos Tokenizer, NeMo Curator, LeRobot
Tags
Sources