Boston Dynamics and the Robotics & AI Institute (formerly The AI Institute) have formed a partnership to advance humanoid robots through reinforcement learning.
Together, the two organizations will establish a shared reinforcement learning training pipeline for the new electric Atlas robot to build dynamic and generalizable mobile manipulation behavior.
The work, which kicked off this month, brings together two of the industry’s leading research teams to advance robot technology and to produce new capabilities on Atlas.
The partnership expands upon previous collaborations between Boston Dynamics and the Robotics & AI Institute (RAI Institute), including joint development work on Spot’s Reinforcement Learning Researcher Kit.
Released last year, the kit trains unique behavior and modes of locomotion on the quadruped, and was used to achieve record running speeds of 11.5 mph (5.2 m/s).
This collaboration builds upon that work, with a new focus on humanoid robots. The project has several objectives:
- Develop sim-to-real for mobility: Despite advances in fast parallel simulators and sophisticated policy optimization techniques, transferring simulation results to real robotic hardware remains one of the most challenging aspects of applying reinforcement learning in robotics. To bridge the sim-to-reality gap, the teams will collaborate to train policies that generate a variety of agile behavior on physical hardware to achieve novel, robust and practical locomotion behavior.
- Improve whole body loco-manipulation: A robot’s capability to manipulate objects and fixtures, such as doors and levers, in conjunction with locomotion would significantly enhance its utility. The team will explore developing new policies to improve robustness in these scenarios.
- Explore full-body contact strategies: This work will explore high-performance, whole-body locomotion and tasks that require full-body contact strategies, such as dynamic running and full-body manipulation of heavy objects, necessitating close coordination between the arms and legs. The aim is to utilize reinforcement learning to generate such behavior during complex contact events without imposing strict requirements.
Robert Playter, CEO of Boston Dynamics, says: “We are living in an extremely exciting time for humanoid robot development.
“But for humanoids to be useful, they must be flexible enough to work in many different kinds of environments and perform tasks in a wide variety of applications.
“Our collaboration with the RAI Institute brings together two of the world’s leading robotics organizations to help accelerate core capabilities needed to make robots like Atlas a valuable tool in people’s lives.”
Marc Raibert, executive director of the RAI Institute, says: “Our aim at RAI is to develop technology that enables future generations of intelligent machines.
“Working on Atlas with Boston Dynamics enables us to make advances in reinforcement learning on arguably the most sophisticated humanoid robot available. This work will play a crucial role in advancing the capabilities of humanoids not only by expanding its skillset, but also streamlining the process to achieve new skills.”
Boston Dynamics has a longstanding reputation for creating groundbreaking advances in dynamic robots, from extreme mobility to bimanual manipulation.
The latest generation of Atlas is the result of years of hardware and software co-design aimed at building the most capable humanoid platform, both in terms of physical capability and software interfaces for authoring behavior. This makes it an ideal platform for advancing the science of AI-based manipulation skills.
The RAI Institute is a research organization focused on solving the most important problems in artificial intelligence related to robotics, with the goal of achieving fundamental advances in what robotics and other intelligent machines can do.
The organization’s work is focused on developing the perception, situational understanding, reasoning and other cognitive functions underpinning robots’ abilities and combining them with advances in their physical capabilities.
Partnering with Boston Dynamics for this collaboration will both build upon the RAI Institute’s existing research in AI and learning, and help the organization further advance the technology as it applies to other robot platforms.
The organizations will periodically release updates on this collaborative work, including publications and demonstrations with Atlas.
