1. A new AI startup, Figure, has put OpenAI’s artificial intelligence into a robot, creating Figure 01.
2. Figure 01 can have real-time voice conversations, identify objects, and hold complex conversations.
3. The robot uses cameras to capture images, microphones to transcribe speech, and a multimodal model trained by OpenAI to understand both images and text.
Figure, an AI robotics company worth $2.6 billion, has partnered with OpenAI to create Figure 01, a robot capable of real-time voice conversation and contextualizing images. The robot is able to identify objects, such as an apple, within its visual context and hand them over to humans in a matter of seconds. Figure 01 can hold complex conversations, describe its visual experience, plan future actions, reflect on its memory, and explain its reasoning verbally.
The robot’s cameras capture images and its microphones transcribe speech to text, which is then fed into a large multimodal model trained by OpenAI to understand both images and text. This allows Figure 01 to provide logical responses, such as handing over an apple because it’s the only edible item available on the table.
The technology behind Figure 01 is pushing the boundaries of AI and robotics, prompting questions about the future of science and technology. The robot’s capabilities raise questions about whether we are on the cusp of a new era of innovation or potentially facing unintended consequences. In any case, the development of Figure 01 showcases the potential of AI and robotics to revolutionize human-robot interactions and advance technological capabilities.