AI & Humanoids

Video: High-speed humanoid feels like a step change in robotics

View 2 Images
Lordy, that thing is starting to move quickly – and naturally
Sanctuary AI
Lordy, that thing is starting to move quickly – and naturally
Sanctuary AI
Sanctuary co-founder Suzanne Gildert proudly claims that Phoenix's hydraulic hands, with their combination of speed, strength and precision, are the world's best humanoid robot hands
Sanctuary AI

You've seen a ton of videos of humanoid robots – but this one feels different. It's Sanctuary's Phoenix bot, with "the world's best robot hands," working totally autonomously at near-human speeds – much faster than Tesla's or Figure's robots.

Canadian company Sanctuary AI has been accelerating its own progress toward general-purpose humanoids, using teleoperation to show Phoenix how to do things, and letting it go away and figure out more in simulation.

Phoenix is an odd duck in this space, in that the Sanctuary team hasn't got it up and walking yet, deciding to let others figure that bit out so its team can focus on the nitty gritty of work behaviors. Thus, it sits on a decidedly unsexy wheeled platform, but it has some of the most finely-tuned and human-like hands out of anything we've ever seen.

And it's also starting to move in a way that's much faster, more fluid and natural-looking than anything else in the space. Take a look – and remember, this is fully autonomous. Phoenix has been trained by human operators, but now it's doing this task all by itself.

That kind of motion feels like a marked step change in the humanoid field. It's pretty dang impressive. But how has Phoenix accelerated past the pack here?

We spoke to Sanctuary co-founder and CTO Suzanne Gildert in an extensive interview last week, and look forward to bringing you that whole chat shortly – but one thing we discussed was the unique approach Sanctuary is taking to the challenge of teaching Phoenix how to do... Well, pretty much anything we can do.

Phoenix's hands, Gildert told us, are hydraulically actuated as opposed to the electric motors in others like Optimus and the Figure 01. "We moved over to hydraulics," she said, "and there's disadvantages there, they leak and they're very expensive to do R&D on. But it's the only technology that gives us a combination of three factors that are very important: obviously precision, but there's also speed and strength."

"If you see a robot doing something really dexterous," she continued, "like threading a needle, or doing a button or something, you have to ask yourself, could that hand also lift a 50-pound suitcase? And could it also move fast enough to, say, type on a keyboard? Usually people only show one of these three factors, but the ultimate hand needs to have all three. Currently, the hydraulic technology's the only one that can get you all three of those."

"The one we've built, I think is the ultimate," she grinned. "The world's best robot hand. But there's probably plenty of research you can do on a simpler hand as well."

Those hands are indeed extraordinary in motion, and with the hardware looking extremely capable, the team has been focused on creating the building blocks of movement. Where other groups have gone straight to full task training, Sanctuary has been working on the absolute basics in a way that Gildert compares to a baby playing with toys dangling over the crib.

"When you do this sort of learning on grasping data from teleoperation, you find these common movements of the hand start coming out," she explained. "Like, when machine learning people train vision algorithms, you find common features coming out of images; things like edges, corners and little patterns, the building blocks of all images. When you train on data coming from hands, you find that all hand movements are combinations of these basic movements we call Eigengrasps, which, if you combine them in different ways, allow your hands to do anything.

"There's 31 to 33 different grasps that the human hand can do. And with our learning algorithms, we're trying to see if it comes up with the same 33 that have been put forward by physiotherapists and the medical field for the human hand. Power grasps, prismatic grasps where the fingers are spread. Pinch grasps, precision grasps, there's a whole bunch of them separated into a whole taxonomy of grasping. So when we were trying to design our robot hand, we tried to design one that could do all 33 of these motions that are primary to human interaction with the world."

Sanctuary co-founder Suzanne Gildert proudly claims that Phoenix's hydraulic hands, with their combination of speed, strength and precision, are the world's best humanoid robot hands
Sanctuary AI

By concentrating on the absolute fundamentals, Sanctuary is building up Phoenix's capabilities in a super-granular fashion, which Gildert says might be slow to get going, but should show a wild rate of acceleration as the robot begins to make connections between movements and broaden its capabilities.

Whatever the case, the way this thing moves in the X post released today is profoundly different to other humanoids in the space, and it certainly seems to validate the approach. We look forward to watching a lot more in the near future!

Fascinating stuff. We look forward to bringing you the full interview soon!

Source: Sanctuary AI

  • Facebook
  • Twitter
  • Flipboard
  • LinkedIn
9 comments
NL_01
Great journalism as always. I'm curious to what degree they're doing something different on the computational side that cuts the latency. Looking forward to the full interview!
BlueOak
"We moved over to hydraulics," she said, "and there's disadvantages there, they leak and they're very expensive to do R&D on. But it's the only technology that gives us a combination of three factors that are very important: obviously precision, but there's also speed and strength."

Heard a fascinating Lex Fridman interview with Boston Dynamics founder Marc Raibert. Raibert mentioned Boston Dynamics moved the opposite direction, away from hydraulic actuators due to the weight and leaking issues.
Jinpa
Can it gasp straw without cutting it? Can it thread a needle? Can it peel onions of various sizes? Can it flip a half-cooked egg without breaking the yolk? Can it hold, maneuver and solve a Rubik's Cube? Can it open the top third of a soft-boiled egg? Can it shoot a marble, accurately? Can it shoot a spitball with good rubber band? Can it do a surgeon's stitch and knot?
irongamer
Detective Spooner: "You are a clever imitation of life... Can a robot write a symphony? Can a robot take a blank canvas and turn it into a masterpiece?"
Sonny (robot): "Can you?"
mediabeing
Feels?? It feels different?
Best in the world?? Maybe...for a while. There is no ultimate in the world of design.
Extraordinary??
Where's the technical, 'no fluff' writing?
Did you use AI for this?
grey
it's so cuuuuute
Pucksaver
I'm curious why robotics try to mimic humans. Might there be a better design for a robot hand than a human hand? For example, would it be better to have "eyes" in the tips of the "fingers", whatever eyes and fingers could/should look like in a robot?
MikeofLA
@Pucksaver - everything currently "designed for humans to interface with" is designed for human interfaces, hands, and motion. There may be more efficient ways to do some things, but those are typically already done by specifically designed machines. The entire point of humanoid robots is to do tasks that are already done by humans, just more efficiently.
bwana4swahili
Give it a year or so and it'll be doing its tasks 2, 3, ... times faster than a human and doing it 24/7 without strikes and other demands.