Robotics

Jackrabbot plays nice with pedestrians

Jackrabbot plays nice with ped...
Jackrabbot is designed to learn how to share the pavement with pedestrians
Jackrabbot is designed to learn how to share the pavement with pedestrians
View 5 Images
Jackrabbot uses images to deduce pedestrian behavior
1/5
Jackrabbot uses images to deduce pedestrian behavior
Jackrabbot's view of the world
2/5
Jackrabbot's view of the world
Jackrabbot is designed to learn how to share the pavement with pedestrians
3/5
Jackrabbot is designed to learn how to share the pavement with pedestrians
Jackrabbot with its hat and tie
4/5
Jackrabbot with its hat and tie
Jackrabbot's sensors
5/5
Jackrabbot's sensors

With the era of autonomous cars almost upon us, engineers at Stanford University are already working on something more difficult – robots that can share the pavement with pedestrians. Jackrabbot may look like a backyard BB8 with WALL-E's head stuck on, but its function goes beyond cuteness. It's designed to interact with pedestrians and learn from them how to get around without bumping into people or annoying them.

Given that autonomous cars are giant pieces of metal designed to drive on crowded roads at high speeds, it would seem that making one that could handle a sidewalk to be relatively easy. But the Stanford School of Engineering team says that's not true. In fact, the cars have a lot of advantages because road vehicles run along very carefully laid out routes and they have to follow minutely defined rules. There may be things like dogs leaping into traffic to be accounted for, but they're relatively rare and are more like anomalies than routine problems.

Pedestrian traffic, on the other hand, is an absolute nightmare for robots, even if they are doing something as simple as delivering pizza. How people get about on the pavement is pretty much up to them, with very few explicit rules to follow no matter how crowded the precinct is. Instead, humans rely on all sorts of unwritten rules and unspoken cues that even the walkers themselves might be totally unaware of. Given how few pile ups and punch ups happen on street corners, this seems to work. Most of the time.

Jackrabbot's view of the world
Jackrabbot's view of the world

Named after the jackrabbits that take up residence on the Stanford campus, Jackrabbot is a 3-foot tall experimental prototype that's engineered to learn the rules of the pavement and to be as friendly as possible with the humans it meets. Its diminutive height, cuddly shape, jaunty hat, and necktie are deliberate features that the team came up with to make it friendly and non-threatening, as demonstrated by the hugs it gets as it roams around campus.

Jackrabbot works by means of a suite of cameras and navigational sensors that allow it to negotiate outdoor pathways, streets, and indoor hallways. Since it is a "social robot," it's programmed to observe human pedestrian etiquette and imitate it. This way, it's hoped that it will eventually learn enough about the unwritten rules of the road to not only avoid obstacles in malls, railway stations, and airports, as well as avoiding hurting anyone's feelings. This may involve everything from learning how to negotiate a ramp, deducing rights of way, waiting its turn at an entrance, or joining a spontaneously begun queue.

The robot does this by collecting images of people as they move about the campus. From these, it maps coordinates and then its algorithms deduce what the proper etiquette is in a particular situation.

Jackrabbot with its hat and tie
Jackrabbot with its hat and tie

The project is still in its early days as Jackrabbot learns how to navigate and builds up its library of social rules. The hope is that such an understanding can later be transferred to other robots, which in five or six years could cost around US$500 for commercial models.

"It's possible to make these robots affordable for on-campus delivery, or for aiding impaired people to navigate in a public space like a train station or for guiding people to find their way through an airport," says Silvio Savarese, assistant professor of computer science and director of the Stanford Computational Vision and Geometry Lab.

The team's research will be presented in a paper at the Computer Vision and Pattern Recognition conference in Las Vegas on June 27.

The video below introduces JackRabbot.

Meet Jackrabbot: The social robot

2 comments
Bob Flint
Unlike a larger autonomous car that can be stopped by stepping in front of it, but since it's probably locked, and awkward to get into, this little guy would fall prey to vandals stripping it clean by knocking it over, and disarming... Unless "it" has a real reason to be mixing up with pedestrians, stay off the sidewalks, paths, etc. Is this an investigative alternative to those flying deliveries?? Legally couldn't arm "It" with self-defense because it's not human, doesn't pay taxes, and what delivering pizza??? Yeah that will work real well, after it falls over/into the first curb or puddle.
HensleyBeuronGarlington
@Bob Flint Though it wouldn't help much, it could be armed with non lethal weaponry for when it is the subject of on-going vandalism or theft. Eventually we will have machines like this can recognize threats and attacks and take preventive action. If anything, it could explode with dye marking any individuals involved as well as providing authorities and the internet with images and video of the perpetrators. Or pass control off to an overseer that can monitor dozens of these bots and take control when necessary. It will not be a bad idea either to have them act like a hive mind and share information. Be a great way to track said perpetrators after. All are ideas that could help with situations like you've described. Puddles and curbs are not really a problem. Robots with legs can already get up and water proofing electronics has been around for a very long time.