Robotics

Quadriplegic successfully uses mind-controlled robotic arm

Quadriplegic successfully uses mind-controlled robotic arm
Quadriplegic Jan Scheuermann gave the mind-controlled robotic arm a big thumbs up at the end of her trial period (Photo: Journal of Neural Engineering/IOP Publishing)
Quadriplegic Jan Scheuermann gave the mind-controlled robotic arm a big thumbs up at the end of her trial period (Photo: Journal of Neural Engineering/IOP Publishing)
View 3 Images
Quadriplegic Jan Scheuermann gave the mind-controlled robotic arm a big thumbs up at the end of her trial period (Photo: Journal of Neural Engineering/IOP Publishing)
1/3
Quadriplegic Jan Scheuermann gave the mind-controlled robotic arm a big thumbs up at the end of her trial period (Photo: Journal of Neural Engineering/IOP Publishing)
Scheuermann could use to thoughts to command the robot arm to take four shapes: fingers spread, scoop, pinch, and thumbs up (Photo: Journal of Neural Engineering/IOP Publishing)
2/3
Scheuermann could use to thoughts to command the robot arm to take four shapes: fingers spread, scoop, pinch, and thumbs up (Photo: Journal of Neural Engineering/IOP Publishing)
An earlier study with the same woman allowed her to control a slightly-less sophisticated robotic arm with her thoughts to the point where she could feed herself a chocolate bar (Photo: UPMC)
3/3
An earlier study with the same woman allowed her to control a slightly-less sophisticated robotic arm with her thoughts to the point where she could feed herself a chocolate bar (Photo: UPMC)
View gallery - 3 images

In 2012, a quadriplegic woman managed to move a robotic arm, using only her thoughts, to a level of proficiency that allowed her to eat a chocolate bar using said arm. The University of Pittsburgh team behind the study didn't stop there, though. By improving the technology in the arm and working more closely with test subject Jan Scheuermann, researchers have since enabled her to replace the simple pincer grip of before with four new hand shapes – fingers spread, pinch, scoop, and thumb up – that allow for more complicated object manipulation.

Back in February 2012, Schuermann had two electrode grids – with 96 contact points each – surgically implanted into her left motor cortex, which controls right arm and hand movements. Hooked up to a brain-computer-interface, she was able to reach in and out, left and right, and up and down with the arm within a week of the surgery. In a few months she learned to flex the wrist back and forth, move it from side to side, and rotate it. She could also grip objects using a crab-like pincer hand shape.

For this second study, the researchers sought to increase the hand's functional utility while also maintaining a relatively low-complexity control space because more possible maneuvers means considerably more calibration. The 10-dimensional (10D) control (three dimensions of translation, three of orientation, four of hand shape) that they settled on had not been tested elsewhere, and they were unsure whether the brain would exhibit a preference for just one dimension or simultaneously handle all 10.

To calibrate the arm, Scheuermann watched animations of the movements and new hand shapes and imagined herself doing them while the team recorded the resultant signals in her brain. After identifying the brain activity patterns that correspond to each movement, these signals were then translated into instructions for the robotic arm.

As in the previous study, Scheuermann's performance improved over time, though the researchers were surprised that her overall ability to control the arm was better with the higher complexity of the 10D version than in the prior 7D experiments. Scheuermann still struggled to perform more difficult object manipulation, however, and she tended to favor the strategies she developed in the 7D trials – as though attempting to negate the extra dimensions of hand control. The researchers believe this behavior was a direct result of the previous experience, which suggests it might not occur in subjects who jump straight from nothing to 10D control.

The researchers also note with curiosity that Schuermann found objects easier to grasp if they had been displayed during the preceding calibration.

Schuermann underwent surgery in October to have the electrode arrays removed. She speaks of the experience fondly, saying "this study has enriched my life, given me new friends and coworkers, helped me contribute to research, and taken my breath away."

For other victims of paralysis, the research provides a new hope. "Our results indicate that highly coordinated, natural movement can be restored to people whose arms and hands are paralyzed," said co-author Andrew Schwartz.

A paper describing the research was published in the Journal of Neural Engineering.

Source: University of Pittsburgh School of Medicine

View gallery - 3 images
No comments
0 comments
There are no comments. Be the first!