Wearables

Designers create Leap Motion accessory to interpret sign language

A display shows sign language interpreted into written words
A display shows sign language interpreted into written words
View 3 Images
A display shows sign language interpreted into written words
1/3
A display shows sign language interpreted into written words
The device is practical and stylish
2/3
The device is practical and stylish
The technology can facilitate communication for people who rely on sign language
3/3
The technology can facilitate communication for people who rely on sign language

Two Portuguese designers based in Sydney have come up with a practical idea for facilitating communication between people when sign language is involved. Catarina Araujo and Sofia Santos’ project, still at the development stage and looking for financial backers, taps Leap Motion technology to create a wearable sign language translator to be worn as a necklace.

Leap Motion technology tracks hand movements. The new device translates those tracked movements into words that appear on a screen, not unlike a foreign language expert doing simultaneous interpreting. For those people who can't read sign language, the device could be a great facilitator of interaction, also making life a lot easier for those who can only communicate through hand gestures.

The duo has been selected for the second phase of the TEDx Youth competition in Sydney. The winners get a mentor for three months to help them develop an idea. Twelve teams have been selected, but only four will make it.

“The design is a concept that translates our idea of a low-cost and attractive device that a person can wear as a necklace. This way they can wear it all the time, making the interaction more natural,” they told Gizmag.

Similar devices have been developed elsewhere, such as EnableTalk by the Ukraine’s quadSquad, which consists of sensor-fitted gloves and software to convert hand signals into speech in real time. Additionally, students at the University of Houston have created MyVoice, a portable device that translates hand gestures into an audio message.

Source: Catarina Araujo/Sofia Santos

3 comments
Nelson Hyde Chick
Too bad most of the handicapped live in poverty, so few deaf will be able to afford this gizmo.
Paul Utry
This is a great idea! Regarding the poverty aspect above, if there's a government subsidy for this kind of thing it could at least help some lower income earners get this kind of device. Just looking at the pic above showing someone ordering a coffee, how about a reversal of this idea for shops where there's a kinect type device that sits on a counter facing a customer. The kinect could translate the hand gestures to text on a small LCD screen, or maybe even plugged into the cash register, allowing the person serving to be able to understand the signals?
noteugene
Thanks for noticing Nelson. Spent my whole working career paying for ramps and bathroom stalls for the wheelchair bound but when it comes to hearing assisted devices do they provide that for me for free as I do them? um, no. Again, I have to pay. But your the only hearing person I've ever known of to have notice that. Thanks.