Good Thinking

Google Glass autism app is a real conversation-starter

Google Glass autism app is a real conversation-starter
Although Google Glass never did reach the market, the technology could presumably be adapted to other smart glasses
Although Google Glass never did reach the market, the technology could presumably be adapted to other smart glasses
View 1 Image
Although Google Glass never did reach the market, the technology could presumably be adapted to other smart glasses
1/1
Although Google Glass never did reach the market, the technology could presumably be adapted to other smart glasses

Among other things, children with autism spectrum disorder (ASD) often have difficulty initiating and maintaining conversations. That's why a team of scientists, led by University of Toronto assistant professor Azadeh Kushki, created Holli. It's an app that presently runs on Google Glass, and it tells ASD kids what they should say next.

"We developed software for a wearable system that helps coach children with autism spectrum disorder in everyday social interactions," says Kushki, who is also a scientist at Toronto's Bloorview Research Institute. "In this study, we show that children are able to use this new technology and they enjoy interacting with it."

The system listens to what the user and another person are saying in a conversation, and recognizes commonly-used conversational prompts on the part of that other person. It then presents suitable responses for the user to choose from, in the glasses' display.

If the other person were to greet the user by saying "Welcome," for instance, the user would be presented with responses such as "Hey," "Hello" or "Afternoon." Once Holli heard the user say one of those things, it would clear the display and wait to hear the next prompt.

The app has been tested on 15 children with ASD, who were able to use it to carry on relatively smooth conversations. And although Google Glass never did reach the market, the technology could presumably be adapted to other smart glasses.

"The interesting thing about our new technology is that we are not trying to replace human-to-human interactions; instead, we use this app to coach children who are communicating with people in real-world situations," says Kushki. "Children can practice their skills outside of their normal therapy sessions and it can provide them with increased independence in everyday interactions."

A paper on the research was recently published in the journal Frontiers in Robotics and AI.

Source: Frontiers

1 comment
1 comment
bergamot69
On one level, this seems like a smart solution to helping those on the autistic spectrum to socialise,
On another level, it strikes me as a way of 'programming' autistic children to respond robotically to social cues.
This might please some parents who don't care for the lack of manners in their autistic offspring, but I believe it is better to keep persevering and teach them why it is in their interest to socialise better, rather than training them like dogs.
For those who might consider my opinion naive or ill-informed, I am dyspraxic, (Developmental Co-ordination Disorder, or DCD, in American English), and this has a lot in common with Asperger's, (indeed, I was thought to be autistic in my early life). I've also worked professionally caring for those on the autistic spectrum.