Mobile Technology

EM-Sense tech expands IoT by telling smartwatches what their users are touching

EM-Sense tech expands IoT by telling smartwatches what their users are touching
This form of wireless communication holds great potential to bring new layers of functionality to the smartwatch
This form of wireless communication holds great potential to bring new layers of functionality to the smartwatch
View 23 Images
In testing, participants were instructed to touch, grasp and operate 23 different objects including laptops, drills, desk lamps, refrigerators and tablets
1/23
In testing, participants were instructed to touch, grasp and operate 23 different objects including laptops, drills, desk lamps, refrigerators and tablets
In testing, participants were instructed to touch, grasp and operate 23 different objects including laptops, drills, desk lamps, refrigerators and tablets
2/23
In testing, participants were instructed to touch, grasp and operate 23 different objects including laptops, drills, desk lamps, refrigerators and tablets
Dubbed EM-Sense, Disney's device was built using a cheap software-defined radio receiver that was modified to widen its range
3/23
Dubbed EM-Sense, Disney's device was built using a cheap software-defined radio receiver that was modified to widen its range
A lot of the objects we come into contact with throughout a regular day give off their own special profiles of electromagnetic noise
4/23
A lot of the objects we come into contact with throughout a regular day give off their own special profiles of electromagnetic noise
In testing, participants were instructed to touch, grasp and operate 23 different objects including laptops, drills, desk lamps, refrigerators and tablets
5/23
In testing, participants were instructed to touch, grasp and operate 23 different objects including laptops, drills, desk lamps, refrigerators and tablets
This form of wireless communication holds great potential to bring new layers of functionality to the smartwatch
6/23
This form of wireless communication holds great potential to bring new layers of functionality to the smartwatch
Dubbed EM-Sense, Disney's device was built using a cheap software-defined radio receiver that was modified to widen its range
7/23
Dubbed EM-Sense, Disney's device was built using a cheap software-defined radio receiver that was modified to widen its range
Dubbed EM-Sense, Disney's device was built using a cheap software-defined radio receiver that was modified to widen its range
8/23
Dubbed EM-Sense, Disney's device was built using a cheap software-defined radio receiver that was modified to widen its range
A lot of the objects we come into contact with throughout a regular day give off their own special profiles of electromagnetic noise
9/23
A lot of the objects we come into contact with throughout a regular day give off their own special profiles of electromagnetic noise
As the EM signal makes its way through the body, a conducting electrode in contact with the skin senses it, and the modified radio then converts into digital data
10/23
As the EM signal makes its way through the body, a conducting electrode in contact with the skin senses it, and the modified radio then converts into digital data
As the EM signal makes its way through the body, a conducting electrode in contact with the skin senses it, and the modified radio then converts into digital data
11/23
As the EM signal makes its way through the body, a conducting electrode in contact with the skin senses it, and the modified radio then converts into digital data
A lot of the objects we come into contact with throughout a regular day give off their own special profiles of electromagnetic noise
12/23
A lot of the objects we come into contact with throughout a regular day give off their own special profiles of electromagnetic noise
As the EM signal makes its way through the body, a conducting electrode in contact with the skin senses it, and the modified radio then converts into digital data
13/23
As the EM signal makes its way through the body, a conducting electrode in contact with the skin senses it, and the modified radio then converts into digital data
As the EM signal makes its way through the body, a conducting electrode in contact with the skin senses it, and the modified radio then converts into digital data
14/23
As the EM signal makes its way through the body, a conducting electrode in contact with the skin senses it, and the modified radio then converts into digital data
A lot of the objects we come into contact with throughout a regular day give off their own special profiles of electromagnetic noise
15/23
A lot of the objects we come into contact with throughout a regular day give off their own special profiles of electromagnetic noise
This form of wireless communication holds great potential to bring new layers of functionality to the smartwatch
16/23
This form of wireless communication holds great potential to bring new layers of functionality to the smartwatch
In testing, participants were instructed to touch, grasp and operate 23 different objects including laptops, drills, desk lamps, refrigerators and tablets
17/23
In testing, participants were instructed to touch, grasp and operate 23 different objects including laptops, drills, desk lamps, refrigerators and tablets
EM-Sense list of items recognized during tests
18/23
EM-Sense list of items recognized during tests
Em-Sense machine learning to detect objects
19/23
Em-Sense machine learning to detect objects
Standard hardware in the EM-Sense SDR receiver
20/23
Standard hardware in the EM-Sense SDR receiver
EM-Sense prototype
21/23
EM-Sense prototype
EM-Sense analysis of a signal
22/23
EM-Sense analysis of a signal
EM-Sense use cases and signaling
23/23
EM-Sense use cases and signaling
View gallery - 23 images

EM-Sense is a software defined radio solution with the potential to make smartwatches smarter by informing them what a user is touching. By measuring electro-magnetic (EM) signals conducted through the body and interpreted in real time, EM-Sense can quantify the world in new and useful ways. From guiding projects that include sensing what a wearer is doing while providing feedback through to fitness and health tracking, the Internet of Things just became exponentially larger.

Developed by scientists at Disney Research and Carnegie Mellon University, this novel approach to sensing the environment could be game changing since the entire universe of legacy objects can now be detected without costly modifications or the need to add additional sensors.

The premise behind EM-Sense technology is delightfully simple. Our bodies conduct electro-magnetic signals and this conduction can be easily measured. Likewise, objects produce distinctive EM signals of their own. By using the body as an antenna and software to filter the signals, EM-Sense has shown it is possible to discriminate reliably among things as similar as drills and dremels, and to identify large structural features such as doors as well as a wide array of common devices.

Em-Sense machine learning to detect objects
Em-Sense machine learning to detect objects

What makes EM-Sense particularly exciting is the proof of concept prototype the researchers were able to create using an off-the-shelf software defined receiver. The fact that key components are commonly available likely means quick iteration and rapid uptake into commercial smartwatches and other products.

Standard hardware in the EM-Sense SDR receiver
Standard hardware in the EM-Sense SDR receiver

Though the prototype device is very much a proof-of-concept, this technology holds great potential to bring new layers of functionality to the smartwatch. It could mean that your computer unlocks the moment your watch-wielding wrist is plonked onto its trackpad, for example, or your kettle begins to boil the moment you shut off your alarm clock in the morning.

Benefits of this new technology are obvious from watching the video below, and who knows where else it might lead. Last month, for example, researchers at the University of Washington unveiled a device based on the same principle that aims to track your carbon footprint by monitoring your daily interactions with the world around you.

... though it makes one wonder just how much you want a watch to know about everything you do and everything you touch.

The research paper entitled EMSense: Recognizing Handled, Uninstrumented, Electro-Mechanical Objects Using Software-Defined Radio was presented on November 8 at the ACM Symposium on User Interface Software and Technology (ACM UIST) 2015.

Source: Disney Research, Gierad Laput

EM-Sense: Touch Recognition of Uninstrumented Electrical and Electromechanical Objects

View gallery - 23 images
1 comment
1 comment
CodiSlayton
What are the top 5 mobile gadgets that are very helpful in everyday life of 2015?