Automotive

Ford developing biometric systems to manage "driver workload"

Ford developing biometric systems to manage "driver workload"
Jeff Greenberg (right) demonstrating the MyFord Touch intelligent test rig (Photo: Gizmag)
Jeff Greenberg (right) demonstrating the MyFord Touch intelligent test rig (Photo: Gizmag)
View 4 Images
Jeff Greenberg (right) demonstrating the MyFord Touch intelligent test rig (Photo: Gizmag)
1/4
Jeff Greenberg (right) demonstrating the MyFord Touch intelligent test rig (Photo: Gizmag)
Some of the data that Ford has gathered in developing its biometrics systems for use in MyFord Touch (Photo: Gizmag)
2/4
Some of the data that Ford has gathered in developing its biometrics systems for use in MyFord Touch (Photo: Gizmag)
The real-time driver readout for the test rig (Photo: Gizmag)
3/4
The real-time driver readout for the test rig (Photo: Gizmag)
A conference participant tries out the test rig (Photo: Gizmag)
4/4
A conference participant tries out the test rig (Photo: Gizmag)
View gallery - 4 images

The Ford Motor Company recently invited Gizmag to attend its Go Further With Ford 2012 conference on technological trends, which took place last Tuesday through Thursday in Detroit. One of the presentations that we took in looked at the automaker’s MyFord Touch system, and where that technology may be heading. Among other things, the Ford engineers want the system to be able to automatically ascertain how mentally-taxed the driver is, so it can determine if it should deliver notifications to them, or just shut up and let them drive.

The existing version of Touch is built around Ford’s Windows-based SYNC communications and entertainment system. Using touchscreen or button controls, or verbal commands, users are able to access the navigation system, place phone calls, control music playback, or perform any number of other functions. For its part, the system is in turn able to notify drivers (both verbally and visually) of things such as incoming phone calls, text messages and emails.

Needless to say, some people wonder if all this instrumentation and access to information will cause drivers to become too distracted from the task at hand – driving. In at least some cases, where drivers are already stressed by what’s happening on the road around them, it certainly could do so. Hopefully, most drivers would know to lay off the Touch-usage while experiencing such stressful driving conditions. The problem, however, is that Touch doesn’t know not to bother them at such times – at least, not yet.

A conference participant tries out the test rig (Photo: Gizmag)
A conference participant tries out the test rig (Photo: Gizmag)

Touch does already have a “Do Not Disturb” feature, which drivers can enable when they don’t want to be distracted by any notifications. The driver must make a point of turning that feature on and off, however. “It’s entirely a manual function, you have to choose to do it,” said Ford Senior Technical Leader, Jeff Greenberg. “Challenges in driving are pretty episodic ... I might be negotiating an intersection and I don’t want to be disturbed, then as soon as I’m done, things calm down and it’s OK. It’s unrealistic to expect people to be turning this on and off, that actually just increases the burden.”

Instead, Greenberg and his team envision a system that uses in-vehicle sensors to assess both the conditions around the vehicle, and the driver’s reaction to those conditions. Already, he pointed out, it’s fairly simple to determine the vehicle’s speed, its rate of acceleration, and how fast it’s going into turns, along with what the driver is doing with the steering wheel, pedals, and dashboard controls. Additionally, some Ford vehicles now have multiple radar systems and forward-facing cameras that can detect the presence and proximity of other cars on the road. Traction control systems can also be used to determine how slippery the road surface is.

Biometrics systems, which are still in development, could be used to ascertain the driver’s physiological responses to all of these stimuli – what is known as their "driver workload." These systems could measure parameters such as heart rate, skin conductance (using electrical sensors in the steering wheel rim), respiration (using piezoelectric sensors in the seat belt), along with hand and face temperature (via infrared cameras).

The real-time driver readout for the test rig (Photo: Gizmag)
The real-time driver readout for the test rig (Photo: Gizmag)

“We want to take information about what’s going on in the cabin – what the driver is doing – information about the vehicle response, about the environment, and we want to combine all of that into a mathematical model that says ‘This is how we think the average person is going to be in this situation,’” he explained. “And then, looking even a little bit farther out, we’d like to personalize that – not just how the average person would respond, but how you would respond.”

Ford has already built many of these “Intelligent Simplification” technologies into a driving simulator, which Greenberg demonstrated for us. It may be at least a few years, however, before we see such systems making their way into commercially-available automobiles.

View gallery - 4 images
2 comments
2 comments
Daishi
I want them to replace the in-dash display with a kind of thick tablet that can be user or dealer replaced down the road as technology improves. The current system in the edge is a 4.2 inch screen but they could standardize on a couple of sizes depending on the vehicle.
Lets say I buy an Edge with Sync today. In a couple years I should be able to replace the on board system with something newer running on Windows Phone 8 or what ever version of it Surface will be using for $400.
The new tablet would just run an updated version of SYNC written for the newer platform so I don't have to replace my entire $40k car for a $400 tablet because computer and automotive technologies evolve at a totally different pace.
They should also open up the platform to 3rd party developers as long as there is a way to reset it to factory defaults. This would allow things like potentially better GPS/map software, vastly superior voice recognition where 3G/4G connection is available, and maybe some competing user interfaces that some prefer over the default SYNC interface etc.
There is no way for Ford to complete with the software R&D budgets with the combined tablet/mobile industry so why ride on the coat tails of it to build a better products. The slowness to realize this is the reason a $200 phone or tablet is significantly more capable than the computing platform in a $100,000 Mercedes.
By moving to common upgradable platform and allowing 3rd party development Ford could offer a better computer in the Focus than you can get in a 6 figure Benz.
If you don't think it is possible to build a standard form factor car computer for $400 think about how much comes with the $200 Google Nexus 7 and then realize you wouldn't require a battery, power savings isn't as important, and neither is thickness, cooling, or weight so you could make it several inches thick so any tablet manufacturer could repackage hardware into that form factor just about in their sleep.
Hopefully the days of paying $1,500 for mediocre on board GPS are far behind us but there is still so much more cars could be doing. It's jaw dropping that I can casually ask a phone to remind me of appointments, what the weather will be next Wednesday, what the 75th prime number is, or who directed Howard the Duck and get a correct answers back but I still have to ask my passenger if there is a car in my blind spot.
Nicolas Zart
Hi Ben, I was also there and thought this was a terrific idea. although I wonder how well the visual recognition software will get my quirky sense of humor and faces :) Ford's doing a great job. Nicolas