Electronics

Eye-tracking window tech tells sightseers about what they're looking at

Eye-tracking window tech tells sightseers about what they're looking at
The AR Interactive Vehicle Display combines a transparent microLED panel with eye-tracking and GPS data
The AR Interactive Vehicle Display combines a transparent microLED panel with eye-tracking and GPS data
View 2 Images
The AR Interactive Vehicle Display combines a transparent microLED panel with eye-tracking and GPS data
1/2
The AR Interactive Vehicle Display combines a transparent microLED panel with eye-tracking and GPS data
The system will make its public debut at CES 2024
2/2
The system will make its public debut at CES 2024

If you're on a sightseeing tour in a bus, you really don't want to be looking away from the passing attractions to Google them on your smartphone. The AR Interactive Vehicle Display is intended to help, by showing relevant information on the vehicle's window glass.

Set to debut next week at CES, the technology was developed by Taiwan's Industrial Technology Research Institute (ITRI). It works as follows …

On each window of the bus, an eye-tracking camera is located above the window, and a transparent microLED touchscreen panel covers the entire inside surface of the window glass. As the passenger looks out the window, the system continuously assesses the direction of their gaze.

By factoring in GPS data to ascertain the vehicle's current speed and geographical location, it's possible to tell which specific attraction the person is presently viewing. The system uses this information to display a small photo of the attraction (on the microLED panel), which appears beside the passenger's view of the real thing.

If the person wants to know more about what they're looking at, they just tap that photo. Doing so causes information to appear in text boxes located around their view of the attraction, but not right overtop of it.

The system will make its public debut at CES 2024
The system will make its public debut at CES 2024

Needless to say, the technology could also be incorporated into the windows of trains, tour boats, gondolas or other sightseeing vehicles. In fact, ITRI has already utilized very similar technology in the glass of public aquariums which tell people about the fish they're presently viewing.

The AR Interactive Vehicle Display is demonstrated in the video below.

AR Interactive Vehicle Display

Source: ITRI

2 comments
2 comments
Global
Sorry, any decent sightseeing vehicle will have either an interactive person explaining the highlights of the trip, including getting off and exploring in real life the sight, sounds, tastes, etc...
Daishi
I think eye tracking adds a layer of expensive complexity to what would otherwise be a pretty simple technology to implement. Some tour buses already do something like this with audio where you can plug in headphones and it will give you an audio description of what you are driving by in the language that it chose. The tech to do that is simple. The reason to use tech instead of a person to do this is simple: The cost for the user is closer to that of a bus ticket than something like a vacation. It's good for "hop on hop off" type tour buses. The local experiences, sounds, and tastes you will get as you get on and off the bus (without an attached tour group with you).