Automotive

Nissan readies smart rear vision combining mirror, LCD and image processing

Nissan readies smart rear vision combining mirror, LCD and image processing
Nissan's focus on combining digital cameras and image processing technologies to better inform the driver has been a highlight of its active safety R&D and the benefits will have significant roll-on effects for the marque, not the least of which will be great design freedom for the entire car in the longer term.
Nissan's focus on combining digital cameras and image processing technologies to better inform the driver has been a highlight of its active safety R&D and the benefits will have significant roll-on effects for the marque, not the least of which will be great design freedom for the entire car in the longer term.
View 18 Images
Nissan will deploy the smart mirror in its race cars this year, and is planning to use it in the ZEOD RC and other NISMO race cars at the Le Mans 24 Hour race in June.
1/18
Nissan will deploy the smart mirror in its race cars this year, and is planning to use it in the ZEOD RC and other NISMO race cars at the Le Mans 24 Hour race in June.
Nissan's Around View Monitor system offers a degree of situational awareness not found in other vehicles - since I first tried it, many times I have wished for such facility when driving other vehicles.
2/18
Nissan's Around View Monitor system offers a degree of situational awareness not found in other vehicles - since I first tried it, many times I have wished for such facility when driving other vehicles.
Nissan's smart mirror. In conditions where glare is a problem, such as dawn, dusk and with a tailing car with headlights on high beam, the image processing software can provide a clearer picture by modifying the image.
3/18
Nissan's smart mirror. In conditions where glare is a problem, such as dawn, dusk and with a tailing car with headlights on high beam, the image processing software can provide a clearer picture by modifying the image.
Nissan was the first manufacturer to provide a comprehensive information system for parking with its birds-eye view and for 360 degree situational awareness with its Around View Monitor.
4/18
Nissan was the first manufacturer to provide a comprehensive information system for parking with its birds-eye view and for 360 degree situational awareness with its Around View Monitor.
Nissan's smart mirror. In conditions where glare is a problem, such as dawn, dusk and with a tailing car with headlights on high beam, the image processing software can provide a clearer picture by modifying the image.
5/18
Nissan's smart mirror. In conditions where glare is a problem, such as dawn, dusk and with a tailing car with headlights on high beam, the image processing software can provide a clearer picture by modifying the image.
Nissan's smart mirror is switchable between the LCD and mirror modes via a switch on the rear of the mirror.
6/18
Nissan's smart mirror is switchable between the LCD and mirror modes via a switch on the rear of the mirror.
Nissan's smart mirror. In low contrast situations such as rain and snow, the image processing also provides clearer visual information to the driver.
7/18
Nissan's smart mirror. In low contrast situations such as rain and snow, the image processing also provides clearer visual information to the driver.
Nissan's smart mirror. In low contrast situations such as rain and snow, the image processing also provides clearer visual information to the driver.
8/18
Nissan's smart mirror. In low contrast situations such as rain and snow, the image processing also provides clearer visual information to the driver.
Nissan's smart mirror. In conditions where glare is a problem, such as dawn, dusk and with a tailing car with headlights on high beam, the image processing software can provide a clearer picture by modifying the image.
9/18
Nissan's smart mirror. In conditions where glare is a problem, such as dawn, dusk and with a tailing car with headlights on high beam, the image processing software can provide a clearer picture by modifying the image.
Nissan's focus on combining digital cameras and image processing technologies to better inform the driver has been a highlight of its active safety R&D and the benefits will have significant roll-on effects for the marque, not the least of which will be great design freedom for the entire car in the longer term.
10/18
Nissan's focus on combining digital cameras and image processing technologies to better inform the driver has been a highlight of its active safety R&D and the benefits will have significant roll-on effects for the marque, not the least of which will be great design freedom for the entire car in the longer term.
Part of the display at Tokyo Motor Show in 2007 when Nissan's visual information system R&D first began to bear fruit
11/18
Part of the display at Tokyo Motor Show in 2007 when Nissan's visual information system R&D first began to bear fruit
Part of the display at Tokyo Motor Show in 2007 when Nissan's visual information system R&D first began to bear fruit
12/18
Part of the display at Tokyo Motor Show in 2007 when Nissan's visual information system R&D first began to bear fruit
Part of the display at Tokyo Motor Show in 2007 when Nissan's visual information system R&D first began to bear fruit
13/18
Part of the display at Tokyo Motor Show in 2007 when Nissan's visual information system R&D first began to bear fruit
Nissan's birds-eye-view makes parking in tight situations MUCH easier. No more touch-parking for the spacially-challenged
14/18
Nissan's birds-eye-view makes parking in tight situations MUCH easier. No more touch-parking for the spacially-challenged
Nissan's birds-eye-view makes parking in tight situations MUCH easier. No more touch-parking for the spacially-challenged
15/18
Nissan's birds-eye-view makes parking in tight situations MUCH easier. No more touch-parking for the spacially-challenged
Nissan's Around View Monitor system has now been enhanced with Moving Object Detection (MOD), which informs the driver of moving objects detected near the car when manoeuvring out of a parking space.
16/18
Nissan's Around View Monitor system has now been enhanced with Moving Object Detection (MOD), which informs the driver of moving objects detected near the car when manoeuvring out of a parking space.
Nissan's Around View Monitor system. Situational awareness is as vital to one's health when driving a car as it is for a soldier on the battlefield.
17/18
Nissan's Around View Monitor system. Situational awareness is as vital to one's health when driving a car as it is for a soldier on the battlefield.
Nissan will deploy the smart mirror in its race cars this year, and is planning to use it in the ZEOD RC and other NISMO race cars at the Le Mans 24 Hour race in June.
18/18
Nissan will deploy the smart mirror in its race cars this year, and is planning to use it in the ZEOD RC and other NISMO race cars at the Le Mans 24 Hour race in June.
View gallery - 18 images

Nissan has announced the commercialization of a new type of driver rear visibility system that integrates a wide-aspect, hi-res LCD monitor with image processing into the traditional rearview mirror. With the system switchable between mirror and LCD modes, the big advantage of the "smart" mirror is that in LCD mode, it can provide an unobstructed rear view without blind spots, and an enhanced picture in difficult conditions.

In conditions where glare is a problem, such as dawn, dusk and with a tailing car with headlights on high beam, the image processing software can provide a clearer picture by modifying the image. Similarly, in low contrast situations such as rain and snow, the image processing also provides clearer visual information to the driver, as well as overcoming the issues of a wet, clouded or dirty rear window.

Nissan plans to introduce the Smart rearview mirror to the Japanese market as an option over the next few months, with a global roll-out planned for 2015. We'll get to see the "smart mirror" system in action for the first time next week at the Geneva Motor Show.

Nissan's smart mirror. In conditions where glare is a problem, such as dawn, dusk and with a tailing car with headlights on high beam, the image processing software can provide a clearer picture by modifying the image.
Nissan's smart mirror. In conditions where glare is a problem, such as dawn, dusk and with a tailing car with headlights on high beam, the image processing software can provide a clearer picture by modifying the image.

One of the key advantages of the LCD mirror, which provides images from a high-resolution camera mounted above the rear window, is that it offers an unobstructed view of the rear flanks without any blind spots.

Nissan recognizes that driving is a sight-response activity

Part of the display at Tokyo Motor Show in 2007 when Nissan's visual information system R&D first began to bear fruit
Part of the display at Tokyo Motor Show in 2007 when Nissan's visual information system R&D first began to bear fruit

Driving is a sight-response activity. Nearly all the information with which a driver makes decisions when driving, is visual, and Nissan has long been a strong proponent of better visual information systems for the driver.

It was the first manufacturer to provide a comprehensive information system for parking with its birds-eye view and for 360 degree situational awareness with its Around View Monitor.

Nissan's focus on combining digital cameras and image processing technologies to better inform the driver has been a highlight of its active safety R&D and the benefits will have significant roll-on effects for the marque, not the least of which will be great design freedom for the entire car in the longer term.

Nissan was the first manufacturer to provide a comprehensive information system for parking with its birds-eye view and for 360 degree situational awareness with its Around View Monitor.
Nissan was the first manufacturer to provide a comprehensive information system for parking with its birds-eye view and for 360 degree situational awareness with its Around View Monitor.

Parking has long been a problem area for human drivers, and the ingenious combination of the output of four corner-mounted cameras into a bird's eye view of a vehicle's surroundings, was one of the highlights of the 2007 Tokyo Motor Show.

The Around View Monitor system has evolved considerably since Nissan first allowed me to experience this virtual 360-degree image of the vehicle in the car park of Makkuhari Messe in Chiba in 2007.

From its initial introduction, the system evolved to provide more useful information in easily-comprehended visual form with a Front Wide View Function and Rear Wide View Function.

When a driver needs to perform a blind corner turn, or when exiting a car park, the system can provide a 180-degree view of the front and back of the vehicle on the monitor inside the car.

Moving Object Detection (MOD) was subsequently added, and this informs the driver of moving objects detected near the car when maneuvering out of a parking space.

Nissan's birds-eye-view makes parking in tight situations MUCH easier. No more touch-parking for the spacially-challenged
Nissan's birds-eye-view makes parking in tight situations MUCH easier. No more touch-parking for the spacially-challenged

The cameras have also contributed other safety technologies, including the Lane Departure Prevention system, which alerts the driver when the car unintentionally leaves the driving lane. Given the epidemic of distracted driving precipitated by the proliferation of the smartphone, the technology is making it safer not just for Nissan drivers, but for all road users.

The camera systems have also been instrumental in the development of Nissan's Emergency Brake System, which detects a car in front of the vehicle and alerts the driver with an in-vehicle audible and visual warning and if necessary, emergency brake is applied to help avoid an imminent collision. That was another technology I previewed in that Chiba car park in 2007.

The Smart rearview mirror is equipped with a newly developed high-performance, narrow-angle camera and a specially-shaped LCD monitor. Matching a standard wide angle camera lens to this unique monitor could not be done since the images from the camera, when adjusted to the special monitor size, produced a low-resolution image resulting in an insufficient picture quality. To rectify this challenge, a 1.3 megapixel narrow-angle camera was developed so that picture quality would not be sacrificed when formatted for the specially designed monitor.

Nissan's smart mirror. In low contrast situations such as rain and snow, the image processing also provides clearer visual information to the driver.
Nissan's smart mirror. In low contrast situations such as rain and snow, the image processing also provides clearer visual information to the driver.

Also, conventional monitors possess an aspect ratio of 4:3 or 16:9, but these traditional-sized aspect ratios could not adequately be displayed in a rearview mirror. Therefore, an LCD monitor with a unique aspect ratio of approximately 4:1 was developed.

When the LCD monitor and mirror are used in unison, the transparency of the monitor and the reflection in the mirror can create an image overlap ─ a dual layered effect-making it difficult to get a clean view, but with the Smart rearview mirror, Nissan applied a unique technology to the structural design of the LCD monitor and the mirror, enabling it to function without any image overlaps.

Flow-on effects of the smart mirror will influence Nissan vehicle design

Automobile designers have long been hampered by the need for an unobstructed view for the rear vision mirror in creating aesthetic and aerodynamic vehicles. The development of the smart mirror might well give Nissan a competitive edge in the design area in the future as blind spots will no longer be a factor.

Nissan will deploy the smart mirror in its race cars this year, and is planning to use it in the ZEOD RC and other NISMO race cars at the Le Mans 24 Hour race in June.
Nissan will deploy the smart mirror in its race cars this year, and is planning to use it in the ZEOD RC and other NISMO race cars at the Le Mans 24 Hour race in June.

Nissan will deploy the new mirror in its race cars this year, and is planning to use it in the ZEOD RC and other NISMO race cars at the Le Mans 24 Hour race in June.

"Under the harsh driving conditions in the world of motorsport, retaining a clear view for the race driver is of utmost importance", said NISMO president, Shoichi Miyatani.

"In that sense, the Smart rearview mirror will be a powerful tool for our Nissan NISMO drivers. Also, we have high expectations towards improving the cars' aerodynamic design, thanks to the Smart rearview mirror, thereby expanding the possibilities of race cars to a new level."

Several major accidents have been caused in the Le Mans race by slower cars in the GT categories failing to see fast-closing LMP1 and LMP2 cars (the speed differential between the classes is stark), and this might be a significant racing safety of the future.

Regardless of what happens on the racetrack, the new smarter rear vision system in conjunction with the Around View Monitor, Front and Rear Wide View function, and Moving Object Detection adds up to an unquestionably safer vehicle.

This is an important new safety feature and Nissan now has a unique selling feature which will impact buyer decision making. For those who regularly see the family fleet dented or damaged by less-than-skillful drivers, this is also a feature which will be worthwhile.

And for Nissan, perhaps it could further enhance the surround camera system with the facility to take video whenever the car is parked in the street, supermarket car park ad infinitum. If the car is bumped or tampered with, the video could be transmitted to the driver's smartphone. Number plate detection software would help too.

View gallery - 18 images
7 comments
7 comments
Max Kennedy
Think about camera being obscured by rain or snow. Good idea but don't forget weather!
-dphiBbydt
The issue of refocusing the driver's eyes has not been mentioned. In normal driving the eyes are focused on the cars in front, signs, road markings and the local scenery. These things are nominally at 'long distance' visually. When you glance in the mirrors, your eyes do not have to change focus since the relevant objects in the mirror (other cars etc) are at a similar distance. However, an image on a screen such as a GPS device or now with Nissan's camera mirror will be much closer requiring momentary refocusing of the eyes. We are supposed to glance in our mirrors every few seconds and I wonder if LCD mirrors are going to cause eye-strain. Maybe Nissan has some special optics to make the image appear 'at infinity' to prevent this problem. Toyota did some clever trick in the Prius with the digital display - the actual electronics is under the dash somewhere and they use mirrors to reflect the display to the driver. Because the digital display is physically further away from the driver it requires less refocusing when glancing at the speed etc.
Slowburn
I they want to improve rear vision the first thing to do is brighter reverse lights.
ash
i can't believe they don't also deploy the equivalent of wing mirrors on the front fenders, with the video feeds displayed just above the dash on either side of the steering wheel area (panels or integrated); this would give a much "better" field of view and also improve aerodynamics considerably - plus one less bit for cyclists or narrow access to collide with in normal use, and requiring only a small pod which would be easily serviced or cleaned (not like mirrors to stay very clean either)
equally useful would be lateral proximity alarms for lane changers who don't look or indicate :)
Bruce H. Anderson
I have been in a Nissan with a rear display, and the curving orange lines that project your path make a huge difference (see the photo above), and if that makes it to the rear that is a real plus. An I've seen the 360 thing on an Infiniti. Both cool. And though exterior cameras and mirrors both get dirty, the mirrors handle it much better. I believe they can peacefully co-exist.
And Slowburn, you are a bit off topic but I agree wholeheartedly!!!!
Slowburn
@ -dphiBbydt Check the "mirror" when you check your instruments.
@ Bruce H. Anderson You can keep the tiny camera lenses clean by shielding them with jets of clean air or mount them inside the windows. The subject is improving rear vision. perhaps I should have said I like the smart mirrors but first make brighter back up lights.
Stephen N Russell
Bring this to the US, must have esp for So CA market & retrofit onto older models, awesome, at dealer for Free IE drivers Test in the Field\& lisc for other auto makers too & must have for Infiniti alone.