ZF developing 3D interior observation system for autonomous driving

ZF is developing a three-dimensional Interior Observation System (IOS) capable of detecting and classifying vehicle occupants, determining their size, location and position, and whether or not they are in active control of the vehicle.

While ZF is well-known as a world leader in the production of forward facing object recognition cameras that sense the external vehicle environment, the company has also been involved in the development of interior observation cameras for more than ten years.

Due to the trend toward advanced safety and vehicle automation, interest in interior camera technology has intensified and ZF is now developing a 3D camera interior observation system supporting a broad variety of potential safety, comfort and AD applications.

A prime example is occupant position sensing. Seat-mounted sensors are already used to determine whether airbag and seat belt pre-tensioners should be deployed and at what force.

A 3D IOS camera can augment this information on the size and real-time position and posture of occupants, including out-of-position detection such as reclined seats – all information that can help tailor occupant energy management prior or in the event of a crash.

Just knowing if an occupant or other object is present in a seating position can help determine if and with which adaptive occupant safety functions to deploy in that position.

The camera can complement existing seat belt buckle sensors with visual verification if the occupant is properly belted, and give guidance to do so with a reminder or other action if this is not the case.

Occupant sensing can also be extremely valuable in situations where small children may be left in the car – leading to emergency situations particularly in extreme temperatures – the IOS system can be calibrated to determine the presence of a child and activate emergency actions.

This could include an automatic call to the vehicle owner’s mobile phone, lowering electric windows and opening a moon roof to reduce interior temperatures, activation of the horn and emergency flashers so others nearby can assist, or a call to emergency providers.

As vehicles become increasingly equipped with automated functions, intelligently networked interior sensors can determine if the driver’s hands are on the steering wheel and if the driver’s head is facing the road and monitoring the vehicle.

The system can indicate that the driver is in an automated mode and when a potential emergency situation is detected can trigger alerts.

“The bottom line is that visual data from the interior of the vehicle can be highly valuable from many standpoints,” said Norbert Kagerer, senior vice president, engineering for the occupant safety systems business.

“The development of our 3D interior observation system leads to enhanced safety, convenience and helps support the evolution toward automated vehicles.”

The IOS system is expected to be production ready by late 2021.