Robotics & Automation News

Market trends and business perspectives

ambarella CV22AQ-chip-photo copy

Ambarella and Smart Eye partner to deliver ‘next-generation AI-based driver monitoring’

Ambarella, a developer of high-resolution video processing and computer vision semiconductors, and Smart Eye, a developer of artificial intelligence-powered eye, mouth, and head tracking technology, are partnering to deliver a Driver Monitoring System platform that they say “tracks driver actions and intentions”.

The platform is based on Ambarella’s CV22AQ CVflow computer vision processor, which offers high-quality image processing and high-performance AI computing at low power consumption, typically below 2.5 watts.

Smart Eye AI software running on CV22AQ will make it possible for automotive original equipment manufacturers and tier-1s to deploy a new generation of driver and in-cabin monitoring systems with advanced AI features, increasing safety and convenience for drivers and passengers. 

Martin Krantz, CEO of Smart Eye, says: “We are very pleased to be working with Ambarella to enable advanced AI in the next generation of compact driver and in-cabin monitoring camera designs.

“The pairing of Ambarella’s CVflow high-performance, low power consumption computer vision processing with Smart Eye’s growing array of high-accuracy and AI-based driver monitoring algorithms offers a highly-effective, scalable solution for Smart Eye’s OEM and tier-1 customers.

“With the Ambarella CV22AQ, Smart Eye is able to provide high-resolution, high-precision head pose, gaze, eyelid and mouth tracking in 60Hz paired with concurrent execution of our growing portfolio of AI-based interior sensing algorithms.”

Fermi Wang, president and CEO of Ambarella, says: “We are seeing significantly increased demand for both driver and in-cabin monitoring cameras.

“Powered by CV22AQ, this joint platform will allow system designers to fully optimize Smart Eye’s innovative tracking technology in high performance, low power system designs.”

The Ambarella CV22AQ offers support for both global shutter and rolling shutter CMOS sensors, both of which are required for in-cabin applications.

The processor’s powerful Image Signal Pipeline, with support for RGB-IR color filter arrays, enables high-accuracy detection and monitoring, even in low-light in-cabin environments.

Its High Dynamic Range processing extracts maximum image detail in high-contrast scenes, further enhancing the computer vision capabilities of the chip and performance potential of Smart Eye algorithms.

The CV22AQ CVflow architecture provides the computational power necessary for multi-camera monitoring system designs, running multiple AI algorithms on each video stream.

CV22AQ includes a suite of advanced security features, including secure boot, TrustZone, and I/O virtualization to protect against hacking.