• Skip to primary navigation
  • Skip to main content
  • Skip to primary sidebar
  • Skip to secondary sidebar
  • Skip to footer
  • Home
  • Subscribe
  • Your Membership
    • Edit Your Profile
  • Services
    • Advertising
    • Case studies
    • Design
    • Email marketing
    • Lead generation
    • Magazine
    • Press releases
    • Publishing
    • Sponsored posts
    • Webcasting
    • Webinars
    • White papers
    • Writing
  • Shop
    • My Account
    • Cart
  • About
    • Contact
    • Privacy
    • Terms of use
  • Events

Robotics & Automation News

Market trends and business perspectives

  • News
  • Features
  • Video
  • Webinars
  • White papers
  • Press releases
  • Featured companies
    • AMD Xilinx
    • BlueBotics
    • Elite Robot
    • RGo Robotics
    • SICK Sensor Intelligence
    • Vicor Power

Ambarella, Lumentum and ON Semiconductor collaborate on AI processing based 3D sensing for next-gen AIoT devices

May 26, 2021 by Mai Tao Leave a Comment

Ambarella, an AI vision silicon company, Lumentum, a designer and manufacturer of innovative optical and photonic products, and ON Semiconductor, a provider of CMOS image sensor solutions, have partnered to produce two new joint reference designs that they say will “accelerate artificial intelligence of things device deployment across verticals”.

The designs build on the companies’ previous joint solution for contactless access systems.

By combining the data from Lumentum’s high-performance VCSEL array illuminators and an ON Semiconductor image sensor using Ambarella’s AI SoC, higher levels of accuracy and more intelligent decision-making can be achieved in next-generation AIoT devices for biometric access control, 3D electronic locks and other intelligent sensing applications.

Originally intended for biometric access control and electronic locks, these new reference designs can also address the needs of smart cities, smart buildings, smart homes and intelligent healthcare.

Additionally, the high level of integration provided by these joint solutions significantly lowers system power consumption and thermal design requirements while enabling much smaller product form factors.

Fermi Wang, president and CEO of Ambarella, says: “Ambarella’s vision is to combine AI processing with 3D and vision sensing to create an ambient intelligent future.

“This collaboration with Lumentum and ON Semiconductor will further advance the convergence of AI and IoT to enable a new generation of access control systems, while inspiring novel categories of ambient sensing products – all powered by the fusion of sensors using AI vision processors that interact intelligently and unobtrusively with people to address their ever-evolving needs.”

Téa Williams, senior vice president and general manager, 3D sensing at Lumentum, says: “Our new joint solutions will greatly increase the accuracy of AIoT devices across application verticals – starting with biometric access control and electronic locks – enabling them to recognize people and predict their needs, rather than requiring a direct human interface.

“Many of these applications will take advantage of 3D sensing to inject a new dimension of data input for improved decision-making. As an example, using higher resolution VCSEL-based spot illumination enables longer sensing ranges and higher-accuracy facial recognition.

“Lumentum’s industry-leading and high-performance VCSEL arrays with zero field failures, used across these joint solutions, are driving new applications and helping realize the dream of AIoT devices with 3D sensing capabilities.”

Gianluca Colli, vice president and general manager, industrial and consumer sensor division (ICSD) group at ON Semiconductor, says: “Image sensors are the eyes for intelligent sensing devices. Their ability to see farther with more detail provides significantly more information for the AI processor’s decision-making in AIoT devices.

“Our industry leading RGB-IR sensor technology, combined with the advanced ISP capabilities of Ambarella’s AI vision SoCs, can bring both visible and IR images into devices simultaneously. For this second generation of our joint solutions, we leveraged customer feedback to quadruple the resolution of our RGB-IR image sensors to 4K (8MP).”

The three companies’ new joint AIoT solutions consist of two reference designs and additional 3D sensing development kits, each uniquely configured to address application-specific demands for the combination of AI processing, 3D depth sensing and vision sensing:

Targeted at next-generation biometric access control readers, the Vision+ reference design is the AIoT industry’s first 4K solution to perform single-camera, 940nm structured-light sensing based on RGB-IR technology.

It is also the first to leverage a single-chip solution for depth processing, AI processing and video processing. Based on the Ambarella CV22 CVflow AI vision processor, it includes single-camera structured-light sensing powered by Lumentum’s VCSEL technology, featuring a range of 2 meters, and a 4K (8MP) RGB-IR CMOS image sensor from ON Semiconductor.

Targeted at next-generation smart electronic door locks, or eLocks, for both commercial and residential applications, the Saturn reference design is the AIoT industry’s first to integrate AI processing for both single-camera structured-light sensing and fast-boot video processing.

It is based on the Ambarella CV25 CVflow AI vision processor and includes a structured-light camera powered by Lumentum’s VCSEL technology and the AR0237CS 2MP RGB-IR image sensor from ON Semiconductor.

Targeted at intelligent sensing applications and with opportunities across verticals, Ambarella’s CV2 series CVflow AI vision processor-based development kits can now be outfitted with ToF sensor adapters that are powered by Lumentum’s leading-edge VCSEL arrays. An optional 4K RGB-IR image sensor adapter is also available for these kits.

The open software development kit (SDK) for Ambarella’s CVflow AI vision processors allows the easy integration of third-party applications while enabling OEMs to address differing regional requirements with a single platform (for example, using different AI algorithms in different regions).

Additionally, this robust, Linux-based SDK expands the capabilities of edge sensing devices, simplifies product development and speeds time-to-market through:

  • Custom application development capabilities
  • Support for different 3D modalities, including structured light and ToF. Uniquely, a single Ambarella SoC provides 3D sensing processing without the need for a dedicated depth processor or a separate host processor
  • High AI inference capabilities on the camera device to enable multiple neural networks running simultaneously
  • Robust AI tools to support deep neural network development and migration
  • Integrated ISP to handle challenging scenes, including high dynamic range and low light scenarios
  • Built-in Arm processors to run customer applications
  • Integrated security hardware, including secure boot, OTP to store encryption keys and Arm TrustZone technology for secure encryption key comparisons
  • Rich peripheral interface support to simplify system designs

Availability

These joint reference designs and development kits are expected to be available in June. More information is available from Ambarella.

Print Friendly, PDF & Email

Share this:

  • Print
  • Facebook
  • LinkedIn
  • Reddit
  • Twitter
  • Tumblr
  • Pinterest
  • Skype
  • WhatsApp
  • Telegram
  • Pocket

You might also like…

Filed Under: Computing, News Tagged With: access, ai, aiot, ambarella, applications, control, designs, development, devices, image, intelligent, joint, lumentum, processing, processor, reference, rgb-ir, semiconductor, sensing, sensor, solutions, technology, vcsel, vision

Join the Robotics & Automation News community

Reader Interactions

You must log in to post a comment.

Primary Sidebar

Latest articles

  • The Impact of Automation on Digital Marketing: 5 Key Areas
  • Big Joe Forklifts launches autonomous pallet mover in partnership with Thoro.ai
  • Wingtra lands $22 million funding round for its commercial drones
  • DeepRoute.ai launches $1,000 ‘map-free’ self-driving solution
  • MobileDrive builds next generation ADAS with Siemens’ digital twin technology
  • Seegrid releases software to enable its warehouse robots to work together
  • Ambi Robotics unveils fleet management and business intelligence platform
  • Geodis almost doubles case picking throughput with Vecna Robotics solution
  • How to Automate the Mechanical Tasks in Your Company Better
  • What to Wear for Cycling in Cold Weather

Most Read

  • Best Fat Tire Electric Bike: The Ultimate All-Terrain Companion
    Best Fat Tire Electric Bike: The Ultimate All-Terrain Companion
  • Top 20 electric vehicle charging station companies
    Top 20 electric vehicle charging station companies
  • Stiga launches ‘world’s smartest’ autonomous lawn mower
    Stiga launches ‘world’s smartest’ autonomous lawn mower
  • Indian startup Unbox Robotics launches sortation robots in the US
    Indian startup Unbox Robotics launches sortation robots in the US
  • Difference Between Three-Phase and Single-Phase Power
    Difference Between Three-Phase and Single-Phase Power
  • Scientists have found more water in space than they ever knew possible
    Scientists have found more water in space than they ever knew possible
  • Top 20 programmable logic controller manufacturers
    Top 20 programmable logic controller manufacturers
  • Built Robotics launches fully autonomous solar piling system
    Built Robotics launches fully autonomous solar piling system
  • The Best Mechanical Engineering Design Software in 2022
    The Best Mechanical Engineering Design Software in 2022
  • ABB launches new version of its Swifti collaborative cobot
    ABB launches new version of its Swifti collaborative cobot

Overused words

ai applications automated automation automotive autonomous business companies company control customers data design development digital electric global industrial industry logistics machine manufacturing market mobile operations platform process production robot robotic robotics robots safety software solution solutions system systems technologies technology time vehicle vehicles warehouse work

Secondary Sidebar

Latest news

  • The Impact of Automation on Digital Marketing: 5 Key Areas
  • Big Joe Forklifts launches autonomous pallet mover in partnership with Thoro.ai
  • Wingtra lands $22 million funding round for its commercial drones
  • DeepRoute.ai launches $1,000 ‘map-free’ self-driving solution
  • MobileDrive builds next generation ADAS with Siemens’ digital twin technology
  • Seegrid releases software to enable its warehouse robots to work together
  • Ambi Robotics unveils fleet management and business intelligence platform
  • Geodis almost doubles case picking throughput with Vecna Robotics solution
  • How to Automate the Mechanical Tasks in Your Company Better
  • What to Wear for Cycling in Cold Weather

Footer

We are…

Robotics and Automation News was established in May, 2015, and is now one of the most widely-read websites in its category.

Please consider supporting us by becoming a paying subscriber, or through advertising and sponsorships, or by purchasing products and services through our shop – or a combination of all of the above.

Thank you.

Independent

Archivists

May 2021
M T W T F S S
 12
3456789
10111213141516
17181920212223
24252627282930
31  
« Apr   Jun »

Complex

Old-skool

This website and its associated magazine, and weekly newsletter, are all produced by a small team of experienced journalists and media professionals.

If you have any suggestions or comments, feel free to contact us at any of the email addresses on our contact page.

We’d be happy to hear from you, and will always reply as soon as possible.

Future-facing

Free, fair and legal

We support the principles of net neutrality and equal opportunities.

Member of The Internet Defense League

Copyright © 2023 · News Pro on Genesis Framework · WordPress · Log in

We use cookies on our website to give you the most relevant experience by remembering your preferences and repeat visits. By clicking “Accept”, you consent to the use of ALL the cookies.
Do not sell my personal information.
Cookie SettingsAccept
Manage consent

Privacy Overview

This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience.
Necessary
Always Enabled
Necessary cookies are absolutely essential for the website to function properly. These cookies ensure basic functionalities and security features of the website, anonymously.
CookieDurationDescription
cookielawinfo-checkbox-analytics11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Analytics".
cookielawinfo-checkbox-functional11 monthsThe cookie is set by GDPR cookie consent to record the user consent for the cookies in the category "Functional".
cookielawinfo-checkbox-necessary11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookies is used to store the user consent for the cookies in the category "Necessary".
cookielawinfo-checkbox-others11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Other.
cookielawinfo-checkbox-performance11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Performance".
viewed_cookie_policy11 monthsThe cookie is set by the GDPR Cookie Consent plugin and is used to store whether or not user has consented to the use of cookies. It does not store any personal data.
Functional
Functional cookies help to perform certain functionalities like sharing the content of the website on social media platforms, collect feedbacks, and other third-party features.
Performance
Performance cookies are used to understand and analyze the key performance indexes of the website which helps in delivering a better user experience for the visitors.
Analytics
Analytical cookies are used to understand how visitors interact with the website. These cookies help provide information on metrics the number of visitors, bounce rate, traffic source, etc.
Advertisement
Advertisement cookies are used to provide visitors with relevant ads and marketing campaigns. These cookies track visitors across websites and collect information to provide customized ads.
Others
Other uncategorized cookies are those that are being analyzed and have not been classified into a category as yet.
SAVE & ACCEPT