• Skip to primary navigation
  • Skip to main content
  • Skip to primary sidebar
  • Skip to secondary sidebar
  • Skip to footer
  • Home
  • Subscribe
  • Your Membership
    • Edit Your Profile
  • Services
    • Advertising
    • Case studies
    • Design
    • Email marketing
    • Lead generation
    • Magazine
    • Press releases
    • Publishing
    • Sponsored posts
    • Webcasting
    • Webinars
    • White papers
    • Writing
  • Shop
    • My Account
    • Cart
  • About
    • Contact
    • Privacy
    • Terms of use
  • Events

Robotics & Automation News

Market trends and business perspectives

  • News
  • Features
  • Video
  • Webinars
  • White papers
  • Press releases
  • Featured companies
    • AMD Xilinx
    • BlueBotics
    • Elite Robot
    • RGo Robotics
    • SICK Sensor Intelligence
    • Vicor Power

Nvidia offers glimpse into Silicon Valley simulator in the cloud used for autonomous car development

May 27, 2020 by David Edwards Leave a Comment

As much of the world continues to conduct business from home, Nvidia’s autonomous test vehicles are hard at work in the cloud. (See video below.)

During the GTC 2020 keynote, Nvidia CEO Jensen Huang demonstrated how Nvidia Drive technology is being developed and tested in simulation.

While physical testing is temporarily paused, the cloud-based Nvidia Drive Constellation platform makes it possible to dispatch virtual vehicles in virtual environments to continue making great progress in self-driving technology.

In the video demonstration, a virtual Nvidia BB8 test vehicle drives near Nvidia headquarters in Silicon Valley, traveling through highways and urban streets – all in simulation.

The 17-mile loop shows the Nvidia Drive AV Software navigating the roadways, pedestrians and traffic in a highly accurate replica environment.

Data center proving ground

Nvidia Drive Constellation is a cloud-based simulation platform, designed from the ground up to support the development and validation of autonomous vehicles. The data center-based platform consists of two side-by-side servers.

The first server uses Nvidia GPUs running DRIVE Sim software and generates the sensor output from the virtual car driving in a virtual world. The second server contains the actual vehicle computer, processing the simulated sensor data running the exact same Drive AV and Drive IX software that’s being deployed in the real car.

The driving decisions from the second server are fed back into the first, enabling real-time, bit-accurate, hardware-in-the-loop development and testing.

The system is designed to be deployed in a data center as a scalable virtual fleet. This provides development engineers with a vehicle on demand, and gives them the ability to conduct testing at scale. It also makes it possible to consistently test rare and dangerous scenarios that are difficult or impossible to encounter in the real world.

Development and testing from end to end

Building an autonomous vehicle requires testing at every level – starting at subsystems and continuing all the way to full vehicle integration tests. Drive Constellation enables this type of end-to-end development and testing for autonomous vehicles in simulation, similar to developing a physical car.

End-to-end tests ensure timing and performance accuracy as well as accurate modeling of the complex interdependency of different systems in autonomous vehicle software.

Achieving this level of fidelity at scale is a major undertaking. The environment, traffic behavior, sensor inputs and vehicle dynamics must appear, act and feed into the car computer just as they would in the real world.

This requires multiple GPUs to generate synthetic data in sync with precise timing. The vehicle software and hardware signals and interfaces must be replicated in simulation – and everything has to run in real time.

Simulating Silicon Valley

Comprehensive simulation starts with the environment. To accurately recreate the Silicon Valley driving loop, 3D Mapping, a member of the Nvidia Drive ecosystem, scanned the roadways to within 5 centimeters of accuracy. The raw scanned data was then processed into a dataset format known as OpenDrive.

From there, Nvidia developed a content creation pipeline to generate a highly accurate 3D environment using the Nvidia Omniverse collaboration platform. The environment includes accurate road networks and roadmarks.

Material properties are also applied to ensure it interacts with light rays, radio waves and lidar rays in the same way real sensors interact with the physical world.

Recreating sensor data

With an accurate environment in place, high-fidelity development and testing next requires accurately generated sensor data.

The sensor models include those typically found on an autonomous test vehicle, such as camera, lidar, radar and inertial measurement unit. DRIVE Sim provides a flexible sensor pipeline and APIs that allow configuring sensors to match real-world vehicle architectures.

For camera data, the image pipeline starts by rendering an HDR image that is warped according to the lens properties of the camera used on the vehicle. Exposure control, black and white level balancing, and color grading are applied to the image to match the sensor profile. Finally, the pixel data is converted to its native output format using a sensor-specific encoder.

In addition to camera models, Drive Sim provides physically based lidar and radar sensors using ray tracing. Nvidia RTX GPUs enable Drive Sim to run highly computationally intensive radar and lidar models in real time.

Modeling vehicle behavior

Finally, vehicle models are critical for accurate simulation. As control signals – steering, acceleration and braking – are sent to the in-vehicle computer, the car must respond just as it would in the physical world.

To do so, the simulation platform must recreate motion properly, including details such as interaction with the road surface. Vehicle models in DRIVE Sim are handled using a plugin system with the included PhysX models or third-party vehicle dynamics models from Nvidia Drive ecosystem partners such as Mechanical Simulation or IPG.

Vehicle dynamics also play a key role in accurate sensor data generation. As the vehicle operates, the position and pose of the vehicle changes significantly, affecting a sensor’s viewpoint. For example, the forward-facing cameras will pitch downward when a car is braking. Modeling vehicle dynamics correctly is important to generating sensor data properly.

By accurately simulating each of these components – environment, sensors, vehicle dynamics – on a single, end-to-end platform, Nvidia Drive Constellation and Drive Sim are critical pieces to a comprehensive development and testing pipeline.

They enable Nvidia and its partners to work toward safer and more efficient autonomous vehicles as physical fleets remain in the garage.

Print Friendly, PDF & Email

Share this:

  • Print
  • Facebook
  • LinkedIn
  • Reddit
  • Twitter
  • Tumblr
  • Pinterest
  • Skype
  • WhatsApp
  • Telegram
  • Pocket

You might also like…

Filed Under: Computing, Features Tagged With: accurate, autonomous, car, data, development, drive, environment, models, nvidia, platform, real, sensor, sim, simulation, testing, vehicle, virtual

Join the Robotics & Automation News community

Reader Interactions

You must log in to post a comment.

Primary Sidebar

Latest articles

  • ABB robots help tackle Covid by automating testing, research and diagnostics
  • Svaya Robotics launches ‘India’s first collaborative robot’
  • Thermo Fisher Scientific partners with Celltrio to build fully automated cell culture system
  • Comau builds robotic welding solution for Daimler Trucks China operation
  • Mitsubishi Electric Automation releases new 3D simulator software
  • Kuka unveils new compact autonomous mobile robot for intralogistics
  • Global autonomous cars market size to reach $16 billion by 2030
  • Volvo invests in Waabi to strengthen autonomous truck offering
  • Hacking Robots: The 5 Threats You Need to Know About
  • AMD launches Kria ecosystem program to help developers bring automation solutions to market faster

Most Read

  • Foxconn plans to build autonomous vehicles on Nvidia computing platform
    Foxconn plans to build autonomous vehicles on Nvidia computing platform
  • Manufactured in the metaverse: Mercedes-Benz designs virtual factories with Nvidia Omniverse
    Manufactured in the metaverse: Mercedes-Benz designs virtual factories with Nvidia Omniverse
  • Top 20 electric vehicle charging station companies
    Top 20 electric vehicle charging station companies
  • Why is My Car Key Stuck in the Ignition?
    Why is My Car Key Stuck in the Ignition?
  • Difference Between Three-Phase and Single-Phase Power
    Difference Between Three-Phase and Single-Phase Power
  • UPS and Gap units partner to offer ‘unmatched automation and supply chain capabilities’ to apparel merchants
    UPS and Gap units partner to offer ‘unmatched automation and supply chain capabilities’ to apparel merchants
  • Top 20 programmable logic controller manufacturers
    Top 20 programmable logic controller manufacturers
  • DHL becomes first to install Boston Dynamics’ Stretch robot to unload trucks
    DHL becomes first to install Boston Dynamics’ Stretch robot to unload trucks
  • The Best Mechanical Engineering Design Software in 2022
    The Best Mechanical Engineering Design Software in 2022
  • How to Know if Your iPhone is Being Tracked? Check This!
    How to Know if Your iPhone is Being Tracked? Check This!

Overused words

ai applications automated automation automotive autonomous business china companies company control customers data design development digital electric global industrial industry logistics machine manufacturing market mobile operations platform process production robot robotic robotics robots safety software solution solutions system systems technologies technology time vehicle vehicles warehouse

Secondary Sidebar

Latest news

  • ABB robots help tackle Covid by automating testing, research and diagnostics
  • Svaya Robotics launches ‘India’s first collaborative robot’
  • Thermo Fisher Scientific partners with Celltrio to build fully automated cell culture system
  • Comau builds robotic welding solution for Daimler Trucks China operation
  • Mitsubishi Electric Automation releases new 3D simulator software
  • Kuka unveils new compact autonomous mobile robot for intralogistics
  • Global autonomous cars market size to reach $16 billion by 2030
  • Volvo invests in Waabi to strengthen autonomous truck offering
  • Hacking Robots: The 5 Threats You Need to Know About
  • AMD launches Kria ecosystem program to help developers bring automation solutions to market faster

Footer

We are…

Robotics and Automation News was established in May, 2015, and is now one of the most widely-read websites in its category.

Please consider supporting us by becoming a paying subscriber, or through advertising and sponsorships, or by purchasing products and services through our shop – or a combination of all of the above.

Thank you.

Independent

Archivists

May 2020
M T W T F S S
 123
45678910
11121314151617
18192021222324
25262728293031
« Apr   Jun »

Complex

Old-skool

This website and its associated magazine, and weekly newsletter, are all produced by a small team of experienced journalists and media professionals.

If you have any suggestions or comments, feel free to contact us at any of the email addresses on our contact page.

We’d be happy to hear from you, and will always reply as soon as possible.

Future-facing

Free, fair and legal

We support the principles of net neutrality and equal opportunities.

Member of The Internet Defense League

Copyright © 2023 · News Pro on Genesis Framework · WordPress · Log in

We use cookies on our website to give you the most relevant experience by remembering your preferences and repeat visits. By clicking “Accept”, you consent to the use of ALL the cookies.
Do not sell my personal information.
Cookie SettingsAccept
Manage consent

Privacy Overview

This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience.
Necessary
Always Enabled
Necessary cookies are absolutely essential for the website to function properly. These cookies ensure basic functionalities and security features of the website, anonymously.
CookieDurationDescription
cookielawinfo-checkbox-analytics11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Analytics".
cookielawinfo-checkbox-functional11 monthsThe cookie is set by GDPR cookie consent to record the user consent for the cookies in the category "Functional".
cookielawinfo-checkbox-necessary11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookies is used to store the user consent for the cookies in the category "Necessary".
cookielawinfo-checkbox-others11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Other.
cookielawinfo-checkbox-performance11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Performance".
viewed_cookie_policy11 monthsThe cookie is set by the GDPR Cookie Consent plugin and is used to store whether or not user has consented to the use of cookies. It does not store any personal data.
Functional
Functional cookies help to perform certain functionalities like sharing the content of the website on social media platforms, collect feedbacks, and other third-party features.
Performance
Performance cookies are used to understand and analyze the key performance indexes of the website which helps in delivering a better user experience for the visitors.
Analytics
Analytical cookies are used to understand how visitors interact with the website. These cookies help provide information on metrics the number of visitors, bounce rate, traffic source, etc.
Advertisement
Advertisement cookies are used to provide visitors with relevant ads and marketing campaigns. These cookies track visitors across websites and collect information to provide customized ads.
Others
Other uncategorized cookies are those that are being analyzed and have not been classified into a category as yet.
SAVE & ACCEPT