• Skip to primary navigation
  • Skip to main content
  • Skip to primary sidebar
  • Skip to secondary sidebar
  • Skip to footer
  • Home
  • Subscribe
  • Your Membership
    • Edit Your Profile
  • Services
    • Advertising
    • Case studies
    • Design
    • Email marketing
    • Lead generation
    • Magazine
    • Press releases
    • Publishing
    • Sponsored posts
    • Webcasting
    • Webinars
    • White papers
    • Writing
  • Shop
    • My Account
    • Cart
  • About
    • Contact
    • Privacy
    • Terms of use
  • Events

Robotics & Automation News

Market trends and business perspectives

  • News
  • Features
  • Sections A-Z
    • Agriculture
    • Aircraft
    • Artificial Intelligence
    • Automation
    • Autonomous vehicles
    • Business
    • Computing
    • Construction
    • Design
    • Drones
    • Economy
    • Energy
    • Engineering
    • Environment
    • Health
    • Humanoids
    • Industrial robots
    • Industry
    • Infrastructure
    • Investments
    • Logistics
    • Manufacturing
    • Marine
    • Material handling
    • Materials
    • Mining
    • Promoted
    • Research
    • Robotics
    • Science
    • Sensors
    • Service robots
    • Software
    • Space
    • Technology
    • Transportation
    • Warehouse robots
    • Wearables
  • Video
  • Webinars
  • White papers
  • Press releases
  • Featured companies
    • AMD Xilinx
    • BlueBotics
    • Elite Robot
    • RGo Robotics
    • SICK Sensor Intelligence
    • Vicor Power

Picking the Unknown: Robust and Flexible Robotic Automation in Logistics

February 9, 2021 by Elaine Leave a Comment

The global pandemic has radically impacted the supply chain and logistics industry, making the need for robotic automation more urgent than ever. With more than 70 percent of labor in warehousing being dedicated to picking and packing, numerous companies are gradually investing in logistics automation.

But what happens when the robots must handle an unlimited number of (unknown) stock keeping units? These companies need a fast, reliable, and robust way to automate picking and placing of a large variety of objects.

This challenge was taken up successfully by the Dutch company Fizyr. The computer vision company based in Delft focuses on enabling robots to pick unknown objects even in harsh logistics environments.

The result is an automated vision solution that enables logistic automation in various conditions and applications, like item picking, parcel handling, depalletising, truck unloading or baggage handling. To complete the system with the optimal hardware, Fizyr integrates compact, robust Ensenso 3D cameras in combination with high performance GigE uEye cameras from IDS.

Instead of providing a proprietary picking cell, like most players in the market do, Fizyr has created a plug-and-play modular software product that integrates smoothly with any system, giving integrators the freedom to choose the best hardware (for example, cobots or Industrial robots) for their picking cell.

While facilitating cost, robustness, and speed optimization, IDS is the preferred partner in terms of cameras. In essence, the camera sees products to be picked or classified. Depending on the individual customer application, up to four Ensenso 3D cameras in combination with powerful GigE uEye CMOS cameras are used.

The integrated IDS industrial cameras ensure a reliable, precise image capture that is needed for Fizyr’s software algorithms which provide over 100 grasp poses each second, including the classification to handle objects differently.

The software also performs quality controls and detects defects to prevent damaged items from being placed on a sorter – with the help of IDS cameras as sharp eyes of the automatic system.

Thus these algorithms are able to provide all relevant information about segmentation as well as about classification of type of parcel (including box, bag, envelope/flat, tube, cylinder, deformable, and so on).

The system recognizes outliers or non-conveyables (that is, damaged goods), best possible grasp poses in 6 DoF (degrees of freedom) and multiple ordered poses per object.

It allows sensors or robots to deal with closely stacked or overlapping objects, highly reflective items and apparel in polybags, white-on-white and black-on-black flats, as well as transparent objects.

Since the Stereo Vision quality directly depends on the scene’s light condition and object surface textures, finding and calculating coordinates of corresponding points on less textured or reflecting surfaces is very difficult.

To meet these high requirements, Fizyrs first choice for customer solutions are camera models out of the IDS portfolio. Thereby the tasks are well divided: The uEye GigE CP camera is taking 2D images of objects and provides them as input for Fizyr’s algorithms, which then proceed to classify the objects under the camera.

The objects can be unknown and varying in shape, size, color, material, and stacking. Then the Ensenso camera creates the point cloud maps, Fizyr’s software combines it with the information from the 2D image and analyses the surface of the cloud for suitable grasp poses for the gripper (or multiple grippers) and proposes the best ones.

A clear representation of surfaces for different materials is critical, as it is a key component of its algorithms. No problem for the Ensenso 3D cameras from IDS: They improve the classic Stereo Vision principle by additional techniques to achieve a higher quality depth information and more precise measurement results.

The system robustly segments unknown parcels, even under harsh lighting conditions

The specific camera models, as well as the number of cameras per system, depend on the individual use case of the customer. For a typical bin-picking solution with a cobot, one Ensenso N35 is used in combination with a GigE uEye CP, but there are clients that use one Ensenso X36 and a GigE uEye CP for bin picking together with four Ensenso N35 cameras for stowing the item in other bins.

The recommended uEye CP stands for “Compact Power” and is the tiny powerhouse for industrial applications of all kinds. It offers maximum functionality with extensive pixel pre-processing and, thanks to the internal 120 MB image memory, is also perfectly suited for multi-camera systems. The camera delivers data at full GigE speed and enables single-cable operation up to 100 metres via PoE (“Power over Ethernet”).

The selected UI-5240CP-C-HQ Rev. 2 is a particularly powerful industrial camera with the e2v 1.3 megapixel CMOS sensor.

This is one of the most sensitive sensors in the IDS product portfolio and apart from the here used a color version it is available in monochrome and as NIR version. Besides its outstanding sensitivity to light, the camera also has a range of other distinctive features which makes the sensor extremely flexible if requirements or ambient conditions change.

The compact and robust aluminum housing of the Ensenso N35 3D camera with lockable GPIO connector for trigger and flash and GigE connector, has two monochrome CMOS sensors (Global Shutter, 1280 x 1024 pixels) and a projector.

Via Power over Ethernet a data transfer and power supply are possible with long cable lengths. Due to the integrated FlexView technology the N35 models are particularly suitable for 3D acquisition of still objects and for working distances up to 3,000 mm. 

The Ensenso X36 3D camera system consists of a projector unit, two GigE uEye cameras either with 1.3 MP or 5 MP sensors (CMOS, monochrome), mounting brackets and adjustment angles, three lenses as well as sync. and patch cables to connect the camera with the projector unit. The FlexView technology ensures a better spatial resolution as well as a very high robustness of the system for dark or reflecting surfaces.

“Fizyr normally uses one camera per system, usually uEye cameras in combination with Ensenso N35 and X36, but there are no limitations. The most common use case for Fizyr so far is one uEye and one Ensenso per system,” underlines Herbert ten Have, CEO at Fizyr.

The different Ensenso models that can be used have one thing in common: the dispose of a light-intensive projector produces a high-contrast texture on the object surface by using a pattern mask, even under difficult light conditions.

The projected texture supplements the weak or non-existent object surface structure. Therefore this principle is also called “Projected Texture Stereo Vision”.

The result is a more detailed disparity map and a more complete and homogeneous depth information of the scene.

Data acquisition

Their extensive features qualify both Ensenso 3D camera models for the wide range of demanding applications in the supply chain and logistics industry, such as 3D object recognition, classification and localization (e.g. quality assurance, commissioning), logistics automation (for example, de-palletizing), robot applications (for example, bin picking), capture of objects up to 8 cubic metres, (for example, pallets) or automatic storage systems.

“Fizyr has integrated the Ensenso SDK in its software using a modern and fast wrapper,” Herbert ten Have explains. “A great advantage is the 2D/3D combination, which allows the image from the 2D camera to be placed over the 3D point cloud as an overlay.”

This provides a more vivid impression of the scene. On the other hand, the camera image can be optimally adjusted to the robot coordinate system by means of “hand-eye calibration” in order to ensure a target-oriented gripping.

Outlook

The strong growth of e-commerce has increased the demand for larger packages. At the same time, the constraints imposed by the global pandemic have led both to a reduction in the available labour force and to an urgent need for physical distance in companies.

To meet these challenges, companies are increasingly turning to robotic automation, in which artificial intelligence and machine vision play a crucial role. At the same time, this reduces costs and increases occupational safety.

The demand for high-quality modules for state-of-the-art automated picking cells is growing worldwide. System integrators’ requirements for software and hardware components are increasing in equal measure. The Fizyr-IDS solution offers the following advantages:

  • As a plug-and-play solution, it enables easy integration into any system.
  • It is hardware-agnostic and thus enables customers to flexibly adapt their order picking system to their needs at any time.
  • It includes a robust, precise, flexible and easy-to-use 3D vision system that provides optimal object information at all times

All of them are indispensable components of a future-proof automated “Good-To-Person” system.

Author: Silke von Gemmingen, IDS Imaging Development Systems
Tel: +49 7134 96196-0
Email: s.gemmingen@ids-imaging.de
Website: www.ids-imaging.com

© 2021 IDS Imaging Development Systems GmbH

Print Friendly, PDF & Email

Share this:

  • Print
  • Facebook
  • LinkedIn
  • Reddit
  • Twitter
  • Tumblr
  • Pinterest
  • Skype
  • WhatsApp
  • Telegram
  • Pocket

You might also like…

Filed Under: Features, Industry Tagged With: ensenso, Ensenso N35, Ensenso N35 3D camera, Fizyr, FlexView Technology, GigE uEye CP, ids, integrated FlexView technology, Projected Texture Stereo Vision, ueye, UI-5240CP-C-HQ Rev. 2

Join the Robotics & Automation News community

Reader Interactions

You must log in to post a comment.

Primary Sidebar

Latest articles

  • Choosing the Best Magento Ecommerce Development Company: A Guide to Success
  • How to Promote Your Homemade Food Business Online
  • 3 Best Site to Buy Instagram Followers UK (Real & Cheap)
  • Email Marketing Automation with Retainly
  • Top 10 Amazing Tips to Transport Your Car in 2023
  • Maximizing Profit on Amazon: Utilizing the Amazon FBA Calculator and Analyzing Price History
  • North America Becomes the Fastest-Growing Regional Market for New Battery Facilities in 2022
  • The Ultimate Guide to Artist Alley: Con Prep and the Magic of Acrylic and Custom Keychains
  • Choosing a Robotic Spindle for Deburring
  • The Future of Modern Application Development with .NET

Most Read

  • Snapchat Plus Planet Order 2023 Explained
    Snapchat Plus Planet Order 2023 Explained
  • Why is Money Important in Our Lives?
    Why is Money Important in Our Lives?
  • Top 20 electric vehicle charging station companies
    Top 20 electric vehicle charging station companies
  • How to Track a Phone Number on Google Maps
    How to Track a Phone Number on Google Maps
  • Difference Between Three-Phase and Single-Phase Power
    Difference Between Three-Phase and Single-Phase Power
  • Why is My Car Key Stuck in the Ignition?
    Why is My Car Key Stuck in the Ignition?
  • Top 20 programmable logic controller manufacturers
    Top 20 programmable logic controller manufacturers
  • The Future of Personal Computers: What to Expect in the Next Decade
    The Future of Personal Computers: What to Expect in the Next Decade
  • Scientists have found more water in space than they ever knew possible
    Scientists have found more water in space than they ever knew possible
  • What You Need to Know About Fixing an Engine Misfire
    What You Need to Know About Fixing an Engine Misfire

Overused words

ai applications automated automation automotive autonomous business companies company control customers data design development digital electric global industrial industry logistics machine manufacturing market mobile operations platform process production robot robotic robotics robots safety software solution solutions system systems technologies technology time vehicle vehicles warehouse work

Secondary Sidebar

Latest news

  • Choosing the Best Magento Ecommerce Development Company: A Guide to Success
  • How to Promote Your Homemade Food Business Online
  • 3 Best Site to Buy Instagram Followers UK (Real & Cheap)
  • Email Marketing Automation with Retainly
  • Top 10 Amazing Tips to Transport Your Car in 2023
  • Maximizing Profit on Amazon: Utilizing the Amazon FBA Calculator and Analyzing Price History
  • North America Becomes the Fastest-Growing Regional Market for New Battery Facilities in 2022
  • The Ultimate Guide to Artist Alley: Con Prep and the Magic of Acrylic and Custom Keychains
  • Choosing a Robotic Spindle for Deburring
  • The Future of Modern Application Development with .NET

Footer

We are…

Robotics and Automation News was established in May, 2015, and is now one of the most widely-read websites in its category.

Please consider supporting us by becoming a paying subscriber, or through advertising and sponsorships, or by purchasing products and services through our shop – or a combination of all of the above.

Thank you.

Independent

Archivists

February 2021
M T W T F S S
1234567
891011121314
15161718192021
22232425262728
« Jan   Mar »

Complex

Old-skool

This website and its associated magazine, and weekly newsletter, are all produced by a small team of experienced journalists and media professionals.

If you have any suggestions or comments, feel free to contact us at any of the email addresses on our contact page.

We’d be happy to hear from you, and will always reply as soon as possible.

Future-facing

Free, fair and legal

We support the principles of net neutrality and equal opportunities.

Member of The Internet Defense League

Copyright © 2023 · News Pro on Genesis Framework · WordPress · Log in

We use cookies on our website to give you the most relevant experience by remembering your preferences and repeat visits. By clicking “Accept”, you consent to the use of ALL the cookies.
Do not sell my personal information.
Cookie SettingsAccept
Manage consent

Privacy Overview

This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience.
Necessary
Always Enabled
Necessary cookies are absolutely essential for the website to function properly. These cookies ensure basic functionalities and security features of the website, anonymously.
CookieDurationDescription
cookielawinfo-checkbox-analytics11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Analytics".
cookielawinfo-checkbox-functional11 monthsThe cookie is set by GDPR cookie consent to record the user consent for the cookies in the category "Functional".
cookielawinfo-checkbox-necessary11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookies is used to store the user consent for the cookies in the category "Necessary".
cookielawinfo-checkbox-others11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Other.
cookielawinfo-checkbox-performance11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Performance".
viewed_cookie_policy11 monthsThe cookie is set by the GDPR Cookie Consent plugin and is used to store whether or not user has consented to the use of cookies. It does not store any personal data.
Functional
Functional cookies help to perform certain functionalities like sharing the content of the website on social media platforms, collect feedbacks, and other third-party features.
Performance
Performance cookies are used to understand and analyze the key performance indexes of the website which helps in delivering a better user experience for the visitors.
Analytics
Analytical cookies are used to understand how visitors interact with the website. These cookies help provide information on metrics the number of visitors, bounce rate, traffic source, etc.
Advertisement
Advertisement cookies are used to provide visitors with relevant ads and marketing campaigns. These cookies track visitors across websites and collect information to provide customized ads.
Others
Other uncategorized cookies are those that are being analyzed and have not been classified into a category as yet.
SAVE & ACCEPT