• Skip to primary navigation
  • Skip to main content
  • Skip to primary sidebar
  • Skip to secondary sidebar
  • Skip to footer
  • Home
  • Subscribe
  • Your Membership
    • Edit Your Profile
  • Services
    • Advertising
    • Case studies
    • Design
    • Email marketing
    • Lead generation
    • Magazine
    • Press releases
    • Publishing
    • Sponsored posts
    • Webcasting
    • Webinars
    • White papers
    • Writing
  • Shop
    • My Account
    • Cart
  • About
    • Contact
    • Privacy
    • Terms of use
  • Events

Robotics & Automation News

Market trends and business perspectives

  • News
  • Features
  • Video
  • Webinars
  • White papers
  • Press releases
  • Featured companies
    • AMD Xilinx
    • BlueBotics
    • Elite Robot
    • RGo Robotics
    • SICK Sensor Intelligence
    • Vicor Power
Claude Florin, CEO, Fastree3D

Robot vision: Mine eyes have seen the glory of three dimensions

February 12, 2016 by Abdul Montaqim

Euro NCAP has been conducting tests to see how well autonomous cars can see pedestrians
Euro NCAP has been conducting tests to see how well autonomous cars can see pedestrians

Exclusive interview with Claude Florin, CEO of Fastree3D, on helping robots finally see the light just that little bit better than they did before

How do robots see the world? Until now, most of them have had to make do with conventional digital cameras for eyes. In technological terms, these cameras are much like those available to consumers in the shops and, increasingly these days, in their smartphones. As clever as they are, and as high quality as the images turn out to be, these cameras only capture the image as a two-dimensional arrangement of pixels.

This means that a robot using such cameras would not able to perceive the three-dimensional space its “eyes” are looking at. This problem of perception – of perceiving 3D space as 2D space – is solved, or at least tackled, at the coding stage.

To program the robot to translate the flat image into a three-dimensional space, and infer such things as depth, distance and geospatial location, is really quite difficult if approached from a purely computer programming – as in, coding – standpoint. 

The better solution would be to use cameras that send 3D images of what the robot is looking directly into its brain, or its artificial intelligence engine. This would eliminate the need to write probably thousands of lines of code which may or may not work in a given environment.

With such 3D cameras and vision, robots can probably observe and move within their surroundings with much more efficiency and accuracy, using their constantly-updating geospatially accurate model of the world it finds itself in.

The technology to provide robots with 3D vision has been available for quite some time, but only recently has the technology developed to a point where it can be made available at a reasonable price.

One of the companies at the forefront of the innovations that have led to 3D vision technologies being cost-effective enough to use in consumer electronic products is Fastree3D, a Switzerland-based company that grew out of the Bern University of Applied Sciences, the Delft University of Technology, and the Ecole polytechnique fédérale de Lausanne (EPFL).

Armed with more than 10 patents, Fastree3D was recently voted one of Switzerland’s top 25 startups in all categories. And in a more relevant category, photonics, it was considered one of the top 15 startups.

A number of other plaudits have been bestowed on the company and there are high hopes that its visionary technology – pun intended, droll as it is – will be accepted widely and lead to commercial success. The critical ingredient in its recipe for success is something Fastree3D calls its “time-of-flight” technology, or ToF, which the company says precisely resolves the distance based on the speed of light. Sounds clever, and surely it must be if it’s based on the understanding and calculation of the speed of light.

Claude Florin, CEO, Fastree3D
Claude Florin, CEO, Fastree3D

Claude Florin, chief executive officer of Fastree3D, is confident the company has something to offer the market. In an interview with Robotics and Automation News, he says: “Fastree3D Time-of-Flight imager brings unprecedented sensing price and performance for mid-range 3D imaging and fast motion applications.

“The system integrates CMOS single photon detectors (SPAD), laser array illuminators, SoC and FPGA with a developer’s kit. The innovation results from leading research, nine patents, and industrial validation.

“Fastree3D is a fabless semiconductor company that delivers products, services and licensing rights to the robotics and automotive industries. Our goal is to establish our SPAD based on ToF technology as the standard for volume applications in the market.

“During the first five years we will demonstrate the feasibility with a capital-efficient joint-development strategy with partners. After those five years, we will favor either an acquisition or evolve to long-term intellectual property (IP)-licensing business model in which we neither manufacture nor sell semiconductors incorporating our technology.”

The applications for 3D imagers are many and varied. The one that immediately springs to mind is cars, which are increasingly being equipped with safety features such as autonomous emergency braking (AEB), and collision detection systems. Fastree3D itself emphasises technology that will help cars identify and avoid pedestrians, an area that the European car safety group – Euro New Car Assessment Programme (Euro NCAP) – is also looking into, and has already conducted a number of tests.

Euro NCAP’s secretary general, Dr Michiel van Ratingen, says: “These new tests are the first in the world to assess highly automated vehicle features and driver assistance systems from the pedestrian’s perspective.

“Many new cars now offer some form of AEB system that can help prevent car-to-car collisions, but only some are also able to detect pedestrians. By checking the results on Euro NCAP’s website, consumers will be able to verify manufacturers’ safety claims and choose the right AEB option.”

https://roboticsandautomationnews.com2016/02/12/the-floow-of-traffic-is-about-to-change-forever/2523/

Innovative as it is, Fastree3D does have competitors in this burgeoning business sector. Florin, who studied at the Massachusetts Institute of Technology (MIT) as well as EPFL, says Fastree3D’s competitors fall into two main groups:

  1. 3D camera manufacturers. 3D camera manufacturers mostly integrating indirect ToF. A few implemented high-end direct time-of-flight for research applications.
  2. Specialised photo sensor suppliers. These companies offer photo sensors and engineering services similar to Fastree3D. However the majority operates in industries such as telecoms or scientific instruments. Most of them, deliver more expensive technologies (single cell or small array APD, expensive InGaAs, or only indirect ToF modulated light approaches).
    Critical competitive advantages.

Florin says: “The Fastree3D implementation integrates a CMOS detector and a semiconductor illuminator, based on the detection principle of Time-Correlated Single-Photon Counting (TCSPC), a form of direct Time-of-Flight (ToF).

“Other commonly used terminologies for ToF solutions are Lidar (light detection and ranging) and ladar (laser radar).

“The other optical measurement technologies offer different ranges and resolutions and are well known: interferometry, triangulation, video analysis (inter-frame, plenoptic, and so on), and indirect ToF (illuminating with modulated light and deriving time from the phase shift of reflected light).”

Florin views the technical and performance benefits of Fastree3D’s system as being:

Higher reliability. We will provide unambiguous measurements, insensitive to background light and color contrast. Customers benefit from meaningful, actionable data for navigation out of complex environments.

spad technology, fastree3d
Fastree3D can deliver subsystems or cross-license the SPAD technology, on a nonexclusive basis

Better sensitivity. Compared with competing active illumination cameras, FastSight requires less emitted optical power to allow imaging farther away (>30m) and at higher frame rate (<2ms/image or >500fps at <10m).

In terms of the market for Fastree3D’s technology, Florin says the customers are mainly from outside Switzerland, despite their being many Swiss robotics companies –ABB being one particularly famous example.

He adds that the main business sectors Fastree3D is targeting include “advanced machine vision, also known as ‘industrial vision’ or ‘vision guided robotics’, focused on computer vision in the perspective of industrial manufacturing processes like quality control, automated manufacturing robots, autonomous vehicle guidance.  Machine vision system typically performs ‘sensor fusion’ from of multiple cameras capturing 1D, 2D, 2D ½ or 3D image data, and one or more control system processing such data to extract shapes, distances, speed”.

As for future plans, Florin says: “We intend to operate a fabless semi-conductor business with outsourced camera manufacturing. Our core control will be the subsystem SoC [system-on-chip] sensor design – including masks, layouts and embedded software algorithms for readout.

“We can deliver subsystems or cross-license the SPAD technology, on a nonexclusive basis, to image sensor semiconductor manufacturers or industrial vision camera integrators.

“Our technology will be used for security cameras as well as Advanced Driving Assistance Systems for automotive industry. Our future SoC platform (SDK) will be as flexible as possible in order to be integrated in many applications as possible. The resolution of the SoC is targeted to have a QQVGA [quarter quarter VGA] resolution.”

Only just into its third year of operation, Fastree3D has a team of seven key personnel, two of whom are professors and one a doctor.

Florin says the key trends of interest to the company are machine vision in general, automotive and consumer markets – smartphones and tablets.

As for its future prospects, Florin has embraced the world of business. He says: “We are a fully commercial company as Fastree3D was born in 2013 as a spin-off from EPFL and TU-Delft. Bern University is only a research partner on a special research project.

“It is clear IP development is ongoing. From 2014 onwards, we really saw an increasing demand for direct ToF. Before 2014, there were a lot of industry companies thinking this would remain exclusively for the academic domain.”

Sounds like the accelerated development in robotics and related technologies, as well as its acceptance in the wider market, is something Florin did not expect to happen so soon. But the evidence is there for everyone to see if they have the means to do so – robotics and automation technology is gradually taking over the world. It’s just that most people hadn’t noticed until now.

Print Friendly, PDF & Email

Share this:

  • Print
  • Facebook
  • LinkedIn
  • Reddit
  • Twitter
  • Tumblr
  • Pinterest
  • Skype
  • WhatsApp
  • Telegram
  • Pocket

You might also like…

Filed Under: Miscellaneous Tagged With: 3d vision for robots and cameras, cameras, claude, fastree, fastree3d, florin, robotics, soc, tof

Join the Robotics & Automation News community

Primary Sidebar

Latest articles

  • What to Look for When Searching for a Metal Fabrication Company
  • Unlock the Benefits of 25G Network with 25GBASE-SR Modules
  • Best Dentists in Dallas
  • Körber develops new robotic system for de-palletizing pallets to trays
  • Autonomous logistics startup Venti Technologies raises $28.8 million in Series A funding
  • Autonomous mobile robots market expected to expand at 22 percent a year
  • Will a robot take my job? Notre Dame researcher says this view is overly pessimistic
  • Flexiv partners with Doco Engineering to meet ‘expanding US robotics demand’
  • Addverb opens second software development centre in India
  • ABI Research gives 16 autonomous forklift system vendors competitive rankings

Most Read

  • Top 20 electric vehicle charging station companies
    Top 20 electric vehicle charging station companies
  • Top Benefits of Using Automation in Your Business
    Top Benefits of Using Automation in Your Business
  • Scientists have found more water in space than they ever knew possible
    Scientists have found more water in space than they ever knew possible
  • Difference Between Three-Phase and Single-Phase Power
    Difference Between Three-Phase and Single-Phase Power
  • What You Need to Know About Fixing an Engine Misfire
    What You Need to Know About Fixing an Engine Misfire
  • How to Know if Your iPhone is Being Tracked? Check This!
    How to Know if Your iPhone is Being Tracked? Check This!
  • IoT Basics: A Guide to the Internet of Things for Beginners
    IoT Basics: A Guide to the Internet of Things for Beginners
  • Top 20 programmable logic controller manufacturers
    Top 20 programmable logic controller manufacturers
  • Why is My Car Key Stuck in the Ignition?
    Why is My Car Key Stuck in the Ignition?
  • Hengbot unveils ‘world’s first robotic dog with musculoskeletal limbs’
    Hengbot unveils ‘world’s first robotic dog with musculoskeletal limbs’

Overused words

ai applications automated automation automotive autonomous business companies company control customers data design development digital electric global industrial industry logistics machine manufacturing market mobile operations platform process production robot robotic robotics robots safety software solution solutions system systems technologies technology time vehicle vehicles warehouse work

Secondary Sidebar

Latest news

  • What to Look for When Searching for a Metal Fabrication Company
  • Unlock the Benefits of 25G Network with 25GBASE-SR Modules
  • Best Dentists in Dallas
  • Körber develops new robotic system for de-palletizing pallets to trays
  • Autonomous logistics startup Venti Technologies raises $28.8 million in Series A funding
  • Autonomous mobile robots market expected to expand at 22 percent a year
  • Will a robot take my job? Notre Dame researcher says this view is overly pessimistic
  • Flexiv partners with Doco Engineering to meet ‘expanding US robotics demand’
  • Addverb opens second software development centre in India
  • ABI Research gives 16 autonomous forklift system vendors competitive rankings

Footer

We are…

Robotics and Automation News was established in May, 2015, and is now one of the most widely-read websites in its category.

Please consider supporting us by becoming a paying subscriber, or through advertising and sponsorships, or by purchasing products and services through our shop – or a combination of all of the above.

Thank you.

Independent

Archivists

February 2016
M T W T F S S
1234567
891011121314
15161718192021
22232425262728
29  
« Jan   Mar »

Complex

Old-skool

This website and its associated magazine, and weekly newsletter, are all produced by a small team of experienced journalists and media professionals.

If you have any suggestions or comments, feel free to contact us at any of the email addresses on our contact page.

We’d be happy to hear from you, and will always reply as soon as possible.

Future-facing

Free, fair and legal

We support the principles of net neutrality and equal opportunities.

Member of The Internet Defense League

Copyright © 2023 · News Pro on Genesis Framework · WordPress · Log in

We use cookies on our website to give you the most relevant experience by remembering your preferences and repeat visits. By clicking “Accept”, you consent to the use of ALL the cookies.
Do not sell my personal information.
Cookie SettingsAccept
Manage consent

Privacy Overview

This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience.
Necessary
Always Enabled
Necessary cookies are absolutely essential for the website to function properly. These cookies ensure basic functionalities and security features of the website, anonymously.
CookieDurationDescription
cookielawinfo-checkbox-analytics11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Analytics".
cookielawinfo-checkbox-functional11 monthsThe cookie is set by GDPR cookie consent to record the user consent for the cookies in the category "Functional".
cookielawinfo-checkbox-necessary11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookies is used to store the user consent for the cookies in the category "Necessary".
cookielawinfo-checkbox-others11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Other.
cookielawinfo-checkbox-performance11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Performance".
viewed_cookie_policy11 monthsThe cookie is set by the GDPR Cookie Consent plugin and is used to store whether or not user has consented to the use of cookies. It does not store any personal data.
Functional
Functional cookies help to perform certain functionalities like sharing the content of the website on social media platforms, collect feedbacks, and other third-party features.
Performance
Performance cookies are used to understand and analyze the key performance indexes of the website which helps in delivering a better user experience for the visitors.
Analytics
Analytical cookies are used to understand how visitors interact with the website. These cookies help provide information on metrics the number of visitors, bounce rate, traffic source, etc.
Advertisement
Advertisement cookies are used to provide visitors with relevant ads and marketing campaigns. These cookies track visitors across websites and collect information to provide customized ads.
Others
Other uncategorized cookies are those that are being analyzed and have not been classified into a category as yet.
SAVE & ACCEPT