• Skip to primary navigation
  • Skip to main content
  • Skip to primary sidebar
  • Skip to secondary sidebar
  • Skip to footer
  • Home
  • Subscribe
  • Your Membership
    • Edit Your Profile
  • Services
    • Advertising
    • Case studies
    • Design
    • Email marketing
    • Lead generation
    • Magazine
    • Press releases
    • Publishing
    • Sponsored posts
    • Webcasting
    • Webinars
    • White papers
    • Writing
  • Shop
    • My Account
    • Cart
  • About
    • Contact
    • Privacy
    • Terms of use
  • Events

Robotics & Automation News

Market trends and business perspectives

  • News
  • Features
  • Video
  • Webinars
  • White papers
  • Press releases
  • Featured companies
    • BlueBotics
    • SICK Sensor Intelligence
    • Vicor Power
robotized endurance open-source platform

Endurance Robots launches fully roboticized open-source platform

August 17, 2016 by Sam Francis

robotized endurance open-source platform

Promoted

A year ago we started tо work at a platform to be used as a basis for a simple robotic interface.  Our task was to combine face and voice recognition with voice synthesis.

We began with a simpler task: voice synthesis, as this task is solved by many vendors.  In 1984 Steve Jobs surprised everybody at his Macintosh presentation when the first Mac started speaking.

We did not have any problems with the selection of the speech synthesis modules. They all work well and have a wide choice of voices.

Finally, we used the standard Microsoft SAPI.  This product with various language sets is distributed free of charge. 

As for the image recognition, the task here was more complicated, as we needed not just to recognize a face or an object but to recognize it in the streaming video going from the camera.  The choice of the resources used by the program is very important.  It does not matter for a computer but does matter for a tablet, as the program should work efficiently and should not slow or stop the system.    

For this solution we used the OpenCV library. To speed up the work, any face of a certain size in the camera field vision is searched for. The search is done with the help of Haar cascades and the ready trained template from the OpenCV library.

A detected face is cut out, normalized (unified) in size and light, and reproduced in black and white. 

After that a ready FaceRecognizer algorithm, trained on a number of images of the same face taken from different angles, is used to recognize a certain person.

Now let’s go to a more complicated part – voice recognition.

Here we have spent 90% of our labor and should admit that only now we are fully satisfied with the result. We tried to use ready Open Source solutions.

Unfortunately,  99% of these solutions are either not free or poor. That is, if you say “Manchester” the system hears “Liverpool”. We had to choose and try various words and combinations.

Thus, a well-known Open Source Sphinx works off-line and has all the necessary tools, but it takes much time to train it to get more or less acceptable level of recognition.   

At the end we chose Google Speech API, which maintains not more than 50 recognitions a day (about 15 minutes of the recognition process). It’s enough for a demo.

The Google program has a good quality of recognition. It works even at the distance of a few meters. 

So, how does the program work?

The first thing the program does when activated is to detect a face in the field of camera vision. If it sees the face for the first time (it is not found in the database), it asks to enter and save the name.  After that the program will always recognize this face. 

Then the program switches to the mode of speech recognition: pronounced words, sentences or commands. As soon as the program recognizes a phrase, pronounced be a person, it looks for an adequate answer in the database and voices the answer.  It is necessary to put all possible answers into the program beforehand for the program to know what to say. So far, it looks like a simple text file.

This is not about an artificial intellect. This is about an interface for image and speech recognition and speech synthesis.

So, what possibilities do this program and the interface open? It is possible to use them for development of a certain robotic platform. This kind of platforms exists nowadays as electronic kiosks.   

As we see it, this program will look more elegant if used together with our DIY SelfieBot.

Let’s consider theoretical options of the platform application

Conference registration counter SelfieBot

Problem to be solved: reduction of conference staff costs.

Task: Support of conference visitors and guests with a user-friendly interface for automatic online registration.

Solution: A guest comes to the registration counter, tells his name. The system recognized him, checks him in the database and registers the guest online.   

Example:

– Introduce yourself, please.

– Tim Cook.

– Good afternoon, Tim. We welcome you at our conference. 

robotized endurance open-source platform

robotized endurance open-source platform

Virtual secretary SelfieBot

Problem to be solved: reduction of expenses for a secretary work in an office center.

Task: Support of visitors with a user-friendly interface for automatic registration when visiting an office center.

Solution: A guest comes to the SelfieBot and tells his name. The info goes to the receiving party as a text or voice mail.    

Example:

– Please, introduce yourself.

– Steve Voznyak.

– Thank you for coming. You’ll be welcomed now, Steve. Have a nice day!

robotized endurance open-source platform

robotized endurance open-source platform

Self-service terminal SelfieBot

Problem to be solved: reduction of expenses for customers’ self-service and improvement of the service quality.

Task: Customer support with a user-friendly interface for interaction with a self-service terminal. Voice communication.

Solution: A guest comes to the terminal and tells what he wants to do. No need to touch the screen.

Example:

– Good afternoon. What would you like to do?

– I’d like to know when my credit repayment is due. My account number is 35310204.

– It is due before the 30th day of the following month. 

robotized endurance open-source platform

Shop assistant SelfieBot

Problem to be solved: reduction of expenses for personnel and virtual information service. 

Task: Customer support with a user-friendly interface for interaction with an electronic shop assistant.

Solution: A customer approaches the electronic assistant, asks questions and gets all the necessary information. 

Example:

– Good afternoon! We are happy to see you in our shop.

– What special discounts do you offer?

– We offer 10% discounts to our regular customers for all goods.

– Do you have new collections?

– We do, you’ll find them in the far right-hand corner.

robotized endurance open-source platform

robotized endurance open-source platform 3

Robot-waiter SelfieBot in a café/restaurantе

Problem to be solved: reduction of expenses for personnel;  waiting time reduction.

Task: Customer support with a user-friendly interface for interaction with an electronic waiter.

Solution: A robot-waiter approaches a customer, asks if he is ready with the order and takes the order.   

Example:

– Good afternoon! We are happy to see you in our café. Are you ready with the order?

– Yes. Please, bring me one cappuccino and a croissant. 

– Thank you for the order. You’ll get it in 5 minutes.

robotized endurance open-source platform

robotized endurance open-source platform

We invite schools and colleges for cooperation. We are ready to share our project with you for non-commercial purposes and further researches.

We remind you that the project is open-source and is distributed among educational institutions free of charge.

https://www.youtube.com/watch?v=lbKiUkbyGmE

Ask us any questions you might have gf@EnduranceRobots.com

Skype: George.fomitchev

Talk to us: +7 916 225 4302 (including WhatsApp, Viber)

Lean more about us: http://EnduranceRobots.com

Print Friendly, PDF & Email

Share this:

  • Print
  • Facebook
  • LinkedIn
  • Reddit
  • Twitter
  • Tumblr
  • Pinterest
  • Skype
  • WhatsApp
  • Telegram
  • Pocket

You might also like…

Filed Under: Computing, News Tagged With: assistant, camera, conference, database, electronic, face, interaction, interface, platform, problem, program, recognition, selfiebot, solved, speech, synthesis, task, terminal, user-friendly, voice

Join the Robotics & Automation News community

Primary Sidebar

Latest articles

  • Continental to unveil new autonomous mobile robots for first time at LogiMAT
  • GreyOrange raises $110 million for ‘growth financing’
  • Ally Robotics aims to raise $8.5 million to bring automation to the restaurant industry
  • ABB launches new robotic depalletizer to ‘reduce complexity and improve efficiency’
  • Switzerland’s largest trade fair celebrates its 20th anniversary with a promising edition
  • Seegrid launches online knowledge base for its autonomous mobile robots
  • Hydroplane highlights its hydrogen fuel cell powerplant development
  • How does Intralogistics support warehouse processes?
  • Einride unveils expanded product offerings for its autonomous trucks
  • Halodi selects Immervision to give ‘human-like’ vision to its humanoid robots

Most Read

  • Track your lost Android
    Track your lost Android
  • Top 20 electric vehicle charging station companies
    Top 20 electric vehicle charging station companies
  • Difference Between Three-Phase and Single-Phase Power
    Difference Between Three-Phase and Single-Phase Power
  • Top 25 vertical farming companies
    Top 25 vertical farming companies
  • Scientists have found more water in space than they ever knew possible
    Scientists have found more water in space than they ever knew possible
  • Top 20 programmable logic controller manufacturers
    Top 20 programmable logic controller manufacturers
  • The Best Mechanical Engineering Design Software in 2022
    The Best Mechanical Engineering Design Software in 2022
  • What You Need to Know About Fixing an Engine Misfire
    What You Need to Know About Fixing an Engine Misfire
  • Top 10 graphics processing unit manufacturers: Nvidia clearly in the lead
    Top 10 graphics processing unit manufacturers: Nvidia clearly in the lead
  • Wood that’s twice as expensive as gold? Really?
    Wood that’s twice as expensive as gold? Really?

Overused words

abb ai applications automated automation automotive autonomous business china companies company control customers data design development digital electric global industrial industry logistics machine manufacturing market mobile platform process production robot robotic robotics robots safety software solution solutions system systems technologies technology time vehicle vehicles warehouse

Secondary Sidebar

Latest news

  • Continental to unveil new autonomous mobile robots for first time at LogiMAT
  • GreyOrange raises $110 million for ‘growth financing’
  • Ally Robotics aims to raise $8.5 million to bring automation to the restaurant industry
  • ABB launches new robotic depalletizer to ‘reduce complexity and improve efficiency’
  • Switzerland’s largest trade fair celebrates its 20th anniversary with a promising edition
  • Seegrid launches online knowledge base for its autonomous mobile robots
  • Hydroplane highlights its hydrogen fuel cell powerplant development
  • How does Intralogistics support warehouse processes?
  • Einride unveils expanded product offerings for its autonomous trucks
  • Halodi selects Immervision to give ‘human-like’ vision to its humanoid robots

Footer

We are…

Robotics and Automation News was established in May, 2015, and is now one of the most widely-read websites in its category.

Please consider supporting us by becoming a paying subscriber, or through advertising and sponsorships, or by purchasing products and services through our shop – or a combination of all of the above.

Thank you.

Independent

Archivists

August 2016
M T W T F S S
1234567
891011121314
15161718192021
22232425262728
293031  
« Jul   Sep »

Complex

Old-skool

This website and its associated magazine, and weekly newsletter, are all produced by a small team of experienced journalists and media professionals.

If you have any suggestions or comments, feel free to contact us at any of the email addresses on our contact page.

We’d be happy to hear from you, and will always reply as soon as possible.

Future-facing

Free, fair and legal

We support the principles of net neutrality and equal opportunities.

Member of The Internet Defense League

Copyright © 2022 · News Pro on Genesis Framework · WordPress · Log in

We use cookies on our website to give you the most relevant experience by remembering your preferences and repeat visits. By clicking “Accept”, you consent to the use of ALL the cookies.
Do not sell my personal information.
Cookie SettingsAccept
Manage consent

Privacy Overview

This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience.
Necessary
Always Enabled
Necessary cookies are absolutely essential for the website to function properly. These cookies ensure basic functionalities and security features of the website, anonymously.
CookieDurationDescription
cookielawinfo-checkbox-analytics11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Analytics".
cookielawinfo-checkbox-functional11 monthsThe cookie is set by GDPR cookie consent to record the user consent for the cookies in the category "Functional".
cookielawinfo-checkbox-necessary11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookies is used to store the user consent for the cookies in the category "Necessary".
cookielawinfo-checkbox-others11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Other.
cookielawinfo-checkbox-performance11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Performance".
viewed_cookie_policy11 monthsThe cookie is set by the GDPR Cookie Consent plugin and is used to store whether or not user has consented to the use of cookies. It does not store any personal data.
Functional
Functional cookies help to perform certain functionalities like sharing the content of the website on social media platforms, collect feedbacks, and other third-party features.
Performance
Performance cookies are used to understand and analyze the key performance indexes of the website which helps in delivering a better user experience for the visitors.
Analytics
Analytical cookies are used to understand how visitors interact with the website. These cookies help provide information on metrics the number of visitors, bounce rate, traffic source, etc.
Advertisement
Advertisement cookies are used to provide visitors with relevant ads and marketing campaigns. These cookies track visitors across websites and collect information to provide customized ads.
Others
Other uncategorized cookies are those that are being analyzed and have not been classified into a category as yet.
SAVE & ACCEPT