• Skip to primary navigation
  • Skip to main content
  • Skip to primary sidebar
  • Skip to secondary sidebar
  • Skip to footer
  • Home
  • Subscribe
  • Your Membership
    • Edit Your Profile
  • Services
    • Advertising
    • Case studies
    • Design
    • Email marketing
    • Lead generation
    • Magazine
    • Press releases
    • Publishing
    • Sponsored posts
    • Webcasting
    • Webinars
    • White papers
    • Writing
  • Shop
    • My Account
    • Cart
  • About
    • Contact
    • Privacy
    • Terms of use
  • Events

Robotics & Automation News

Market trends and business perspectives

  • News
  • Features
  • Video
  • Webinars
  • White papers
  • Press releases
  • Featured companies
    • AMD Xilinx
    • BlueBotics
    • Elite Robot
    • RGo Robotics
    • SICK Sensor Intelligence
    • Vicor Power

Robot displays ‘glimmer of empathy’ to partner robot

January 15, 2021 by Sam Francis Leave a Comment

Columbia University engineers say they have created a robot that learns to visually predict how its partner robot will behave, displaying a glimmer of empathy. This “Robot Theory of Mind” could help robots get along with other robots – and humans – more intuitively.

Like a longtime couple who can predict each other’s every move, a Columbia Engineering robot has learned to predict its partner robot’s future actions and goals based on just a few initial video frames.

When two primates are cooped up together for a long time, we quickly learn to predict the near-term actions of our roommates, co-workers or family members. Our ability to anticipate the actions of others makes it easier for us to successfully live and work together.

In contrast, even the most intelligent and advanced robots have remained notoriously inept at this sort of social communication. This may be about to change.

An actor robot runs on a playpen trying to catch the visible green food, while an observer machine learns to predict the actor robot’s behavior purely through visual observations.

Although the observer can always see the green foods, the actor, from its own perspective, cannot due to occlusions.

The study, conducted at Columbia Engineering’s Creative Machines Lab led by Mechanical Engineering Professor Hod Lipson, is part of a broader effort to endow robots with the ability to understand and anticipate the goals of other robots, purely from visual observations.

The researchers first built a robot and placed it in a playpen roughly 3×2 feet in size. They programmed the robot to seek and move towards any green circle it could see.

But there was a catch: Sometimes the robot could see a green circle in its camera and move directly towards it. But other times, the green circle would be occluded by a tall red cardboard box, in which case the robot would move towards a different green circle, or not at all.

After observing its partner puttering around for two hours, the observing robot began to anticipate its partner’s goal and path.

The observing robot was eventually able to predict its partner’s goal and path 98 out of 100 times, across varying situations – without being told explicitly about the partner’s visibility handicap.

“Our initial results are very exciting,” says Boyuan Chen, lead author of the study, which was conducted in collaboration with Carl Vondrick, assistant professor of computer science, and published today by Nature Scientific Reports.

“Our findings begin to demonstrate how robots can see the world from another robot’s perspective.

“The ability of the observer to put itself in its partner’s shoes, so to speak, and understand, without being guided, whether its partner could or could not see the green circle from its vantage point, is perhaps a primitive form of empathy.”

When they designed the experiment, the researchers expected that the Observer Robot would learn to make predictions about the Subject Robot’s near-term actions.

What the researchers didn’t expect, however, was how accurately the Observer Robot could foresee its colleague’s future “moves” with only a few seconds of video as a cue.

The researchers acknowledge that the behaviors exhibited by the robot in this study are far simpler than the behaviors and goals of humans.

They believe, however, that this may be the beginning of endowing robots with what cognitive scientists call “Theory of Mind” (ToM). At about age three, children begin to understand that others may have different goals, needs and perspectives than they do.

This can lead to playful activities such as hide and seek, as well as more sophisticated manipulations like lying.

More broadly, ToM is recognized as a key distinguishing hallmark of human and primate cognition, and a factor that is essential for complex and adaptive social interactions such as cooperation, competition, empathy, and deception.

In addition, humans are still better than robots at describing their predictions using verbal language. The researchers had the observing robot make its predictions in the form of images, rather than words, in order to avoid becoming entangled in the thorny challenges of human language.

Yet, Lipson speculates, the ability of a robot to predict the future actions visually is not unique: “We humans also think visually sometimes. We frequently imagine the future in our mind’s eyes, not in words.”

Lipson acknowledges that there are many ethical questions. The technology will make robots more resilient and useful, but when robots can anticipate how humans think, they may also learn to manipulate those thoughts.

“We recognize that robots aren’t going to remain passive instruction-following machines for long,” Lipson says. “Like other forms of advanced AI, we hope that policymakers can help keep this kind of technology in check, so that we can all benefit.”

Print Friendly, PDF & Email

Share this:

  • Print
  • Facebook
  • LinkedIn
  • Reddit
  • Twitter
  • Tumblr
  • Pinterest
  • Skype
  • WhatsApp
  • Telegram
  • Pocket

You might also like…

Filed Under: Design, Features Tagged With: green, partner, predict, robot, robots

Join the Robotics & Automation News community

Reader Interactions

You must log in to post a comment.

Primary Sidebar

Latest articles

  • How do you heat a car to sleep?
  • Florida university opens Blendid robotic smoothie kiosk
  • Robots vs CNCs: What’s better for working metal?
  • Thermal imaging cameras in the food industry
  • IDS offers its industrial camera users free update to its new deep learning method
  • August Robotics machines helping with floor marking at Leipzig Messe
  • Security robots ‘deter crime and minimize risk’, says Knightscope
  • Schneider Electric invests €40 million in new smart factory in Hungary
  • Jabil to manufacture Sarcos’ robotic systems
  • Smart Robotics launches new robotic mixed case palletizer

Most Read

  • Stiga launches ‘world’s smartest’ autonomous lawn mower
    Stiga launches ‘world’s smartest’ autonomous lawn mower
  • Top 20 electric vehicle charging station companies
    Top 20 electric vehicle charging station companies
  • Difference Between Three-Phase and Single-Phase Power
    Difference Between Three-Phase and Single-Phase Power
  • Agility Robotics launches next generation of its humanoid worker robot
    Agility Robotics launches next generation of its humanoid worker robot
  • Scientists have found more water in space than they ever knew possible
    Scientists have found more water in space than they ever knew possible
  • Schneider Electric invests €40 million in new smart factory in Hungary
    Schneider Electric invests €40 million in new smart factory in Hungary
  • Top 20 programmable logic controller manufacturers
    Top 20 programmable logic controller manufacturers
  • Qualcomm releases ‘groundbreaking IoT and robotics’ platforms
    Qualcomm releases ‘groundbreaking IoT and robotics’ platforms
  • DeepRoute.ai launches $1,000 ‘map-free’ self-driving solution
    DeepRoute.ai launches $1,000 ‘map-free’ self-driving solution
  • Robots vs CNCs: What’s better for working metal?
    Robots vs CNCs: What’s better for working metal?

Overused words

ai applications automated automation automotive autonomous business companies company control customers data design development digital electric global industrial industry logistics machine manufacturing market mobile operations platform process production robot robotic robotics robots safety software solution solutions system systems technologies technology time vehicle vehicles warehouse work

Secondary Sidebar

Latest news

  • How do you heat a car to sleep?
  • Florida university opens Blendid robotic smoothie kiosk
  • Robots vs CNCs: What’s better for working metal?
  • Thermal imaging cameras in the food industry
  • IDS offers its industrial camera users free update to its new deep learning method
  • August Robotics machines helping with floor marking at Leipzig Messe
  • Security robots ‘deter crime and minimize risk’, says Knightscope
  • Schneider Electric invests €40 million in new smart factory in Hungary
  • Jabil to manufacture Sarcos’ robotic systems
  • Smart Robotics launches new robotic mixed case palletizer

Footer

We are…

Robotics and Automation News was established in May, 2015, and is now one of the most widely-read websites in its category.

Please consider supporting us by becoming a paying subscriber, or through advertising and sponsorships, or by purchasing products and services through our shop – or a combination of all of the above.

Thank you.

Independent

Archivists

January 2021
M T W T F S S
 123
45678910
11121314151617
18192021222324
25262728293031
« Dec   Feb »

Complex

Old-skool

This website and its associated magazine, and weekly newsletter, are all produced by a small team of experienced journalists and media professionals.

If you have any suggestions or comments, feel free to contact us at any of the email addresses on our contact page.

We’d be happy to hear from you, and will always reply as soon as possible.

Future-facing

Free, fair and legal

We support the principles of net neutrality and equal opportunities.

Member of The Internet Defense League

Copyright © 2023 · News Pro on Genesis Framework · WordPress · Log in

We use cookies on our website to give you the most relevant experience by remembering your preferences and repeat visits. By clicking “Accept”, you consent to the use of ALL the cookies.
Do not sell my personal information.
Cookie SettingsAccept
Manage consent

Privacy Overview

This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience.
Necessary
Always Enabled
Necessary cookies are absolutely essential for the website to function properly. These cookies ensure basic functionalities and security features of the website, anonymously.
CookieDurationDescription
cookielawinfo-checkbox-analytics11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Analytics".
cookielawinfo-checkbox-functional11 monthsThe cookie is set by GDPR cookie consent to record the user consent for the cookies in the category "Functional".
cookielawinfo-checkbox-necessary11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookies is used to store the user consent for the cookies in the category "Necessary".
cookielawinfo-checkbox-others11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Other.
cookielawinfo-checkbox-performance11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Performance".
viewed_cookie_policy11 monthsThe cookie is set by the GDPR Cookie Consent plugin and is used to store whether or not user has consented to the use of cookies. It does not store any personal data.
Functional
Functional cookies help to perform certain functionalities like sharing the content of the website on social media platforms, collect feedbacks, and other third-party features.
Performance
Performance cookies are used to understand and analyze the key performance indexes of the website which helps in delivering a better user experience for the visitors.
Analytics
Analytical cookies are used to understand how visitors interact with the website. These cookies help provide information on metrics the number of visitors, bounce rate, traffic source, etc.
Advertisement
Advertisement cookies are used to provide visitors with relevant ads and marketing campaigns. These cookies track visitors across websites and collect information to provide customized ads.
Others
Other uncategorized cookies are those that are being analyzed and have not been classified into a category as yet.
SAVE & ACCEPT