• Skip to primary navigation
  • Skip to main content
  • Skip to primary sidebar
  • Skip to secondary sidebar
  • Skip to footer
  • Home
  • Subscribe
  • Your Membership
    • Edit Your Profile
  • Services
    • Advertising
    • Case studies
    • Design
    • Email marketing
    • Lead generation
    • Magazine
    • Press releases
    • Publishing
    • Sponsored posts
    • Webcasting
    • Webinars
    • White papers
    • Writing
  • Shop
    • My Account
    • Cart
  • About
    • Contact
    • Privacy
    • Terms of use
  • Events

Robotics & Automation News

Market trends and business perspectives

  • News
  • Features
  • Video
  • Webinars
  • White papers
  • Press releases
  • Featured companies
    • AMD Xilinx
    • BlueBotics
    • Elite Robot
    • RGo Robotics
    • SICK Sensor Intelligence
    • Vicor Power
columbia university robot imagines itself copy

Columbia University engineers create ‘a robot that can imagine itself’

February 1, 2019 by Sam Francis

Columbia University engineers say they have created “a robot that can imagine itself”, taking the industry one step closer to self-aware machines. (See video below.)

Robots that are self-aware have been science fiction fodder for decades, and now we may finally be getting closer.

Humans are unique in being able to imagine themselves – to picture themselves in future scenarios, such as walking along the beach on a warm sunny day. 

Humans can also learn by revisiting past experiences and reflecting on what went right or wrong.

While humans and animals acquire and adapt their self-image over their lifetime, most robots still learn using human-provided simulators and models, or by laborious, time-consuming trial and error. Robots have not learned to simulate themselves the way humans do.

Columbia Engineering researchers have made a major advance in robotics by creating a robot that learns what it is, from scratch, with zero prior knowledge of physics, geometry, or motor dynamics.

Initially, the robot does not know if it is a spider, a snake, an arm – it has no clue what its shape is. After a brief period of “babbling”, and within about a day of intensive computing, their robot creates a self-simulation.

The robot can then use that self-simulator internally to contemplate and adapt to different situations, handling new tasks as well as detecting and repairing damage in its own body. The work is published today in Science Robotics.

To date, robots have operated by having a human explicitly model the robot. “But if we want robots to become independent, to adapt quickly to scenarios unforeseen by their creators, then it’s essential that they learn to simulate themselves,” says Hod Lipson, professor of mechanical engineering, and director of the Creative Machines Lab, where the research was done.

For the study, Lipson and his PhD student Robert Kwiatkowski used a four-degree-of-freedom articulated robotic arm.

Initially, the robot moved randomly and collected approximately one thousand trajectories, each comprising one hundred points. The robot then used deep learning, a modern machine learning technique, to create a self-model.

The first self-models were quite inaccurate, and the robot did not know what it was, or how its joints were connected. But after less than 35 hours of training, the self-model became consistent with the physical robot to within about four centimeters.

The self-model performed a pick-and-place task in a closed loop system that enabled the robot to recalibrate its original position between each step along the trajectory based entirely on the internal self-model.

With the closed-loop control, the robot was able to grasp objects at specific locations on the ground and deposit them into a receptacle with 100 percent success.

Even in an open-loop system, which involves performing a task-based entirely on the internal self-model, without any external feedback, the robot was able to complete the pick-and-place task with a 44 percent success rate.

“That’s like trying to pick up a glass of water with your eyes closed, a process difficult even for humans,” observed the study’s lead author Kwiatkowski, a PhD student in the computer science department who works in Lipson’s lab.

The self-modeling robot was also used for other tasks, such as writing text using a marker.

To test whether the self-model could detect damage to itself, the researchers 3D-printed a deformed part to simulate damage and the robot was able to detect the change and re-train its self-model. The new self-model enabled the robot to resume its pick-and-place tasks with little loss of performance.

Lipson, who is also a member of the Data Science Institute, notes that self-imaging is key to enabling robots to move away from the confinements of so-called “narrow-AI” towards more general abilities.

“This is perhaps what a newborn child does in its crib, as it learns what it is,” he says. “We conjecture that this advantage may have also been the evolutionary origin of self-awareness in humans. While our robot’s ability to imagine itself is still crude compared to humans, we believe that this ability is on the path to machine self-awareness.”

Lipson believes that robotics and AI may offer a fresh window into the age-old puzzle of consciousness.

“Philosophers, psychologists, and cognitive scientists have been pondering the nature self-awareness for millennia, but have made relatively little progress,” he observes.

“We still cloak our lack of understanding with subjective terms like ‘canvas of reality,’ but robots now force us to translate these vague notions into concrete algorithms and mechanisms.”

Lipson and Kwiatkowski are aware of the ethical implications. “Self-awareness will lead to more resilient and adaptive systems, but also implies some loss of control,” they warn. “It’s a powerful technology, but it should be handled with care.”

The researchers are now exploring whether robots can model not just their own bodies, but also their own minds – that is, whether robots can think about thinking.

The study is titled Task-Agnostic Self-Modeling Machines, and its authors are: Robert Kwiatkowski, Department of Computer Science, and Hod Lipson, Department of Mechanical Engineering, Columbia Engineering, and Data Science Institute, Columbia University.

The study was supported by the Defense Advanced Research Projects Agency.

Print Friendly, PDF & Email

Share this:

  • Print
  • Facebook
  • LinkedIn
  • Reddit
  • Twitter
  • Tumblr
  • Pinterest
  • Skype
  • WhatsApp
  • Telegram
  • Pocket

You might also like…

Filed Under: Industrial robots, News Tagged With: columbia university, robot that can imagine itself, robotics research

Join the Robotics & Automation News community

Primary Sidebar

Latest articles

  • AMD launches Kria ecosystem program to help developers bring automation solutions to market faster
  • Manufactured in the metaverse: Mercedes-Benz designs virtual factories with Nvidia Omniverse
  • Foxconn plans to build autonomous vehicles on Nvidia computing platform
  • Geek+ provides 82 robots to C-StoreMaster’s new $20 million distribution warehouse in Huntsville, Alabama
  • Flexiv launches ‘revolutionary’ force-controlled parallel robot
  • The Core Concepts of Successful Online Stock Investing
  • UPS and Gap units partner to offer ‘unmatched automation and supply chain capabilities’ to apparel merchants
  • stow Robotics and Phononic collaborate to design cold chain fulfillment solutions
  • Three strikes and you’re out! Humans give up on robots after multiple mistakes
  • China overtakes USA in robot density

Most Read

  • Foxconn plans to build autonomous vehicles on Nvidia computing platform
    Foxconn plans to build autonomous vehicles on Nvidia computing platform
  • Manufactured in the metaverse: Mercedes-Benz designs virtual factories with Nvidia Omniverse
    Manufactured in the metaverse: Mercedes-Benz designs virtual factories with Nvidia Omniverse
  • Why is My Car Key Stuck in the Ignition?
    Why is My Car Key Stuck in the Ignition?
  • Top 20 electric vehicle charging station companies
    Top 20 electric vehicle charging station companies
  • Difference Between Three-Phase and Single-Phase Power
    Difference Between Three-Phase and Single-Phase Power
  • How to Know if Your iPhone is Being Tracked? Check This!
    How to Know if Your iPhone is Being Tracked? Check This!
  • Scientists have found more water in space than they ever knew possible
    Scientists have found more water in space than they ever knew possible
  • AMD launches Kria ecosystem program to help developers bring automation solutions to market faster
    AMD launches Kria ecosystem program to help developers bring automation solutions to market faster
  • What You Need to Know About Fixing an Engine Misfire
    What You Need to Know About Fixing an Engine Misfire
  • The Best Mechanical Engineering Design Software in 2022
    The Best Mechanical Engineering Design Software in 2022

Overused words

ai applications automated automation automotive autonomous business china companies company control customers data design development digital electric global industrial industry logistics machine manufacturing market mobile operations platform process production robot robotic robotics robots safety software solution solutions system systems technologies technology time vehicle vehicles warehouse

Secondary Sidebar

Latest news

  • AMD launches Kria ecosystem program to help developers bring automation solutions to market faster
  • Manufactured in the metaverse: Mercedes-Benz designs virtual factories with Nvidia Omniverse
  • Foxconn plans to build autonomous vehicles on Nvidia computing platform
  • Geek+ provides 82 robots to C-StoreMaster’s new $20 million distribution warehouse in Huntsville, Alabama
  • Flexiv launches ‘revolutionary’ force-controlled parallel robot
  • The Core Concepts of Successful Online Stock Investing
  • UPS and Gap units partner to offer ‘unmatched automation and supply chain capabilities’ to apparel merchants
  • stow Robotics and Phononic collaborate to design cold chain fulfillment solutions
  • Three strikes and you’re out! Humans give up on robots after multiple mistakes
  • China overtakes USA in robot density

Footer

We are…

Robotics and Automation News was established in May, 2015, and is now one of the most widely-read websites in its category.

Please consider supporting us by becoming a paying subscriber, or through advertising and sponsorships, or by purchasing products and services through our shop – or a combination of all of the above.

Thank you.

Independent

Archivists

February 2019
M T W T F S S
 123
45678910
11121314151617
18192021222324
25262728  
« Jan   Mar »

Complex

Old-skool

This website and its associated magazine, and weekly newsletter, are all produced by a small team of experienced journalists and media professionals.

If you have any suggestions or comments, feel free to contact us at any of the email addresses on our contact page.

We’d be happy to hear from you, and will always reply as soon as possible.

Future-facing

Free, fair and legal

We support the principles of net neutrality and equal opportunities.

Member of The Internet Defense League

Copyright © 2023 · News Pro on Genesis Framework · WordPress · Log in

We use cookies on our website to give you the most relevant experience by remembering your preferences and repeat visits. By clicking “Accept”, you consent to the use of ALL the cookies.
Do not sell my personal information.
Cookie SettingsAccept
Manage consent

Privacy Overview

This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience.
Necessary
Always Enabled
Necessary cookies are absolutely essential for the website to function properly. These cookies ensure basic functionalities and security features of the website, anonymously.
CookieDurationDescription
cookielawinfo-checkbox-analytics11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Analytics".
cookielawinfo-checkbox-functional11 monthsThe cookie is set by GDPR cookie consent to record the user consent for the cookies in the category "Functional".
cookielawinfo-checkbox-necessary11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookies is used to store the user consent for the cookies in the category "Necessary".
cookielawinfo-checkbox-others11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Other.
cookielawinfo-checkbox-performance11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Performance".
viewed_cookie_policy11 monthsThe cookie is set by the GDPR Cookie Consent plugin and is used to store whether or not user has consented to the use of cookies. It does not store any personal data.
Functional
Functional cookies help to perform certain functionalities like sharing the content of the website on social media platforms, collect feedbacks, and other third-party features.
Performance
Performance cookies are used to understand and analyze the key performance indexes of the website which helps in delivering a better user experience for the visitors.
Analytics
Analytical cookies are used to understand how visitors interact with the website. These cookies help provide information on metrics the number of visitors, bounce rate, traffic source, etc.
Advertisement
Advertisement cookies are used to provide visitors with relevant ads and marketing campaigns. These cookies track visitors across websites and collect information to provide customized ads.
Others
Other uncategorized cookies are those that are being analyzed and have not been classified into a category as yet.
SAVE & ACCEPT