• Skip to primary navigation
  • Skip to main content
  • Skip to primary sidebar
  • Skip to secondary sidebar
  • Skip to footer
  • Home
  • Subscribe
  • Your Membership
    • Edit Your Profile
  • Services
    • Advertising
    • Case studies
    • Design
    • Email marketing
    • Lead generation
    • Magazine
    • Press releases
    • Publishing
    • Sponsored posts
    • Webcasting
    • Webinars
    • White papers
    • Writing
  • Shop
    • My Account
    • Cart
  • About
    • Contact
    • Privacy
    • Terms of use
  • Events

Robotics & Automation News

Market trends and business perspectives

  • News
  • Features
  • Video
  • Webinars
  • White papers
  • Press releases
  • Featured companies
    • AMD Xilinx
    • BlueBotics
    • Elite Robot
    • RGo Robotics
    • SICK Sensor Intelligence
    • Vicor Power
augmented-reality-glasses atheer

Opinion: Augmented and virtual reality ‘open up whole new world of opportunities’

July 20, 2017 by David Edwards

augmented-reality-glasses atheer

By Douglas Bruey, electrical engineering program lead at Synapse

At first glance, a gamer playing Pokémon Go has little in common with a surgeon saving lives in an operating theatre. But dig a little deeper and you’ll discover that might not be the case for much longer.

Augmented reality and virtual reality technologies are poised to open up a whole new world of opportunities. We’re already seeing the effects of VR when it comes to gaming. But in future could AR add a new dimension to surgery?

AR and VR both have the ability to alter our perception of the world. AR takes our current reality and adds something to it – virtual objects or information. VR, on the other hand, immerses us in a different – virtual – world. 

For many people, AR started in 2013 with Google Glass. The heads-up display delivered two-dimensional content to one eye via a prism projector. However, aside from detecting head movement, it lacked context awareness – limiting its use.

The Sony SmartEyeglass came next and provided an increased field of view and improved performance, which allowed the development of applications that recognised objects and provided context relevant
content.

Fast forward to 2016 and Microsoft’s HoloLens appeared – with Kinect-style sensing powering rock-solid anchoring of virtual content. We’ve harnessed this technology to demonstrate what it could mean for the operating theatre of the future, more of which later.

It was also in 2016 that VR achieved its first commercial successes with the introduction of the Samsung Gear VR, the Sony PlayStation VR, Oculus Rift and the Valve-powered HTC Vive. So why has VR come of age now? In a word – speed.

The challenge of VR development is to fool the brain into accepting what is being seen as real. Any delay between actually moving and the image moving confuses our senses and can result in a loss of balance or even nausea. The accuracy and latency of visual input relative to a change in head position is critical.

Hardware and software technology needed to reach a point that they could work that magic. Today, displays are small enough to sit on a user’s nose and serve up three times more frames per second than a fi lm – and all at very low latencies. VR systems couple these technologies with ‘pose-tracking’ solutions that quickly and accurately detect the position of a user’s head to close the loop with the visual system.

It is the speed and accuracy of the pose-tracking technology that truly differentiates the VR experience. Solutions targeting the mobile phone market use the inertial measurement unit in the phone to detect the motion of the user’s head and scroll visuals accordingly – but cannot track a user’s absolute position in space.

External camera-based tracking is another popular technology, which identifies points on an object and computes the pose using computer vision algorithms – but camera resolution and depth of field limit its range.

State of the art today is Valve’s SteamVR Tracking technology which uses scanning lasers to triangulate the position of tracked objects with sub-millimetre accuracy in a 25 square metre
room. Outside of gaming, SteamVR Tracking is poised to make an impact on training simulations, physical and psychological therapy, industrial control, architecture and design.

But VR is not the only application that will benefit from SteamVR Tracking. The user experience in AR systems is also tied to the speed and accuracy of pose tracking. Internal cameras and other systems can solve many of AR’s challenges – including depth perception, object recognition and pose tracking. However, relying on the ‘inside-out’ tracking of a headset’s camera may not be sufficient in all environments.

In a typical operating theatre today, for example, there are numerous charts, consoles and displays to support a surgical procedure – with new sensing and imaging technologies adding to this all the time. Add in lab results, patient history and a surgical plan, and presentation of information becomes a challenge. How can we make all this available to the surgeon and yet not distracting?

AR could replace physical screens with floating monitors, improving visibility, reducing clutter and enabling ‘weightless’ reconfiguration – positioning with a simple gesture. Virtual screens could be summoned to show information as and when it is needed, with CT scan slices visualised as a three-dimensional model.

Now imagine if the 3D scan was overlaid on to a patient. Such a step could quite literally provide a surgeon with X-ray vision, allowing a CT scan to be reviewed relative to actual anatomy. Laparoscopic tool handles could be ‘pose tracked’ to give the surgeon ‘virtual sight’ of the tool tips hidden from normal view
inside the patient.

We’ve used today’s technology to bring the augmented operating theatre to life as never before in a demonstration of what is becoming possible. Of course, the clinical reality is still some way off – but it’s an interesting glimpse into the future.

Despite great technological strides, AR is still an infant technology. And visualisation is only part of the problem – it is of limited use without a convincing, natural user interface. With improvements in augmented hardware guaranteed, the next battleground will surely be the user interface.

We see the technologies that drive AR and VR as very complementary and potentially convergent. There are many uses outside of gaming that these will enable and we’re already working on diverse applications with clients. Moore’s law, as it applies here, says headsets will get smaller, lighter and faster – so ultimately we will only be limited by our imagination.

Print Friendly, PDF & Email

Share this:

  • Print
  • Facebook
  • LinkedIn
  • Reddit
  • Twitter
  • Tumblr
  • Pinterest
  • Skype
  • WhatsApp
  • Telegram
  • Pocket

You might also like…

Filed Under: Miscellaneous Tagged With: ar, augmented, operating, reality, scan, surgeon, technology, virtual, vr

Join the Robotics & Automation News community

Primary Sidebar

Latest articles

  • Autonomous mobile robots market expected to expand at 22 percent a year
  • Will a robot take my job? Notre Dame researcher says this view is overly pessimistic
  • Flexiv partners with Doco Engineering to meet ‘expanding US robotics demand’
  • Addverb opens second software development centre in India
  • ABI Research gives 16 autonomous forklift system vendors competitive rankings
  • euroTECH’s Vacuum Lifter System Increases Efficiency and Ergonomics in Wood Processing
  • How to Reduce Chatter in Robotic Milling Applications
  • Otto Motors launches new ‘mid-sized’ autonomous mobile robot
  • SGS introduces ‘cutting-edge testing protocol’ for robots checking furniture drawer slides
  • Europalco buys two robots from Kuka to add ‘wow factor’ to shows

Most Read

  • Top 20 electric vehicle charging station companies
    Top 20 electric vehicle charging station companies
  • Difference Between Three-Phase and Single-Phase Power
    Difference Between Three-Phase and Single-Phase Power
  • Scientists have found more water in space than they ever knew possible
    Scientists have found more water in space than they ever knew possible
  • Top 20 programmable logic controller manufacturers
    Top 20 programmable logic controller manufacturers
  • How to Know if Your iPhone is Being Tracked? Check This!
    How to Know if Your iPhone is Being Tracked? Check This!
  • What You Need to Know About Fixing an Engine Misfire
    What You Need to Know About Fixing an Engine Misfire
  • Why is My Car Key Stuck in the Ignition?
    Why is My Car Key Stuck in the Ignition?
  • Why is Money Important in Our Lives?
    Why is Money Important in Our Lives?
  • IoT Basics: A Guide to the Internet of Things for Beginners
    IoT Basics: A Guide to the Internet of Things for Beginners
  • Otto Motors launches new ‘mid-sized’ autonomous mobile robot
    Otto Motors launches new ‘mid-sized’ autonomous mobile robot

Overused words

ai applications automated automation automotive autonomous business companies company control customers data design development digital electric global industrial industry logistics machine manufacturing market mobile operations platform process production robot robotic robotics robots safety software solution solutions system systems technologies technology time vehicle vehicles warehouse work

Secondary Sidebar

Latest news

  • Autonomous mobile robots market expected to expand at 22 percent a year
  • Will a robot take my job? Notre Dame researcher says this view is overly pessimistic
  • Flexiv partners with Doco Engineering to meet ‘expanding US robotics demand’
  • Addverb opens second software development centre in India
  • ABI Research gives 16 autonomous forklift system vendors competitive rankings
  • euroTECH’s Vacuum Lifter System Increases Efficiency and Ergonomics in Wood Processing
  • How to Reduce Chatter in Robotic Milling Applications
  • Otto Motors launches new ‘mid-sized’ autonomous mobile robot
  • SGS introduces ‘cutting-edge testing protocol’ for robots checking furniture drawer slides
  • Europalco buys two robots from Kuka to add ‘wow factor’ to shows

Footer

We are…

Robotics and Automation News was established in May, 2015, and is now one of the most widely-read websites in its category.

Please consider supporting us by becoming a paying subscriber, or through advertising and sponsorships, or by purchasing products and services through our shop – or a combination of all of the above.

Thank you.

Independent

Archivists

July 2017
M T W T F S S
 12
3456789
10111213141516
17181920212223
24252627282930
31  
« Jun   Aug »

Complex

Old-skool

This website and its associated magazine, and weekly newsletter, are all produced by a small team of experienced journalists and media professionals.

If you have any suggestions or comments, feel free to contact us at any of the email addresses on our contact page.

We’d be happy to hear from you, and will always reply as soon as possible.

Future-facing

Free, fair and legal

We support the principles of net neutrality and equal opportunities.

Member of The Internet Defense League

Copyright © 2023 · News Pro on Genesis Framework · WordPress · Log in

We use cookies on our website to give you the most relevant experience by remembering your preferences and repeat visits. By clicking “Accept”, you consent to the use of ALL the cookies.
Do not sell my personal information.
Cookie SettingsAccept
Manage consent

Privacy Overview

This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience.
Necessary
Always Enabled
Necessary cookies are absolutely essential for the website to function properly. These cookies ensure basic functionalities and security features of the website, anonymously.
CookieDurationDescription
cookielawinfo-checkbox-analytics11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Analytics".
cookielawinfo-checkbox-functional11 monthsThe cookie is set by GDPR cookie consent to record the user consent for the cookies in the category "Functional".
cookielawinfo-checkbox-necessary11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookies is used to store the user consent for the cookies in the category "Necessary".
cookielawinfo-checkbox-others11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Other.
cookielawinfo-checkbox-performance11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Performance".
viewed_cookie_policy11 monthsThe cookie is set by the GDPR Cookie Consent plugin and is used to store whether or not user has consented to the use of cookies. It does not store any personal data.
Functional
Functional cookies help to perform certain functionalities like sharing the content of the website on social media platforms, collect feedbacks, and other third-party features.
Performance
Performance cookies are used to understand and analyze the key performance indexes of the website which helps in delivering a better user experience for the visitors.
Analytics
Analytical cookies are used to understand how visitors interact with the website. These cookies help provide information on metrics the number of visitors, bounce rate, traffic source, etc.
Advertisement
Advertisement cookies are used to provide visitors with relevant ads and marketing campaigns. These cookies track visitors across websites and collect information to provide customized ads.
Others
Other uncategorized cookies are those that are being analyzed and have not been classified into a category as yet.
SAVE & ACCEPT