• Skip to primary navigation
  • Skip to main content
  • Skip to primary sidebar
  • Skip to secondary sidebar
  • Skip to footer
  • Home
  • Subscribe
  • Your Membership
    • Edit Your Profile
  • Services
    • Advertising
    • Case studies
    • Design
    • Email marketing
    • Lead generation
    • Magazine
    • Press releases
    • Publishing
    • Sponsored posts
    • Webcasting
    • Webinars
    • White papers
    • Writing
  • Shop
    • My Account
    • Cart
  • About
    • Contact
    • Privacy
    • Terms of use
  • Events

Robotics & Automation News

Market trends and business perspectives

  • News
  • Features
  • Video
  • Webinars
  • White papers
  • Press releases
  • Featured companies
    • BlueBotics
    • SICK Sensor Intelligence
    • Vicor Power

Essential Legal Issues Associated With Web Scraping

April 6, 2020 by Polly Leave a Comment

“Web scraping”, also called crawling or spidering, is the automated gathering of data from someone else’s website.

Scraping is an essential part of how the Internet functions, and it has traditionally been the backbone of many companies’ marketing, lead generation, and market intelligence efforts.

In fact, many online services, large and small, use scraping to build their databases, all of which are worth hundreds of billions of dollars. This article will answer the question – is web scraping legal?

Even though web scraping is ubiquitous, a plethora of legal issues remains fraught with the process. The following analysis explains the position of the law on web scraping in the world today.

Under the GDPR

Under the EU’s General Data Protection Regulation (or GDPR) web scraping does not apply to a person or company except such an entity is scrapping personal data of people within the European Economic Area, including Iceland, Liechtenstein, and Norway.

Examples of personal data include a person’s Name, Physical Address, Email Address, Phone Number, Credit Card Details, Bank Details, IP Address, Date of Birth, Employment Information, Social Security Number, Medical Information and Video/Audio Recording.

Use this guide to web scraping legal issues to ensure your web scraping is GDPR compliant.

However, exceptions can be made for the scraping of the personal data of people within the EEA. The five types of lawful reasons are Consent, Contract, Compliance (with a legal obligation), Vital Interest/Public Interest/Official Authority, Legitimate Interest.

Is scraping e-commerce sites legal? In 1999, the first web scraping case between eBay and Bidder’s Edge was heard in a US court. Therein, Bidder’s Edge accessed eBay’s approximately 100,000 times without the latter’s authorization.

The case was settled out of court when Bidder’s Edge paid Ebay an undisclosed amount and agreed not to access Ebay’s data. The legal principle has been amended in the US, among a plethora of cases, the latest of which will be addressed in subsequent paragraphs.

Is Scraping Social Media Sites Legal? In late 2019, the US Court of Appeals denied LinkedIn’s request to prevent HiQ, an analytics company, from scraping its data. Consequently, the historic decision showed that any data that is publicly available and is not copyrighted is legally valid for the use of web crawlers.

The decision did not, however, grant HiQ or other web crawlers the freedom to use data obtained for unlimited commercial purposes. For example, a web crawler would be allowed to search YouTube for video titles, but it could not re-post the Youtube videos on its own site since the videos are copyrighted.

To keep your scraping activities ethical and also to avoid any problems follow the best practices, like limiting your requests to every target site so that they will not feel invaded and their servers will not overload. Also, the proxy provider and type of proxy IP you choose is also very important.

Check out this guide to web scraping proxies and find out which proxy providers offer the best combination of reliability and price.

Existing Legal Issues With Web Scraping

Copyright Infringement: In most jurisdictions, web scraping is legal, but using copyright data contains certain restrictions.

Violation of the Computer Fraud and Abuse Act (CFAA): This law, enacted to prevent computer hackers, prevents fetching data by getting unauthorized access to a page.

Trespass to Chattel: Here, a chattel (or data) is violated if the website server is hurt in any way. Thus, trespass to chattel is violated if the server slows or stops because of the scraping.

Promoted 

Print Friendly, PDF & Email

Share this:

  • Print
  • Facebook
  • LinkedIn
  • Reddit
  • Twitter
  • Tumblr
  • Pinterest
  • Skype
  • WhatsApp
  • Telegram
  • Pocket

You might also like…

Filed Under: Computing, Industry, Promoted Tagged With: crawling, data, legal, scraping, spidering, web, web scraping

Join the Robotics & Automation News community

Reader Interactions

You must log in to post a comment.

Primary Sidebar

Latest articles

  • How robots and RPA will change the business of the future
  • The Pros and Cons of Selling vs Trading in Your Vehicle
  • How to Ensure Your Drivers Stay Safe on the Road
  • Reasons Why You Need to Buy a Rotary Fill and Seal Coffee Packaging Machine
  • Fulfyld selects inVia Robotics to automate warehouses
  • DB Schenker to operate zero-emission autonomous ship for Ekornes
  • Southie Autonomy secures $2.5 million seed funding and $5 million in robot lease financing
  • Daimler Truck makes strategic investment in Apex.AI
  • Berkshire Grey launches new mobile robotic platform
  • Clearpath Robotics launches latest version of TurtleBot

Most Read

  • Top 20 electric vehicle charging station companies
    Top 20 electric vehicle charging station companies
  • Track your lost Android
    Track your lost Android
  • Difference Between Three-Phase and Single-Phase Power
    Difference Between Three-Phase and Single-Phase Power
  • Top 20 programmable logic controller manufacturers
    Top 20 programmable logic controller manufacturers
  • Top 25 vertical farming companies
    Top 25 vertical farming companies
  • The Best Mechanical Engineering Design Software in 2022
    The Best Mechanical Engineering Design Software in 2022
  • Top 10 graphics processing unit manufacturers: Nvidia clearly in the lead
    Top 10 graphics processing unit manufacturers: Nvidia clearly in the lead
  • Scientists have found more water in space than they ever knew possible
    Scientists have found more water in space than they ever knew possible
  • What You Need to Know About Fixing an Engine Misfire
    What You Need to Know About Fixing an Engine Misfire
  • How to become a G-Code master with a complete list of G-Codes
    How to become a G-Code master with a complete list of G-Codes

Overused words

abb ai applications automated automation automotive autonomous business china companies company control customers data design development digital electric global industrial industry logistics machine manufacturing market mobile platform process production robot robotic robotics robots safety software solution solutions system systems technologies technology time vehicle vehicles warehouse

Secondary Sidebar

Latest news

  • How robots and RPA will change the business of the future
  • The Pros and Cons of Selling vs Trading in Your Vehicle
  • How to Ensure Your Drivers Stay Safe on the Road
  • Reasons Why You Need to Buy a Rotary Fill and Seal Coffee Packaging Machine
  • Fulfyld selects inVia Robotics to automate warehouses
  • DB Schenker to operate zero-emission autonomous ship for Ekornes
  • Southie Autonomy secures $2.5 million seed funding and $5 million in robot lease financing
  • Daimler Truck makes strategic investment in Apex.AI
  • Berkshire Grey launches new mobile robotic platform
  • Clearpath Robotics launches latest version of TurtleBot

Footer

We are…

Robotics and Automation News was established in May, 2015, and is now one of the most widely-read websites in its category.

Please consider supporting us by becoming a paying subscriber, or through advertising and sponsorships, or by purchasing products and services through our shop – or a combination of all of the above.

Thank you.

Independent

Archivists

April 2020
M T W T F S S
 12345
6789101112
13141516171819
20212223242526
27282930  
« Mar   May »

Complex

Old-skool

This website and its associated magazine, and weekly newsletter, are all produced by a small team of experienced journalists and media professionals.

If you have any suggestions or comments, feel free to contact us at any of the email addresses on our contact page.

We’d be happy to hear from you, and will always reply as soon as possible.

Future-facing

Free, fair and legal

We support the principles of net neutrality and equal opportunities.

Member of The Internet Defense League

Copyright © 2022 · News Pro on Genesis Framework · WordPress · Log in

We use cookies on our website to give you the most relevant experience by remembering your preferences and repeat visits. By clicking “Accept”, you consent to the use of ALL the cookies.
Do not sell my personal information.
Cookie SettingsAccept
Manage consent

Privacy Overview

This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience.
Necessary
Always Enabled
Necessary cookies are absolutely essential for the website to function properly. These cookies ensure basic functionalities and security features of the website, anonymously.
CookieDurationDescription
cookielawinfo-checkbox-analytics11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Analytics".
cookielawinfo-checkbox-functional11 monthsThe cookie is set by GDPR cookie consent to record the user consent for the cookies in the category "Functional".
cookielawinfo-checkbox-necessary11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookies is used to store the user consent for the cookies in the category "Necessary".
cookielawinfo-checkbox-others11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Other.
cookielawinfo-checkbox-performance11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Performance".
viewed_cookie_policy11 monthsThe cookie is set by the GDPR Cookie Consent plugin and is used to store whether or not user has consented to the use of cookies. It does not store any personal data.
Functional
Functional cookies help to perform certain functionalities like sharing the content of the website on social media platforms, collect feedbacks, and other third-party features.
Performance
Performance cookies are used to understand and analyze the key performance indexes of the website which helps in delivering a better user experience for the visitors.
Analytics
Analytical cookies are used to understand how visitors interact with the website. These cookies help provide information on metrics the number of visitors, bounce rate, traffic source, etc.
Advertisement
Advertisement cookies are used to provide visitors with relevant ads and marketing campaigns. These cookies track visitors across websites and collect information to provide customized ads.
Others
Other uncategorized cookies are those that are being analyzed and have not been classified into a category as yet.
SAVE & ACCEPT