Web Crawlers

Based on recent court cases, web scraping has been deemed an “acceptable” practice when certain stipulations have been fulfilled. Those stipulations have created a path for legal data scraping in a multitude of applications.

What are those stipulations?

  • Web scraping must be completed only when the use of an “account” on the target site is not required to gain access to the content being scraped.
  • Web scraping activities must not impede the normal operation or cause excessive load on the target sites servers

 

We create custom-built web crawlers that follow these guidelines and respect the businesses we gather information from. We use Python, VBA, and Selenium to perform a wide range of tasks, not limited to scraping. 

Microsoft_Office_Excel_2018present
Microsoft Excel

All logos are trademarks of their respective companies. All rights reserved.