PiratProxies

Glossary

What is web scraping?

Web scraping is collecting information from web pages with a program instead of by hand, for example prices, listings or search results.

A scraper requests pages the way a browser does, picks out the parts it needs and saves them. Businesses use it to follow competitors' prices, track their search rankings, gather listings and check where their adverts appear.

Sites limit how many pages one address may load, so larger jobs spread their requests over many addresses with a rotating proxy. Collect public pages only, follow the law where you and the site are, and keep the pace low enough that the site stays fast for its real visitors.

Related plans on PiratProxies

Read next: Proxies for web scraping