PiratProxies

Web scraping

How to use proxies with ScrapeBox

ScrapeBox is a Windows tool for harvesting search results and checking lists of addresses in bulk. It keeps its proxies as a list of lines.

Which proxy to use

Residential Lite is the economical choice for harvesting, where volume matters and only the country needs to be right.

What to enter

A PiratProxies plan gives you four things: a host, a port, a username and a password. These are the values for Residential Lite; the username and password are on your plan page.

Hostlite.piratproxies.com
HTTP port6969
SOCKS5 port9696
UsernameUSERNAME
Passwordfrom your plan page

As one line:

lite.piratproxies.com:6969:USERNAME:PASSWORD

The country and the session are chosen in the username, not in a separate setting. The generator on your plan page writes the username for you, and Targeting and sessions explains each part.

Steps

  1. Open the proxy manager, or paste straight into the proxy box on the main screen.
  2. Add your proxy as lite.piratproxies.com:6969:USERNAME:PASSWORD, one line per proxy.
  3. Tick the option to use proxies before you start a harvest.

Menu names can differ a little between versions of ScrapeBox. The four values to enter are always the same.

Rotating or sticky

For crawling many pages with ScrapeBox, leave the username without a session so every request leaves from a new IP address. For anything with steps that belong together, such as a login, a cart or a paginated search that sets cookies, add a session to the username so those requests share one address.

A sticky username looks like this:

USERNAME-country-us-time-600-session-a1b2c3d4

If it does not work

  • To spread a harvest over many IP addresses, generate a list of lines with different session IDs on your plan page and paste them all in.
  • If ScrapeBox will not accept a host name, test with a single line first and check for spaces at the end of the line.
  • A 407 error means the username or password was not accepted. Copy both again from your plan page, and check that nothing added a space or cut the username short.
  • If the IP address is in the wrong country, look at the username: the country code is part of it. More fixes.

Questions

Which PiratProxies proxy should I use with ScrapeBox?

Residential Lite is the economical choice for harvesting, where volume matters and only the country needs to be right.

ScrapeBox is a product of its own makers. PiratProxies is not affiliated with it; the name is used here only to say what this guide is about. Use it within the rules of the sites you work with and our acceptable use policy.