< Back to webinars

Introduction to set up your crawler and proxy effectively

Get all the tools you need to effectively run your crawler using an Open Source Proxy Manager.

10 min
beginner
02-Jul-2018

Get all the tools you need to effectively run your crawler using an Open Source Proxy Manager.

Agenda

  • Set crawler ports and IP without developers
  • IP rotation
  • Keep exclusive IP
  • Keep session alive with same IP
  • Automatically retry and change IP
  • Success rate indicators and log details
  • Setup crawler journey rules
  • Use multiple PCs/VMs
  • SOCKS5 and HTTPS
  • Bypass proxy
  • How to reduce bandwidth
  • Luminati expert tips and tricks