Integrations

< Back to Integrations

Octoparse Proxy Integration with Luminati


Octoparse is an easy-to-use web scraping tool allowing you to build your own crawler, no coding required.

Octoparse can assist by bypassing the majority of anti-scraping technologies. This is done by extending wait times, automatically switching the browser, and more. In some cases, an IP proxy network is still required. For example, many large retail sites have strict restrictions on abnormal access, in this case, it is recommended to rotate the IP address at a certain frequency.

Integrate Luminati’s Proxy Manager with Octoparse

Getting started with Octoparse:

  • Download and install Octoparse
  • To build a crawler on your own choose the Advanced Mode and click the Task button
  • Type in your target domain/s in the website field
  • Scroll down and click save URL

Generate high-quality IP addresses with Luminati

  • Sign-up for Luminati and input a payment method for your $5 credit bonus
  • Go to your Luminati Dashboard and click Add Zone
  • Select a network type and press Add Zone
  • Once you have created your zone, click the pencil icon on the left side to go the zone details
  • Within the zone details page, go to the IPs section
  • Click Download IPs list

How to paste the IP addresses directly into your Octoparse crawler

  • Open the task that requires the use of IPs in Octoparse
  • Click settings on the top left corner to set up IP proxy

  • Scroll down go to Anti-blocking settings
  • Choose Use IP Proxies
  • Then click on the Settings
  • In the IP Proxies field, copy and paste the Luminati downloaded IPs list

  • Save your IPs by clicking OK
  • Scroll up and save your new proxy settings by clicking Save in the top left corner

Start using Luminati and Octoparse