Residential IPs are private IP addresses, meaning that your requests are routed through a real user when accessing the web. Buying residential IPs ensures that you will never get blocked or misled.
Data Center IPs are also known as static IPs.
A Static IP means you can keep using a specific IP for as long as you need (one long single session). These are more economical than Residential IPs.
Mobile IPs are a segment of residential IPs that are connected to the Internet via cellular (3G / 4G) connection, rather than WiFi or cable. Mobile IPs are commonly used to verify that your ads are being displayed correctly on mobile devices with different providers.
Shared IPs are the easiest way to start using Luminati network. They refer to global pool of IPs in various countries that are shared amongst many users to access numerous sites. you can use this option as the first entry point and scale to more exclusive one when getting blocked or misled.
Exclusive Domains promise that you will be the only one using those IPs for the target sites that you have chosen.
Unlimited Domains refers to IPs that are completely dedicated to you. No one can use those IPs while you are using them. Buying dedicated IPs ensures that your results will not be affected by another user of proxy services.
Allocation of IPsis done through the Zones section of your account.
To get started you need to create a new zone and among other settings, choose the number of IPs you want and save.
You can also update number of allocated IPs by editing the number of IPs in your zone.
When turning a zone off all IPs allocated to it are released, so when you turn the zone back on you will have new IPs allocated to it
In order to download a list of all gIPs or datacenter IPs allocated to one of your Zones there are 2 possible actions:
curl "https://luminati.io/api/get_route_vips?" \ -H "X-Hola-Auth: lum-customer-ACCOUNT_ID-zone-ZONE-key-ZONE_PASSWORD"
curl "https://luminati.io/api/get_route_ips?" \ -H "X-Hola-Auth: lum-customer-ACCOUNT_ID-zone-ZONE-key-ZONE_PASSWORD"
How did we calculate this table?
Your company needs to collect information from the web by sending 1,000 http requests per hour to a specific website. You write the scraper code and run it through a server. The target website allows 50 requests per minute from the same IP before blocking your scraper. Now, you have to purchase more proxies.
Assuming you choose datacenter proxies:
You don’t want to share IPs, so you buy 200 dedicated data-center IPs. You code the integration of the scraper with the new data-center proxies for 2 hours and then run the new program. This time, it takes 3 days for your target website to detect your scraper. Once your proxies are detected, you’ll have to purchase new proxies and repeat this process again, checking each day to make sure the proxies haven’t been detected. Cost per month (all numbers are from real customers):
Your total cost per month will be at least $1400 for just these things alone, and the salary of $30 per hour for a developer is very conservative. Additionally, this doesn’t account for a lack of information reliability if your target website sends misinformation before blocking you or if your information flow is cut every few days, which can be detrimental to your brand or your revenue stream.
Assuming you choose Luminati residential proxies:
You buy a basic package of 40GB with access to unlimited residential IPs. It takes 2 hours to integrate your scraper. Due to an average of 3 million residential IPs available each day, your target website can’t detect your scraper, allowing you to focus on other projects.
The bandwidth and unlimited IPs cost just $500 per month. Your information is always reliable because your requests are always successful and access is never cut in the middle of the month. When your business grows as a result of this scraping and your projects exceed 600MB each month, the difference in costs can be much higher than just ~$1000.
Luminati also allows you to suspend your account when not in use, so your cost can be lower than $500 per month. Start by using the $5 voucher for free data-center traffic to test Luminati’s benefits and then ask for access to our residential network for cheap and reliable data collection.
Why should I care?
When a target website detects crawlers from a proxy (datacenter) IP, it typically
How does the target website identify my crawling activity?
Target websites log the IPs of whomever visits them and analyzes the activity of these IPs. Assuming you are using a traditional data center proxy, the target website can:
Why should I care?
Example: If you are responsible for testing Yelp’s city level service - you need to check the site from 10,000 different cities around the world.
How to get an IP in a specific city?
If you only use a traditional data center proxy solution for your information collecting tasks, you are limited to where these datacenters are located. Large residential networks can get you IPs in any specific city in the world.
Why should I care?
If the number of requests you rotate through a single IP are higher than what target websites allow, the website you target will identify your IP and block or mislead you with false information. It means that your information collecting can be much slower than what you’re used to.
How do I improve the speed of my data harvesting?
Assuming you're running 10 million requests, 1 request per second per IP with 1000 data center IPs, your routine can take about 3 hours. With 10,000,000 residential IPs, your routine can potentially take 1 second.
Guidelines to rotate multiple parallel sessions through Luminati’s residential network:
Why should I care?
When many requests are sent to a website from the same IP, the website can tag the IP used as a crawler and send misleading information or block you. Periodically changing, or rotating, your IP address helps prevent a target site from identifying your IP as a crawler. Rotating your IPs can drop your failure rate to below 1%.
How do I rotate my IP address?
With its easy-to-use proxy manager, Luminati allows you to control:
Why should I care?
A SOCKS server is a proxy server that works for any type of network protocol on any port and establishes a connection to a server on behalf of a user, then routes traffic between the user and the server.
Why use SOCKS5 with Luminati?
When you use SOCKS5 with Luminati, the proxy manager converts any requests to port 80 or port 443 to http and https requests, so you don’t have to worry about which format is accepted by your target site. With any other port, the traffic is sent as-is between the user and the host.
Guidelines to use SOCKS5:
What is a subnet block range?
Smaller sections of a network are called subnets, which are useful for grouping hosts together and managing them all at once. Subnets are based on IP address, making it easy for websites or malicious users to target or block an entire subnet. For example, blocking 223 would block all IP addresses that begin with 223, while blocking 223.1 would only block IP addresses that begin with 223.1, and so on - this is the subnet block range.
Why should I care?
Because a database’s IPs are often all within the same subnet, they are easily blocked by websites, especially if they are known proxies.
Avoiding subnet block range:
Residential proxies cannot be blocked this way, because they don’t have subnet ranges. Using Luminati’s residential IPs ensures you won’t be affected if a website uses the subnet block range method.
Why should I care?
Using the Luminati Proxy Manager offers advanced features that are not readily available in the API. Instead of having to manually code mechanisms for tasks like keeping an IP as long as possible or rotating your IP after each request, you can simply click a button in the proxy manager.
Guidelines to to switch from API to Proxy Manager:
zproxy.lum-superproxy.io
22225
Authentication: DISABLE
Why should I care?
Getting cloaked means that you’re getting misleading information from the website you are scraping.
Example: If you are collecting comparative competitive information to feed your automatic pricing algorithms, the target website can return artificial lower prices to your requests, to skew your pricing and profits.
How to know when you’re getting cloaked
When using traditional proxy networks (data center based IPs), your target websites may identify your activity quite easily and may cloak your requests. Therefore, the only way to ensure you’re not getting cloaked is to rotate your requests through residential IPs.
Guidelines for rotating requests through millions of residential IPs:
Why should I use it?
Use the Chrome extension to self-test your website, verify your ads, or simply browse a site as if from another country. It’s a powerful complement to the Luminati Proxy Manager and an easy-to-use tool for less technical users. You can also have people who don’t have access to the dashboard use the extension without knowing the account credentials.
What features are available in the extension?
Luminati Chrome Extension supports datacenter and residential IP browsing, allowing you to search from any country. You can adjust the user agent, customize configuration of the DNS to maximize discretion or speed, and set random IP rotation.
Guidelines to download Luminati Chrome Extension: