Guides, Tutorials & Insights
Learn about residential proxies, web scraping, data collection strategies, and industry best practices from the Shifter team.
Rate Limiting and Request Throttling with Residential Proxies
A large proxy pool does not exempt you from rate limits, it just changes where they apply. Here is how to pace requests per target, per IP, and across a fleet.
How to Prevent DNS Leaks When Using Residential Proxies
If your client resolves hostnames locally, your DNS never goes through the proxy. That leaks your location and quietly breaks geo-targeted collection.
How to Whitelist Your IP for Residential Proxies
Short answer: the residential gateway does not use IP whitelisting, it uses credentials. Here is why, where whitelisting does apply, and how to set it up there.
Residential Proxy Authentication: Fixing 407 and Credential Errors
A 407 means the proxy rejected your credentials, and it is almost always one of three causes. Here is the diagnostic order that finds it in a couple of minutes.
How to Choose the Right Residential Proxy Plan for Your Project
Picking a proxy plan is three decisions: which product type, how much bandwidth, and which features you actually need. Here is how to get each one right.
Real vs Fake Residential Proxies: How to Spot Datacenter IPs Sold as Residential
Some providers sell datacenter IPs as residential. Here is how to tell the difference before you buy, using checks you can run in a few minutes.
Scraping App Store and Google Play Data Across Countries
An app does not have one ranking, one price, or one set of reviews. It has a different set in every storefront, and you can only read each one from inside it.
Monitoring Product Availability and Stock at Scale with Residential Proxies
Stock status changes fast and varies by market, so a national in-stock can be a local sold-out. Here is how to monitor availability per region, at scale.
Scraping Flight and Hotel Prices: Why Fares Change by Location
The same flight or room costs different amounts depending on where the shopper appears to be. To collect the real price per market, scrape from that market.