Proxies
The Web Scraping API runs requests through a pool of millions of IP addresses across more than 195 geolocations. Pick the right pool for your target with proxy_type.
Endpoint
Section titled “Endpoint” GET https://scrape.shifter.io/v1?api_key=YOUR_API_KEY&url=<TARGET_URL>&proxy_type=<datacenter|residential>
Parameters
Section titled “Parameters”| Parameter | Type | Required | Description |
|---|---|---|---|
api_key | string | yes | Your Web Scraping API key |
url | string | yes | Target URL to fetch |
proxy_type | string | no | datacenter (default) or residential. |
Datacenter vs residential
Section titled “Datacenter vs residential”Datacenter proxies come from cloud providers, not ISPs. They are fast, cheap, and anonymous, but some targets pre-flag datacenter ranges. Shifter’s datacenter pool is private, keeping blacklisting low.
Residential proxies are real IPs assigned by ISPs to home users. They look like genuine consumer traffic and bypass most IP-based blocking, at a higher cost per request.
Example request
Section titled “Example request”Datacenter
Section titled “Datacenter”curl "https://scrape.shifter.io/v1?api_key=YOUR_API_KEY&url=https://httpbin.org/get&proxy_type=datacenter"import requests
r = requests.get("https://scrape.shifter.io/v1", params={ "api_key": "YOUR_API_KEY", "url": "https://httpbin.org/get", "proxy_type": "datacenter",})print(r.json())import fetch from 'node-fetch';
const url = 'https://scrape.shifter.io/v1?' + new URLSearchParams({ api_key: 'YOUR_API_KEY', url: 'https://httpbin.org/get', proxy_type: 'datacenter',});const res = await fetch(url);console.log(await res.json());Residential
Section titled “Residential”curl "https://scrape.shifter.io/v1?api_key=YOUR_API_KEY&url=https://httpbin.org/get&proxy_type=residential"import requests
r = requests.get("https://scrape.shifter.io/v1", params={ "api_key": "YOUR_API_KEY", "url": "https://httpbin.org/get", "proxy_type": "residential",})print(r.json())import fetch from 'node-fetch';
const url = 'https://scrape.shifter.io/v1?' + new URLSearchParams({ api_key: 'YOUR_API_KEY', url: 'https://httpbin.org/get', proxy_type: 'residential',});const res = await fetch(url);console.log(await res.json());