Web Scraping API

Send a URL, get back rendered HTML or parsed JSON. One endpoint handles proxy rotation, headless Chrome, JavaScript execution, CAPTCHA solving, and retries.

Key capabilities

JavaScript rendering

Full headless Chrome on demand. Wait for CSS selectors, execute scripts, scroll or click before capture.

Automatic retries + CAPTCHAs

Failed or blocked requests retry automatically with different proxies. reCAPTCHA and hCaptcha solved in-flight.

Extraction rules

Return parsed JSON instead of raw HTML. Define CSS selectors per field, no downstream parser required.

Residential + mobile

Growth plans and above route through the 205M+ residential pool plus mobile IPs. Global geolocation.

Endpoint

https://scrape.shifter.io/v1?api_key=YOUR_API_KEY&url=<TARGET_URL>

Add parameters as query strings. Everything else (proxy choice, browser, retries) is handled for you.

Quick example

curl "https://scrape.shifter.io/v1?api_key=YOUR_API_KEY&url=https://example.com&render_js=1"

Returns the fully rendered HTML. Add extract_rules for structured JSON:

curl "https://scrape.shifter.io/v1?api_key=YOUR_API_KEY&url=https://example.com&extract_rules=%7B%22title%22%3A%7B%22selector%22%3A%22h1%22%2C%22output%22%3A%22text%22%7D%7D"

# {"title": "Example Domain"}

Plans

Plan	Credits	Concurrency	Price	Proxy pool
Starter	100K	20	$44/mo	Datacenter (US/EU)
Growth	1M	50	$134/mo	Residential + Mobile
Business	3M	100	$269/mo	Residential + Mobile
Enterprise	10M	500	$719/mo	Residential + Mobile

1 credit = 1 successful request. Failed requests are not charged. See live pricing.

Next steps

Quickstart Your first rendered scrape in under 60 seconds.

Rendering JavaScript render_js, wait_for_css, timeouts, JS instructions.

Extraction rules Return structured JSON instead of raw HTML.

Sessions & proxies Hold a session across requests, pick a country.

Advanced Custom headers, cookies, POST/PUT, screenshots, binary.

Errors & limits Error codes, credits, failure behavior.