See also

The Shifter Web Scraping API is a scalable building block for large-scale scraping pipelines. Jump to any feature page below to see the specific parameters and example calls.

All endpoints

Basic request Minimal api_key + url call.

API request Full parameter reference.

Rendering JavaScript render_js=1 to use a headless browser.

Proxies Switch between datacenter and residential.

Geolocation Route requests through a specific country.

Sessions Reuse the same proxy across requests.

Custom headers Send your own request headers.

Custom cookies Attach cookies to the scrape.

POST requests Scrape forms and POST endpoints.

PUT requests Send PUT requests through the API.

Forcing timeouts Bound slow pages with the timeout param.

Waiting for CSS Pause until a selector appears.

JavaScript instructions Click, scroll, fill forms before scraping.

Extraction rules Return structured data from CSS selectors.

JSON auto parser Get the page as structured JSON.

Screenshot Capture a page as a JPEG screenshot.

Binary files Fetch files as base64 strings.

Disable stealth Turn off the default stealth plugin.

API errors Status codes and retry guidance.