Web Scraping API
Send a URL. Get the data back.
Managed REST API for web scraping. We handle proxy rotation, JavaScript rendering, CAPTCHA solving and retries. You handle the data.
{
"url": "▍",
"render": true,
"country": "us"
}Trusted by 50,000+ clients worldwide
A complete scraping stack
Browser rendering, proxy rotation, and anti-bot defense, behind a single REST endpoint.
JavaScript Rendering
Real headless browsers render single-page apps, dynamic content and infinite scroll. Get the same HTML a user sees in Chrome.
Proxies Across 195+ Countries
Residential and ISP (static residential) IPs across 195+ countries. Geo-target requests at the country level with one parameter.
Auto-Retry & CAPTCHA Solving
reCAPTCHA, hCaptcha and bot challenges are detected and bypassed automatically. Failed requests retry on a fresh IP, you only pay for successful responses.
Headers, Cookies & Sessions
Forward custom headers, cookies and POST bodies through the API. Maintain a session across requests with a session ID.
Structured JSON or Raw HTML
Get parsed JSON for common targets, or raw HTML and decide how to extract. Webhook delivery available for async batch jobs.
Built for Scale
Hundreds of concurrent requests per plan, sub-second average latency, 99.9% uptime SLA. Run thousands of jobs in parallel without managing infrastructure.
One HTTP request away
Plain REST. Send a URL, get the data, no scraper code to maintain.
const params = new URLSearchParams({
api_key: process.env.SHIFTER_API_KEY,
url: "https://amazon.com/dp/B0CRMR6JKZ",
render_js: "1",
country: "us",
});
const res = await fetch(`https://scrape.shifter.io/v1?${params}`);
const data = await res.json();
console.log(data.title, data.price);Built for data teams
Engineers and analysts use the Scraping API to power monitoring, research and ML pipelines, without owning scraper infrastructure.
Travel Fare Aggregation
Collect rates from hotel and flight sites, online travel agencies and aggregators. Beat anti-bot defenses without building scrapers from scratch.
Price & Product Monitoring
Track competitor pricing, stock levels, product descriptions and reviews across marketplaces. Automate pricing strategies with real-time data.
Financial Data
Pull market data, broker rates and alternative datasets. Aggregate from multiple sources to power investment decisions and risk models.
Real Estate
Gather listings, rental prices and market trends from regional portals. Build acquisition pipelines with structured property data.
Customer Reviews
Scrape product reviews and ratings from marketplaces, app stores and review sites. Feed sentiment models with the freshest data.
HR & Hiring Data
Monitor job boards and career pages for new openings, hiring patterns and talent trends across competitors.
Simple, transparent pricing
Credit-based pricing. JS rendering and CAPTCHA solving included on every plan. Scale concurrency from 20 to 500+.
What's included
- 100,000 API credits
- 20 concurrent requests
- JavaScript rendering
- Datacenter Proxies
- US/EU geolocation
What's included
- 1,000,000 API credits
- 50 concurrent requests
- JavaScript rendering
- Residential & Mobile Proxies
- All geolocation
What's included
- 3,000,000 API credits
- 100 concurrent requests
- JavaScript rendering
- Residential & Mobile Proxies
- All geotargeting
What's included
- 10,000,000 API credits
- 500 concurrent requests
- JavaScript rendering
- Residential & Mobile Proxies
- All geotargeting
The first residential proxy provider.
Now one of the largest.
Since 2012, Shifter has grown into a global proxy network trusted by over 50,000 clients including Fortune 500 companies. Connect from anywhere, access local data without restrictions, while preserving complete privacy and security.
Frequently asked FAQ questions
Common questions about the Web Scraping API. Can't find what you're looking for? Contact our support team.
You pay per credit, not per request. Standard datacenter request: 1 credit. JavaScript-rendered datacenter request: 5 credits. Standard residential request: 10 credits. JavaScript-rendered residential request: 25 credits. Failed requests are not charged.
The API is built on auto-scaling cloud infrastructure and currently handles thousands to millions of requests per day across customers. Plans scale concurrency from 20 to 500+ requests in parallel; for higher volume, contact us for a custom plan.
Yes. Set render=true and the request runs in a real headless browser. SPAs, dynamic content, lazy-loaded sections and infinite scroll are all handled. JavaScript rendering uses more credits but unlocks targets that pure-HTTP scrapers cannot reach.
CAPTCHAs (reCAPTCHA, hCaptcha and others) are detected and solved automatically inside the request flow, no third-party solver required. Blocks and rate limits trigger automatic retries on a fresh IP from the residential pool.
Yes. Pass a 'country' parameter in the request to route through an IP in that country. 195+ countries are supported, with city-level targeting available on residential plans.
Official SDKs for Node.js, Python, Scrapy and Rust are published on GitHub. The API is plain REST so any HTTP client works, the SDKs add convenience helpers for retries, batching and webhook handling.
Start with the Web Scraping API
Forget about proxies, browsers and anti-bot defenses. Send a URL, get the data. Plans from $44/mo.