Web Scraper API

Production-grade web scraping with automatic anti-bot bypass, structured JSON parsing for 40+ targets, and geo-targeting.

You say
Buy it · $12 Read it before you buy $12 Written by oxylabs · unverified publisher
Context cost
4.3k tokensestimated from the bundle, loaded when it triggers
Bundle
3 files · 17.3 kBtext throughout, nothing executable
Licence
MITpaid listing
Last change
no release on file
Servers it uses
Noneruns standalone

What it does

Production-grade web scraping with automatic anti-bot bypass, structured JSON parsing for 40+ targets, and geo-targeting. Use when the user needs to scrape web pages, extract product data, get search results, or collect structured data from supported e-commerce and search platforms without worrying about getting blocked and when geo targeting is required.

Installed, it changes the agent in these ways.

What this skill changes about the agent is not written down here yet. The listing was collected from its source, and the description is in its own SKILL.md.

Expertise

Domain judgement the base model does not have.

scrapingapianti-botgeo-targeting

The skill itself

This is the whole product. A skill is instructions the model reads, so there is nothing behind the listing you cannot see first — the front matter loads with every session, and the body below it loads when the skill triggers.

SKILL.md5.8 kB · 136 lines
--- name: web-scraper-api description: Production-grade web scraping with automatic anti-bot bypass, structured JSON parsing for 40+ targets, and geo-targeting. Use when the user needs to scrape web pages, extract product data, get search results, or collect structured data from supported e-commerce and search platforms without worrying about getting blocked and when geo targeting is required. ---
6# Oxylabs Web Scraper API
7
8## Authentication
9
10Requires HTTP Basic Auth with credentials from environment variables:
11
12```bash
13curl -u "$OXY_WSA_USERNAME:$OXY_WSA_PASSWORD" ...
14```
15
16## Endpoint
17
18```
19POST https://realtime.oxylabs.io/v1/queries # immediate response
20POST https://data.oxylabs.io/v1/queries # Push-Pull jobs, callbacks, storage
21Content-Type: application/json
22```
23
24## Core Parameters
25
26| Parameter | Required | Description |
27|-----------|----------|-------------|
28| source | Yes | Target scraper (e.g., universal, amazon_product, google_search) |
29| url | Conditional | URL to scrape (for universal and *_url sources) |
30| query | Conditional | Search query or product ID (for *_search and *_product sources) |
31| parse | No | Enable structured data parsing (recommended for supported sources) |
32| render | No | JavaScript rendering: html or png |
33| geo_location | No | Geographic targeting: country/state/city, ZIP/postcode, coordinates, or Criteria ID where supported |
34| session_id | No | Reuse the same proxy IP across multiple jobs |
35| content_encoding | No | Set to base64 when downloading image files via Realtime or Push-Pull |
36| user_agent_type | No | Device/browser preset, e.g., desktop_chrome, mobile_ios, tablet_android |
37| locale | No | Interface language / Accept-Language, e.g., de-DE |
38| callback_url | No | Push-Pull callback endpoint |
39| storage_type, storage_url | No | Push-Pull cloud upload target (gcs, s3, tos, s3_compatible) |
40| markdown, xhr | No | Enable markdown or captured XHR result types |
41| browser_instructions | No | Rendered browser actions; requires render: "html" |
42| parsing_instructions, parser_preset | No | Custom parser rules or saved preset; pair with parse: true |
43| client_notes | No | Client-side job tag saved with the job metadata |
44| domain, subdomain, start_page, pages, limit, store_id, delivery_zip, fulfillment_type | Source-specific | Marketplace/search/store localization and pagination fields |
45
46user_agent_type values: desktop, desktop_chrome, desktop_edge, desktop_firefox, desktop_opera, desktop_safari, mobile, mobile_android, mobile_ios, tablet, tablet_android, tablet_ios.
47
48## Context Parameters
49
50Add these as { "key": "...", "value": ... } objects in context:
51
52| Key | Use |
53|-----|-----|
54| force_headers, headers | Merge custom headers with managed headers |
55| force_cookies, cookies | Merge custom cookies with managed cookies |
56| http_method, content | Use post with Base64-encoded body content |
57| follow_redirects | Follow 3xx redirect chains |
58| successful_status_codes | Treat specific non-standard HTTP codes as successful |
59
60For multi-format output, enable types in the payload (parse, markdown, xhr, render: "png") and request them with ?type=raw,parsed,png,markdown,xhr.
61
62For batch Push-Pull jobs, use POST /v1/queries/batch with arrays only for query or url; keep all other parameters singular. Maximum batch size is 5,000 values.
63
64## Quick Start
65
66**Scrape any URL:**
67```bash
68curl -X POST 'https://realtime.oxylabs.io/v1/queries' \
69 -u "$OXY_WSA_USERNAME:$OXY_WSA_PASSWORD" \
70 -H 'Content-Type: application/json' \
71 -d '{"source": "universal", "url": "https://example.com"}'
72```
73
74**Google search with parsing:**
75```bash
76curl -X POST 'https://realtime.oxylabs.io/v1/queries' \
77 -u "$OXY_WSA_USERNAME:$OXY_WSA_PASSWORD" \
78 -H 'Content-Type: application/json' \
79 -d '{"source": "google_search", "query": "best laptops", "parse": true}'
80```
81
82**Amazon product by ASIN:**
83```bash
84curl -X POST 'https://realtime.oxylabs.io/v1/queries' \
85 -u "$OXY_WSA_USERNAME:$OXY_WSA_PASSWORD" \
86 -H 'Content-Type: application/json' \
87 -d '{"source": "amazon_product", "query": "B07FZ8S74R", "parse": true}'
88```
89
90## Choosing the Right Source
91
921. **Use specific sources when available** (amazon_product, google_search) - better parsing and reliability
932. **Use universal for unsupported sites** - works with any URL
943. **Enable parse: true** for structured JSON output on supported sources
95
96## Response Structure
97
98```json
99{
100 "results": [{
101 "content": "...",
102 "status_code": 200,
103 "url": "https://..."
104 }]
105}
106```
107
108With parse: true, content contains structured data (title, price, reviews, etc.) instead of raw HTML.
109
110## Available Sources
111
112For the complete list of 40+ supported sources organized by category, see [sources.md](sources.md).
113
114## More Examples
115
116For detailed request/response examples including geo-location, JavaScript rendering, and custom headers, see [examples.md](examples.md).
117
118## Error Handling
119
120| Code | Meaning |
121|------|---------|
122| 200 | Success |
123| 400 | Invalid parameters |
124| 401 | Authentication failed |
125| 403 | Access denied |
126| 429 | Rate limit exceeded |
127
128## Key Guidelines
129
130- Always set parse: true for supported sources to get structured data
131- Use ZIP codes for US e-commerce geo-location (e.g., "90210")
132- Use country/state format for search engines (e.g., "California,United States")
133- Add render: "html" for JavaScript-heavy pages
134- Use render: "" only to disable automatic forced rendering for force-rendered pages; set client timeouts near 180 seconds for rendered Realtime or Proxy Endpoint requests
135- Add content_encoding: "base64" when scraping image URLs, then decode results[0].content before saving the file
136
In the file
SKILL.md775 words
Files3
LicenceMIT
Why you can read it

Nothing in a skill executes. The client loads the text and the model follows it, so a skill can be audited the way a runbook is — by reading it.

What it costs in context

Skills are not billed by the call. They are paid for in context: every token the instructions occupy is a token your code, your diff and your conversation cannot use. Here is what this one takes and when it takes it.

≈100
always loaded
The name and description, so the model knows the skill exists and when to reach for it.
4,225
on trigger
The instruction body and 2 supporting files, read only when the skill fires.
2.2%
of a 200k window
Ten skills this size would take about 22% of the window before you open a file.
050k100k150k200k context window

4.3k tokens, estimated from the bundle at four bytes to the token, held for the rest of the session once it triggers. Heavy. Teams tend to install this one per project rather than globally, and load it only when the job comes up.

Servers bill, skills cost

A server charges by the month. A skill charges once per session, in context, and then keeps charging it for as long as the session lives.

Before and after

The same question, put to the same model twice: once as it comes, and once with these instructions loaded.

No worked example has been published for this skill yet.

Adoption
Installsnone yet
Ratingno reviews yet

The procedure it runs

The procedure has not been published here. It is in the skill’s own SKILL.md, which its author has not sent to the marketplace yet.

Prose, not code

These steps are written for a model to follow, not executed by a runtime. It can still be told to skip one, and it will say so when it does.

Servers it uses

None. This skill calls no MCP servers at all.

Everything it needs is in the instructions, so it works in a project with nothing connected — the model reads the file and changes how it works with what it can already reach.

It writes no files and reaches no network. All it changes is how the model reasons and writes.

What it asks for
Writes filesno
Network accessno

Read from the allowed-tools line of this skill’s own SKILL.md. A skill grants no permissions of its own — it can only ask for tools your client already has.

What it will not do

Every skill is narrow, and the useful ones say where they stop. These are the jobs this one is the wrong tool for.

What this skill is not for has not been published here. Nothing is implied by that: it is a section the author has not filled in.

What is in the bundle

3 files, 17.3 kB on disk. A bundle is text throughout: the instructions the model reads, plus the templates it fills in.

  • SKILL.md5.8 kB
  • examples.md6.0 kB
  • sources.md5.5 kB
What is not in it

No dependencies and nothing executable: a skill is text the agent reads, so the bundle is 3 files you can review in full before installing. The MIT licence covers the templates and examples as well as the instructions.

Install

Installing copies the bundle into your project. Nothing runs at install time — the files sit on disk until the model reads them.

$12 once
Web Scraper API · MIT · oxylabs
one-time
Price$12 once
LicenceMIT — the author’s, unchanged by this purchase
Paid throughStripe, once, on the card you add at the checkout
Keeps workingfor good — the files are yours once they are on disk
Updatesevery update its author ships, delivered through this account

You can read the whole bundle before paying — the SKILL.md above is the product, not a preview of it. What the money buys is the delivery: the folder packaged and handed to your machine by key, every update its author ships, and our support if it does not do what this listing says. The terms of use are MIT, set by the author and unchanged by buying it here.

Payment runs through Stripe, on a page like this one rather than a redirect. Once there is an account it joins the same mcprush invoice as everything else you run, so there is never a second card to enter.

Which clients pick it up on their own

A skill is a folder of text. A client with a skills folder reads it without being told; everywhere else the same text works, it is just handed to the model rather than found.

Claude Code.claude/skills/
Claude Desktop
ChatGPT
Cursor.cursor/skills/
VS Code.github/skills/
Codex CLI.agents/skills/
Gemini CLI.gemini/skills/
Grok.grok/skills/
Zed.agents/skills/
Windsurf.windsurf/skills/
Agent SDK.claude/skills/
HTTP / API
This release
Versionnot versioned
Publishedno release date on file
Price$12
Referenceoxylabs/web-scraper-api

Versions

Its author publishes no version number, so there is nothing here to pin to: what you install is the folder as it stands today. Instructions change more often than APIs do — a skill can be rewritten entirely without anything it depends on moving.

v
  • No earlier releases have been published to the marketplace.
Pinning

Nothing to pin to: this skill carries no version number of its own. What you install is what the folder holds on the day you install it.

Reviews

no reviews yet · no installs yet

Nobody has reviewed this skill yet. The rating is the mean of the reviews written here, so there is none until somebody writes the first.

Who can post

Only accounts that have had the skill installed for fourteen days, so a review is written after living with it rather than after reading it. Publishers may reply once.

Publisher
Servers0