Website Scraper API

For a site with no ready-made endpoint, Upscrape has five APIs that read any public page. Each costs 1 credit a call, a failed call costs nothing, and each has a short address of its own.

One request shape

Send the page and the options as the body, with your API key:

curl https://data.upscrape.com/markdown \  -H "Authorization: Bearer $UPSCRAPE_API_KEY" \  -H "Content-Type: application/json" \  -H "Prefer: wait=30" \  -d '{"url": "https://stripe.com/privacy"}'

import osimport requestsjob = requests.post(    "https://data.upscrape.com/markdown",    headers={"Authorization": f"Bearer {os.environ['UPSCRAPE_API_KEY']}", "Prefer": "wait=30"},    json={"url": "https://stripe.com/privacy"},).json()print(job["results"][0]["data"]["parsed"]["markdown"][:500])

const res = await fetch("https://data.upscrape.com/markdown", {  method: "POST",  headers: {    Authorization: `Bearer ${process.env.UPSCRAPE_API_KEY}`,    "Content-Type": "application/json",    Prefer: "wait=30",  },  body: JSON.stringify({ url: "https://stripe.com/privacy" }),});const job = await res.json();console.log(job.results[0].data.parsed.markdown.slice(0, 500));

The answer is the same job as every other call: state, the data in results[0].data and billing.credits_charged. A call still running after 30 seconds answers 202; fetch its poll_url, as Jobs and results shows.

Each API is also an endpoint like any other, so POST /execute with {"capability": "web.markdown", "input": {"url": "…"}} runs the same job, and an AI agent finds them over MCP.

What they share

• Public pages only. Anything a visitor can see without signing in.

• Pages that need JavaScript are opened in a real browser for you, at the same price.

• Robots rules. The crawl and sitemap APIs follow a site's robots.txt by default.

• Honest failures. A page that is blocked, empty or gone fails with its reason, such as website_not_found or unsupported_content, and costs nothing. Errors and retries lists them.

• Same headers as every call: Prefer: wait=N, Idempotency-Key and X-Max-Credits.