Questions and answers
What the API returns, what it costs, how it treats the sites it reads, and how an agent connects.
The product
What is SuperScraper?
An API that searches, scrapes, crawls, maps, extracts and parses the live web and returns content a model can read. A page scrape says how the page was fetched. When the page has structured data, the result also carries a 0 to 1 completeness score, so an agent can decide what to use.
What does a scrape return besides the page?
metadata.fetchMethod says how the page was fetched: plain HTTP, a real browser or a proxy route. When the page publishes structured data, you also get _completeness, one score for how complete that data is, and _extraction_method, which says whether it came from JSON-LD, Open Graph or the page text. The X-Credits-Consumed header says what the call cost.
Is SuperScraper open source?
No. It is a hosted service you call over a REST API. There is nothing to install or run yourself.
What SDKs and integrations exist?
Call the REST API over HTTP with a Bearer key from any language. There are no official SDK packages yet. Adapters for LangChain, LlamaIndex, CrewAI, the Vercel AI SDK and Google ADK are planned and not published, so there is nothing to install for those today.
Credits and plans
How do credits and pricing work?
One page is one credit. Extraction without a schema (JSON-LD and Open Graph) is free, and a scrape that returns no data costs nothing. Free is $0 a month for 1,000 credits, Hobby is $12 a month for 5,000 credits, Pro is $59 a month for 100,000 credits, Scale is $239 a month for 500,000 credits.
Is search on every plan?
Yes. Every plan can call every endpoint, search included.
What are the rate limits, and how is support handled?
Requests per minute by plan: Free 10, Hobby 60, Pro 200, Scale 600. Support is community support on Free, email support on Hobby, priority email support on Pro, priority support on Scale.
Data and compliance
Do you respect robots.txt?
Yes. Scrape and crawl respect robots.txt by default. If you are allowed to access content a site disallows, set ignoreRobotsTxt: true on that request.
How fresh is the data?
A scrape fetches the live page by default. To accept a cached copy, send maxAge in milliseconds. A cache hit within that age costs 0 credits, and metadata.cached tells you it came from cache.
Can a person ask to have their details removed?
Yes. Email privacy@superscraper.dev. Removed records leave results right away and are permanently deleted after 30 days; a daily job completes the deletion, so it can take up to about a day longer. The takedown page lists what to send.
Agents and migration
Can an agent sign up without a human?
Yes. The agent calls POST /v1/keys/provision to create its own free key, then reads /agent-onboarding/SKILL.md to learn the API. There is no signup form and no dashboard step.
Is there an MCP server?
Hosted MCP is coming soon. Until then, agents call the REST API with a Bearer key. The MCP page lists the tools and shows the setup.
I already use another scraping API. How do I move?
The /v2 paths accept the request and response shapes of one widely used scraping API, so an existing integration can switch by changing its base URL and key. Coverage is partial, and the migration page lists each route. New work should call the /v1 endpoints directly.
Still have a question?
Run a request in the playground or read the docs. Most answers are one call away.