Oxylabs MCP: scrape, crawl and search the web from your AI app
Oxylabs' MCP server fetches and processes web content through the Oxylabs Web Scraper API: scrape a page, crawl a site, map its URLs, search the web, or pull Google and Amazon results. ContextGate connects it to Claude, ChatGPT and Cursor without a sign-in and records each scrape, so you can see which sites your team's AI apps pulled data from.
- Ready to connect
- Free
- 10 example tools
Add the Oxylabs Web Scraper API to your AI app
- 1Click Connect Oxylabs free. There's no sign-in, so its tools are ready at once.
- 2All ten tools fetch data. `ai_browser_agent` goes further, navigating a site and taking actions on it, so switch it off if you only want pages read, not clicked through.
- 3Add ContextGate to your AI app as a connector or MCP server. The steps for each app are on the Works with page.
- 4Ask your AI app to scrape the first page of Amazon results for a product search, then open Activity to see the `amazon_search_scraper` call.
Web data jobs for Claude or Cursor
- Get the content of any page with `universal_scraper`, with browser rendering when a page needs it.
- Crawl a site from a starting URL with `ai_crawler`, or list its URLs with `ai_map`.
- Pull Google Search results with `google_search_scraper`, with locale and geolocation settings.
- Scrape Amazon search results and product pages with `amazon_search_scraper` and `amazon_product_scraper`.
Know what your AI apps scraped
- Switch off `ai_browser_agent`, or any other Oxylabs tool, and your AI apps can no longer see or call it.
- Policies check each call, so a URL carrying a token in its query string can be blocked.
- Activity records every scrape, crawl and search your team's AI apps run through Oxylabs.
What you get with Oxylabs and ContextGate
- Your AI apps can use OxylabsClaude, Cursor, ChatGPT and other AI apps reach Oxylabs through the one ContextGate connection you add to them.
- You choose which tools they can useSwitch off any Oxylabs tool you don't want used. It's hidden from your AI apps and refused if called.
- Every call is checked and recordedYour policies check each call (for example, personal data is hidden and secrets are blocked), and Activity keeps a record of it.
ContextGate sees only the tool calls that go through it, not your AI app's built-in tools or your chats.
Oxylabs tools
Examples of what your AI apps can do in Oxylabs. You'll see the exact list of tools after you connect it.