Skip to content

MCP servers for web scraping

MCP servers whose description mentions reading or crawling third party web pages.

504 servers 1.1% of 44,302 in the directory

This category in numbers

The most frequent value per property, counted across the entries of this category. The full distribution is further down.

Entries

Filter further

Entries 1 to 50 of 504

Entries
402registrycom.402registry/402registry
AI Crawler Access Checkio.github.hamzawamiqhq/ai-crawler-check
AI Crawler Indexdev.workers.pathwren.www/ai-crawler-index
AI Review Analysis Tool - Customer Action Plancom.ranovam/ai-review-intelligence
AI Search Kitcom.modernmustardseed/ai-search-kit
AIReadyio.github.everyai-com/ai-ready
AIsa On-Page Auditone.aisa/seo-onpage
AIsa Web Search & Researchone.aisa/web-search
ATEX AI Gatewayio.github.lm203688/atex-ai-gateway
Aayat AIio.github.faisal-maverick/aayat-ai
ActableSite AI Crawler Monitorcom.actablesite/ai-crawler-robots-monitor
ActableSite AI Crawler Monitorcom.actablesite/readiness
Adliciocom.tryadlicio/adlicio
Aetheris-MCP — x402 Web Scraping MCP Serverio.github.Timwal78/aetheris-mcp
Agent Crawl Readinessio.github.sadri-dridi/agent-crawl-readiness
Agent Hubcom.torbrooknews.mcp/agent-hub
Agent Search Proio.github.AgentMindCloud/agent-search-pro
Agent Utility Suite (x402)io.github.vanakenj45/x402-agent-api
Agent Wholesaleio.github.despiteryan/agentwholesale
Agent360 Browser MCPio.github.Agent360dk/browser-mcp
AgentIndex x402world.agentindex/x402
AgentMart Procurementonline.agentmart/procurement
AgentScrapeio.github.hshintelligence/agent-scrape
AgentSearch (agentsearchhq.com)io.github.agentsearchhq-coder/agentsearch-mcp
AgentsHub Web Searchio.github.tvstat1/agent-data-provider
AiPayGen — 65+ AI Tools as an MCP Serverio.github.Damien829/aipaygen
All Jobs Scraper - 10 ATS Job Boards in One Actorcom.ranovam/all-ats-jobs-scraper
Amazon Reviews Scraper & AI Review Analysiscom.ranovam/amazon-review-intelligence
Amazon Scraper APIio.github.ChocoData-com/amazon-scraper-api-mcp
Anakinio.anakin/mcp
Andi Searchcom.andiai/andi-search
AnyAPIio.github.getanyapi-com/anyapi
Anyfetchio.github.aliasmode/anyfetch
Apifyio.github.pipeworx-io/apify
Apollo Intelligenceteam.apolloai/intelligence
Arachne MCPio.github.Samuelfmedeiros/arachne
Ashby Job Scraper & API for Team Job Boardscom.ranovam/ashby-scraper
Ashby Jobs Scraper & API - All Companies, Remote, Last 24 Hoursio.github.AnshumanAtrey/ashby-jobs-search
Atlas Web Compiler & Scrapercom.atlas-compiler/atlas
Atlassian Statuspage Scraper & JSON API Toolcom.ranovam/statuspage-scraper
AuditAE SEO MCPapp.auditae/mcp
AutomationNation Data Toolsio.github.retracn/automationnation-mcp
Baizhi Cloud Agent Toolkitio.github.ct-jaryn/baizhi-agent-toolkit
Bing Search APIio.github.saulius876-lgtm/bing-search
Bizcrawcom.bizcraw/bizcraw
Black SEO Analyzerio.github.sethblack/bseoa
Brainiall Webcom.brainiall/web
Bright Dataio.github.pipeworx-io/bright-data
Business Site Auditio.github.mthburnsbarber-web/business-site-audit
CLIO Webio.github.iowarp/web-mcp

All 504 entries in the list, with filters and pagination

Newest in this category

The 10 entries of this category that this registry listed most recently for the first time and that are not shown above. Ordered by the day first listed, not by any rating.

How it works

Before choosing

This category is derived from terms in the provider’s description. The classification describes the source text; tracevero has not run the stated functionality. The search patterns used are: scraping, scrape, scraper, crawl, crawler, crawling, web search, serp. Compare the entry descriptions, then check execution, package and declared credentials.

What this category selects

What this category selects
Field of use, derived from the vendor descriptionWeb scraping
derived from: Description (raw)

A derived value carries its original data beside it; the derivation rule is published, with a version, on the methodology page.

Caveats, distribution and query

What this category does not say

  • Field of use, derived from the vendor description is not declared but computed: from Description (raw). The rule is published, with a version, on the methodology page.

What is measured is what a manifest declares, not what a piece of software does. This registry fetches no repository URL, no endpoint and no package index; nothing here is verified. Which value comes from which source, and by which rule it was formed, is set out in the Methodology.

Every sentence here follows from the condition above, not from an assessment.

How this category is distributed

Delivery form (raw)

504
Delivery form (raw)
remote295 59 %
package170 34 %
package and remote32 6.3 %
neither7 1.4 %

Execution location

504
Execution location
remote299 59 %
local205 41 %

Repository URL listed

504
Repository URL listed
yes336 67 %
no168 33 %

Repository platform (raw)

504
Repository platform (raw)
github336 67 %
nothing declared168 33 %

Required secrets declared

504
Required secrets declared
no375 74 %
yes129 26 %

Icon formats (raw)

504
Icon formats (raw)
nothing declared437 87 %
image/png44 8.7 %
image/png, image/svg+xml11 2.2 %
image/svg+xml11 2.2 %
image/svg+xml, image/webp1 0.2 %

Per property, the measured values inside this category. The share refers to the 504 entries of the category, not to the registry. Shown are 6 of 8 properties: those whose values spread the most inside this category.

The same category through the interface

curl -s "https://api.tracevero.com/v1/eintraege?art=mcp_server&einsatzgebiet=websammlung&grenze=200"

The command carries exactly the condition of this page. 504 entries at 200 each are 3 requests; the total is in the X-Gesamt header.

Changes to these entries

https://tracevero.com/aenderungen.atom?thema=einsatz-websammlung

Both addresses narrow the change stream to exactly the entries in this category. The feed carries an identifier of its own, so a feed reader keeps it apart from the full stream.

Questions about this selection

How do I set up one of these servers in my client?

Open the entry and choose “Build configuration” when a launch template is available. The builder lists the supported clients and identifies the values you need to supply. A generated file does not establish that the server is reachable or works with your installation.

View clients and setup

Are the listed servers free?

Membership of this category says nothing about price. Neither a repository address nor the absence of declared required secrets establishes that a service is free. Check the individual provider’s pricing and access terms.

How can I follow changes to this selection?

Each entry identifies the source and collection date of its declarations. The change stream for this category shows published changes to its entries. You can subscribe to its Atom feed without creating an account.

Follow changes to this category

Categories sharing entries with this one

MCP servers for documents 1,491 entries in this category57 shared Remote MCP servers with declared required secrets 2,413 entries in this category68 shared Remote MCP servers with an Authorization header 2,223 entries in this category61 shared MCP servers with declared required secrets 6,353 entries in this category129 shared MCP servers for social media 681 entries in this category21 shared MCP servers for the browser 126 entries in this category11 shared

Per neighbour its own size and the counted number of shared entries. A category without a single shared entry is not listed here.

tracevero · https://tracevero.com/themen/einsatz-websammlung