Tag “crawling” — 131

LegalSearch

roopslawassist.com

Public Indian legal search MCP for Roop judgments, statutes, and corpus grounding.

com.dethboy/vedetta

vedetta.dethboy.com

x402 pay-per-call crypto sentiment, divergence & analyst reads. USDC on Base. NFA.

ShearQuery — Barber & Beauty Industry Data

shearquery.com

Barber & cosmetology exam pass rates, booth rent with open chairs, and Texas licensee counts

Pet Data Station

petforai.com

Source-verified pet food regulations, recalls, nutrient standards and species care data.

Weav

docs.weav.com

Connect AI tools to Weav customer service. Search conversations, reply, and manage knowledge.

io.github.JdPG23/market-data-toolkit-mcp

apify.com

17 market-data tools for AI agents: eBay sold prices, company KYC, SEC filings, patents, auctions

Exactly 50 data transformation and live web verification tools for AI agents.

GroundRoute: Web Search for AI Agents across 6 Engines ($10 free credit)

smithery.ai

GroundRoute gives your AI agent web search across six engines (Serper, Brave, Exa, Tavily, Firecrawl, Perplexity) through a single search tool. That one tool covers web, news, and academic search, synthesized answers with citations, and full-page fetch, all selectable with a mode parameter, so you never wire up or pay for six separate APIs. It routes each query to the cheapest engine that meets a quality bar, caches repeats, and fails over automatically. Pricing is gain-sha

crawlforge-mcp

smithery.ai

CrawlForge MCP is a production-ready MCP server that gives AI agents the power to scrape websites, extract structured data, run deep research, bypass anti-bot detection, and process documents. It packages 27 specialized web scraping tools into a single MCP server with credit-based pricing and a free tier.

Crawlie

smithery.ai

**Technical SEO + AI-search audits for agents.** Crawl any website and get a structured report your agent can actually work with — broken links, redirect chains, missing titles/canonicals, duplicate content, structured data, and GEO (generative engine optimization) readiness: is your site answerable by ChatGPT, Claude, and Perplexity? ### What your agent can do - **Audit** a single URL, a list, or crawl an entire site - **Slice saved reports** without re-crawling — top fixes

Gkmex Crane Inventory

smithery.ai

Public, zero-auth, read-only Gkmex used-crane inventory. Search current mobile and crawler cranes or retrieve one listing by ID.

Hyperbrowser

smithery.ai

Scrape, extract structured data, and crawl webpages effortlessly. Enhance your applications with powerful web scraping capabilities and structured data extraction tools.

Crawlora

smithery.ai

Crawlora is a hosted MCP server exposing 319 structured web-data tools across search, maps, commerce, social, finance, travel, app stores, and reviews — each returning clean JSON instead of HTML to parse. Streamable HTTP transport with API-key auth (x-api-key / Bearer). No proxies, browsers, or parsers to maintain. Pay only on successful responses — 2,000 free credits per month, no card. Docs and playground: https://crawlora.net/docs

Scrayle Web Scraper

smithery.ai

Scrayle.com gives AI agents full web access through 35 tools spanning scraping, browser automation, AI-powered browsing, workflow orchestration, and more. • Scrape & Crawl - Extract content from single pages or crawl entire sites. Batch scrape multiple URLs at once. Get clean markdown, HTML, links, and metadata. • Cloud Browsers - Launch stealth cloud browsers with anti-detection. Navigate, click, type, screenshot, scroll, select dropdowns, and execute JavaScript - all remo

swarm-web-crawller

smithery.ai

A powerful web crawling MCP server built for autonomous AI agent swarms. It provides high-speed, parallel web data extraction, allowing distributed multi-agent systems to seamlessly harvest real-time web intelligence. Scale your swarm’s automated research capabilities with optimized, structured web data delivery built directly for LLM tool use.

Anakin

smithery.ai

Web data for AI agents: scrape, crawl, search, deep research, site monitoring, browser automation

Firecrawl Web Scraping Server

smithery.ai

Enable advanced web scraping, crawling, and content extraction capabilities for your agents. Perform deep research, batch scraping, and structured data extraction with automatic retries and rate limiting. Support both cloud and self-hosted deployments with seamless integration into popular MCP clients.

Firecrawl Web Scraping Server

smithery.ai

Enable advanced web scraping, crawling, and content extraction capabilities for your agents. Perform deep research, batch scraping, and structured data extraction with automatic retries and rate limiting. Integrate seamlessly with cloud or self-hosted Firecrawl APIs to enhance your data gathering workflows.

Firecrawl Web Scraping Server

smithery.ai

Enable advanced web scraping, crawling, and content extraction with support for JavaScript rendering, batch processing, and smart filtering. Perform deep research and structured data extraction using LLM-powered tools. Monitor credit usage and handle rate limits automatically for efficient and reliable web data integration.

Deep Research Server

smithery.ai

Perform comprehensive web research by combining AI-powered search and deep content crawling to gather extensive, up-to-date information on any topic. Aggregate and structure research data into detailed JSON outputs optimized for generating high-quality markdown documentation with LLMs. Customize documentation prompts and output paths to fit your workflow and save research results securely.

Tavily Web Search and Extraction Server

smithery.ai

Enable AI assistants to perform real-time web searches, extract data from web pages, map website structures, and crawl websites systematically. Enhance your AI's capabilities with powerful tools for intelligent data retrieval and analysis from the web. Seamlessly integrate advanced search and extraction features into your MCP client workflows.

veed-crawl

smithery.ai

Veedcrawl lets agents search and understand public social videos across YouTube, TikTok, Instagram, X/Twitter, and Facebook. Use this MCP server to: - Search social videos by topic, keyword, creator, or trend - Fetch video metadata, stats, descriptions, tags, and thumbnails - Get transcripts from public videos - Extract structured insights from videos using a custom prompt and JSON schema - Inspect public TikTok and Instagram creator profiles Good for trend re

Prowlo — Reddit & X for AI agents

prowlo.com

Reddit & X data for AI agents over MCP. Semantic search, hosted, no Reddit API.