Trending repositories: web-crawler
2 tracked repositories tagged with web-crawler, ordered by stars. Use the topic filters below to narrow further.
Filter by topic
2 of 2 repositories
firecrawl/firecrawl
The context API to search, scrape, and interact with the web at scale. 🔥
AI summary: An API service that crawls websites and turns them into clean, LLM-ready markdown data.
162,732dataTypeScriptAGPL-3.0KnockOutEZ/wigolo
The go-to web for your AI coding agent — local-first search, fetch, crawl & research over MCP. No API keys, no cloud, $0/query. Public beta.
AI summary: Local-first web intelligence and search endpoint for AI agents.
4,369developer-toolsTypeScriptOther