Trending repositories: scraping
4 tracked repositories tagged with scraping, ordered by stars. Use the topic filters below to narrow further.
4 of 4 repositories
firecrawl/firecrawl
The context API to search, scrape, and interact with the web at scale. 🔥
AI summary: An API service that crawls websites and turns them into clean, LLM-ready markdown data.
162,764dataTypeScriptAGPL-3.0D4Vinci/Scrapling
🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!
AI summary: A fast, undetectable web scraping framework for Python.
72,978dataPythonBSD-3-Clausesansan0/TrendRadar
⭐AI-driven public opinion & trend monitor with multi-platform aggregation, RSS, and smart alerts.🎯 告别信息过载，你的 AI 舆情监控助手与热点筛选工具！聚合多平台热点 + RSS 订阅，支持关键词精准筛选。AI 智能筛选新闻 + AI 翻译 + AI 分析简报直推手机，也支持接入 MCP 架构，赋能 AI 自然语言对话分析、情感洞察与趋势预测等。支持 Docker ，数据本地/云端自持。集成微信/飞书/钉钉/Telegram/邮件/ntfy/bark/slack 等渠道智能推送。
AI summary: An automated intelligence gathering tool that monitors and summarizes emerging tech trends across platforms.
61,197dataPythonGPL-3.0soxoj/maigret
🕵️♂️ Collect a dossier on a person by username from 3000+ sites
AI summary: An OSINT tool that collects a dossier on a person by username across 3000+ sites.
36,199securityPythonMIT