Trending repositories: scraper

4 of 4 repositories

• firecrawl/firecrawl

  The context API to search, scrape, and interact with the web at scale. 🔥

  AI summary: An API service that crawls websites and turns them into clean, LLM-ready markdown data.

  162,764dataTypeScriptAGPL-3.0aiai-agentsai-crawlerai-scraping

• NanmiCoder/MediaCrawler

  小红书笔记 | 评论爬虫、抖音视频 | 评论爬虫、快手视频 | 评论爬虫、B 站视频 ｜ 评论爬虫、微博帖子 ｜ 评论爬虫、百度贴吧帖子 ｜ 百度贴吧评论回复爬虫 | 知乎问答文章｜评论爬虫

  AI summary: A comprehensive crawler for extracting posts and comments from major Chinese social media platforms.

  60,171dataPythonOthercrawlerscrapersocial-mediadata-extraction

• wechat-article/wechat-article-exporter

  一款在线的 微信公众号文章批量下载 工具，支持导出阅读量与评论数据，无需搭建任何环境，可通过 在线网站 使用，支持 docker 私有化部署和 Cloudflare 部署。 支持下载各种文件格式，其中 HTML 格式可100%还原文章排版与样式。

  AI summary: A comprehensive tool to bulk download WeChat public articles and export their data.

  12,670dataTypeScriptMITdownloadwechatwechat-articlewechat-download

• jackwener/xiaohongshu-cli

  A CLI for Xiaohongshu (小红书) — search, read, interact via reverse-engineered API

  AI summary: Command-line interface tool for interacting with Xiaohongshu (Little Red Book).

  2,463developer-toolsPythonclidata-extractionxiaohongshuscraper