crawl4ai - 技术专题

Completely free, private, UI based Tech Documentation MCP server. Designed for coders and software developers in mind. Easily integrate into Cursor, Windsurf, Cline, Roo Code, Claude Desktop App

Transform Web Content into LLM-Ready Data

OpenClaw-inspired autonomous AI agent built entirely in n8n. Adaptive RAG-powered memory, Skills via MCP templates, Expert Agents with delegated sub-agents, proactive task management, media understanding - self-hosted with one setup script

High-performance web crawler API optimized for LLMs. Turn any search or website into clean Markdown using remote browsers. Firecrawl alternative

🕷️ A lightweight Model Context Protocol (MCP) server that exposes Crawl4AI web scraping and crawling capabilities as tools for AI agents. Similar to Firecrawl's API but self-hosted and free. Perfect for integrating web scraping into your AI workflows with OpenAI Agents SDK, Cursor, Claude Code, and other MCP-compatible tools.

AI web scraper built with Crawl4AI for extracting structured leads data from websites.

Web crawling tool that integrates with AI assistants via the MCP

Scrape JavaScript-heavy sites and extract structured data via reusable CSS schemas. Portable agent skill wrapping the Crawl4AI CLI and Python SDK.

Langchain FastAPI server

Integrates Supabase with Crawl4AI and AI Chat to create a powerful web crawling and semantic search solution. Streamlit supabase data visualization. Run all in Docker. API and more!

A simple proxy server to integrate crawl4ai with OpenWebUI

Pinned, tested distribution of upstream Crawl4AI with MCP client setup and deployment guidance.

A Python tool for crawling and processing TradingView's PineScript V6 documentation. Built with Crawl4Ai framework, it extracts, cleans, and organizes documentation into searchable markdown files, making it easier to reference and analyze PineScript features and syntax.

Docker Compose to install N8N, Openweb UI, Qdrant, Ollama, EvolutionAPI, Flowise, OpenCode, Hermes-agent and many more.

A feature-rich web application for automated news scraping and summarization. It allows users to enter article URLs, fetches the full content, and generates concise summaries. The system supports both local inference with custom models and remote deployment via FastAPI or Streamlit interfaces.

Crawl4DeepSeek = Crawl4AI + DeepSeek 🚀 Smart, efficient, and built for deep web exploration! 🌐🤖

The Web Metadata Extraction Toolkit is designed to streamline the process of extracting, cleaning, and analyzing metadata from websites. Utilizing advanced AI models and custom extraction strategies, this toolkit helps users efficiently gather data like titles, descriptions, and keywords, which are crucial for SEO and content strategy.

Open-source MCP server for AI agents: web search, content extraction, and library docs -- 5-strategy scraping, runs without API keys.

🛒 An intelligent shopping agent powered by LLMs. Cross-platform search (JD, Taobao, Vipshop), AI-driven product analysis, and smart scoring reports. 全网比价，AI 决策购物助手。

Private web search MCP: SearXNG metasearch → ML reranking → 4-tier fetch cascade (Firecrawl / Crawl4AI / raw / Wayback) with per-domain learning, Ollama query expansion and synthesis. No cloud APIs.