crawl4ai
Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key.
| Category | Browser Automation |
|---|---|
| Author | unclecode |
| Stars | 85642 |
| Language | Python |
| License | Apache-2.0 |
| Last update | 2026-10-15 |
| Source | https://github.com/unclecode/crawl4ai |
Tags: ai, ai-agents, crawler, data-extraction, llm, markdown, mcp, open-source, playwright, python, rag, scraper, web-crawler, web-crawling, web-scraping
Maintain this project? Get it featured.
Comparisons
- firecrawl vs crawl4ai
- browser-use vs crawl4ai
- Agent-Reach vs crawl4ai
- taste-skill vs crawl4ai
- Scrapling vs crawl4ai
- crawl4ai vs hyperframes
Alternatives to crawl4ai
firecrawl firecrawl · ★191999 · TypeScript
Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥
browser-use browser-use · ★118149 · Python
Open-source Python library for AI browser agents, plus Browser Use Cloud: stealth browsers and a hosted agent API.
Agent-Reach Panniantong · ★97895 · Python
Give your AI agent eyes to see the entire internet. Read & search Twitter, Reddit, YouTube, GitHub, Bilibili, XiaoHongShu — one CLI, zero API fees.
taste-skill Leonxlnx · ★97631 · JavaScript
Agent skills that give coding agents taste: art direction, reference images and a browser check instead of generic AI pages
Scrapling D4Vinci · ★87996 · Python
🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev