cockroach-crawler
Give AI agents superpowers on the web: crawl, render, map, extract, and verify evidence through one governed Node.js crawler.
| Category | Browser Automation |
|---|---|
| Author | GitHub Actions |
| Stars | 0 |
| Language | JavaScript |
| License | |
| Last update | 2026-08-09 |
| Source | https://www.npmjs.com/package/cockroach-crawler |
Tags: crawler, cockroach-crawler, agent, ai-web-crawler, ai-agent-crawler, llm-ready-data, web-to-markdown, site-mapping, structured-extraction, web-crawler, scraper, robots.txt, sitemap, markdown, jsonl, research, github-api, youtube-api, youtube-search, reddit-api, x-api, browser-session, browser-agent, adaptive-crawling, depth-first-crawl, pdf-extraction, xpath, mcp-server, docker-crawler, linkedin, ssrf-protection, cloudflare-workers, serverless, adaptive-selectors, self-healing-selectors, css-selectors, html-parser, data-export, cookies, proxy-rotation, session, spider, crawl-spider, autothrottle, ad-blocking, tracker-blocking, repl
Maintain this project? Get it featured.