Home / Directory / Website Content Crawler

Website Content Crawler Measured

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with ๐Ÿฆœ๐Ÿ”— LangChain, LlamaIndex, and the wider LLM ecosystem.

apify/website-content-crawler ยท View on Apify Store โ†— ยท โ˜… 4.6 (235 reviews)

Measured usage (last 30 days)

3,332,487runs / 30 days
96.330%success rate
0.25%failure rate
13,455monthly active users
248runs per user
Metric (30d)^Value
Total runs (TOTAL)3,332,487
Succeeded3,210,193
Failed8,449
Aborted11,754
Timed out102,091
All-time runs46,562,034
All-time users170,282
Last run started2026-10-20

Pricing (Apify list price)

Model: FREE

List price from the public Store API on 2026-10-20 โ€” not a benchmark. Platform compute (actor start, memory) is billed separately by Apify.

Categories & tags

AIDEVELOPER_TOOLS

How to read this data

Runs, success and failure counts come from the Apify public Store API aggregate for the trailing 30 days ending 2026-10-20. Failure rate = FAILED / TOTAL; aborted and timed-out runs are excluded from the failure numerator. See full methodology. Snapshot: October 21, 2026.