---
name: "crawl4ai-deep-llm-extractor"
description: "Execute blazing-fast, open-source asynchronous web crawling optimized for LLMs with Crawl4AI."
metadata:
  author: "unclecode"
  version: "1.0.0"
  runtime_compatibility:
    - "codex"
    - "claude-code"
    - "cursor"
    - "windsurf"
triggers:
  - "crawl web page crawl4ai"
  - "extract content async crawl4ai"
  - "clean html for llm crawl4ai"
permissions:
  fs_read: true
  fs_write: "workspace"
  shell_exec: false
  net_access: false
---

# Crawl4AI Asynchronous Deep Extraction Engine

Crawls and extracts web content with Crawl4AI: asynchronous Playwright execution, heuristic noise filtering, cosine similarity content clustering, and structured JSON extraction via local models.

## When to Invoke
Invoke this skill whenever you need to:
- crawl web page crawl4ai
- extract content async crawl4ai
- clean html for llm crawl4ai

## Execution SOP & Rules
1. Run crawls asynchronously using async with AsyncWebCrawler() as crawler: result = await crawler.arun(url).
2. Use extraction strategies like LLMExtractionStrategy or CosineStrategy for structured records.
3. Configure word_count_threshold to discard low-content navigation links and footer fragments.
4. Inspect result.markdown and result.extracted_content for downstream vector ingestion.

## Verification Checklist
- Run local linting, syntax validation, and type-checks before reporting completion.
- Ensure all created or modified files adhere to workspace boundaries and avoid uncommitted secrets.
- Verify tests or build commands exit cleanly with return code 0.