hermes-cloudflare
Cloudflare Browser Rendering plugin for hermes-agent — crawl, scrape, extract content from web pages
hermes-cloudflare
Cloudflare Browser Rendering plugin for hermes-agent — crawl, scrape, and extract content from web pages using Cloudflare's headless browser API.
Tools
| Tool | Description |
|---|---|
cf_crawl |
Async website crawling with depth/limit controls, format selection (HTML/Markdown/JSON), include/exclude patterns, sitemap discovery |
cf_scrape |
CSS-selector-based element extraction (text, HTML, attributes, dimensions) |
cf_markdown |
Convert pages to clean Markdown (handles JS-heavy sites) |
cf_json_extract |
AI-powered structured data extraction (Workers AI / Llama 3.3 70B) with prompt + JSON schema |
cf_links |
Link discovery with visible-only and external domain filtering |
cf_content |
Fully rendered HTML after JavaScript execution |
cf_screenshot |
Page screenshots (full-page, element, viewport control, PNG/JPEG/WebP) |
cf_pdf |
Page-to-PDF with headers/footers, margins, scale |
Installation
Quick install (hermes-agent v0.3.0+)
curl -sSL https://raw.githubusercontent.com/raulvidis/hermes-cloudflare/main/install.sh | bash
Manual install
git clone https://github.com/raulvidis/hermes-cloudflare.git
mkdir -p ~/.hermes/plugins
cp -r hermes-cloudflare/hermes-cloudflare-plugin ~/.hermes/plugins/hermes-cloudflare
pip install httpx
Configuration
Set these environment variables (in your shell profile or .env):
export CLOUDFLARE_API_TOKEN="your-api-token"
export CLOUDFLARE_ACCOUNT_ID="your-account-id"
Getting your credentials
- Go to Cloudflare Dashboard
- Create a token with Browser Rendering - Edit permission
- Copy your Account ID from the dashboard sidebar
Usage examples
Once installed, hermes-agent can use the tools directly:
Crawl a website:
Crawl https://docs.example.com and return the content as Markdown
Scrape specific elements:
Scrape all h1 tags and .price elements from https://shop.example.com
Extract structured data with AI:
Extract all product names, prices, and ratings from https://store.example.com as JSON
Get page as Markdown:
Convert https://blog.example.com/post to Markdown
Take a screenshot:
Take a full-page screenshot of https://example.com
Requirements
- hermes-agent v0.3.0+
- Python 3.10+
httpx(installed automatically by install.sh)- Cloudflare account with Browser Rendering enabled (available on Free and Paid plans)
License
MIT