firecrawl-scrape

by firecrawl

Extract clean markdown from any URL, including JavaScript-rendered single-page applications. Handles both static pages and JS-rendered SPAs with configurable wait times for rendering Supports multiple concurrent URL scraping with output format options including markdown, HTML, links, and screenshots Includes content filtering options like main-content-only mode to strip navigation and footers, plus tag inclusion/exclusion Optional inline question answering via --query flag for targeted... npx skills add https://github.com/firecrawl/cli --skill firecrawl-scrape Download ZIPGitHub507

firecrawl scrape

Scrape one or more URLs. Returns clean, LLM-optimized markdown. Multiple URLs are scraped concurrently.

When to use

• You have a specific URL and want its content

• The page is static or JS-rendered (SPA)

• Step 2 in the workflow escalation pattern: search → scrape → map → crawl → interact

Options

Option Description -f, --format <formats> Output formats: markdown, html, rawHtml, links, screenshot, json -Q, --query <prompt> Ask a question about the page content (5 credits) -H Include HTTP headers in output --only-main-content Strip nav, footer, sidebar — main content only --wait-for <ms> Wait for JS rendering before scraping --include-tags <tags> Only include these HTML tags --exclude-tags <tags> Exclude these HTML tags --redact-pii Redact personally identifiable information from output -o, --output <path> Output file path

Tips

• Prefer plain scrape over --query. Scrape to a file, then use grep, head, or read the markdown directly — you can search and reason over the full content yourself. Use --query only when you want a single targeted answer without saving the page (costs 5 extra credits).

• Try scrape before interact. Scrape handles static pages and JS-rendered SPAs. Only escalate to interact when you need interaction (clicks, form fills, pagination).

• Multiple URLs are scraped concurrently — check firecrawl --status for your concurrency limit.

• Single format outputs raw content. Multiple formats (e.g., --format markdown,links) output JSON.

• Always quote URLs — shell interprets ? and & as special characters.

• Naming convention: .firecrawl/{site}-{path}.md

See also

• firecrawl-search — find pages when you don't have a URL

• firecrawl-interact — when scrape can't get the content, use interact to click, fill forms, etc.

• firecrawl-download — bulk download an entire site to local files