firecrawl-crawl

Instead of opening a site's pages one by one, this collects a whole section in a single run and hands back all the text together.

WHEN TO USE

SCOPE

USE FOR

Collect a whole documentation site for reading or reference.
Follow a site's links a few levels deep and pull in what you find.
See what a large crawl will cost in credits before starting it.
Check on a long crawl's progress with its job ID.

NOT FOR

Finding just one specific page on a site — map plus a single scrape is quicker.

This is a saved copy of the skill's SKILL.md instructions. It may differ from the upstream file or the version you install.

In this document (4)

firecrawl crawl

Bulk extract content from a website. Crawls pages following links up to a depth/limit.

Prerequisite: crawl requires authentication (no keyless free tier); without credentials the CLI prompts an interactive login.

Quick start

# Crawl a docs section
firecrawl crawl "<url>" --include-paths /docs --limit 50 --wait -o .firecrawl/crawl.json

# Full crawl with depth limit
firecrawl crawl "<url>" --max-depth 3 --wait --progress -o .firecrawl/crawl.json

# Check status of a running crawl
firecrawl crawl <job-id>

Run firecrawl crawl --help for the full option list.

Done when: the crawl reaches a terminal status and the saved output under .firecrawl/ contains the expected pages.

Tips

Use --wait when you need the results immediately. It has no default timeout; use --timeout <seconds> to bound polling. Without --wait, crawl returns a job ID for async polling.
Scope crawls with --include-paths whenever the request names a section — crawl only the pages you need.
Crawl consumes credits per page. Check firecrawl credit-usage before large crawls (credit-usage requires authentication).

Check selected tools if a picker appears; Claude Code may be unchecked under Additional agents. ↑/↓ moves, Space toggles selections, Enter confirms.
Without a tool picker, check Installing to: for your intended tool. Stop if it names a different tool.
If asked, choose Symlink (Recommended) for shared files or Copy to all agents for separate copies; review the summary before confirming installation.
Install the find-skills skill? defaults to Yes, adding another skill for all projects. Choose No if you don't want that extra installation.

Skills CLI 1.7.2 sends install data to skills.sh by default, including the source, skill names, target tools and file details; GitHub sources are reported only when GitHub confirms the repository is public, while other remote sources can also be reported. Confirmed-public GitHub sources also trigger a security-audit request. Before installing, set the environment variable DO_NOT_TRACK=1 or DISABLE_TELEMETRY=1 to disable both.

npx skills add firecrawl/cli --skill firecrawl-crawl firecrawl-agent firecrawl-alexandria firecrawl-developer-index firecrawl-download firecrawl-interact firecrawl-map firecrawl-research-index firecrawl-scrape firecrawl-search --full-depth

It installs 10 skills: this one and the 9 it relies on, listed below. Once these skills are installed where Claude Code loads them, their descriptions help Claude decide when to use them.

What's inside

Files included with this skill.

View on GitHub

firecrawl crawl

Quick start

Tips

See also

Account or credentials required

What's inside

firecrawl-crawl

firecrawl crawl

Quick start

Tips

See also

Account or credentials required

What's inside

More skills

MCP keyword matches