
firecrawl-map
โ 508by firecrawl ยท part of firecrawl/firecrawl-cli
Discover and list all URLs on a website, with optional search filtering. Use this skill when the user wants to find a specific page on a large site, list all URLs, see the site structure, find where something is on a domain, or says "map the site", "find the URL for", "what pages are on", or "list all pages". Essential when the user knows which site but not which exact page.
This is the playbook your agent receives when the skill activates โ you don't need to read it to use the skill, but it's here to audit before installing.
firecrawl map
Discover URLs on a site. Use --search to find a specific page within a large site.
When to use
- You need to find a specific subpage on a large site
- You want a list of all URLs on a site before scraping or crawling
- Step 3 in the workflow escalation pattern: search โ scrape โ map โ crawl โ interact
Options
| Option | Description |
|---|---|
--limit <n> | Max number of URLs to return |
--search <query> | Filter URLs by search query |
--sitemap <include|skip|only> | Sitemap handling strategy |
--include-subdomains | Include subdomain URLs |
--json | Output as JSON |
-o, --output <path> | Output file path |
Tips
- Map + scrape is a common pattern: use
map --searchto find the right URL, thenscrapeit. - Example:
map https://docs.example.com --search "auth"โ found/docs/api/authenticationโscrapethat URL.
See also
- firecrawl-scrape โ scrape the URLs you discover
- firecrawl-crawl โ bulk extract instead of map + scrape
- firecrawl-download โ download entire site (uses map internally)
npx skills add https://github.com/firecrawl/firecrawl-cli --skill firecrawl-mapRun this in your project โ your agent picks the skill up automatically.
Quick start
# Find a specific page on a large site
firecrawl map "<url>" --search "authentication" -o .firecrawl/filtered.txt
# Get all URLs
firecrawl map "<url>" --limit 500 --json -o .firecrawl/urls.jsonNo common issues documented yet. If you hit a problem, the repository's GitHub Issues page is the best place to look.