Labsco
firecrawl logo

firecrawl-map

โ˜… 508

by firecrawl ยท part of firecrawl/firecrawl-cli

Discover and list all URLs on a website, with optional search filtering. Use this skill when the user wants to find a specific page on a large site, list all URLs, see the site structure, find where something is on a domain, or says "map the site", "find the URL for", "what pages are on", or "list all pages". Essential when the user knows which site but not which exact page.

๐Ÿ”Œ This skill ships inside the firecrawl plugin โ€” installing the plugin keeps everything updated together.

This is the playbook your agent receives when the skill activates โ€” you don't need to read it to use the skill, but it's here to audit before installing.

firecrawl map

Discover URLs on a site. Use --search to find a specific page within a large site.

When to use

  • You need to find a specific subpage on a large site
  • You want a list of all URLs on a site before scraping or crawling
  • Step 3 in the workflow escalation pattern: search โ†’ scrape โ†’ map โ†’ crawl โ†’ interact

Options

OptionDescription
--limit <n>Max number of URLs to return
--search <query>Filter URLs by search query
--sitemap <include|skip|only>Sitemap handling strategy
--include-subdomainsInclude subdomain URLs
--jsonOutput as JSON
-o, --output <path>Output file path

Tips

  • Map + scrape is a common pattern: use map --search to find the right URL, then scrape it.
  • Example: map https://docs.example.com --search "auth" โ†’ found /docs/api/authentication โ†’ scrape that URL.

See also