firecrawl-knowledge-ingest

Pulls every article out of a help center or documentation site, including the ones behind a login or buried under a load-more button.

WHEN TO USE

SCOPE

USE FOR

Pull every article out of a login-gated support knowledge base.
Extract a slow, script-heavy docs site's pages as plain text.
Turn a help center split over many pages into one single file.

This is a saved copy of the skill's SKILL.md instructions. It may differ from the upstream file or the version you install.

In this document (6)

Firecrawl Knowledge Ingest

Use this when a docs portal needs browser navigation, auth, pagination, or JS rendering.

Onboarding Interview

Infer the portal URL, output format, auth needs, and page limit from context. If the portal is clear, proceed immediately.

Ask at most 1-3 concise questions only if blocked, such as the portal URL, whether authentication is required, or the desired output format.

Firecrawl Collection Plan

Use Firecrawl browser to:

open the portal and inspect navigation
identify sections, categories, sidebar links, and article URLs
follow sidebar navigation, next links, pagination, load-more controls, or search
scrape article content as markdown
extract metadata such as title, section, last updated date, author, and tags

Try Firecrawl map as a supplement for public URLs, but use browser navigation for auth-gated or JS-heavy content.

Final Deliverable

# Knowledge Ingest: [Portal]

## Summary
[Pages extracted, sections covered, limitations]

## Output
[JSON/markdown/merged file path or content]

## Sections
[Section names and article counts]

## Failed Or Restricted Pages
[Any access/loading issues]

## Sources
[URLs extracted]

## Rerun Inputs
workflow: firecrawl-knowledge-ingest
url: [portal url]
format: [json/markdown/merged]
max_pages: [number]

JSON Shape

Use source, url, extractedAt, totalArticles, and sections[] with article title, url, section, content, and metadata.

Quality Bar

Preserve code examples, tables, and formatting.
Strip nav chrome, headers, and footers.
Track extraction progress and page failures.
Respect authentication boundaries.

Account or credentials required

1 FOR YOU

01
Add your Firecrawl API key
Get an API key from firecrawl.dev and set it as FIRECRAWL_API_KEY so the workflow can run the hosted Firecrawl browser session that navigates and scrapes the docs portal.
You set: FIRECRAWL_API_KEY

Listed as free: Connected services may require an account or charge fees.
Setup details: Expect some account or credential setup.

This skill ships inside the Firecrawl Workflows plugin.

Needs the Firecrawl CLI or MCP server. Set that up first — this skill doesn't include it.

Install just this skill

Run this outside your AI tool, using Node.js 22.20.0 or newer. Skills CLI 1.7.2 skips skill selection; prompts cancel installation without an interactive terminal. If choosing Project when asked about installation scope, open your project's folder before running this.

Install checklist

Check selected tools if a picker appears; Claude Code may be unchecked under Additional agents. ↑/↓ moves, Space toggles selections, Enter confirms.
Without a tool picker, check Installing to: for your intended tool. Stop if it names a different tool.
If asked, choose Symlink (Recommended) for shared files or Copy to all agents for separate copies; review the summary before confirming installation.
Install the find-skills skill? defaults to Yes, adding another skill for all projects. Choose No if you don't want that extra installation.

Skills CLI 1.7.2 sends install data to skills.sh by default, including the source, skill names, target tools and file details; GitHub sources are reported only when GitHub confirms the repository is public, while other remote sources can also be reported. Confirmed-public GitHub sources also trigger a security-audit request. Before installing, set the environment variable DO_NOT_TRACK=1 or DISABLE_TELEMETRY=1 to disable both.

npx skills add firecrawl/firecrawl-workflows --skill "firecrawl-knowledge-ingest" --full-depth

After installing for Claude Code, open it in the installation project if you chose Project; Global makes the skill available across projects on this computer. Once Claude Code loads the skill, its description helps Claude decide when to use it.

If installation created a top-level skills folder that did not exist when your Claude Code session started, run /reload-skills in that session. Run it again after later changes in that folder.

Install the whole plugin

This route installs the Firecrawl Workflows plugin package selected for your AI tool.

PLUGIN MARKETPLACE

Add the marketplace, then install the plugin

Typed inside the agent's own prompt, not in a terminal. The marketplace is called firecrawl-workflows, which is the part after the @.

/plugin marketplace add firecrawl/firecrawl-workflows

/plugin install firecrawl-workflows@firecrawl-workflows

Open plugin page ↗

What's inside

Files included with this skill.

View on GitHub