Labsco
regenrek logo

Deepwiki

★ 1,400

from regenrek

Fetches content from deepwiki.com and converts it into LLM-readable markdown.

🔥🔥✓ VerifiedFreeAdvanced setup
#social-media#scraping#devops#git

Deepwiki MCP Server

⚠️ IMPORTANT NOTICE: This server is currently not working since DeepWiki has cut off the possibility to scrape it. We recommend using the official DeepWiki MCP server at https://docs.devin.ai/work-with-devin/deepwiki-mcp for the time being.

This is an unofficial Deepwiki MCP Server

It takes a Deepwiki URL via MCP, crawls all relevant pages, converts them to Markdown, and returns either one document or a list by page.

Features

  • 🔒 Domain Safety: Only processes URLs from deepwiki.com

  • 🧹 HTML Sanitization: Strips headers, footers, navigation, scripts, and ads

  • 🔗 Link Rewriting: Adjusts links to work in Markdown

  • 📄 Multiple Output Formats: Get one document or structured pages

  • 🚀 Performance: Fast crawling with adjustable concurrency and depth

  • NLP: It's to search just for the library name

Cursor

Add this to .cursor/mcp.json file.

Copy & paste — that's it
{
 "mcpServers": {
 "mcp-deepwiki": {
 "command": "npx",
 "args": ["-y", "mcp-deepwiki@latest"]
 }
 }
}

MCP Tool Integration

The package registers a tool named deepwiki_fetch that you can use with any MCP-compatible client:

Copy & paste — that's it
{
 "action": "deepwiki_fetch",
 "params": {
 "url": "https://deepwiki.com/user/repo",
 "mode": "aggregate",
 "maxDepth": "1"
 }
}

Parameters

  • url (required): The starting URL of the Deepwiki repository

  • mode (optional): Output mode, either "aggregate" for a single Markdown document (default) or "pages" for structured page data

  • maxDepth (optional): Maximum depth of pages to crawl (default: 10)

Response Format

Success Response (Aggregate Mode)

Copy & paste — that's it
{
 "status": "ok",
 "data": "# Page Title\n\nPage content...\n\n---\n\n# Another Page\n\nMore content...",
 "totalPages": 5,
 "totalBytes": 25000,
 "elapsedMs": 1200
}

Success Response (Pages Mode)

Copy & paste — that's it
{
 "status": "ok",
 "data": [
 {
 "path": "index",
 "markdown": "# Home Page\n\nWelcome to the repository."
 },
 {
 "path": "section/page1",
 "markdown": "# First Page\n\nThis is the first page content."
 }
 ],
 "totalPages": 2,
 "totalBytes": 12000,
 "elapsedMs": 800
}

Error Response

Copy & paste — that's it
{
 "status": "error",
 "code": "DOMAIN_NOT_ALLOWED",
 "message": "Only deepwiki.com domains are allowed"
}

Partial Success Response

Copy & paste — that's it
{
 "status": "partial",
 "data": "# Page Title\n\nPage content...",
 "errors": [
 {
 "url": "https://deepwiki.com/user/repo/page2",
 "reason": "HTTP error: 404"
 }
 ],
 "totalPages": 1,
 "totalBytes": 5000,
 "elapsedMs": 950
}

Progress Events

When using the tool, you'll receive progress events during crawling:

Copy & paste — that's it
Fetched https://deepwiki.com/user/repo: 12500 bytes in 450ms (status: 200)
Fetched https://deepwiki.com/user/repo/page1: 8750 bytes in 320ms (status: 200)
Fetched https://deepwiki.com/user/repo/page2: 6200 bytes in 280ms (status: 200)

Development

Copy & paste — that's it
# Install dependencies
pnpm install

# Run in development mode with stdio
pnpm run dev-stdio

# Run tests
pnpm test

# Run linter
pnpm run lint

# Build the package
pnpm run build

Contributing

We welcome contributions! Please see CONTRIBUTING.md for details.

License

MIT

Links

Courses

See my other projects:

  • AI Prompts - Curated AI Prompts for Cursor AI, Cline, Windsurf and Github Copilot

  • codefetch - Turn code into Markdown for LLMs with one simple terminal command

  • aidex A CLI tool that provides detailed information about AI language models, helping developers choose the right model for their needs.# tool-starter