Contendeo
from 0xKaroshi
Give your agent eyes — multimodal video analysis MCP.
Contendeo
Give your agent eyes.
Contendeo is the multimodal layer that lets your AI actually see video — not just read its transcript.
What it is
Contendeo is a remote MCP server that gives LLMs frame-level context from video — transcription, keyframe vision analysis, OCR, and structured output, unified into a single response your agent can reason over.
Paste a YouTube, Instagram Reels, Vimeo, Twitter/X, TikTok, or direct video URL into Claude (or any MCP client). Contendeo downloads, transcribes, extracts keyframes, runs OCR, analyzes visuals, and returns a structured document.
Live at contendeo.app. MCP endpoint at contendeo.app/mcp/.
Why it exists
Transcripts capture what was said. They don't capture what was shown — chart values, UI states, overlays, code on screen, circled regions, dashboard numbers. For any video where the visual layer carries information (trading tutorials, product demos, technical walkthroughs, data dashboards, design reviews), transcript-only analysis misses half the signal.
Contendeo closes that gap.
See the side-by-side comparison at contendeo.app/demo.
Tools
Four tools exposed over MCP. Credit costs charged per successful call. Cache hits are free.
| Tool | Credits | What it does |
|---|---|---|
quick_transcribe | 1 | Timestamped transcript with speaker identification. Audio-only. Fast. |
deep_analyze | 5 | Full multimodal pipeline — transcript + keyframe vision + OCR, unified output. |
clip_context | 1 (quick) / 3 (deep) | Analyze a specific timestamp range without paying for the full video. |
batch_analyze | per-video, −10% at 5+ | Process up to 10 videos in parallel with cross-video synthesis. |
Full schemas and response formats: docs/tools.md.
Authentication
Contendeo uses OAuth 2.0. First use flow:
- Your MCP client initiates a connection
- Browser redirect to contendeo.app sign-in (Google OAuth or email)
- Approve the MCP client
- Bearer token issued, client reconnects, tools become available
New accounts get 10 free credits. No card required.
Details: docs/authentication.md.
Pricing
| Plan | Price | Credits | Notes |
|---|---|---|---|
| Free | $0 | 10 on signup | All 4 tools, no card |
| Pro | $12/mo (₹999) | 100/mo | Priority queue, rollover to 200 |
| Power | $39/mo (₹3,299) | 500/mo | Batch, webhooks, rollover to 1000 |
| PAYG | $0.15/credit | on demand | No subscription |
Cache hits are free. Failed analyses auto-refund.
Details: docs/pricing.md.
Stack
Under the hood:
- yt-dlp — video download across 1000+ sites
- Apify — Instagram Reels fetching
- Webshare — residential proxy pool for YouTube anti-bot
- ffmpeg — audio extraction + keyframe scene detection
- Groq Whisper (large-v3) — transcription
- Tesseract OCR — deterministic text extraction from frames
- Claude Vision (Sonnet 4.6) — visual frame analysis
- Supabase — auth + Postgres
- Redis — URL-hash result cache
- FastAPI + MCP Python SDK — server, streamable HTTP transport
- Traefik — SSL termination + routing
Links
- Landing — contendeo.app
- Demo — contendeo.app/demo
- MCP endpoint — contendeo.app/mcp/
- Dashboard — contendeo.app/dashboard
- Docs —
docs/ - Server card — contendeo.app/.well-known/mcp/server-card.json
Support
Questions, bug reports, feature requests: open an issue.
Commercial/partnership inquiries: @0xKaroshi on X.
Installation
Contendeo is a remote MCP server — no local install, no package download. Connect via URL from your MCP client.
Claude Desktop
Add to your claude_desktop_config.json:
{
"mcpServers": {
"contendeo": {
"url": "https://contendeo.app/mcp/"
}
}
}Claude will walk you through OAuth on first use.
Claude Code
claude mcp add --transport http contendeo https://contendeo.app/mcp/Other MCP clients (Cursor, Continue, Cline, etc.)
Any client that supports remote MCP servers over streamable HTTP. Point it at https://contendeo.app/mcp/.
Full walkthrough with screenshots: docs/installation.md.
No common issues documented yet. If you hit a problem, the repository's GitHub Issues page is the best place to look.
Licensed under MIT— you can use, modify, and redistribute it under that license's terms.
License
MIT — covers this wrapper repo (documentation, examples, manifest). The production server source is not open-sourced.
See LICENSE.
Contendeo — every frame, every word, every edge.