Labsco
pedramamini logo

RSSidian

★ 32

from pedramamini

Connects RSS feeds to Obsidian for automated content analysis and AI-powered summarization.

🔥🔥🔥✓ VerifiedFreeAdvanced setup
#automation#database#git#maps#security#news#memory

RSSidian

RSSidian is a powerful tool that bridges your RSS feed subscriptions with Obsidian, creating an automated pipeline for article content analysis and knowledge management.

Features

  • OPML Integration:
    • Automatically imports RSS subscriptions from OPML files
    • Direct feed addition via command line (no OPML required)
    • Smart feed management with mute/unmute capabilities
    • Easy subscription organization and article listing
  • RSS Feed Processing:
    • Retrieves and parses RSS feeds to discover new articles
    • Defaults to processing only recent articles (last 7 days)
    • Configurable lookback period for older content
  • Smart Storage:
    • SQLite3 database for article metadata and full content
    • Annoy vector index for fast semantic search
    • Vector embeddings for efficient content discovery
    • Feed statistics tracking (article count, quality ratings)
    • Configurable Obsidian markdown export
  • AI-Powered Analysis:
    • Uses OpenRouter to generate customized summaries and insights
    • Smart content quality assessment (S/A/B/C/D tier system)
    • Value analysis with numerical scoring (1-100)
    • Configurable quality thresholds for content filtering
    • Cost tracking for all AI API calls
  • Digest Generation:
    • Creates comprehensive digest notes in Obsidian
    • Collapses similar/overlapping stories for concise presentation
    • Organizes content by quality tier and relevance
    • Includes feed statistics and processing metrics
  • Natural Language Search:
    • Fast semantic search powered by Annoy library
    • Intelligent search that understands the meaning of your queries
    • Finds relevant content even when exact words don't match
    • Configurable relevance threshold for fine-tuning results
    • Results grouped by feed with relevant excerpts
  • Obsidian Integration:
    • Generates markdown notes with customizable templates
  • MCP Service API: -Exposes a Model Context Protocol service for AI agents

OSX XCode Issues

If you have build issues, try:

Copy & paste — that's it
sudo xcode-select --reset
sudo xcode-select --switch /Applications/Xcode.app/Contents/Developer

sudo xcodebuild -license

export SDKROOT=$(xcrun --sdk macosx --show-sdk-path)
export CFLAGS="-isysroot $SDKROOT -I$SDKROOT/usr/include"
export CXXFLAGS="$CFLAGS"
export LDFLAGS="-L$SDKROOT/usr/lib"
export PATH="$SDKROOT/usr/bin:$PATH"

rm -rf ~/.cache/uv/builds-v0
uv pip install -e .

Top Stories

{summary_items}

Feed Statistics

{feed_stats} """

[search]

Search configuration options

Length of context to include in search excerpts (in characters)

excerpt_length = 300

[openrouter]

OpenRouter API configuration

API key can also be set via RSSIDIAN_OPENROUTER_API_KEY environment variable

api_key = ""

Model to use for topic detection and article processing

processing_model = "openai/gpt-4o"

Sample size in characters for topic detection

topic_sample_size = 4096

Model to use for summarization

See https://openrouter.ai/docs for available models

model = "openai/gpt-4o"

Prompt template for processing articles

Available variables: {content}

prompt = """Your custom prompt template here. Available variable: {content}"""

Enable value analysis in output

When enabled, each article will include a Value assessment

value_prompt_enabled = true

Minimum quality tier to include in digest (S, A, B, C, D)

Articles with lower quality tiers will be discarded

minimum_quality_tier = "B"

[annoy]

Path to vector index file

index_path = "~/.config/rssidian/annoy.idx"

Number of trees (more = better accuracy but slower build)

n_trees = 10

Distance metric (angular = cosine similarity)

metric = "angular"

Copy & paste — that's it

## Database Backup

RSSidian includes a robust backup system to help you safeguard your article database:

- Automatic Timestamping: Backups are automatically named with YYYY-MM-DD format
- Multiple Daily Backups: System automatically handles multiple backups on the same day by adding an index
- Safe Restore Process: Creates temporary backup before restore in case of failures

Commands:

```bash
# Create a new backup
rssidian backup create

# List all backups with sizes and dates
rssidian backup list

# Restore from a specific date
rssidian backup restore 2025-02-24

When restoring a backup, RSSidian will:

  • Show size difference between current and backup database
  • Display time difference between current and backup
  • Require explicit confirmation before proceeding
  • Create a temporary backup of your current database as a safety measure

System Status

Use the show-config command to view the current state of your RSSidian installation:

Copy & paste — that's it
rssidian show-config

This will display:

  • Vector index location and size
  • Number of total articles
  • Number of articles with embeddings
  • Other configuration settings

How It Works

Feed Management:

  • Imports feed URLs from OPML file
  • Exports feeds to OPML file (with option to include/exclude muted feeds)
  • Stores subscription data in SQLite database
  • Enables muting/unmuting of specific feeds

Content Processing:

  • Fetches articles from RSS feeds
  • Generates vector embeddings
  • Updates Annoy vector index
  • Stores in SQLite database

AI Processing:

  • Generates summaries via OpenRouter
  • Analyzes content value (S/A/B/C/D tiers)
  • Assigns quality scores (1-100)
  • Filters out low-value content (configurable threshold)

Knowledge Integration:

  • Creates digest notes in Obsidian
  • Organizes content by quality and relevance
  • Includes feed statistics and processing metrics
  • Customizable filename templates with date variables ({from_date}, {to_date}, {date_range}, {date}, {datetime})
  • Enables semantic search across all content

MCP (Model Context Protocol) Service API

RSSidian provides a Model Context Protocol (MCP) service that enables AI agents like Claude to interact with your RSS content. The MCP service exposes a RESTful API that allows for comprehensive access to your RSS-ingested content.

Starting the MCP Service

Copy & paste — that's it
# Start the MCP service on the default port (8080)
rssidian mcp

# Start the MCP service on a custom port
rssidian mcp --port 9000

API Endpoints

Copy & paste — that's it
# Base URL
http://localhost:8080/api/v1

# Standard API Endpoints
GET  /search                       # Natural language search across articles
GET  /articles                     # List all processed articles
GET  /articles/:id                 # Get article details and content
GET  /subscriptions                # List all subscriptions with mute state
POST /subscriptions/:title/mute    # Mute a feed subscription
POST /subscriptions/:title/unmute  # Unmute a feed subscription

# MCP-specific Endpoints
GET  /mcp                          # Discovery endpoint with capabilities and endpoints
GET  /mcp/subscriptions            # List all feed subscriptions
GET  /mcp/articles                 # List articles with advanced filtering
GET  /mcp/articles/:id/content     # Get full article content
GET  /mcp/search                   # Semantic search with relevance control
GET  /mcp/digest                   # Get digest of high-value articles
GET  /mcp/feed-stats               # Get feed statistics
POST /mcp/query                    # Process natural language queries

Configuring Claude Desktop to Use RSSidian MCP

RSSidian MCP can be used with Claude Desktop in two ways: HTTP mode or STDIO mode.

Option 1: STDIO Mode (Recommended)

STDIO mode allows Claude Desktop to directly spawn and communicate with the RSSidian MCP server, without requiring a separate HTTP server to be running.

  1. Edit Claude Desktop's configuration file by clicking on the Claude icon in the menu bar, selecting "Settings", and then clicking "Edit Configuration File"

  2. Add a new entry to the mcpServers section of the JSON configuration:

    Copy & paste — that's it
    {
  "globalShortcut": "Shift+Space",
  "mcpServers": {
    "rssidian": {
      "command": "/path/to/your/python",
      "args": [
        "-m",
        "rssidian",
        "mcp",
        "--stdio"
      ]
    }
    // other MCP servers...
  }
}

    Replace /path/to/your/python with the actual path to your Python executable where RSSidian is installed. You can find this by running which python in the terminal where you normally run RSSidian.

  3. Save the configuration file

Option 2: HTTP Mode

In HTTP mode, you need to start the RSSidian MCP service separately and configure Claude Desktop to connect to it.

  1. Start the RSSidian MCP service manually:

    Copy & paste — that's it
    rssidian mcp --port 8080

  2. Edit Claude Desktop's configuration file by clicking on the Claude icon in the menu bar, selecting "Settings", and then clicking "Edit Configuration File"

  3. Add a new entry to the mcpServers section of the JSON configuration:

    Copy & paste — that's it
    {
  "globalShortcut": "Shift+Space",
  "mcpServers": {
    "rssidian-http": {
      "command": "/path/to/your/python",
      "args": [
        "-m",
        "rssidian",
        "mcp",
        "--port",
        "8080"
      ]
    }
    // other MCP servers...
  }
}

  4. Save the configuration file

  5. When chatting with Claude, you can now ask questions about your RSS content such as:

    • "What are the latest articles about AI?"
    • "Find articles about blockchain from the last week"
    • "Summarize the top quality articles from my tech feeds"
    • "What are the trending topics across my subscriptions?"

Claude will automatically use the RSSidian MCP service to access your RSS content and provide informed responses based on your feeds.

Development

Copy & paste — that's it
# Setup development environment
./scripts/setup_dev.sh

# Activate environment
source .venv/bin/activate

License

This project is open source and available under the MIT License.