LabscoMCP early access ↗
arkheiaaiMCP SERVER

Arkheia Hallucination Detection

Scores a model's answer for fabrication risk before you act on it — LOW, MEDIUM or HIGH, in one tool call.

by arkheiaai ↗LLM Evaluation & ObservabilityCommunity

LABSCO SUMMARY

A risk score an agent can branch on, not a second opinion to read.

The value is that it returns a level rather than a paragraph, which is what makes it usable inside a loop: LOW passes through, MEDIUM gets a caveat, HIGH blocks the merge from a sub-agent until someone looks. Try it on a plausible-sounding API that does not exist — that is the failure mode it is built for, and the one review by eye is worst at catching.

What it is

A screening service for model output. You hand it the model name, the prompt and the response, and it returns a fabrication risk score derived from behavioural fingerprinting rather than a fact-check lookup. It covers Claude, GPT, Gemini, Grok, Llama, Mistral and others.

What you get

  • arkheia_verify scores a response for fabrication risk
  • arkheia_audit_log reviews your detection history
  • run_grok, run_gemini and run_together call the model and screen the answer in the same step
  • run_ollama does the same against a local model
  • A three-level result — LOW, MEDIUM, HIGH — that an agent policy can branch on directly
  • A ready-made verification protocol for CLAUDE.md in the README, including how to handle sub-agent output

Requirements

Node.js 18+, Python 3.10+ and git. npx @arkheia/mcp-server sets up the Python environment and configuration; the client then runs python -m mcp_server.server from ~/.arkheia/mcp with ARKHEIA_API_KEY set. Keys are free and provisioned by one HTTP call against your email address, and shown once. The free tier covers 1,500 detections a month with 5 concurrent, no card. Screening means the prompt and the response leave your machine. Version 1.3.0.

Setup effort

Follow the published steps — npx @arkheia/mcp-server