Last updated
March 16, 2026
MCP profile
Github OtherVibes Mcp As A Judge
MCP as a Judge: a behavioral MCP that strengthens AI coding assistants via explicit LLM evaluations
Developer ToolsPackagePythonOpen SourceExternal
Visibility
Public
ByRegistry
About This MCP Server
mcp-name: io.github.OtherVibes/mcp-as-a-judge
> MCP as a Judge acts as a validation layer between AI coding assistants and LLMs, helping ensure safer and higher-quality code.
It enforces evidence-based research, reuse over reinvention, and human-in-the-loop decisions.
> If your IDE has rules/agents (Copilot, Cursor, Claude Code), keep using them—this Judge adds enforceable approval gates on plan, code diffs, and tests.
Capabilities
Intelligent code evaluation via MCP sampling; enforces software‑engineering standards and flags security/performance/maintainability risksComprehensive plan/design review: validates architecture, research depth, requirements fit, and implementation approachUser‑driven decisions via MCP elicitation: clarifies requirements, resolves obstacles, and keeps choices transparentSecurity validation in system design and code changes
Tools & Endpoints
Example Workflow
• Tasklist = planning/organization: tracks tasks, priorities, and status. It doesn’t guarantee engineering quality or readiness.
• Judge workflow = quality gates: enforces approvals for plan/design, code diffs, tests, and final completion. It demands real evidence (e.g., unified Git diffs and raw test output) and returns structured approvals and required improvements.
• Together: Use the tasklist to organize work; use the Judge to decide when each stage is actually ready to proceed. The server also emits next_tool guidance to keep progress moving through the gates.
What Problems It Solves
- For troubleshooting
- visit the FAQs section.
Why Use Github OtherVibes Mcp As A Judge?
- Tasklist = planning/organization: tracks tasks, priorities, and status. It doesn’t guarantee engineering quality or readiness.
- Judge workflow = quality gates: enforces approvals for plan/design, code diffs, tests, and final completion. It demands real evidence (e.g., unified Git diffs and raw test output) and returns structured approvals and required improvements.
- Together: Use the tasklist to organize work; use the Judge to decide when each stage is actually ready to proceed. The server also emits next_tool guidance to keep progress moving through the gates.
Specifications
Status
live
Industry
Developer Tools
Category
General
Server type
Package
Language
Python
License
Open Source
Verified
Yes
Requirements
- MCP Sampling - Required for AI-powered code evaluation and judgment
- MCP Elicitation - Required for interactive user decision prompts
- Docker Desktop / Python 3.13+ - Required for running the MCP server
Hosting
Hosting Options
- Package
API
Integrate this server into your application. Choose a connection method below.
1
Configure
Configuration
json
{
"command": "uv",
"args": ["tool", "run", "mcp-as-a-judge"],
"env": {
"LLM_API_KEY": "your-openai-api-key-here",
"LLM_MODEL_NAME": "gpt-4.1"
}
}Performance
Usage
Quick Reference
- Name
- Github OtherVibes Mcp As A Judge
- Function
- MCP as a Judge: a behavioral MCP that strengthens AI coding assistants via explicit LLM evaluations
- Transport
- Package
- Language
- Python
- Source
- External (Registry)
- License
- Open Source
Get started
Ready to integrate this MCP server?
Book a demo to see how this server fits your workflow, or explore the full catalog.