TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Show HN: Open-source load balancer for distributed MCP server architecture

2 pointsby mlenhardabout 1 month ago
Like many others, I’ve been hacking on MCP servers lately. The issue I ran into was that running multiple MCP servers behind a unified backend was hard. I needed a way to combine all the tool calls from different MCP servers so the client got a unified view, route requests to the correct server based on the tool call, and maintain session affinity for SSE requests. This led me to build CATIE, which solves the above issues.<p>CATIE is a lightweight proxy that routes MCP requests to the appropriate backend services based on their content.<p>Key Features<p>- Content-Based Routing: Routes requests based on tool call. This allows server operators to use a micro-service architecture, with the user only installing one server. This separation allows server operators to scale tool calls independently.<p>- Unified Tool Call Response: Combine the tool list response from multiple MCP servers. - Session Stickiness: Maintains client connections to the same backend<p>- Pattern Matching: Uses regex patterns to route tool requests<p>- Real-time Monitoring: Simple dashboard to see traffic patterns and performance with built-in Prometheus integration.<p>- Backend Switching: Change where requests go without client reconfiguration<p>How It Works<p>CATIE sits between your clients and your MCP servers. When a request comes in, it:<p>- Parses the JSON-RPC request to understand what it&#x27;s trying to do<p>- Applies your routing rules to determine the appropriate backend<p>- Forwards the request to the backend<p>- Maintains session stickiness for ongoing conversations<p>- Has a built-in UI for monitoring statistics and integrates with Prometheus<p>CATIE is fully open source under the MIT license. Contributions, feedback, and feature requests are all welcome!<p>- GitHub: <a href="https:&#x2F;&#x2F;github.com&#x2F;mclenhard&#x2F;catie-mcp">https:&#x2F;&#x2F;github.com&#x2F;mclenhard&#x2F;catie-mcp</a> - Docs: <a href="https:&#x2F;&#x2F;www.catiemcp.com&#x2F;docs&#x2F;" rel="nofollow">https:&#x2F;&#x2F;www.catiemcp.com&#x2F;docs&#x2F;</a>

no comments

no comments