TE
科技回声
首页24小时热榜最新最佳问答展示工作
GitHubTwitter
首页

科技回声

基于 Next.js 构建的科技新闻平台,提供全球科技新闻和讨论内容。

GitHubTwitter

首页

首页最新最佳问答展示工作

资源链接

HackerNews API原版 HackerNewsNext.js

© 2025 科技回声. 版权所有。

Show HN: Open-source load balancer for distributed MCP server architecture

2 点作者 mlenhard大约 1 个月前
Like many others, I’ve been hacking on MCP servers lately. The issue I ran into was that running multiple MCP servers behind a unified backend was hard. I needed a way to combine all the tool calls from different MCP servers so the client got a unified view, route requests to the correct server based on the tool call, and maintain session affinity for SSE requests. This led me to build CATIE, which solves the above issues.<p>CATIE is a lightweight proxy that routes MCP requests to the appropriate backend services based on their content.<p>Key Features<p>- Content-Based Routing: Routes requests based on tool call. This allows server operators to use a micro-service architecture, with the user only installing one server. This separation allows server operators to scale tool calls independently.<p>- Unified Tool Call Response: Combine the tool list response from multiple MCP servers. - Session Stickiness: Maintains client connections to the same backend<p>- Pattern Matching: Uses regex patterns to route tool requests<p>- Real-time Monitoring: Simple dashboard to see traffic patterns and performance with built-in Prometheus integration.<p>- Backend Switching: Change where requests go without client reconfiguration<p>How It Works<p>CATIE sits between your clients and your MCP servers. When a request comes in, it:<p>- Parses the JSON-RPC request to understand what it&#x27;s trying to do<p>- Applies your routing rules to determine the appropriate backend<p>- Forwards the request to the backend<p>- Maintains session stickiness for ongoing conversations<p>- Has a built-in UI for monitoring statistics and integrates with Prometheus<p>CATIE is fully open source under the MIT license. Contributions, feedback, and feature requests are all welcome!<p>- GitHub: <a href="https:&#x2F;&#x2F;github.com&#x2F;mclenhard&#x2F;catie-mcp">https:&#x2F;&#x2F;github.com&#x2F;mclenhard&#x2F;catie-mcp</a> - Docs: <a href="https:&#x2F;&#x2F;www.catiemcp.com&#x2F;docs&#x2F;" rel="nofollow">https:&#x2F;&#x2F;www.catiemcp.com&#x2F;docs&#x2F;</a>

暂无评论

暂无评论