Here are 356 public repositories matching this topic...

BerriAI / litellm

Sponsor

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]

gateway bedrock openai vertex-ai azure-openai llm langchain llmops anthropic openai-proxy litellm ai-gateway llm-gateway mcp-gateway

Updated Apr 22, 2026
Python

Kong / kong

🦍 The API and AI Gateway

Updated Mar 27, 2026
Lua

QuantumNous / new-api

A unified AI model hub for aggregation & distribution. It supports cross-converting various LLMs into OpenAI-compatible, Claude-compatible, or Gemini-compatible formats. A centralized gateway for personal and enterprise model management. 🍥

gemini openai claude newapi ai-gateway deepseek rerank

Updated Apr 18, 2026
Go

casdoor / casdoor

Sponsor

An open-source Agent-first Identity and Access Management (IAM) /LLM MCP & agent gateway and auth server with web UI supporting OpenClaw, MCP, OAuth, OIDC, SAML, CAS, LDAP, SCIM, WebAuthn, TOTP, MFA, Face ID, Google Workspace, Azure AD

Updated Apr 21, 2026
Go

Portkey-AI / gateway

A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.

mcp gateway openai hacktoberfest llm llms generative-ai langchain llmops ai-gateway llm-gateway mcp-servers mcp-client mcp-gateway model-router

Updated Mar 25, 2026
TypeScript

coaidev / coai

🚀 Next Generation Multi-tenant AI One-Stop Solution. Builtin Admin & Billing System. Enterprise-Grade Unified LLM Gateway Support for 200+ Models And 35+ Providers, Load Balacing w/ Priority-base Routing, Cost Management, Chat Share, Cloud Sync, Credit/Subscription Billing, All File Parsing, Web Search, Built-in Model Cache.

react api chat golang cross-platform proxy gemini openai chatgpt ai-gateway llm-gateway

Updated Mar 12, 2026
TypeScript

alibaba / higress

🤖 AI Gateway | AI Native API Gateway

api-gateway cloud-native envoy ai-native ai-gateway

Updated Apr 21, 2026
Go

katanemo / plano

Plano is an AI-native proxy and data plane for agentic apps — with built-in orchestration, safety, observability, and smart LLM routing so you stay focused on your agents core logic.

proxy routing gateway prompt proxy-server openai envoy envoyproxy llms generative-ai llmops llm-inference llm-proxy ai-gateway llm-gateway llm-routing ai-gateway-support

Updated Apr 22, 2026
Rust

maximhq / bifrost

Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.

gateway load-balancing token-management guardrails gateway-services llm generative-ai llmops ai-gateway llm-observability llm-cost llm-gateway mcp-server mcp-client mcp-gateway model-router

Updated Apr 22, 2026
Go

vllm-project / semantic-router

Sponsor

System Level Intelligent Router for Mixture-of-Models at Cloud, Data Center and Edge

kubernetes rust golang mcp fine-tuning pii-detection mixture-of-models huggingface-transformers bert-classification llm prompt-engineering vllm huggingface-candle ai-gateway semantic-router prompt-guard llmrouter openclaw

Updated Apr 22, 2026
Go

octelium / octelium

A next-gen FOSS self-hosted unified zero trust secure access platform that can operate as a remote access VPN, a ZTNA platform, API/AI/MCP gateway, a PaaS, an ngrok-alternative and a homelab infrastructure.

Updated Apr 21, 2026
Go

nextlevelbuilder / goclaw

GoClaw - GoClaw is OpenClaw rebuilt in Go — with multi-tenant isolation, 5-layer security, and native concurrency. Deploy AI agent teams at scale without compromising on safety.

golang telegram-bot mcp websocket chatbot postgresql discord-bot multi-agent openai harness ai-agent llm anthropic ai-gateway agent-orchestration harness-engineering

Updated Apr 21, 2026
Go

krakend / krakend-ce

KrakenD Community Edition: High-performance, stateless, declarative, API Gateway written in Go.

go graphql docker golang microservices microservice async api-gateway nats reverse-proxy backend-services apis cloud-native ai-gateway

Updated Apr 10, 2026
Go

agentgateway / agentgateway

Next Generation Agentic Proxy for AI Agents and MCP servers

kubernetes rust ai api-gateway mcp reverse-proxy service-mesh agents gateway-api ai-gateway mcp-gateway

Updated Apr 21, 2026
Rust

kaitranntt / ccs

Sponsor

Switch between Claude accounts, Gemini, Copilot, OpenRouter (300+ models) via CLIProxyAPI OAuth proxy. Visual dashboard, remote proxy support, WebSearch fallback. Zero-config to production-ready.

nodejs oauth typescript gemini websearch claude cli-tool multi-account react-dashboard developer-productivity github-copilot openrouter ai-gateway anthropic-api claude-code cliproxyapi profile-switching

Updated Apr 21, 2026
TypeScript

bestruirui / octopus

One Hub All LLMs For You | 为个人打造的 LLM API 聚合服务

ai self-hosted openai codex claude anthropic ai-gateway llm-gateway claude-code

Updated Apr 9, 2026
TypeScript

APIParkLab / APIPark

Cloud native, ultra-high performance AI&API gateway, LLM API management, distribution system, open platform, supporting all AI APIs.🦄云原生、超高性能 AI&API网关，LLM API 管理、分发系统、开放平台，支持所有AI API，不限于OpenAI、Azure、Anthropic Claude、Google Gemini、DeepSeek、字节豆包、ChatGLM、文心一言、讯飞星火、通义千问、360 智脑、腾讯混元等主流模型，统一 API 请求和返回，API申请与审批，调用统计、负载均衡、多模型灾备。一键部署，开箱即用。

api ai api-gateway gateway openai developer-portal api-platform api-portal claude apihub qwen ai-gateway deepseek llm-gateway

Updated Oct 26, 2025
TypeScript

envoyproxy / ai-gateway

Manages Unified Access to Generative AI Services built on Envoy Gateway

kubernetes ai api-gateway cncf inference llm ai-gateway

Updated Apr 20, 2026
Go

theopenco / llmgateway

Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.

enterprise typescript ai analytics opencode rate-limiting inference openai observability codex claude guardrails llm llms anthropic llm-proxy ai-gateway api-key-management llm-gateway

Updated Apr 21, 2026
TypeScript

ArcadeAI / arcade-mcp

The best way to create, deploy, and share MCP Servers

ai mcp arcade llm-tools ai-gateway llm-tool-call toolcalling arcade-ai model-context-protocol mcp-servers mcp-client mcp-tools mcp-gateway model-context-protocol-sdk mcp-runtime

Updated Apr 22, 2026
Python