AI gateway comparison

What is an AI gateway?

One layer between the people, apps and agents that use AI, and the models and tools they call.

Modelsgpt-5gpt-4ogpt-5-miniClaude 3 OpusClaude 3 SonnetClaude 3 HaikuGemini 2.5 ProGemma 3Gemini 2.0 FlashUser InterfacesClaude DesktopPlayground UIUser/AgentAI GatewayAccess controlBudgetsGuardrailsRoutingAudit logModel ProvidersOpenAIAnthropicGCPAWSAzureGroqMCP ServersDocumentProcessing MCPDatabase MCPSlackGitHubJiraGmailToolsslack_list_channelsslack_get_usersslack_post_messageslack_reply_to_threadcreate_repositorycreate_pull_requestlist_commitsget_pull_request_commentsjira_list_projectsjira_get_usersjira_create_issuejira_post_comment
Scroll sideways to see the whole diagram.
Who calls
Chat apps, internal tools and agents send every request to the gateway, not to a provider.
The gateway
It checks who may call what, enforces budgets and guardrails, routes each request and logs it.
What it calls
Models from any provider, and the tools agents reach through MCP servers.

Thirty AI gateways, scored on the same eight criteria. We sell none of them.

Compare all 30 gateways