Announcing the AI Gateway Working Group

Announcing the AI Gateway Working Group What is an AI Gateway? Working group charter and mission Active proposals Payload Processing Egress gateways Upcoming events KubeCon + CloudNativeCon Europe 2026, Amsterdam Get involved The community around Kubernetes includes a number of Special Interest Groups (SIGs) and Working Groups (WGs) facilitating discussions on important topics between interested contributors. Today, we're excited to announce the formation of the AI Gateway Working Group , a new initiative focused on developing standards and best practices for networking infrastructure that supports AI workloads in Kubernetes environments. In a Kubernetes context, an AI Gateway refers to network gateway infrastructure (including proxy servers, load-balancers, etc. ) that generally implements the Gateway API specification with enhanced capabilities for AI workloads. Rather than defining a distinct product category, AI Gateways describe infrastructure designed to enforce policy on AI traffic, including: Token-based rate limiting for AI APIs. Fine-grained access controls for inference APIs. Payload inspection enabling intelligent routing, caching, and guardrails. Support for AI-specific protocols and routing patterns. The AI Gateway Working Group operates under a clear charter with the mission to develop proposals for Kubernetes Special Interest Groups (SIGs) and their sub-projects. Its primary goals include: Standards Development : Create declarative APIs, standards, and guidance for AI workload networking in Kubernetes. Community Collaboration : Foster discussions and build consensus around best practices for AI infrastructure. Extensible Architecture : Ensure composability, pluggability, and ordered processing for AI-specific gateway extensions.