API Gateways
An API gateway is an infrastructure component that sits between clients and backend services, handling cross-cutting concerns like authentication, rate limiting, routing, and protocol translation in one place rather than repeating them in every service.
itDistributed systems, messaging, and integration | OpenSkills.info
Course pathWalk it in order
Look it upDip in anytime
Go furtherLeaves this page
Don't Panic
Don't Panic — API Gateways
An API gateway is the front desk for an API. Clients call one address, and the gateway chooses the backend and boundary rules. Backends can move, split, or live on private addresses without every client receiving a new map and a tiny compass.
The gateway is on the request path. It accepts a connection, matches a route, applies policy, calls a backend, and returns a response. Routing is the core job. TLS handling, credential checks, traffic limits, transformations, caching, and telemetry are additions. Each changes request behavior, so each needs a test and a rollback plan.
The management plane defines routes, policies, credentials, and deployments. The data plane handles live requests. Existing traffic may need to continue while configuration changes are unavailable. A bad configuration needs to reach the data plane slowly enough that it can be stopped.
A gateway is not a promotion ceremony for every concern in a system. It can validate a token and apply a coarse scope. The backend still decides whether that caller may use a specific object or function. Aggregation can reduce client round trips while quietly adding dependencies, which is the architectural equivalent of putting groceries on one very confident bicycle.
HTTP keeps its rules after the gateway arrives. Preserve method intent, status codes, cache directives, validators, and content negotiation unless the contract changes. Trust forwarding information only after a controlled proxy adds it. Rate limits protect capacity, but do not create it.
Read the intro for the request path and limits. Use slides to compare routing, offloading, and aggregation. Keep the cheatsheet near when reviewing policy order, forwarding trust, failures, and rollouts. The exercise gives you a small gateway boundary to test.
Where this skill leads
Relevant careers
See how this topic contributes to broader role-level skill maps.
Sources
- https://www.rfc-editor.org/rfc/rfc9110.html
Supports
- HTTP gateway and reverse-proxy definitions, intermediary chains, connection direction, and message forwarding
- Method semantics, status codes, caching, validators, transformations, Via, and hop-by-hop field handling
- https://learn.microsoft.com/en-us/azure/architecture/microservices/design/gateway
Supports
- API gateways as centralized entry points that route requests and prevent direct backend exposure
- Gateway routing, offloading, aggregation, shared concerns, component overlap, and selection criteria
- Trade-offs among reverse proxies, service-mesh ingress gateways, load balancers, and API management products
- https://learn.microsoft.com/en-us/azure/api-management/api-management-gateways-overview
Supports
- Gateway runtime as a data plane that proxies requests, applies policies, verifies credentials, limits traffic, transforms messages, caches responses, and emits telemetry
- Managed, workspace, and self-hosted gateway placement with capability differences
- https://docs.aws.amazon.com/apigateway/latest/developerguide/welcome.html
Supports
- Managed creation, publication, monitoring, and security for HTTP, REST, and WebSocket APIs
- Traffic management, authorization, version management, logging, custom domains, and backend integrations
- https://docs.aws.amazon.com/apigateway/latest/developerguide/api-gateway-request-throttling.html
Supports
- Token-bucket rate and burst behavior across client, method, API, account, and regional scopes
- Best-effort throttle and quota targets plus Too Many Requests responses
- https://www.rfc-editor.org/rfc/rfc7239.html
Supports
- Forwarded field parameters for client-facing node, proxy interface, original host, and original protocol
- Proxy-chain preservation, information disclosure, privacy, and integrity limits
- https://owasp.org/API-Security/editions/2023/en/0x11-t10/
Supports
- Broken object-level, property-level, and function-level authorization risks
- Resource consumption, business flow, misconfiguration, inventory, and unsafe API consumption risks
- https://opentelemetry.io/docs/specs/semconv/http/http-spans/
Supports
- Separate HTTP client and server spans, request attempts, status, errors, and reverse-proxy examples
- Proxy-aware server address selection and low-cardinality route-based span names
- https://techcrunch.com/2006/11/06/mashery-api-management-service-is-open-for-business/
Supports
- Mashery launch
- https://mail.wso2.org/mailarchive/dev/2012-June/006464.html
Supports
- WSO2 launch
- https://www.globenewswire.com/en/news-release/2015/04/28/1187865/0/en/Mashape-Unleashes-Open-Source-Kong-to-Power-the-Next-Generation-of-Applications-Built-on-Microservices-and-APIs.html
Supports
- Kong launch
- https://press.aboutamazon.com/2015/7/amazon-web-services-announces-amazon-api-gateway
Supports
- AWS launch
- https://www.cncf.io/blog/2022/05/16/introducing-envoy-gateway/
Supports
- Envoy and Envoy Gateway history
- https://cloud.google.com/blog/products/api-management/apigee-is-now-part-of-google
Supports
- Apigee acquisition
- https://kubernetes.io/blog/2020/08/18/kubernetes-1-19-ingress-ga/
Supports
- Ingress GA
- https://blog.cloudflare.com/post-mortem-on-cloudflare-control-plane-and-analytics-outage/
Supports
- Control-plane incident
- https://engineering.atspotify.com/2026/2/how-we-release-the-spotify-app-part-2
Supports
- Aggregation lessons
