Configure rate limits for AI traffic on AgentCore gateway
AWS Anagh Agrawal ● Covered by 4 sources
Amazon Bedrock AgentCore gateway now supports rate limiting for AI traffic, allowing organizations to control how much traffic individual users and groups can consume across inference models, agents, and tools. The feature offers three rate-limiting metrics: requests per minute/second (RPS/RPM), tokens per minute (TPM) for inference targets only, and connections per second (CPS) for managing long-lived sessions. Organizations can define granular, multi-layered limits using JWT claims, IAM principals, and target names, enabling scenarios like per-user caps nested within per-group quotas to prevent resource monopolization.
Why it matters
Learn how to configure rate limits on Amazon Bedrock AgentCore gateway to enforce per-user and per-target traffic controls. Define request, token, and connection limits scoped by JWT claims or IAM identity to protect downstream models, tools, and agents from traffic spikes.