TLDRocket
Sign in

Set up OpenAI ChatGPT Codex with LiteLLM on Amazon ECS and Amazon Bedrock

Amazon Web Services Nick McCarthy Covered by 2 sources

OpenAI Codex for enterprise coding agents is being deployed with a customer-operated LiteLLM gateway on Amazon ECS to centralize control over generative-code model access and usage. The validated walkthrough targets the us-east-1 region and uses an example gateway alias openai.gpt-5.5 mapped to bedrock_mantle/openai.gpt-5.5. Codex request traffic is routed from developers’ workstations through the ECS-hosted LiteLLM gateway to Amazon Bedrock, enabling enforced model routing, budgets, rate limits, and gateway telemetry while keeping tool execution local.

Why it matters

Deploy a customer-operated LiteLLM gateway on Amazon ECS with AWS Fargate, connect it to an OpenAI model on Amazon Bedrock, and configure Codex to route requests through the gateway's Responses API with scoped identities, budgets, rate limits, and telemetry. We also compare direct IAM Identity Center access and a managed Portkey deployment.

Related stories

The daily briefing

Every AI story that matters, in your inbox by 8am.

TLDRocket reads all relevant sources, removes duplicate coverage, and summarises the day in two minutes. Follow companies and topics for alerts, or get the briefing in Slack. Free, no spam, unsubscribe anytime.