Spreading the load: How Salesforce met Multi-AZ HA with SageMaker Inference Components
Amazon Web Services 1 week ago 50
Salesforce used SageMaker Inference Components’ IC Placement controls to deploy Agentforce models with multi-AZ high availability instead of relying on default placement that could create single-AZ or single-instance failures. The approach uses SchedulingConfig with CopyCount=2 for strict 2-AZ support, enforced via MaxImbalance=0 and PlacementStrategy=SPREAD. As a result, model deployments and subsequent scale/update operations preserve balanced copies across Availability Zones, meet a 2-AZ compliance bar, and keep multi-model co-hosting cost efficiency while improving fault isolation.