Together AI

54 summarised stories about Together AI, each linking back to the original source. Browse all topics →

Key players

Together AI NVIDIA OpenAI Meta Anthropic Artificial Analysis

Wednesday, 29 July 2026

Together AI announces strategic partnership with Moonshot AI to natively serve Kimi models

Together AI 1 month ago 7 ● 33 sources

Together AI announced a partnership with Moonshot AI to host Kimi K3, a 2.8-trillion-parameter open-source model, on its inference platform starting today. Kimi K3 features a sparse mixture-of-experts architecture with 1 million token context window and new components like Kimi Delta Attention that deliver 2.5x better scaling efficiency than its predecessor. Developers now have immediate access to Moonshot's open models through Together's US-hosted infrastructure with production-ready options including serverless, provisioned throughput, and dedicated inference, plus the ability to fine-tune models for custom applications.

Read the full story

Open-Weight Models Kimi K3 Together AI Mixture-of-Experts

Configuring Dedicated Model Inference

Together AI 1 month ago 21 ● 2 sources

Together AI's Dedicated Model Inference platform uses endpoints (stable identities), deployments (model + hardware combinations), and configs (runtime recipes) to route traffic based on capacity rather than fixed percentages. Traffic splits assign weights to deployments, and the router distributes requests proportionally to effective capacity (weight × ready replicas), so autoscaling automatically adjusts traffic without manual intervention. This architecture enables A/B tests, rollouts, shadow experiments, and zero-downtime changes, with a live experiment showing that when deployment A scaled from 1 to 2 replicas, its traffic share increased from 50% to 69.4% as the router followed the capacity change.

Read the full story

Inference Optimization Together AI

Every AI story that matters,
in your inbox by 8am.

TLDRocket reads all relevant sources, removes duplicate coverage, and summarises the day in two minutes. Follow companies and topics for alerts, or get the briefing in Slack. Free, no spam, unsubscribe anytime.