5 summarised stories about Cost Efficiency, each linking back to the original source. Browse all topics →
CSET Georgetown 2 weeks ago
A CSET researcher examined how cost-efficient Chinese AI models are gaining global traction and threatening the business models of proprietary AI developers. Chinese models are now considerably cheaper while achieving nearly equivalent capabilities to established proprietary systems. This shift could alter the long-term balance of technological and economic power in the AI industry between the U.S. and China.
NVIDIA 2 weeks ago
NVIDIA's inference software stack has reduced token costs for DeepSeek V4 by up to 5x on the Blackwell platform within one month through optimizations across production operations, application acceleration, and infrastructure access layers. Companies like Baseten, Cognition, and Deep Infra are using NVIDIA's TensorRT-LLM and Dynamo frameworks to achieve throughput gains ranging from 30% to 50% improvements in token generation speed. The full-stack approach compounds individual optimizations to increase Blackwell token throughput per GPU by up to 20x, enabling lower cost-per-token for production AI inference workloads.
