NVIDIA
·
2 weeks ago
NVIDIA introduced Vera, a CPU designed specifically for agentic AI systems that prioritizes single-threaded performance to execute tool calls and data processing between model calls. Vera delivers 1.8x higher sustained per-core performance than x86 CPUs in agentic workloads, with Perplexity achieving 1.5x faster performance on real coding workflows. This optimized CPU architecture helps AI factories reduce GPU idle time and complete more agent tasks by ensuring each step in the agent loop runs faster.
Ben's Bites
·
2 weeks ago
● 3 sources
The author shares personal experiences using Fable, an Anthropic AI model, primarily as a thinking partner rather than a coding tool, noting it exhibits traits similar to Claude Opus. Fable will transition from free Claude subscriptions to a paid usage credit model starting tomorrow. The piece covers various AI developments including OpenAI's reported 50% inference cost reduction, new GPT-Realtime capabilities, and Anthropic's research on Claude's global workspace mechanism.
BAIR
·
2 weeks ago
● 3 sources
The cost of AI inference has dropped 50x to 900x per year, with GPT-4-class capabilities now under $1 per million tokens compared to $30 in early 2023, making sufficient intelligence for knowledge work effectively free. This shift requires rethinking data systems in three ways: designing systems that handle agents issuing thousands of speculative queries per request, building infrastructure to manage agent swarms with shared memory and coordination across thousands of concurrent agents, and enabling agents to synthesize and verify custom data systems. The changes enable new possibilities like multi-query optimization to reduce duplicate work, structured memory systems for agents to retrieve task-relevant information across multiple dimensions, and systems that proactively guide agents rather than passively execute queries.
The Neuron
·
2 weeks ago
● 2 sources
Tencent released Hy3, an open-source model designed for commercial use with reduced licensing restrictions. The model supports a 262,000-token context window and is available through OpenRouter with two weeks of complimentary API access. Users can now deploy a longer-context alternative to proprietary models without the same licensing constraints as closed-source options.
