One Useful Thing
·
3 weeks ago
● 4 sources
AI models from leading labs are improving at exponential rates in their ability to perform complex work autonomously, with systems like Opus 4.7 completing tasks in hours that would take humans weeks, while the usage pattern is shifting from interactive chatbots to autonomous agents managed by human operators. A recent OpenAI study found that a quarter of its workforce regularly manages at least four AI agents simultaneously, with agents adopted across technical and non-technical departments at similar rates, and success depends more on user domain expertise than professional background. As capability improvements compound exponentially, organizations face rapid disruption where AI plans written months ago are already obsolete, creating institutional turbulence as policy and markets struggle to track improvements that don't move at human speed.
Microsoft Research
·
3 weeks ago
SkillOpt treats agent skill files as trainable parameters that can be optimized through a controlled training loop rather than manual editing, using bounded text edits and validation gating to improve performance without modifying model weights. Across six benchmarks, seven models, and three execution modes (52 evaluation cells total), SkillOpt achieved best or tied-best results, with GPT-5.5 improving from 58.8 to 82.3 on average across benchmarks. The optimized skills remain compact (median 920 tokens with one to four accepted edits), transfer across model scales and execution environments, and enable smaller models to match larger baselines without additional inference costs.
TLDR
·
3 weeks ago
● 2 sources
A product designer argues that when AI systems are hard to evaluate, it reflects poor product design rather than an evaluation problem, and demonstrates how to restructure products to make verification easier by showing working, sources, and incremental changes rather than opaque final outputs. The examples span data agents showing 50% more detail through notebooks, PE lesson planners anchored to vetted templates with diffs, and medical report generators that surface contradictions and source citations before the final document. Redesigning products for verifiability reduces user friction, enables better automated testing, and creates feedback loops that improve quality over time.
