User benchmark: Nate Herk prefers Opus on 7 of 8 jobs (but slower/more expensive)
YouTube ● Covered by 2 sources
Nate Herk reportedly preferred Opus on seven of eight usable jobs, but Opus took longer and cost more than Sol. Opus required about 8h40 and $213 compared with Sol’s 5h51 and roughly $74. The takeaway is that model selection should be based on end-to-end workflow outcomes rather than isolated benchmark numbers.
Why it matters
Nate Herk reportedly preferred Opus on seven of eight usable jobs, but Opus took about 8h40 and $213 versus Sol’s 5h51 and roughly $74. The newsletter uses this to argue model choice depends on real workflows, not just isolated metrics.