TLDRocket
Sign in

Inference Optimization

132 summarised stories about Inference Optimization, each linking back to the original source. Browse all topics →

+ Follow this topic

Thursday, 10 September 2026

NVIDIA Details BioNeMo Inference Runtime (BioIR): 2.90x Higher Boltz-2 Folding Throughput and 58.5K Residues per GPU-Hour on 8xH100

MarkTechPost 1 month ago 15

NVIDIA released BioNeMo Inference Runtime (BioIR), a Python library that speeds up supported protein-structure prediction inference on NVIDIA GPUs while keeping the standard PyTorch workflow. In a matched benchmark on 8xH100 for 1,000 human dimers, BioIR delivered 58.5K successfully folded residues per GPU-hour versus 20.2K for an open-source torch-compiled Boltz-2 implementation. The throughput improves by 2.90x on this dataset and hardware, and NVIDIA estimates energy for 1 million comparable targets drops from 35 MWh to 11 MWh (8-GPU TDP equivalent).

Multimodal models need video. We froze time to give it to them

posthog.com 1 month ago 11

Replay Vision built a rasterizer to convert rrweb session replays into MP4 video so multimodal models could correctly “watch” them. It since March 2026 has rasterized more than 370 years of recordings into roughly 3.5 million videos. By gating Chrome’s frame rendering with HeadlessExperimental.beginFrame and freezing the rrweb player’s virtual time, the service eliminates skipped or frozen outputs so CPU contention only changes job duration, not the resulting video.

The daily briefing

Every AI story that matters, in your inbox by 8am.

TLDRocket reads all relevant sources, removes duplicate coverage, and summarises the day in two minutes. Follow companies and topics for alerts, or get the briefing in Slack. Free, no spam, unsubscribe anytime.