Standard Intelligence: Training General Intelligence in Pixel Space

Sequoia · 2 months ago

Standard Intelligence, founded by Galen Mead and Devansh Pandey, is training a general computer agent called FDM-1 by learning directly from raw video of computer use rather than text or language models. The team created an 11-million-hour computer action dataset and a video encoder 50 times more token-efficient than competitors, allowing nearly two hours of video to fit in a 1-million-token context window. The approach aims to build general agents that can perform diverse tasks like CAD modeling, driving, and software debugging by scaling video pre-training rather than expanding language model capabilities.