TLDRocket
Sign in

Grabette: an open system to record robot-manipulation data

Hugging Face

Pollen Robotics just open-sourced Grabette, a handheld gripper that turns hand movements into robot training data. No robot needed, just a hand, a camera, and ~490€ of parts.

Based on reporting by Hugging Face — read the original for the full story.

Summary, retelling and take written by AI under human oversight; images are AI-generated illustrations. How we work · Report an error

Robot learning has never really had a model problem. It's had a data problem. Transformer-based VLAs, diffusion policies, world models — the architectures are there and so are the GPUs. What's missing is enough real-world manipulation footage to actually train them on, and teleoperating an actual robot arm to gather that footage is slow, expensive, and requires, well, a robot.

Pollen Robotics thinks it has a workaround, and it's called Grabette. It's a handheld gripper you carry around like a strange power tool, fitted with a Raspberry Pi, a standard Pi camera, an OAK-D depth camera, and magnetic encoders. You press a button, perform a task with your own hand — picking something up, stacking it, whatever — and press it again to stop. That's the whole recording process. No lab, no rig, no robot in sight. The bill of materials runs about 490 euros, which is pocket change compared to most teleoperation setups.

The idea isn't new on its own; it borrows directly from Stanford's Universal Manipulation Interface, which proved a few years back that a handheld gripper with a fisheye camera and SLAM tracking could recover usable 6-DoF trajectories from human demonstrations. Closed variants exist too, from Agibot's MEgo to Genrobot's DAS gripper. What Pollen is doing differently is making the whole pipeline open and frictionless: record on the device, upload to the Hugging Face Hub, run SLAM and format conversion through a browser-based dashboard, and out comes a standard LeRobot dataset ready to train on. Nothing to install, nothing robot-specific baked into the data format — it's stored as camera-local pose plus gripper state, so in theory any arm with the right end-effector can use it.

That end-effector is Gripette, Grabette's robotic twin — a motorized gripper, about 120 euros in parts, that mounts on a real arm and executes what the policy learned. Pollen demonstrates the full loop with 200 recorded episodes, training a diffusion policy (ResNet18 encoder, DDIM scheduler) that runs on a single consumer GPU, then evaluating it on an OpenArm 7-DoF arm over gRPC. They're careful to frame this as a proof of concept, not the actual product — the product is the recording system itself.

The bigger swing here is the ask: build a Grabette, record whatever tasks you care about, upload the episodes, and help grow a shared dataset that no single lab could assemble alone. It's a reasonable bet that if recording a demonstration is as easy as shooting a short video, a lot more people will actually do it. A head-mounted version called Casquette is apparently already in the works for egocentric capture.

My take — AI-written commentary, not fact-checked reporting

This is the right instinct — robotics has spent years gatekept by hardware costs, and a 490-euro gripper plus an open dataset pipeline is a real crack in that wall. Whether the community actually shows up and floods the Hub with diverse, high-quality episodes is the open question; open datasets live or die on participation, not good intentions. Still, betting on crowdsourced data over another closed proprietary rig is the correct call, and I'd rather see ten mediocre open datasets than one polished closed one nobody can build on.

Read more about this at: Hugging Face

Related stories

The daily briefing

Every AI story that matters, in your inbox by 8am.

TLDRocket reads all relevant sources, removes duplicate coverage, and summarises the day in two minutes. Follow companies and topics for alerts, or get the briefing in Slack. Free, no spam, unsubscribe anytime.