Whole-Body Conditioned Egocentric Video Prediction
BAIR
Researchers developed PEVA, a model that predicts future egocentric video frames from whole-body human motion by conditioning on 48-dimensional action vectors representing joint movements. The model uses an autoregressive conditional diffusion transformer trained on the Nymeria dataset pairing real-world first-person video with body pose capture, and outperforms baselines on perceptual quality metrics across atomic actions and 16-second rollouts. The system enables visual planning by simulating action sequences and scoring them against goals, though current limitations include lack of long-horizon planning and explicit task intent conditioning.
Why it matters
.modal { display: none; position: fixed; z-index: 9999; padding-top: 50px; left: 0; top: 0; width: 100%; height: 100%; overflow: auto; background-color: rgba(0,0,0,0.9); } .modal-content { margin: auto; display: block; max-width: 90%; max-height: 90%; } .close { position: absolute; top: 15px; right: 35px; color: #f1f1f1; font-size: 40px; font-weight: bold; transition: 0.3s; cursor: pointer; } .close:hover, .close:focus { color: #bbb; text-decoration: none; cursor: pointer; } .clickable-img { cursor: zoom-in; transition: opacity 0.3s; } .clickable-img:hover { opacity: 0.9; } @media only screen and (max-width: 700px){ .modal-content { width: 100%; } } × document.addEventListener('DOMContentLoaded', function() { var modal = document.getElementById('imageModal'); var modalImg = document.getElementById('modalImg'); var span = document.getElementsByClassName('close')[0]; // Add click handler to all images in the post var images = document.querySelectorAll('.post-content img, article img'); i
Related stories
Dyna Robotics Introduces Dyna-2: A World-Action Model Pre-Trained on 1 Million Hours of Human Video
MarkTechPost · 3 weeks ago ·
9