Hallo4D: Multi-Modal Hallucination Mitigation for Consistent Spatio-Temporal Generation
arXiv cs.AI 18 hours ago
Hallo4D is a framework that uses large multimodal language models to detect and correct spatial and temporal inconsistencies in 3D and 4D content generation, such as duplicated structures and temporal jitter. The method employs a generation-detection-correction paradigm with LMM-based multi-model voting for consistency optimization without requiring retraining of existing models. The framework shows improvements over baseline methods across diverse 3D and 4D generation settings through techniques like motion-aware keyframe sampling and visibility pruning.