Violin: An open-source video translation skill that breaks language barriers

Together AI · 2 months ago

Together AI released Violin, an open-source video translation tool that uses speech recognition, language models, and speech synthesis to translate video content across languages. The system processes videos through three stages—automatic speech recognition via Whisper V3, translation using DeepSeek V4 Pro, and speech generation with Cartesia's Sonic 3—and includes a chat assistant for querying video content. The tool is available as a web app, command-line interface, and agent skill under an MIT license, designed to address the gap where 66% of top YouTube videos are in English compared to 15% in Spanish.