Video-to-Audio-and-Speech

Paper: https://arxiv.org/abs/2503.22265
Code: https://github.com/acappemin/DeepAudio-V1
Project page: https://acappemin.github.io/DeepAudio-V1.github.io
Models: https://huggingface.co/lshzhm/DeepAudio-V1/tree/main
Examples
Input Video Video-to-Audio Text Prompt Video-to-Audio Num Steps Video-to-Speech Transcription Video-to-Speech Speech Prompt Video-to-Speech Speech Prompt Transcription Video-to-Speech Num Steps