dub-video is a command line utility to translate and dub-over videos.
- yt-dlp
- coqui-tts
- ffmpeg
- OpenAI Whisper
Install Python 3.11 and pip. Locate (or record) a sample audio file.
Clone the repository and install the required depencencies:
python3.11 -m pip install -r requirements.txtDub a local video:
TORCH_FORCE_NO_WEIGHTS_ONLY_LOAD=y python3.11 dub-video.py --video /path/to/video.mp4 --out dubbed_video.mp4 --language en --speaker-wav sample.wavDownload and dub a video:
TORCH_FORCE_NO_WEIGHTS_ONLY_LOAD=y python3.11 dub-video.py --url https://tinyurl.com/yhr5na2b --out dubbed.mp4 --language en --speaker-wav sample.wav