Git Product home page Git Product logo

v2vt's Introduction

English ｜ 中文

带有口型同步功能的视频翻译

  • 转录视频语音并翻译
  • 语音克隆
  • 口型同步
  • 压制字幕
  • 支持中英视频互相转换

效果演示

详见res.mp4

技术栈

环境搭建

  1. 安装ffmpeg并添加到环境变量，或者是直接把相应可执行程序放到当前目录ffmpeg文件夹
ffmpeg
   |- ffmpeg.exe
   |- ffprobe.exe
...
  1. 安装依赖
git clone [email protected]:halfzm/v2vt.git

conda create -n v2vt_clone python=3.11.0
conda activate v2vt_clone

cd v2vt_clone
pip install -r requirements.txt
pip install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu118
  1. 把openvoice中需要的模型放到openvoice_checkpoints文件夹中，目录结构应该如下[optional]
openvoice_checkpoints
   |- base_speakers
    |- ...
   |- converter
    |- ...
...
  1. 把tts中需要的模型放到tts_models文件夹中，目录结构应该如下
tts_models
   |- tts_models--multilingual--multi-dataset--xtts_v2
    |- config.json
    |- model.pth
    |- speakers_xtts.pth
    |- vocal.json
   |- ...
...
  1. 把video_retalking中需要的模型放到video-retalking/checkpoints文件夹中，目录结构应该如下
video-retalking
   |- checkpoints
    |- ...
...

使用说明

  • 快速启动
python app.py

  • 关于输入
    输入视频不能太短，否则语音克隆的时候报错（最好不要低于5S）

  • 关于输出
    默认是输出到当前目录下的output.mp4，也可以在webui中直接下载

其它

licence和code_of_conduct和video-retalking项目一致
详见LICENSE和CODE_OF_CONDUCT

v2vt's People

Contributors

halfzm avatar d3lik avatar

Stargazers

avatar Jewer avatar kings avatar avatar avatar avatar avatar wys929 avatar avatar Stephane Mallette avatar avatar avatar avatar Xinyang (Darren) Li avatar avatar Jin avatar avatar Ben Xu avatar cosanostra avatar avatar avatar avatar avatar xiaoxin avatar Tessa Painter avatar zee avatar avatar avatar JK avatar avatar avatar avatar avatar sean avatar littlebitch avatar Olga Christiana avatar avatar Lovemefan avatar avatar leozhou avatar thR CIrcU5 avatar Smile avatar avatar JHowe avatar xuecheng avatar wzzz_10086 avatar Moonlit avatar avatar LieToMe avatar 4A02 avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar 陶治1024 avatar harry10086 avatar Taxuo avatar 一叶知秋olka avatar avatar avatar avatar HumanMusic avatar avatar avatar latermonk avatar yzlltyyh avatar avatar

Watchers

Kostas Georgiou avatar Stephane Mallette avatar avatar

Forkers

xymfei fengyunzaidushi ishine sanshaoyeyang anionex pianpianbuxinxie keyzf dev-mallettes d3lik jevinjiang xhconceit fishke22 liuqiang1541 yangemail yuebuluo168

v2vt's Issues

pip can not find TTS

pip install -r requirements.txt
Collecting langid (from -r requirements.txt (line 1))
Using cached langid-1.1.6-py3-none-any.whl
Collecting whisper_timestamped (from -r requirements.txt (line 2))
Using cached whisper_timestamped-1.15.4-py3-none-any.whl.metadata (1.2 kB)
Collecting inflect (from -r requirements.txt (line 3))
Using cached inflect-7.2.1-py3-none-any.whl.metadata (21 kB)
Collecting unidecode (from -r requirements.txt (line 4))
Using cached Unidecode-1.3.8-py3-none-any.whl.metadata (13 kB)
Collecting eng_to_ipa (from -r requirements.txt (line 5))
Using cached eng_to_ipa-0.0.2-py3-none-any.whl
Collecting pypinyin (from -r requirements.txt (line 6))
Using cached pypinyin-0.51.0-py2.py3-none-any.whl.metadata (12 kB)
Collecting jieba (from -r requirements.txt (line 7))
Using cached jieba-0.42.1-py3-none-any.whl
Collecting cn2an (from -r requirements.txt (line 8))
Using cached cn2an-0.5.22-py3-none-any.whl.metadata (10 kB)
ERROR: Ignored the following versions that require a different python version: 0.0.10.2 Requires-Python >=3.6.0, <3.9; 0.0.10.3 Requires-Python >=3.6.0, <3.9; 0.0.11
Requires-Python >=3.6.0, <3.9; 0.0.12 Requires-Python >=3.6.0, <3.9; 0.0.13.1 Requires-Python >=3.6.0, <3.9; 0.0.13.2 Requires-Python >=3.6.0, <3.9; 0.0.14.1 Requir
es-Python >=3.6.0, <3.9; 0.0.15 Requires-Python >=3.6.0, <3.9; 0.0.15.1 Requires-Python >=3.6.0, <3.9; 0.0.9 Requires-Python >=3.6.0, <3.9; 0.0.9.1 Requires-Python >
=3.6.0, <3.9; 0.0.9.2 Requires-Python >=3.6.0, <3.9; 0.0.9a10 Requires-Python >=3.6.0, <3.9; 0.0.9a9 Requires-Python >=3.6.0, <3.9; 0.1.0 Requires-Python >=3.6.0, <3
.10; 0.1.1 Requires-Python >=3.6.0, <3.10; 0.1.2 Requires-Python >=3.6.0, <3.10; 0.1.3 Requires-Python >=3.6.0, <3.10; 0.10.0 Requires-Python >=3.7.0, <3.11; 0.10.1
Requires-Python >=3.7.0, <3.11; 0.10.2 Requires-Python >=3.7.0, <3.11; 0.11.0 Requires-Python >=3.7.0, <3.11; 0.11.1 Requires-Python >=3.7.0, <3.11; 0.12.0 Requires-
Python >=3.7.0, <3.11; 0.13.0 Requires-Python >=3.7.0, <3.11; 0.13.1 Requires-Python >=3.7.0, <3.11; 0.13.2 Requires-Python >=3.7.0, <3.11; 0.13.3 Requires-Python >=
3.7.0, <3.11; 0.14.0 Requires-Python >=3.7.0, <3.11; 0.14.2 Requires-Python >=3.7.0, <3.11; 0.14.3 Requires-Python >=3.7.0, <3.11; 0.15.0 Requires-Python >=3.9.0, <3
.12; 0.15.1 Requires-Python >=3.9.0, <3.12; 0.15.2 Requires-Python >=3.9.0, <3.12; 0.15.4 Requires-Python >=3.9.0, <3.12; 0.15.5 Requires-Python >=3.9.0, <3.12; 0.15
.6 Requires-Python >=3.9.0, <3.12; 0.16.0 Requires-Python >=3.9.0, <3.12; 0.16.1 Requires-Python >=3.9.0, <3.12; 0.16.3 Requires-Python >=3.9.0, <3.12; 0.16.4 Requir
es-Python >=3.9.0, <3.12; 0.16.5 Requires-Python >=3.9.0, <3.12; 0.16.6 Requires-Python >=3.9.0, <3.12; 0.17.0 Requires-Python >=3.9.0, <3.12; 0.17.1 Requires-Python

=3.9.0, <3.12; 0.17.2 Requires-Python >=3.9.0, <3.12; 0.17.4 Requires-Python >=3.9.0, <3.12; 0.17.5 Requires-Python >=3.9.0, <3.12; 0.17.6 Requires-Python >=3.9.0,
<3.12; 0.17.7 Requires-Python >=3.9.0, <3.12; 0.17.8 Requires-Python >=3.9.0, <3.12; 0.17.9 Requires-Python >=3.9.0, <3.12; 0.18.0 Requires-Python >=3.9.0, <3.12; 0
.18.1 Requires-Python >=3.9.0, <3.12; 0.18.2 Requires-Python >=3.9.0, <3.12; 0.19.0 Requires-Python >=3.9.0, <3.12; 0.19.1 Requires-Python >=3.9.0, <3.12; 0.2.0 Requ
ires-Python >=3.6.0, <3.10; 0.2.1 Requires-Python >=3.6.0, <3.10; 0.2.2 Requires-Python >=3.6.0, <3.10; 0.20.0 Requires-Python >=3.9.0, <3.12; 0.20.1 Requires-Python
=3.9.0, <3.12; 0.20.2 Requires-Python >=3.9.0, <3.12; 0.20.3 Requires-Python >=3.9.0, <3.12; 0.20.4 Requires-Python >=3.9.0, <3.12; 0.20.5 Requires-Python >=3.9.0,
<3.12; 0.20.6 Requires-Python >=3.9.0, <3.12; 0.21.0 Requires-Python >=3.9.0, <3.12; 0.21.1 Requires-Python >=3.9.0, <3.12; 0.21.2 Requires-Python >=3.9.0, <3.12; 0
.21.3 Requires-Python >=3.9.0, <3.12; 0.22.0 Requires-Python >=3.9.0, <3.12; 0.3.0 Requires-Python >=3.6.0, <3.10; 0.3.1 Requires-Python >=3.6.0, <3.10; 0.4.0 Requir
es-Python >=3.6.0, <3.10; 0.4.1 Requires-Python >=3.6.0, <3.10; 0.4.2 Requires-Python >=3.6.0, <3.10; 0.5.0 Requires-Python >=3.6.0, <3.10; 0.6.0 Requires-Python >=3
.6.0, <3.10; 0.6.1 Requires-Python >=3.6.0, <3.10; 0.6.2 Requires-Python >=3.6.0, <3.10; 0.7.0 Requires-Python >=3.7.0, <3.11; 0.7.1 Requires-Python >=3.7.0, <3.11; 0.8.0 Requires-Python >=3.7.0, <3.11; 0.9.0 Requires-Python >=3.7.0, <3.11
ERROR: Could not find a version that satisfies the requirement TTS (from versions: none)
ERROR: No matching distribution found for TTS

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.