Git Product home page Git Product logo

vits-android-ncnn's Introduction

vits日语模型(莲华)Android部署

介绍

本项目基于https://github.com/jaywalnut310/vits 训练的日语模型(采用游戏语音,在3221组数据从头训练了1000个epoch)

日语cleaners基于https://github.com/CjangCjengh/MoeGoe

日语分词和声调基于https://github.com/r9y9/open_jtalk 进行移植部署

更新

  • 将pytorch模型转换为ncnn模型,缩小模型体积和安装包体积,实现推理加速

  • 优化了一些细节,添加了参数调节

  • 使用ncnn Vulkan,增加gpu推理加速

  • 由于Android 11添加了文件权限机制,因此本项目现仅支持Android 11以下版本API<30,敬请谅解 (有大佬能帮忙解决最好)

使用说明

1、确保安装好ndk并配置好相关环境

2、将编译好的ncnn库放在项目的/app/src/main/cpp/目录下并重命名为ncnn,或者自己在cmake文件修改路径,ncnn下载地址

或者自行下载Vulkan版本,最好是1126的最新版或者自己编译,编译教程见ncnn项目地址页

3、将模型文件(.bin)和配置文件(.json)下载之后解压放在Download文件夹下,点击模型文件加载模型(仅需加载任意一个.bin文件即可),点击加载配置加载以.json为后缀的配置文件

4、编译并运行项目

5、如果下载apk则仅需进行3即可

注意

1、字典下载解压到项目assets的同名文件夹下,模型和配置文件下载到本地后手动导入

2、字典链接:https://pan.baidu.com/s/1H33WODqiRvtaWPsjWE0XVw?pwd=uqo3

模型链接:https://pan.baidu.com/s/1kBlWTQSKPn2TetUfCpA8kw?pwd=584k

3、由于更换了推理框架,目前仅支持ncnn多人模型,也是为了以后能够兼容声线转换,模型替换为基于@CjangCjengh大佬的多人模型

4、ncnn模型和配置文件链接:模型地址

5、@CjangCjengh大佬项目地址:https://github.com/CjangCjengh/MoeGoe

6、本项目主要由c++实现,因此确保安装ndk和配置好环境

7、模型转换工具正在完善,以后也会发布,可以将自己训练好的模型转换成ncnn支持的格式,并且以后也会实现voice convert,总之,敬请期待!!

模型禁止商用,后果自付!!!

预览图

Screenshot_1672929199

鸣谢

再次感谢CjangCjengh大佬的付出,以及@nihui群主提供这么棒的框架,以及各位热心群友帮忙解决模型转换的各种问题

vits-android-ncnn's People

Contributors

weirdseed avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.