Comments (4)
感谢解惑,这个问题我暂时还没遇到,不过用tensorflow处理控制流变量的处理上倒是踩过很多坑,我采样了一些transducer的帧级别输出,以及辅助训练的ctc_dense网络的帧级输出,发现它们对齐后的误差并不大,我在考虑工程化方案中,分离encoder和decoder,将输出结果根据精度要求,采用transducer或ctc_dense+ctc_decode做infer,后者速度会提高很多。同时encoder在分离后可以并行处理,与不能并行的transducer分开处理,更适合生产环境
from tensorflowasr.
感谢指出,能看出这里有重复计算都是高手,给你点个赞!
这个地方这么写是为了配合 TF C 2.3.0版本的模型加载,因为不这样写C版本的推理会有问题,详见问题issue:
tensorflow/tensorflow#44428
至于issue中回复的方法有没有work我没有尝试过,好像是有的work有的不work
transducer_wrap_python.py中有正确的推理方法 XD
from tensorflowasr.
感谢分享嗷
今日更新的streaming结构是encoder和decoder分开了,其infer的速度还是非常可观的。
from tensorflowasr.
好的,后面再去研究一下,从项目里学到很多,感谢
from tensorflowasr.
Related Issues (20)
- 训练am模型的时候,内存一直下降。下降到几百兆 HOT 2
- can i use it in a windows system? HOT 1
- 是否能提供StreamingConformer模型 HOT 1
- tensorflow.python.framework.errors_impl.InternalError: Blas GEMM launch failed HOT 1
- 数字好像无法识别,这个应该如何优化处理? HOT 2
- 一个题外话,交流群的二维码失效了,不知道是否可以再放一次
- 想问一下楼主这个出错是什么问题 HOT 1
- bert_feature_loss in LM HOT 1
- 希望添加命令词模型或例子教程 HOT 3
- dict目录下缺少必要文件 HOT 1
- 关于VAD的训练集
- 关于使用Tester 来大批量测试 HOT 3
- 大佬可以更新下微信群吗,想交流一下 HOT 1
- 标点预测模型转换TFLITE问题
- 训练loss不下降 HOT 1
- 关于train_loss、ctc_loss和translate_loss的关系有些疑问 HOT 2
- 关于标点恢复模型OOV的问问 HOT 3
- 请问一下如何只使用cpu推理的方式
- 你好,考虑将silero-vad加入到项目中吗 HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from tensorflowasr.