Comments (5)
Thank you for your jobs.
The readme.md show the decoder time-consuming is
combined_model_and_conditioning stats for generating 2000 frames of audio, max: 13173 us, min: 9463 us, mean: 9629 us, stdev: 270.788.
which means one frame(40ms) consume 9.463ms. But the log printed in my android app is
combined_model_and_conditioning stats for generating 2000 frames of audio, max: 65081 us, min: 53070 us, mean: 54055 us, stdev: 872.812.
which means one frame(40ms) consume 54.055ms.
The result make me confused. Why such a big difference?
from lyra.
What type of device are you using? As the doc says the numbers reported are for a Pixel 4.
from lyra.
I test it in xiaomi max3, android 10 ,the cpu is arm64-v8a and Linux, both of them consume about 50ms per frame.
from lyra.
I test it in xiaomi max3, android 10 ,the cpu is arm64-v8a and Linux, both of them consume about 50ms per frame.
Thank you for your report. We had not tested on Mi Max3. The lowest-end phone that we tested internally is Pixel1, which is still capable of decoding in real time (<40ms time to decode a 40ms frame). Unfortunately Mi Max3's Qualcomm Snapdragon 636 processor is slower than Pixel1's Snapdragon 821.
However, there is still chance for Max3 to be able to decode in real time, by using the fixed point representation (which could give you at most a 2X speedup). This is done by supplying --copt=-DUSE_FIXED16 in the building command. For example for the android app,
bazel build android_example:lyra_android_example --config=android_arm64 --copt=-DBENCHMARK --copt=-DUSE_FIXED16
Let us know if that works for you, and it would be great if you can share the benchmark results.
from lyra.
The new Lyra 1.2.0 release should give another 5x speed-up.
from lyra.
Related Issues (20)
- MacOS 13.0.1 build: symbol not found in flat namespace '_CFRelease'
- the problem about building v0.0.2 version
- bazel build -c opt lyra/cli_example:encoder_main error on 20.04-Ubuntu
- Can't we directly encode pcm? HOT 3
- Noisy audio
- Can the model size be cut? HOT 1
- Is there any plan to make this lib work on older android devices? HOT 2
- Linux build HOT 1
- ANDROID BUILD HOT 1
- Can't load TFLite output_details for quantizer model (encode) HOT 3
- When will lyra support ios platform? HOT 1
- The decoding CPU is too high. Is there any way to reduce it?
- model structure of lyra 1.3.2
- About crash problem with kInternalSampleRateHz set to 32k
- Android app built as per readme crashes (on Samsung S23) HOT 1
- how to read the encoded data in the sample1_16kHz.lyra file into python/numpy array?
- Directly provide the executable download address HOT 3
- Is that possible to release the model coeffs with codebook size=1024?
- Is it possible to still run the V1 model with the latest API? Or only V2
- LMCodec HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from lyra.