[Bug] Time taken to run TTS command far greater than actual processing time about tts HOT 8 CLOSED

The models are quite large. It takes time to fully download them to RAM, simply. You can monitor the process via python -v, of via resource monitor, the default GUI ones in Windows etc will do.

from tts.

But the delay is present regardless of whether I'm synthesising speech. Even if I'm simply doing tts -h the delay is the same length of time. I can see using my resource manager that the resources are only allocated after this delay period, and are allocated almost instantaneously.

from tts.

Also the memory hard faults may be to blame, especially on e.g. Droids.

I wrote a snippet to monitor just that:

pidstat_while() {
  echo
  pidstat -r | awk 'NR<=3 {print $0}'
  echo
  while true; do
    pidstat -r | awk 'NR>3 {print $0}' | sort -k8nr -k5nr | head -n 1
    sleep 2
  done
}

It is a function that you can run by typing pidstat_while after pasting the above.
It even runs in Termux, but in prooted Debian.
In very short, it shows you the most memory intensive process, and the hard faults. If you have too many (say, over 50 per seconds) - the model is being memory mapped (aka loaded) from disk, now and then. (Excuse my maybe naive and non-IT explanation of the root cause... )

from tts.

I'm away from my PC for the next week, I'll run this and see what it says once I have access to it again, thanks!

from tts.

I didn't really understand what you were talking about and asked a friend, they said because I'm on Windows I won't be able to run what you've sent

from tts.

First of all, you're using a very outdated TTS version (you need at least Python 3.9 to get the latest). Then, making separate CLI calls will always be slow because you have to load the model every time, so e.g. use the server: https://docs.coqui.ai/en/latest/inference.html#on-the-demo-server-tts-server

from tts.

Ah okay, thanks! I had no idea I was outdated, I tried installing on Python 3. something greater than 8 and it told me I needed Python 8. I'm going to assume there must have been some user error there, once I'm able I'll try a fresh reinstall and look into creating the server.

from tts.

Yep, the server runs faaar faster! Thanks, the first line of the server part of the wiki tells you to not use it in real-time applications so I avoided looking into it further, there was my mistake! Maybe this could be made clearer? Thanks!

from tts.