ScriptProcessorNode is deprecated, need help with an AudioWorklet example about amy HOT 9 OPEN

@octetta May be you can help with that?

I'll try to look at this, but I'm a newb on all things web audio.

A thought though, what if we could figure out how to add effects inside AMY?

I suspect the authors might be more interested in this, because it would work with their embedded stuff.

Could you share with me what basic effects you need from tone.js, as a design thought experiment?

from amy.

Just reverbs and delays are enough to profoundly enrich the sound of the synth. And another thing is that implementing AudioWorklet glue we can eliminate any issues with clicks and audio freezes on low end hardware because we get rid of even touching the main JS thread.

from amy.

I also got some pretty cool audio analysis tools and would like to integrate them in a future proof way, which AudioWorklets seem to be now. I tried to do it myself several times with AubioJs, yet from a web-designer perspective it's not that easy to start managing memory buffers and processor threads 😅

But I believe that once we find a solution , it can be implemented widely. Devs at Meyda could appreciate that too!

from amy.

To be honest, I'm a C/embedded engineer, and have poor skills in the web domain (aside from creating ugly monster code when I need a quick UI for exotic hardware control).
I've been very interested in the Erlang and Elixir ecosystem, and will write up a simple Elixir + AMY integration article soon to foster interest and sharing.

from amy.

Love this article @octetta !

I have to admit to being out of my league on web audio stuff. I got it working just enough for the demo, but would love help modernizing it so others can use it easier.

from amy.

For now I just can't figure out what's happening at this line of code:

      scriptNode.onaudioprocess = function (audioProcessingEvent) {
        fn(audioProcessingEvent.outputBuffer.getChannelData(0));
      };

And how the buffer is actually connected to the synth. Help needed.

from amy.

My explorations live here https://github.com/davay42/amy/tree/main/src/es6

from amy.

@octetta May be you can help with that?

from amy.

I've not looked into this yet, but while messing around with this article, I noticed that the sound library I introduced here (miniaudio) has its own Web Audio backend that might be cleaner than what Brian/DAn did.

I'll try to look at it after I get caught up with $DAYJOB.

Also, a thought experiment: I wonder if it's possible generate RTSP stream (or some other subscribe-able audio format) directly from AMY?

from amy.