Git Product home page Git Product logo

fetch-stream-audio's Introduction


Demo

https://fetch-stream-audio.anthum.com/



Background

This repo provides low-latency web audio playback examples for programatically decoding audio in chunks with the Web Audio API and the new Fetch & Streams APIs. Traditionally, decodeAudioData() is used for programmatic decoding but requires the complete file to be downloaded, and chunk-based decoding is not supported. These Streams examples will show how to sidestep that limitation. Media Source Extensions could also be used to play audio and that example may be integrated here one day.

The examples demonstrate:

  1. Opus Streaming opus-stream-decoder is used to decode an Opus file in a Web Worker with WebAssembly. This simulates a real-world use case of streaming compressed audio over the web with the Web Audio API. (MP3 is old and outdated for those of us who grew up with WinPlay3. Opus is the new gold standard). This example is ideal because it allows for small, high-quality files with Opus.
  2. WAV Streaming A WAV file is streamed and decoded by a Web Worker. Chunks are scheduled into a read buffer before sending to encoder to ensure decoder receives complete, decodable chunks. JavaScript (not WebAssembly) is used for decoding. This example requires a much larger file.

Opus Playback Tests

Opus file playback can be tested at throttled download speeds and varkous encoding/bitrate qualities (Issue #14 will add to UI):

opusBitrate = 96; throttle = nolimit
opusBitrate = 96; throttle = 1mbps
opusBitrate = 96; throttle = 104kbps
opusBitrate = 96; throttle = 100kbps
opusBitrate = 64; throttle = 72kbps
opusBitrate = 60; throttle = 64kbps
opusBitrate = 53; throttle = 56kbps
opusBitrate = 32; throttle = 40kbps
opusBitrate = 28; throttle = 32kbps
opusBitrate = 12; throttle = 16kbps

Back-End Nginx Server

To use the config files, create symblink fetch-stream-audio, e.g.:

$ ln -s [LOCATION_TO_THIS_REPO]/.conf/nginx /etc/nginx/fetch-stream-audio

Then, include this repo's nginx config file into your server {} block, e.g.:

server {
  ...

  disable_symlinks off;
  include fetch-stream-audio/include-server.conf;
}

Throttled Bandwidth Endpoints

All /audio/* URIs are configured to intentionally limit download speeds and control response packet sizes for testing the decoding behavior (defined in include-server.conf). For example:

https://fetch-stream-audio.anthum.com/nolimit/opus/decode-test-64kbit.opus
https://fetch-stream-audio.anthum.com/10mbps/opus/decode-test-64kbit.opus
https://fetch-stream-audio.anthum.com/1.5mbps/opus/decode-test-64kbit.opus
https://fetch-stream-audio.anthum.com/512kbps/opus/decode-test-64kbit.opus

All Throttled Endpoints
Speed Example URL
16 kbps https://fetch-stream-audio.anthum.com/16kbps/opus/decode-test-64kbit.opus
24 kbps https://fetch-stream-audio.anthum.com/24kbps/opus/decode-test-64kbit.opus
32 kbps https://fetch-stream-audio.anthum.com/32kbps/opus/decode-test-64kbit.opus
40 kbps https://fetch-stream-audio.anthum.com/32kbps/opus/decode-test-40kbit.opus
56 kbps https://fetch-stream-audio.anthum.com/32kbps/opus/decode-test-56kbit.opus
64 kbps https://fetch-stream-audio.anthum.com/64kbps/opus/decode-test-64kbit.opus
72 kbps https://fetch-stream-audio.anthum.com/72kbps/opus/decode-test-64kbit.opus
80 kbps https://fetch-stream-audio.anthum.com/80kbps/opus/decode-test-64kbit.opus
88 kbps https://fetch-stream-audio.anthum.com/88kbps/opus/decode-test-64kbit.opus
96 kbps https://fetch-stream-audio.anthum.com/96kbps/opus/decode-test-64kbit.opus
100 kbps https://fetch-stream-audio.anthum.com/100kbps/opus/decode-test-64kbit.opus
104 kbps https://fetch-stream-audio.anthum.com/104kbps/opus/decode-test-64kbit.opus
112 kbps https://fetch-stream-audio.anthum.com/112kbps/opus/decode-test-64kbit.opus
120 kbps https://fetch-stream-audio.anthum.com/120kbps/opus/decode-test-64kbit.opus
128 kbps https://fetch-stream-audio.anthum.com/128kbps/opus/decode-test-64kbit.opus
160 kbps https://fetch-stream-audio.anthum.com/160kbps/opus/decode-test-64kbit.opus
192 kbps https://fetch-stream-audio.anthum.com/192kbps/opus/decode-test-64kbit.opus
256 kbps https://fetch-stream-audio.anthum.com/256kbps/opus/decode-test-64kbit.opus
384 kbps https://fetch-stream-audio.anthum.com/384kbps/opus/decode-test-64kbit.opus
512 kbps https://fetch-stream-audio.anthum.com/512kbps/opus/decode-test-64kbit.opus
768 kbps https://fetch-stream-audio.anthum.com/768kbps/opus/decode-test-64kbit.opus
1 mbps https://fetch-stream-audio.anthum.com/1mbps/opus/decode-test-64kbit.opus
4 mbps https://fetch-stream-audio.anthum.com/4mbps/opus/decode-test-64kbit.opus
5 mbps https://fetch-stream-audio.anthum.com/5mbps/opus/decode-test-64kbit.opus
2 mbps https://fetch-stream-audio.anthum.com/2mbps/opus/decode-test-64kbit.opus
3 mbps https://fetch-stream-audio.anthum.com/3mbps/opus/decode-test-64kbit.opus
4 mbps https://fetch-stream-audio.anthum.com/4mbps/opus/decode-test-64kbit.opus
5 mbps https://fetch-stream-audio.anthum.com/5mbps/opus/decode-test-64kbit.opus
6 mbps https://fetch-stream-audio.anthum.com/6mbps/opus/decode-test-64kbit.opus
7 mbps https://fetch-stream-audio.anthum.com/7mbps/opus/decode-test-64kbit.opus
8 mbps https://fetch-stream-audio.anthum.com/8mbps/opus/decode-test-64kbit.opus
9 mbps https://fetch-stream-audio.anthum.com/9mbps/opus/decode-test-64kbit.opus
10 mbps https://fetch-stream-audio.anthum.com/10mbps/opus/decode-test-64kbit.opus
nolimit https://fetch-stream-audio.anthum.com/nolimit/opus/decode-test-64kbit.opus
https://fetch-stream-audio.anthum.com/audio/opus/decode-test-64kbit.opus

Development & Building

Please remember that this is a proof-of-concept demo intended to show developers alternative (and possibly better) ways to play web audio. Currently, there's no formal package or release (see #21), so you'll need to improvise a little to get this working in your apps or websites.

I prefer Yarn, and you'll need Yarn or NodeJS installed to build the project. app.js is the entry point for starting with the code.

# clone repo and install dependencies
$ git clone https://github.com/AnthumChris/fetch-stream-audio
$ cd fetch-stream-audio
$ yarn install
# run the development server in "watch" mode to automatically re-build your changes
$ yarn dev
# build the project formally with minification
$ yarn build

Acknowledgements

Thanks to @bjornm for pointing me to @mohayonao's WAV decoder: https://github.com/mohayonao/wav-decoder

fetch-stream-audio's People

Contributors

anthumchris avatar dependabot[bot] avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.