Comments on: Amazing Audio Sampling in JavaScript with Firefox

By: rdyson

rdyson — Fri, 08 Jan 2010 17:01:45 +0000

This is awesome!!

By: iliad

iliad — Fri, 08 Jan 2010 07:06:53 +0000

Truly mind-blowing stuff. Some really incredible work guys.

By: bfirsh

bfirsh — Thu, 07 Jan 2010 20:59:46 +0000

I’ve just added dynamically generated audio to JSNES which might be of interest:

http://benfirshman.com/projects/jsnes/

And as a side effect, and audio player:

http://benfirshman.com/projects/jstunes/

As soon as you can write samples to elements, I guess the Flash interface can be swapped out with that.

By: corbanbrook

corbanbrook — Thu, 07 Jan 2010 18:46:46 +0000

@p01:

The demo in the video is running an FFT (implemted in js) on a 2048 sample buffer. I was surprised to see that js could handle this in realtime.

David Humphrey’s latest patch (which we are currently testing) implements the FFT in C++ within Firefox and reveals the spectrum data to js. The hope is that this frees up more cycles for animation/other calculations on the js side.

We are currently discussing which features we would like added to the API. If you would like to join in on the discussion, we hang out in #processing.js / irc.mozilla.org

By: Schill

Schill — Thu, 07 Jan 2010 16:46:14 +0000

Very glad to see this; Flash has had a form of spectrum/eq data access via SoundMixer.computeSpectrum() in Flash 9, and Flash 10 introduced “raw” waveform access, plus the ability to create sound on the fly from code (and manipulate live playback by feeding data into the sound buffer.)

I’m a bit surprised Flash didn’t have this stuff say, eight years ago, but in any event it’s good to see they see the value in it. I’ve been looking forward to native audio in the browser for a long time (so eventually I can drop SoundManager 2, which uses Flash under the hood. :D) Being able to get and/or manipulate the sound data opens tons of creative possibilities when used with canvas, etc.

By: p01

p01 — Thu, 07 Jan 2010 15:51:05 +0000

This patch does not expose spectrum data but the raw audio data.

While it’s nice to see that it is possible to process an FFT in JS in realtime, I strongly believe that it should be part of the Audio and Video APIs.

By: rasmusfl0e

rasmusfl0e — Thu, 07 Jan 2010 14:00:27 +0000

Getting spectrum data from audio is actually the only reason I’ve used flash recently. If this makes it into FF (and/or other good browsers) I’ll be looking at many many hours of fun with canvas/audio ;D

By: McDaid

McDaid — Thu, 07 Jan 2010 13:13:06 +0000

Hey that is really incredible, great work and like the tune too.

By: gabel

gabel — Thu, 07 Jan 2010 12:17:19 +0000

Amazing! Really hope Mozilla will include the patch it into a future version of FF.

By: BenGerrissen

BenGerrissen — Thu, 07 Jan 2010 11:52:38 +0000

I bow down in awe! Another ground breaking web innovation!