Linux.conf.au LCA Multimedia Miniconf, 24th Jan 2011
Audio and video processing have traditionally been hard number-crunching tasks to do and nobody would have considered executing them in a Web browser on a remote file. However, with the capabilities of modern hardware and web browser software, and the integration of audio and video into HTML5, it’s now possible to do (almost) everything inside a web browser in real-time with a bit of JavaScript. In this talk we will look at the Firefox Audio API to visualize sound with an FFT and to manipulate sound. For video we look at the possibilities of the Canvas to manipulate video pixels in real-time to achieve things like motion detection.