/WasmVideoEncoder

A videoencoder for the browser using FFmpeg with WebAssembly (for use in musicvid.org)

Primary LanguageC

Check out a live demo here

WasmVideoEncoder

Video utils for the browser using FFmpeg with WebAssembly, primarily developed for use in musicvid.org. Currently encodes raw image and audio data, and muxes into mp4 format (x264 video, mp3 audio).

Example usage in the demo folder, it's the code for the demo website linked earlier.

See webassembly/C/avio_write.c for the main code of the encoder and webassembly/C/avio_read.c for the decoder.

Pthreads to be implemented, but will hold off since they aren't very stable at the moment.

Build

Makefile & patches from ffmpeg.js / videoconverter.js

apt-get update
apt-get -y install wget python git automake libtool build-essential cmake libglib2.0-dev closure-compiler

[[[install and activate emsdk]]]

cd [this repo]
git submodule init
git submodule update --recursive

to run tests without Emscripten:

cd build/reg
make 
cd ../../C
LD_LIBRARY_PATH=/WasmVideoEncoder/webassembly/build/reg/lib
PKG_CONFIG_PATH=/WasmVideoEncoder/webassembly/build/reg/lib/pkgconfig
export LD_LIBRARY_PATH
export PKG_CONFIG_PATH
make [your test]

to build for exporting with Emscripten:

cd build/em
make
cd ../..
make encode.js

Benchmarks

These are mostly for comparison with later versions with threads/SIMD
Firefox 63.0.3
Chrome 70.0

settings Chrome Firefox Firefox nightly (threaded)
60s 640x480 2000k Ultrafast 48.1s, 74.9fps, 12.8MB 35.5s, 101.5fps, 11.8MB 33.7s, 106.8fps, 11.8MB
60s 640x480 2000k Fast 148.6s, 24fps, 9.1MB 143.8s, 25fps, 7.9MB 109.7s, 32.8fps, 7.9MB
60s 640x480 2000k Medium 123.8s, 29fps, 8.9MB 106.1s, 33.9fps, 7.7MB 89.2s, 40.3fps, 7.9MB
60s 1280x720 6000k Ultrafast 121.5s, 29.6fps, 23MB 90.3s, 39.8fps, 21.2MB 89.1s, 40.4fps, 21.2MB
30s 1280x720 6000k Fast 203.2s, 8.6fps, 7.8MB 202.2s, 8.9fps, 6.6MB 150.6s, 12.0fps, 6.7MB
30s 1280x720 6000k Medium 157s, 11.5fps, 7.4MB 141.5s, 12.7fps, 6.4MB 117.8s, 15.3fps, 6.5MB
30s 1920x1080 6000k Medium 336.2s, 5.4fps, 11MB 303s, 5.9fps, 9.4MB 255.2s, 7.1fps, 9.5MB
20s 1920x1080 12000k Ultrafast 87.7s, 13.7fps, 11.7MB 64.5s, 18.6fps, 10.7MB 63.1s, 19.0fps, 10.6MB
20s 1920x1080 12000k Fast 298.9, 4fps, 7.4MB 300.7s, 4fps, 6.5MB 218.6s, 5.5fps, 6.5MB