A 3D game. Jump from platform to platform by clapping your hands and reach the finish. This game demonstrates how to control a game by audio. It was made for the presentation Spiele mit Musik steuern hold on Lange Nacht der Computerspiele, Leipzig in 2015.
Please make sure you have the following modules already installed:
Run Game.bmx. You will see a list of capture devices. The default capture device will be used. To change the capture device open Game.bmx and replace the line (near line 655)
BlitzMax
recorder.Open(devices[index]) ' edit index for your capture device (starting by 0)
The game is controlled by audio. When you clap in your hands the player will jump in its current direction. The strength of your clapping matters. You can also press **[Space]** key for jumping if your audio settings doesn't work.
# Screenshot
# How it works
The audio signal is recorded at a sampling rate of 44100 Hz and divided into frames of 512 samples. For every frame the Fast Fourier Transform (FFT) is calculated. The novelty is the complex distance between the FFT of a frame and the FFT of its predecessor frame. The novelties get pushed into a ring buffer. The median of the whole ring buffer is calculated. A novelty value `x[i]` that satisfies `x[i] > x[i-1] AND x[i] > x[i+1]` (local maximum) and `x[i] > baseThreshold + weight*median` (threshold) get detected as an onset. After detecting an onset a listener get notified about. An onset let jumps the player with the strength of the novelty value.