Prof. Angela Brennecke, Creative Technologies, 03/2020
Contributors: Markus Traber, BSc, CTech Master
In this repository we will pursue research ideas on
- How to visually interpret sound
- How to interact with the visuals / sound sources
- How to sonify interactive visuals in a musically meaningful way
- Zach Lieberman's movement studies 1
- Zach Lieberman's movement studies 2
- Zach Lieberman's movement studies 3
- Choreographiccoding
Please refer to the instructions in our wiki.
openFrameworks v0.11.0
Use the number keys to switch between apps. Further instructions for each instrument is available on execution.
This instrument visualizes a sine oscillator. By pressing 'f' and moving the mouse in the y-direction, the frequency can be adapted.
This instrument records 512 1px-columns via the webcam with a slitscan approach. When the recording is finished, the pixel values are being converted to greyscale. Then the recorded pixel values of each pixel column are made audible by mapping the pixel values to fequencies.
This instrument also utilizes the webcam and the slitscan approach. The pixel column is divided into 6 zones, which each represent a pitch. The instrument calculates the bightness of each zone and plays back the according pitch of the currently brightest zone.
This instrument utilizes the webcam and analyzes the optical flow. Diferent musical tones are assigned to the diferent directions, whose amplitude is determined by the strength of the change in movement which, in turn, is determined by the number of vectors.
Description missing on how sound is generated. The visualization on the right side divides the webcam image into pixel squares. The brightness of each square is being mapped to the rotation of the line, that is being drawn instead.
Based on an ofxOpenCV example this instruments recognizes contours of objects in front of the webcam. It has different modes to generate sound, where area and y-position of a contour can have an influence on the sound generation.
