Try it out at www.kaleidosync.com!
The Echo Nest represents the comprehensive algorithmic analysis of music. Having been acquired by Spotify, their analysis resources are available via the Spotify API. Each song within Spotify's library has been fully analyzed: broken up into individual beats, segments, tatums, bars, and sections. There are variables assigned to describe pitch, timbre, and more esoteric descriptors like mood and "danceability." It's even possible to derive realtime volume information, all without processing the audio stream directly.
This project is my take on using this data to produce visual experiences using the power of WebGL.
As of version 6.0.0 you won't be able to run this project locally in any reasonable/useful way due to how coupled it is with my (unpublished) shader authoring tools. If you absolutely must get this running on your machine, feel free to reach out to me and I'll walk you through the hurdles and what you'll need to build in order for it to be useful.
- Introduces dev mode, allowing live-editing of shaders and the creation of editable uniforms.
- Complete re-write.
- Sketches have been removed from the codebase and are now stored in a database.
- New architecture connects directly with my visualizer authoring tools, enabling the publishing of new visualizers with the push of a button.
- Leverages the Spotify Web Playback SDK (when available), and falls back to legacy polling in browsers that are unsupported.
- Cleanup / bug fixes.
- There are now 8 visualizers to choose from.
- Reduces the complexity of adding new visualizers.
- Reverts back to the traditional polling when running the dev server.
- Surfaces a control interface for WebGL scenes.
- There are now 7 visualizers to choose from.
- Refactor / rate limit debugging.
- There are now 6 visualizers to choose from.
- Major refactor.
- There are now 5 visualizers to choose from.
- Includes an interface for rendering fragment shaders.
- Project backbone has been abstracted away into its own library, spotify-viz.
- Adoped @vue/cli for the UI layer.
- There are now 4 visualizers to choose from.
- User settings now persist when revisiting the site.
- More graceful error handling and authentication flow.
- This project now fully represents what's hosted on www.kaleidosync.com, instead of the bare-bones implementation that it was before.
- Complete refactor with no front end dependencies.
- Transitioned to webpack from gulp.
- Reactive data store using ES6 Proxies, semi-inspired by Vuex.
- (Hopefully) less spaghetti and more comments.
- Re-implemented with
requestAnimationFrame() - Now mobile-friendly, even on older devices.
- Improved tweening.
- Adjusts itself on window resize.
- More accurate syncing with Spotify, including automatic self-correction.
- Holy shit, it's working... kind of.