[[ Copyright Roy Wierer (Seda145) ]] https://nl.linkedin.com/in/roy-wierer-68643a9b
Using the application:
This is a work in progress, a very, very early version. Basic functionality is implemented but not perfected. It will be worked on over time.
This browser application is a tool for musicians to analyze audio, microphone input and midi data for entertainment purposes. You can play a music instrument through your microphone in realtime while music plays. The analyzer will attempt to track your playing accuracy.
Instructions:
- Download all files of this app. If you get it as a zip file, unzip it somewhere, then open app.html in your web browser.
- Select a "userdata" folder. This folder contains all your songs and your profile data. (an example userdata folder is provided).
>>> 
- Give permission for access to your microphone, so your connected music instrument will be detected.
- You are now on the configuration page. You can configure your experience and save your configuration + song progress here.
- Continue to the Song List and select a song. The listed songs come from your userdata folder and match your current configuration, such as choice of instrument.
- Connect your instrument if you haven't yet. The common way to connect your music instrument is through the Line-In port on your pc. This port is similar to the microphone port with less noise and a better signal tolerance. If the signal from your instrument is not loud enough you can use a pre-amp pedal between your istrument and the Line-In port. I personally use a "tc electronic Spark Booster" pedal to boost the signal, which greatly improves how well your accuracy is detected by this app. Ensure that the Line-In input level is set high enough. A low or bad input signal can not be processed.
Your input signal, along with the detected pitch and input volume will be shown further on. There is a small white indicator on the input volume bar which shows the minimum strength of the signal required for processing.
- There is a new page, the "Tones page". Here you can modify the input / output signal of your instrument through effect pedals. This is a new feature. Currently I have implemented a gain boost pedal.
- The music will play, Notes are automatically generated on a fretboard for your selected tuning and chosen instrument, matching to the midi data. You can play at the correct midi timing, which will increase or decrease your score. There are currently two visualizers, a horizontal and a vertical one. You can use your browser zoom function (CTRL + mouse scroll) to resize the visualizers.
Tips and Todos:
- Use this app responsibly. I do not support piracy, so no songs are included except for the example I made.
to see what still needs to be done.
- Bass guitar is the currently implemented instrument.
- Use a microphone device to play along, or use the "stereo mix" (realtek driver) to route system audio as input. The latter is useful when the audio frequencies match the midi and you want to test the system.
- If you are a Rocksmith player, you should know cdlc (psarc) can fully be parsed to this app using Rocksmith EOF (Editor On Fire) and RocksmithToolkit. I am still looking for a way to preserve audio offsets and instrument techniques.