ly2video is a Python script which converts music represented by a GNU
LilyPond file into a video containing a
horizontally scrolling music staff which is synchronized with a
MIDI-generated audio rendering of the music.
It is also possible to synchronize the video of the scrolling music notation with a previously recorded audio track of the same music, such as a live performance, even when the audio uses tempo rubato or is not precisely metronomic.
Here are some examples of videos generated by ly2video.
Beware, here be dragons!
Unfortunately I don't currently have the time to work on ly2video much. These means that bitrot has set in, for example see issue #75.
Having said that, I'll do my best to support anyone who is trying to get it working - please see below for how to get support.
Please also read the Installation section below before you start installing anything!
- GNU LilyPond >= 2.15.41
(needs
one-line-breakingsupport) - FFmpeg (if you are on Ubuntu or Debian, see first see issue 32)
- TiMidity++
- Python >= 3.5
- Python's pip installer
- swig and ALSA development libraries
(
python-midirequires these in order to build its sequencer code successfully, although ly2video doesn't use that code)
Install the ffmpeg package from Packman via 1-click
install (you can also
find the button on this
page), or via YaST
and/or
zypper.
You can ensure the remaining dependencies are installed via something like:
sudo zypper install lilypond timidity python3-pip python-imaging alsa-devel
There is currently a known issue on these distributions, since Debian
and Ubuntu switched from ffmpeg to the libav fork. See issue #32 for a suggested
workaround.
Additionally, Debian and Ubuntu both currently ship very old versions of LilyPond, so you might need to install a newer one via the "Generic Packages" section near the top of: http://lilypond.org/unix.html
You can ensure the remaining dependencies are installed via something like:
sudo apt-get install timidity python3-pip python3-pil swig libasound-dev
Download the source tarball from the Arch User Repository, extract it, and run
makepkg -si
in the directory you extracted to in order to pull all the dependencies (python and otherwise)
from the main repos and then install ly2video. The other dependencies
from the AUR will have to be installed manually; however, they will all be listed
if you run makepkg in the same directory.
If you have an AUR helper such as yaourt installed, this entire process can be shortened to one step:
yaourt -S ly2video
where yaourt would be replaced by the name of your AUR helper if you have a different helper installed.
Regardless, after installing the package, you can use the script by running ly2video with the required arguments.
If you have figured out how to install the dependencies and get ly2video working on another platform, please file a new issue containing the information, so that this README can be updated. Thanks!
ly2video requires some specific Python modules - do NOT install these manually! (unless you are a Python expert.) They can be installed system-wide via:
sudo pip install -r requirements.txt
or for the current user via:
pip install --user -r requirements.txt
You can optionally protect against the risk of installation of these
Python modules destabilising any other Python applications you may
use, by isolating them in a virtual environment using
virtualenv. The most
convenient way to do this is via
virtualenvwrapper.
Once you have virtualenvwrapper installed, it's as simple as:
mkvirtualenv ly2video
pip install -r requirements.txt
This is done via Python's standard package installation mechanism.
For example, to install system-wide, just run
sudo pip install .
or for the current user via:
pip install --user .
If something fails, please double-check you correctly met the requirements and dependencies detailed above.
Run ly2video --help to display usage information.
You must ensure that your .ly input file contains both \layout { }
and \midi commands, which ensure that valid .midi and .png files
are generated when it is run through lilypond --png.
Set up your path to argument LILY_FILES in makefile.
Build docker container with workable ly2video inside
make build
Run docker container with access to direcory you point at LILY_FILES
make run
Use ly2video usually.
All actions applied in container to your files (LILY_FILES) will change your files (LILY_FILES) outside container.
Firstly, please check the issue tracker for known issues, and if yours is not there, please submit it.
Secondly, if you are able to perform some [[trouble-shooting|TROUBLE-SHOOTING]] yourself, even if you can't identify the exact problem or suggest a fix, any extra light you can shed will greatly increase the chances of it being fixed. Please see the [[trouble-shooting|TROUBLE-SHOOTING]] guide for information on how to do this.
If you know how to fix a problem or contribute an enhancement, you are extremely welcome to fork this repository, commit your fix, and then send a pull request!
Huge credits for the initial implementation go to Jiří "FireTight"
Szabó, who wrote it as part of his Bachelor's degree. If you are
lucky enough to understand Czech, you can read his thesis on ly2video
in the doc/thesis/ subdirectory, or
online :-) Work on
an English translation has begun and is being tracked in
issue 15 but is
unlikely to be finished any time soon unless someone else volunteers
to help out.
Very big thanks also to Jan Nieuwenhuizen not only for co-inventing LilyPond in the first place, but also for helping me implement the complete revamp of the synchronization algorithm, which should be much more robust than the previous one.
And finally of course, much gratitude to the many great people who have contributed to LilyPond over the years. This would not have been possible without you.
ly2video is released under the GNU GPL v3.