DCMLab/romantic_piano_corpus

This is a README file for a data repository originating from the DCML corpus initiative and serves as welcome page for both

• the GitHub repo https://github.com/DCMLab/romantic_piano_corpus and the corresponding
• documentation page https://dcmlab.github.io/romantic_piano_corpus

For information on how to obtain and use the dataset, please refer to this documentation page.

• An Annotated Corpus of Tonal Piano Music from the Long 19th Century
  • Version history
  • Getting the data
    • With full version history
    • Without full version history
  • Data Formats
    • Opening Scores
    • Opening TSV files in a spreadsheet
    • Loading TSV files in Python
  • How to read metadata.tsv
    • File information
    • Composition information
    • Score information
    • Identifiers
  • Generating all TSV files from the scores
  • Questions, Suggestions, Corrections, Bug Reports
  • License
• Overview
  • beethoven_piano_sonatas
  • chopin_mazurkas
  • debussy_suite_bergamasque
  • dvorak_silhouettes
  • grieg_lyric_pieces
  • liszt_pelerinage
  • medtner_tales
  • schumann_kinderszenen
  • tchaikovsky_seasons

An Annotated Corpus of Tonal Piano Music from the Long 19th Century

This corpus has been created within the DCML corpus initiative and employs the DCML harmony annotation standard.

The publication covers the following corpora (the DOI links always point at the latest version respectively):

• Ludwig van Beethoven - Piano Sonatas
• Frédéric Chopin - Mazurkas
• Claude Debussy - Suite Bergamasque
• Antonín Dvořák - Silhouettes
• Franz Liszt - Années de Pèlerinage
• Nikolai Medtner - Tales
• Robert Schumann - Kinderszenen
• Pyotr Tchaikovsky - The Seasons
• Edvard Grieg - Lyric Pieces

Version history

See the GitHub releases.

Getting the data

This is a "meta repository" that includes 9 independent corpus repositories as submodules. For more details on the corpora, please click on the respective submodule.

With full version history

The dataset is version-controlled via git. In order to download all files included in this dataset with all revisions they have gone through, git needs to be installed on your machine. Then you can clone this repository using the command

git clone --recurse-submodules -j8 https://github.com/DCMLab/romantic_piano_corpus.git

Without full version history

If you are only interested in the current version of the corpus, you will need to download and unpack the submodules as ZIP files individually:

• beethoven_piano_sonatas
• chopin_mazurkas
• debussy_suite_bergamasque
• dvorak_silhouettes
• grieg_lyrical_pieces
• liszt_pelerinage
• medtner_tales
• schumann_kinderszenen
• tchaikovsky_seasons

Data Formats

Each piece in this corpus is represented by four files with identical names, each in its own folder. For example, the first movement of the first Beethoven sonata Op. 2 no. 1 has the following files:

• beethoven_piano_sonatas/MS3/01-1.mscx: Uncompressed MuseScore file including the music and annotation labels.
• beethoven_piano_sonatas/notes/01-1.tsv: A table of all note heads contained in the score and their relevant features (not each of them represents an onset, some are tied together)
• beethoven_piano_sonatas/measures/01-1.tsv: A table with relevant information about the measures in the score.
• beethoven_piano_sonatas/harmonies/01-1.tsv: A list of the included harmony labels (including cadences and phrases) with their positions in the score.

Opening Scores

After navigating to your local copy, you can open the scores in the folder MS3 with the free and open source score editor MuseScore. Please note that the scores have been edited, annotated and tested with MuseScore 3.6.2. MuseScore 4 has since been released and preliminary tests suggest that it renders them correctly.

Opening TSV files in a spreadsheet

Tab-separated value (TSV) files are like Comma-separated value (CSV) files and can be opened with most modern text editors. However, for correctly displaying the columns, you might want to use a spreadsheet or an addon for your favourite text editor. When you use a spreadsheet such as Excel, it might annoy you by interpreting fractions as dates. This can be circumvented by using Data --> From Text/CSV or the free alternative LibreOffice Calc. Other than that, TSV data can be loaded with every modern programming language.

Loading TSV files in Python

Since the TSV files contain null values, lists, fractions, and numbers that are to be treated as strings, you may want to use this code to load any TSV files related to this repository (provided you're doing it in Python). After a quick pip install -U ms3 (requires Python 3.10) you'll be able to load any TSV like this:

import ms3

labels = ms3.load_tsv('beethoven_piano_sonatas/harmonies/01-1.tsv')
notes = ms3.load_tsv('beethoven_piano_sonatas/notes/01-1.tsv')

How to read metadata.tsv

This section explains the meaning of the columns contained in metadata.tsv.

File information

column	content
fname	name without extension (for referencing related files)
rel_path	relative file path of the score, including extension
subdirectory	folder where the score is located
last_mn	last measure number
last_mn_unfolded	number of measures when playing all repeats
length_qb	length of the piece, measured in quarter notes
length_qb_unfolded	length of the piece when playing all repeats
volta_mcs	measure counts of first and second endings
all_notes_qb	summed up duration of all notes, measured in quarter notes
n_onsets	number of note onsets
n_onset_positions	number of unique note onsets ("slices")

Composition information

column	content
composer	composer name
workTitle	work title
composed_start	earliest composition date
composed_end	latest composition date
workNumber	Catalogue number(s)
movementNumber	1, 2, or 3
movementTitle	title of the movement

Score information

column	content
label_count	number of chord labels
KeySig	key signature(s) (negative = flats, positive = sharps)
TimeSig	time signature(s)
musescore	MuseScore version
source	URL to the first typesetter's file
typesetter	first typesetter
annotators	creator(s) of the chord labels
reviewers	reviewer(s) of the chord labels

Identifiers

These columns provide a mapping between multiple identifiers for the sonatas (not for individual movements).

column	content
wikidata	URL of the WikiData item
viaf	URL of the Virtual International Authority File (VIAF) entry
musicbrainz	MusicBrainz identifier
imslp	URL to the wiki page within the International Music Score Library Project (IMSLP)

Generating all TSV files from the scores

When you have made changes to the scores and want to update the TSV files accordingly, you can use the following command (provided you have pip-installed ms3):

ms3 extract -M -N -X -D # for measures, notes, expanded annotations, and metadata

If, in addition, you want to generate the reviewed scores with out-of-label notes colored in red, you can do

ms3 review -M -N -X -D # for extracting measures, notes, expanded annotations, and metadata

By adding the flag -c to the review command, it will additionally compare the (potentially modified) annotations in the score with the ones currently present in the harmonies TSV files and reflect the comparison in the reviewed scores.

Questions, Suggestions, Corrections, Bug Reports

For questions, remarks etc., please create an issue and feel free to fork and submit pull requests.

License

Creative Commons Attribution-NonCommercial-ShareAlike 4.0 (CC BY-NC-SA 4.0).

Overview

beethoven_piano_sonatas

file_name	measures	labels	standard
01-1	152	241	2.3.0
01-2	61	200	2.3.0
01-3	73	132	2.3.0
01-4	196	355	2.3.0
02-1	336	479	2.3.0
02-2	80	244	2.3.0
02-3	68	124	2.3.0
02-4	187	339	2.3.0
03-1	257	487	2.3.0
03-2	82	233	2.3.0
03-3	127	198	2.3.0
03-4	312	793	2.3.0
04-1	362	0
04-2	90	0
04-3	150	0
04-4	186	0
05-1	284	310	2.3.0
05-2	112	252	2.3.0
05-3	122	313	2.3.0
06-1	202	338	2.3.0
06-2	170	236	2.3.0
06-3	150	308	2.3.0
07-1	344	527	2.3.0
07-2	87	218	2.3.0
07-3	86	92	2.3.0
07-4	113	266	2.3.0
08-1	310	503	2.3.0
08-2	73	143	2.3.0
08-3	210	365	2.3.0
09-1	161	351	2.3.0
09-2	178	235	2.3.0
09-3	131	262	2.3.0
10-1	200	355	2.3.0
10-2	90	330	2.3.0
10-3	254	318	2.3.0
11-1	199	0
11-2	77	0
11-3	46	0
11-4	199	0
12-1	219	0
12-2	95	0
12-3	75	0
12-4	170	0
13-1	88	0
13-2	147	0
13-3	26	0
13-4	285	0
14-1	69	0
14-2	60	0
14-3	201	0
15-1	462	0
15-2	103	0
15-3	94	0
15-4	210	0
16-1	325	303	2.3.0
16-2	119	285	2.3.0
16-3	275	703	2.3.0
17-1	228	352	2.3.0
17-2	103	223	2.3.0
17-3	399	460	2.3.0
18-1	253	269	2.3.0
18-2	169	273	2.3.0
18-3	61	178	2.3.0
18-4	333	410	2.3.0
19-1	110	193	2.3.0
19-2	164	384	2.3.0
20-1	122	286	2.3.0
20-2	120	169	2.3.0
21-1	302	616	2.3.0
21-2	28	82	2.3.0
21-3	543	739	2.3.0
23-1	262	434	2.3.0
23-2	97	220	2.3.0
23-3	361	395	2.3.0
24-1	105	286	2.3.0
24-2	183	317	2.3.0
26-1	255	537	2.3.0
26-2	42	127	2.3.0
26-3	196	317	2.3.0
30-1	99	252	2.3.0
30-2	177	320	2.3.0
30-3	203	656	2.3.0
31-1	116	339	2.3.0
31-2	158	201	2.3.0
31-3	212	644	2.3.0
32-1	157	576	2.3.0
32-2	177	869	2.3.0

chopin_mazurkas

file_name	measures	labels	standard
BI105-2op30-2	64	116	2.3.0
BI105-3op30-3	95	159	2.3.0
BI105-4op30-4	139	228	2.3.0
BI115-1op33-1	48	90	2.3.0
BI115-2op33-2	135	202	2.3.0
BI115-3op33-3	48	119	2.3.0
BI115-4op33-4	224	374	2.3.0
BI122op41-2	68	143	2.3.0
BI126-1op41-4	74	151	2.3.0
BI126-3op41-1	139	233	2.3.0
BI126-4op41-3	78	120	2.3.0
BI134	224	312	2.3.0
BI140	247	213	2.3.0
BI145-1op50-1	104	216	2.3.0
BI145-2op50-2	103	152	2.3.0
BI145-3op50-3	192	309	2.3.0
BI153-1op56-1	204	444	2.3.0
BI153-2op56-2	84	156	2.3.0
BI153-3op56-3	220	481	2.3.0
BI157-1op59-1	130	257	2.3.0
BI157-2op59-2	111	209	2.3.0
BI157-3op59-3	154	358	2.3.0
BI16-1	32	50	2.2.0
BI16-2	32	47	2.3.0
BI162-1op63-1	102	169	2.3.0
BI162-2op63-2	56	80	2.3.0
BI162-3op63-3	76	123	2.3.0
BI163op67-4	80	118	2.3.0
BI167op67-2	56	78	2.3.0
BI168op68-4	40	80	2.3.0
BI18op68-2	64	127	2.3.0
BI34op68-3	60	109	2.3.0
BI38op68-1	72	139	2.3.0
BI60-1op06-1	72	204	2.3.0
BI60-2op06-2	72	105	2.3.0
BI60-3op06-3	90	145	2.3.0
BI60-4op06-4	24	67	2.3.0
BI61-1op07-1	64	104	2.3.0
BI61-2op07-2	56	114	2.3.0
BI61-3op07-3	105	205	2.3.0
BI61-4op07-4	44	104	2.3.0
BI61-5op07-5	20	38	2.3.0
BI71	68	122	2.3.0
BI73	32	44	2.3.0
BI77-1op17-1	60	112	2.3.0
BI77-2op17-2	68	171	2.3.0
BI77-3op17-3	81	214	2.3.0
BI77-4op17-4	132	226	2.3.0
BI85	57	91	2.3.0
BI89-1op24-1	64	123	2.3.0
BI89-2op24-2	120	226	2.3.0
BI89-3op24-3	43	65	2.3.0
BI89-4op24-4	146	294	2.3.0
BI93-1op67-1	60	94	2.3.0
BI93-2op67-3	56	97	2.3.0

debussy_suite_bergamasque

file_name	measures	labels	standard
l075-01_suite_prelude	89	274	2.3.0
l075-02_suite_menuet	104	305	2.3.0
l075-03_suite_clair	72	150	2.3.0
l075-04_suite_passepied	156	284	2.3.0

dvorak_silhouettes

file_name	measures	labels	standard
op08n01	52	80	2.3.0
op08n02	15	67	2.3.0
op08n03	72	238	2.3.0
op08n04	59	136	2.3.0
op08n05	80	139	2.3.0
op08n06	60	113	2.3.0
op08n07	38	167	2.3.0
op08n08	57	100	2.3.0
op08n09	61	97	2.3.0
op08n10	58	104	2.3.0
op08n11	44	88	2.3.0
op08n12	78	210	2.3.0

grieg_lyric_pieces

file_name	measures	labels	standard
op12n01	23	43	2.3.0
op12n02	79	125	2.3.0
op12n03	52	110	2.3.0
op12n04	72	97	2.3.0
op12n05	40	109	2.3.0
op12n06	56	126	2.3.0
op12n07	56	74	2.3.0
op12n08	32	78	2.3.0
op38n01	86	141	2.3.0
op38n02	41	46	2.3.0
op38n03	48	87	2.3.0
op38n04	36	66	2.3.0
op38n05	41	70	2.3.0
op38n06	47	104	2.3.0
op38n07	53	55	2.3.0
op38n08	84	130	2.3.0
op43n01	42	102	2.3.0
op43n02	30	98	2.3.0
op43n03	35	112	2.3.0
op43n04	36	52	2.3.0
op43n05	36	110	2.3.0
op43n06	72	127	2.3.0
op47n01	184	158	2.3.0
op47n02	126	183	2.3.0
op47n03	106	93	2.3.0
op47n04	38	21	2.3.0
op47n05	41	109	2.3.0
op47n06	74	83	2.3.0
op47n07	97	134	2.3.0
op54n01	61	110	2.3.0
op54n02	159	286	2.3.0
op54n03	194	267	2.3.0
op54n04	63	91	2.3.0
op54n05	204	118	2.3.0
op54n06	90	171	2.3.0
op57n01	146	313	2.3.0
op57n02	125	183	2.3.0
op57n03	67	186	2.3.0
op57n04	92	116	2.3.0
op57n05	169	202	2.3.0
op57n06	95	156	2.3.0
op62n01	90	72	2.3.0
op62n02	81	163	2.3.0
op62n03	65	95	2.3.0
op62n04	81	97	2.3.0
op62n05	62	45	2.3.0
op62n06	150	173	2.3.0
op65n01	173	203	2.3.0
op65n02	26	128	2.3.0
op65n03	58	87	2.3.0
op65n04	71	112	2.3.0
op65n05	48	128	2.3.0
op65n06	179	222	2.3.0
op68n01	56	156	2.3.0
op68n02	88	186	2.3.0
op68n03	114	134	2.3.0
op68n04	90	85	2.3.0
op68n05	43	95	2.3.0
op68n06	202	200	2.3.0
op71n01	95	180	2.3.0
op71n02	54	107	2.3.0
op71n03	79	72	2.3.0
op71n04	77	87	2.3.0
op71n05	98	155	2.3.0
op71n06	32	133	2.3.0
op71n07	74	74	2.3.0

liszt_pelerinage

file_name	measures	labels	standard
160.01_Chapelle_de_Guillaume_Tell	97	174	2.3.0
160.02_Au_Lac_de_Wallenstadt	112	84	2.3.0
160.03_Pastorale	48	200	2.3.0
160.04_Au_Bord_dUne_Source	66	465	2.3.0
160.05_Orage	160	307	2.1.1
160.06_Vallee_dObermann	216	631	2.3.0
160.07_Eglogue	117	214	2.1.1
160.08_Le_Mal_du_Pays_(Heimweh)	70	200	2.1.1
160.09_Les_Cloches_de_Geneve_(Nocturne)	188	205	2.1.1
161.01_Sposalizio	133	237	2.1.1
161.02_Il_Pensieroso	48	88	2.3.0
161.03_Canzonetta_del_Salvator_Rosa	75	274	2.3.0
161.04_Sonetto_47_del_Petrarca	95	153	2.3.0
161.05_Sonetto_104_del_Petrarca	79	121	2.3.0
161.06_Sonetto_123_del_Petrarca	84	149	2.3.0
161.07_Apres_une_lecture_du_Dante	373	631	2.3.0
162.01_Gondoliera	125	121	2.3.0
162.02_Canzone	60	98	2.3.0
162.03_Tarantella_da_Guillaume_Louis_Cottrau._Presto_e_canzone_napolitana	479	716	2.1.1

medtner_tales

file_name	measures	labels	standard
op08n01	81	213	2.2.0
op14n01	85	265	2.2.0
op26n01	47	180	2.2.0
op26n02	65	166	2.2.0
op26n03	81	116	2.2.0
op26n04	77	300	2.2.0
op34n01	237	669	2.2.0
op34n02	48	195	2.2.0
op34n03	144	408	2.2.0
op34n04	61	323	2.2.0
op35n01	75	272	2.2.0
op35n02	139	422	2.2.0
op35n03	80	320	2.2.0
op35n04	122	345	2.2.0
op42n01	134	479	2.2.0
op42n02	67	178	2.2.0
op42n03	182	552	2.2.0
op48n01	553	1020	2.2.0
op48n02	186	307	2.2.0

schumann_kinderszenen

file_name	measures	labels	standard
n01	22	44	2.3.0
n02	40	123	2.3.0
n03	31	58	2.3.0
n04	17	53	2.3.0
n05	16	48	2.3.0
n06	24	84	2.3.0
n07	24	71	2.3.0
n08	32	73	2.3.0
n09	24	46	2.3.0
n10	57	67	2.3.0
n11	48	140	2.3.0
n12	32	92	2.3.0
n13	25	49	2.3.0

tchaikovsky_seasons

file_name	measures	labels	standard
op37a01	103	313	2.3.0
op37a02	169	278	2.3.0
op37a03	46	119	2.3.0
op37a04	86	210	2.3.0
op37a05	88	193	2.3.0
op37a06	99	263	2.3.0
op37a07	56	179	2.3.0
op37a08	198	514	2.3.0
op37a09	90	368	2.3.0
op37a10	56	193	2.3.0
op37a11	83	168	2.3.0
op37a12	176	261	2.3.0