/VQMTCrossVal

Cross validation for objective quality metric measurement tools on multiple public datasets

Primary LanguagePython

VQMTCrossVal

Cross validation of objective quality metric measurement tools on multiple public datasets

Datasets used:

Results

CSIQ:

PLCC SROCC KROCC
DSSIM 0.803 0.946 0.793
SSIMULACRA 0.793 0.848 0.644
Butteraugli 0.767 0.902 0.722

IVC:

PLCC SROCC KROCC
DSSIM -0.758 -0.916 -0.748
SSIMULACRA -0.789 -0.834 -0.64
Butteraugli -0.607 -0.792 -0.595

JPEG XR:

PLCC SROCC KROCC
DSSIM -0.833 -0.904 -0.725
SSIMULACRA -0.849 -0.84 -0.656
Butteraugli -0.836 -0.878 -0.696

KADID-10k:

PLCC SROCC KROCC
DSSIM -0.639 -0.856 -0.67
SSIMULACRA -0.623 -0.7 -0.508
Butteraugli -0.605 -0.735 -0.546

LIVE2:

PLCC SROCC KROCC
DSSIM 0.576 0.955 0.813
SSIMULACRA 0.783 0.914 0.74
Butteraugli 0.699 0.9 0.718

TID2013:

PLCC SROCC KROCC
DSSIM -0.773 -0.861 -0.678
SSIMULACRA -0.663 -0.673 -0.485
Butteraugli -0.648 -0.76 -0.572