/Complexity-analysis-of-VVC-encoding-and-decoding

This page contains supplementary material for our paper entitled "COMPLEXITY ANALYSIS OF NEXT-GENERATION VVC ENCODING AND DECODING"

Complexity analysis of VVC encoding and decoding

This page and dataset are supplementary material for our paper titled "COMPLEXITY ANALYSIS OF NEXT-GENERATION VVC ENCODING AND DECODING". For more detailed analysis on this data, plesae refere to the preprint of our paper (accepted to be presented at IEEE ICIP 2020) on: https://arxiv.org/abs/2005.10801

Six video sequences have been encoded and decoded using VVC and HEVC (VTM 6 and HM 16 respectively), under different configurations and QPs, and all operations have been analyzed using Intel VTune 2019. The VTune outputs are reported in csv files in VTune_CSV_reports.zip.

Citation:

In case of using this dataset or the provided reports, please cite the following:

[1] Farhad Pakdaman, Mohammad Ali Adelimanesh, Moncef Gabbouj, Mahmoud Reza Hashemi,"Complexity Analysis Of Next-Generation VVC Encoding and Decoding", IEEE International Conference on Image Processing (ICIP), 2020.

[2] Farhad Pakdaman, Mohammad Ali Adelimanesh, Moncef Gabbouj, Mahmoud Reza Hashemi, "DATASET FOR COMPLEXITY ANALYSIS OF VVC ENCODING AND DECODING", IEEE Dataport, 2020. [Online]. Available: http://dx.doi.org/10.21227/p0rm-4b03.

Tabulated reports

The detailed results of this study have been categorized and tabulated through Tables 1-4 below.

Table. A1 VVC Encoder complexity break-down of different sequences, for Motion Estimation (ME), Intra Prediction (IP), Transform/QUantization (T/Q), Entropy Coding (EC), Loop Filters (LF), and Memory operations (Mem).

Seq Conf QP ME IP T/Q EC LF Mem
BQTerrace_1920x1080_60 LD 22 44.81 6.42 28.55 12.01 1.57 3.39
27 55.57 4.41 23.74 7.01 3.1 2.89
32 62.75 3.67 17.11 4.29 5.86 2.61
37 64.51 3.23 13 2.95 9.52 2.35
RA 22 42.12 8.21 30.91 10.85 1.3 3.69
27 51.33 7.08 24.65 7.02 3.39 3.07
32 55.46 7.27 18.82 5.23 6.22 2.86
37 56.89 7.2 14.36 4.14 9.98 2.43
AI 22 0 25.35 48.94 15.82 1.21 4.34
27 0 29.12 46.16 14.91 1.26 3.96
32 0 31.1 42.92 14.8 1.71 4.18
37 0 33.31 40.59 13.62 2.52 3.77
BasketballDrive_1920x1080_50 LD 22 44.05 7.67 32.11 7.74 1.1 3.92
27 52.44 7.05 24.88 5.99 1.88 3.32
32 58.16 6.13 19.83 4.68 2.99 3.39
37 60.86 5.41 16.61 3.76 5.02 3.05
RA 22 42.75 9.8 31.55 7.84 1.12 3.87
27 51.15 8.91 24.81 5.86 1.9 3.72
32 57.83 7.27 20.08 4.48 3.05 3.27
37 61.49 6.02 16.5 3.41 5.13 2.92
AI 22 0 28.63 48.33 13.6 0.95 4.04
27 0 31.51 44.41 12.36 1.82 4.14
32 0 33.27 40.45 11.6 3.27 4.3
37 0 31.43 38.36 10.49 7.11 4.1
Cactus_1920x1080_50 LD 22 45.34 6.79 31.15 8.63 1.37 3.5
27 54.47 6.23 23.04 6.31 2.7 3.42
32 59.62 5.65 18.49 4.64 3.92 3.19
37 62.08 5.3 15.96 3.61 5.21 2.82
RA 22 41.71 9.15 31.9 8.86 1.36 4.05
27 50.14 9 24.55 6.49 2.6 3.59
32 55.96 8.05 19.71 4.9 3.94 3.24
37 59.5 7.21 16.36 3.81 5.34 2.93
AI 22 0 26.51 49.55 14.99 0.74 4.15
27 0 29.44 46.36 13.65 1.25 4.15
32 0 31.42 42.75 13.28 1.93 4.43
37 0 32.31 40.74 12.12 3.36 4.31
Johnny_1280x720_60 LD 22 62.85 3.63 17.53 4.52 5.56 2.76
27 67.93 2.36 11.16 2.58 10.15 2.11
32 68.61 1.96 7.87 1.74 13.48 2.03
37 65.37 1.64 5.94 1.27 18.49 1.88
RA 22 57.79 6.18 19.3 5.32 5.24 2.76
27 61.41 5.37 13.39 3.6 9.82 2.38
32 61.7 4.96 10.79 2.93 12.47 2.23
37 57.16 5.08 9.6 2.54 17.03 2.02
AI 22 0 30.08 44.55 14.06 1.98 4.07
27 0 30.77 42.73 13.37 3.33 3.98
32 0 31.28 40.52 12.52 5.03 3.92
37 0 31.22 37.61 10.85 8.51 3.96
KristenAndSara_1280x720_60 LD 22 62.49 4.08 17.77 4.57 4.94 2.77
27 66.66 3.22 12.65 3.15 8.13 2.3
32 67.65 2.7 9.8 2.23 10.88 2.18
37 66.23 2.18 7.6 1.61 14.85 2.08
RA 22 57.08 6.69 19.86 5.62 4.58 2.85
27 61.33 5.72 14.43 3.91 8.11 2.49
32 62.31 5.31 11.74 3.16 10.19 2.34
37 58.05 5.29 10.17 2.8 15.36 2.1
AI 22 0 29.72 44.68 14.1 1.96 4.14
27 0 30.05 42.94 13.73 3.13 4.38
32 0 31.5 40.12 13.18 4.51 4.17
37 0 30.58 38.7 12.01 7.25 4.08
DaylightRoad2_3840x2160_60_10b LD 22 21.49 7.23 41.03 23.96 0.31 3.25
27 22.28 7.45 41.65 22.11 0.34 3.32
32 23.33 7.73 42.09 20.07 0.37 3.29
37 24.34 8.15 42.15 18.14 0.42 3.52
AI 22 0 23.55 46.62 22.48 0.6 3.27
27 0 23.54 47.14 21.92 0.59 3.35
32 0 24.47 47.07 20.85 0.6 3.5
37 0 23.8 48.45 19.79 0.67 3.64

Table. A2 HEVC Encoder complexity break-down

Seq Conf QP ME IP T/Q EC LF Mem
BQTerrace_1920x1080_60 LD 22 53.27 1.96 37.45 1.94 0.08 4.99
27 68.61 0.98 23.28 0.84 0.1 5.85
32 77.12 0.48 16.27 0.53 0.1 5.11
37 80.55 0.25 13.34 0.42 0.11 4.96
RA 22 49.61 2.06 40.32 2.06 0.11 5.46
27 63.95 1.12 26.55 0.97 0.13 6.83
32 71.73 0.69 20.35 0.63 0.14 5.95
37 74.93 0.5 17.38 0.54 0.15 6.02
AI 22 0 15.88 71.91 3.61 0.39 6.87
27 0 17.96 68.76 3.09 0.49 8.45
32 0 21 66.44 2.68 0.54 7.98
37 0 23.24 62.86 2.44 0.6 9.49
BasketballDrive_1920x1080_50 LD 22 60.21 1.82 31.41 1.22 0.07 5
27 68.62 1.45 23.68 0.78 0.08 5.08
32 73.92 1.04 18.98 0.6 0.09 5.07
37 76.97 0.81 16.29 0.49 0.09 5
RA 22 54.77 1.95 35.8 1.4 0.11 5.59
27 63.1 1.66 27.96 0.99 0.12 5.79
32 67.86 1.3 23.38 0.82 0.12 6.09
37 71.47 1.03 20.71 0.68 0.13 5.51
AI 22 0 17.77 70.72 2.94 0.45 6.88
27 0 21.62 65.27 2.43 0.59 8.8
32 0 24.12 62.14 2.12 0.59 9.65
37 0 25.2 60.77 2.08 0.61 10.05
Cactus_1920x1080_50 LD 22 56.1 1.88 35.04 1.44 0.09 5.15
27 67.08 1.34 25 0.82 0.09 5.34
32 72.97 0.93 19.45 0.72 0.1 5.49
37 75.95 0.71 16.94 0.52 0.1 5.43
RA 22 51.56 1.89 38.64 1.65 0.12 5.74
27 61.91 1.45 28.71 1.02 0.12 6.31
32 67.44 1.15 23.71 0.82 0.14 6.25
37 70.07 0.94 20.99 0.65 0.14 6.7
AI 22 0 16.53 72.23 3.27 0.41 6.22
27 0 19.79 68.31 2.59 0.56 7.49
32 0 22.58 64.21 2.3 0.6 8.94
37 0 24.61 62.04 2.13 0.62 9.25
Johnny_1280x720_60 LD 22 71.02 0.91 21.34 0.65 0.1 5.62
27 77.28 0.46 15.7 0.48 0.1 5.58
32 79.19 0.23 14.06 0.45 0.11 5.57
37 79.77 0.15 13.62 0.36 0.11 5.57
RA 22 66.08 1.09 25.05 0.77 0.14 6.34
27 71.53 0.66 20 0.73 0.15 6.35
32 73.33 0.53 18.2 0.61 0.15 6.58
37 73.4 0.45 17.79 0.64 0.17 6.99
AI 22 0 20.98 66.1 2.74 0.57 8.33
27 0 23.28 63.48 2.38 0.6 9.07
32 0 24.96 61 2.33 0.6 9.69
37 0 26.12 59.41 2.08 0.63 10.44
KristenAndSara_1280x720_60 LD 22 71.36 0.94 21.03 0.73 0.1 5.46
27 76.84 0.52 15.96 0.54 0.1 5.66
32 78.92 0.28 14.26 0.49 0.1 5.58
37 80.16 0.19 13.36 0.46 0.11 5.34
RA 22 67.26 1.03 24.01 0.89 0.14 6.17
27 71.04 0.65 20.47 0.7 0.13 6.44
32 72.95 0.57 18.44 0.59 0.16 6.73
37 73.74 0.52 17.94 0.62 0.16 6.51
AI 22 0 20.81 66.38 2.64 0.57 8.26
27 0 23.49 63.21 2.58 0.6 8.88
32 0 24.46 61.33 2.28 0.64 9.75
37 0 25.43 60.31 2.13 0.6 10.23
DaylightRoad2_3840x2160_60_10b LD 22 31.41 2.3 57.06 5.02 0.05 3.82
27 32.51 2.33 56.44 4.77 0.05 3.57
32 34.54 2.49 54.55 4.32 0.06 3.75
37 37.25 2.61 51.72 3.86 0.06 4.22
AI 22 0 14.65 73.91 5.22 0.35 4.29
27 0 14.96 73.71 4.99 0.36 4.47
32 0 15.36 73.02 5.03 0.39 4.69
37 0 15.86 71.91 4.64 0.39 5.8

Table. A3 VVC Decoder complexity break-down of different sequences, for Motion Compensation (MC), Intra Prediction (IP), Inverse Transform/ Inverse Quantization (IT/IQ), Entropy Decoding (ED), Loop Filters (LF), and Memory operations (Mem).

Seq Conf QP MC IP IT/IQ ED LF Mem
BQTerrace_1920x1080_60 LD 22 18.81 0.45 6.19 27.06 29.82 5.37
27 21.5 0.6 3.29 14.17 33.27 10.72
32 25.65 0.42 2.55 9.06 34.62 10
37 27.98 0.94 1.06 4.8 31.73 14.85
RA 22 21.74 1.26 4.14 23.86 29.98 6.99
27 29.82 1.69 2.33 12.31 34.57 7.3
32 39.04 2.2 1.83 7.29 29.46 7.73
37 41.11 2.68 1.34 5.47 26.6 7.39
AI 22 0 11.09 8.22 39.47 24.74 3.63
27 0 13.83 6.82 34.49 28.11 5.97
32 0 14.43 12.38 21.8 32.12 7.88
37 0 15.32 6.93 19.45 36.41 10.41
BasketballDrive_1920x1080_50 LD 22 15.79 3.2 8.23 18.26 32.72 7.34
27 19.19 2.9 7.13 12.72 35.81 7.97
32 21.96 2.28 9.43 9.11 33.67 9.6
37 24.28 1.57 5.24 8.08 34.59 7
RA 22 21.35 4.66 5.66 17.9 32.33 6.9
27 27.5 4.51 5.52 10.01 32.39 8.5
32 30.89 3.14 6.22 6.54 31.97 7.38
37 37.65 2.97 2.97 5.86 32 6.33
AI 22 0 11.58 9.71 31.49 28.2 9.27
27 0 9.69 8.89 29.66 34.64 5.72
32 0 15.99 11.42 15.22 39.61 7.62
37 0 16.51 9.88 10.04 41.27 12.56
Cactus_1920x1080_50 LD 22 21.34 0.82 6.86 20.33 31.01 6.46
27 22.13 2 6.92 10.66 35.61 8.47
32 24.69 1.08 4.49 7.66 37.89 7.55
37 24.46 0.65 6.06 6.82 33.9 9.76
RA 22 21.99 2.6 6.38 19.34 30.21 7.39
27 29.39 1.84 4.07 10.71 33.05 7.68
32 30.62 1.57 3.84 7.66 34.55 7.98
37 32.39 4.08 2.91 7.42 28.55 5.6
AI 22 0 13 10.54 37.21 24.05 5.27
27 0 15.65 11.17 26.24 33.33 3.89
32 0 14.59 7.29 22.33 35.24 10.34
37 0 15.19 6.85 18.63 38.01 9.9
Johnny_1280x720_60 LD 22 22.65 0 3.63 10.49 35.66 6.46
27 23.39 0 4.07 7.2 29.24 10.18
32 25.71 0.61 2.45 4.29 24.49 4.9
37 27.33 1.48 0.74 5.17 25.55 6.16
RA 22 29.91 1.26 2.02 9.31 35.75 7.29
27 35.73 2.32 1.39 5.11 30.63 6.03
32 35.49 0.58 0.57 6.87 20.01 10.87
37 35.47 1.87 1.87 6.08 18.03 6.84
AI 22 0 8.22 5.48 34.22 28.77 9.58
27 0 15.01 10.04 23.4 33.41 1.67
32 0 9.45 11.32 11.32 35.91 11.34
37 0 10.93 17.53 13.12 32.9 4.36
KristenAndSara_1280x720_60 LD 22 15.45 1.22 4.47 13.32 32.99 9.36
27 21.96 0.49 2.47 8.29 34.05 10.86
32 23.96 0.58 1.74 4.69 32.75 6.96
37 28 0.7 1.4 4.73 19.62 7.71
RA 22 34.58 1.18 1.97 7.85 32.6 4.32
27 34.03 1.39 2.31 4.62 32.69 6.01
32 34.38 1.14 1.14 7.59 19.58 5.69
37 42.38 1.19 1.79 5.67 21.32 3.58
AI 22 0 7.7 14.1 30.75 32.07 1.28
27 0 13.62 6.05 19.18 33.31 4.54
32 0 12.74 8.66 19.16 30.73 12.2
37 0 7.27 11.63 10.65 39.81 13.56
DaylightRoad2_3840x2160_60_10b LD 22 6.15 4.26 4.95 45.14 18.38 3.13
27 7.87 3.97 5.2 43.6 21.05 3.58
32 8.74 4 4.88 40.57 24.35 3.71
37 9.98 3.72 4.79 37.73 26.78 4.11
AI 22 0 7.93 6.92 43.75 17.02 3.79
27 0 6.79 6.27 47.71 17.96 3.13
32 0 6.5 8.64 46.26 18.23 5.19
37 0 6.94 11.42 41.67 20.77 6.15

Table. A4 HEVC Decoder complexity break-down

Seq Conf QP MC IP IT/IQ ED LF Mem
BQTerrace_1920x1080_60 LD 22 32.16 0.52 6.51 19.4 15.79 6.22
27 37.83 0.67 5.09 7.19 16.65 9.71
32 43.09 0.87 2.69 2.93 13.37 10.21
37 45.75 0.88 1.23 1.43 11.79 10.17
RA 22 31.28 3.02 6.52 16.15 16.23 6.14
27 38.38 2.32 3.85 6.99 14.15 9.16
32 44.46 2.21 2.71 3.52 11.64 8.35
37 46.1 2.44 1.6 1.56 10.79 8.38
AI 22 0 20.16 10.71 29.56 13.32 4.17
27 0 22.76 11.73 21.9 18.52 5.63
32 0 23.97 12.43 17.04 21.87 5.34
37 0 28.89 10.08 11.43 22.98 6.56
BasketballDrive_1920x1080_50 LD 22 29.18 3.99 12.05 12.01 17.04 7.01
27 33.12 3.95 11.26 6 16.51 8.22
32 35.07 2.77 9.42 4.41 14.69 9.04
37 37.16 3.07 7.08 2.2 14.88 8.89
RA 22 28.94 6.87 9.03 10.1 16.78 7.55
27 35.35 4.84 8.32 5.45 14.37 8.07
32 38.26 5.14 5.55 3.27 14.03 8.07
37 39.39 4.17 5.51 2.18 13.41 8.35
AI 22 0 19.91 16.31 21.57 17.04 5.47
27 0 23.01 17.65 11.6 21.69 5.99
32 0 24.3 18.02 8.2 23.04 6.6
37 0 23.41 19.71 5.88 22 7.87
Cactus_1920x1080_50 LD 22 24.84 1.75 9.37 15.42 18.23 8.53
27 25.76 1.48 9.37 7.98 18.13 10.32
32 26.79 1.95 7.66 3.8 17.38 11.02
37 23.56 1.81 7.05 2.6 17.02 11.79
RA 22 26.15 4.43 6.25 13.43 17.88 8.83
27 29.7 4.42 6.81 6.59 15.15 8.98
32 31.05 3.85 5.27 3.27 14.93 10.82
37 32.26 3.1 4.85 2.18 14.44 10.92
AI 22 0 20.53 12.26 27.13 15.27 4.55
27 0 24.19 14.1 17.1 21.04 5.19
32 0 24.62 14.5 13.02 22.96 6.26
37 0 26.33 14.42 8.15 22.89 7.79
Johnny_1280x720_60 LD 22 26.88 0.35 4.59 6.51 17.02 10.35
27 28.17 0.71 3.75 1.83 14.13 12.03
32 25.45 0.7 1.83 1.47 13.86 11.81
37 19.54 0.69 1.96 0.61 14.34 15.09
RA 22 30.83 2.01 3.06 6.22 14.83 8.66
27 32.62 2.16 2.74 1.77 12.43 11.53
32 32.26 1.8 1.92 1.52 13.03 9.84
37 31.07 2.27 1.17 1.11 11.74 10.64
AI 22 0 21.65 14.62 13.63 20.79 6.26
27 0 26.01 12.43 10.03 21.3 6.54
32 0 25.56 12.45 6.77 22.59 6.15
37 0 25.79 11.84 5.31 23.55 7.87
KristenAndSara_1280x720_60 LD 22 29.88 0.74 5.33 5.44 18.51 8.96
27 28.95 0.72 3.34 1.97 15.1 12.62
32 25.06 0.82 3.18 1.84 16.35 13.1
37 25.42 1.04 0.72 0.8 14.86 13.41
RA 22 31.52 2.35 3.25 5.24 16.78 9.73
27 32.67 2.11 2.03 2.55 13.49 10.18
32 34.34 2.25 1.95 1.32 13.11 8.95
37 30.81 2.44 1.04 0.75 12.96 11.59
AI 22 0 22.62 13.03 15.96 21.51 5.84
27 0 23.27 12.91 13.57 22.34 6.33
32 0 24.54 14.1 9.13 22.98 5.27
37 0 25.51 12.97 6.63 22.26 7.53
DaylightRoad2_3840x2160_60_10b LD 22 7.31 7.22 4.01 39.6 9.4 4.1
27 7.91 8.33 5.78 39.97 11.94 4.64
32 9.88 10.01 5.23 34.69 13.82 5.31
37 8.97 10.27 5.95 33.63 15.16 5.44
AI 22 0 17.39 4.5 37.72 10.93 3.6
27 0 18.02 5.17 37.95 11.8 3.48
32 0 21.09 4.51 35.96 12.83 3.71
37 0 20.79 5.63 34.63 14.15 4.59