remove kernels 4.18 and 5.4 (aarch64) from tests matrix

[geyslan]

Description

Drop support of aarch64 4.18 and 5.4.

[yanivagman]

#4247