Convolutional Neural Tangent Kernel In order to better understand how Deep neural architectures learn and generalize, we study the Neural Tangent Kernel regression while the Nets are trained.