The MultiScale Network for hierarchical regression (MS-Net) performs 3D regression based on a hierarchical principle: coarse inputs provide broad information about the data, and progressively finer-scale inputs can be used to refine this information.