Refactor the memory allocation part

[Kaiser-Yang]

In our matix, we find that every constructor and some assignments consist of this part:

This part is easily reused. Use a private method to reuse the codes.