factor initialization

Question

factor initialization

bhomass opened this issue 6 years ago · 2 comments

Any one see the logic in how the factors were initialized? apparently using QR decomposition to obtain 2 orthogonal matrices, dot product them by the lower of the two matrix dimensions, then divide by the square root of (n_topics + n_dim)

Does this guarantee a simplex condition? what exactly does this calculation do for you?

Answer 1 · 2018-09-16T06:20:10.000Z

found this

https://stackoverflow.com/questions/38426349/how-to-create-random-orthonormal-matrix-in-python-numpy

Answer 2 · 2018-09-16T18:57:15.000Z

Having determined that the initialization aims to generate orthonormal random vectors, I see no basis in that requirement at all from the original paper. What would you want to impose orthogonality among the initial topic mixture?