/tensor-methods

Tensor decomposition for (symmetric/asymmetric tensor power iterations) for some latent variable models

Primary LanguageJupyter Notebook

tensor-mehods

Symmetric and Asymmetric tensor power iterations to estimate the parameters of the single topic model

Thoughts: Robustness is a big problem associated with spectral methods; e.g. we can get "negative probabilities" (i.e. note that provable gurantees stated in terms of additive errors, and could thus for parameters for distributions like multinomial, we can have sum_i(p_i)=1 but some p_i negative) if we don't have enough samples, or if the moment tensor has a large magnitude of perturbation. This makes spectral method tricky to work in practice.