Softmax regression, weights going to infinity in deep HMEs

[AmazaspShumik]

In deep trees there are cases where there is complete separability of data , in that case softmax regression (version which is not overparameterised) suffers from the same problem as logistic regression.
Should use overparameterised version (slower convergence since non-unique solution for short trees).