tlverse/hal9001

supporting active-set convergence

Closed this issue · 3 comments

In their Lasso implementation in the glmnet package, Hastie et al. note that

Considerable speedup is obtained by organizing the iterations around the
active set of features—those with nonzero coefficients. After a complete cycle
through all the variables, we iterate on only the active set till convergence. If
another complete cycle does not change the active set, we are done, otherwise
the process is repeated. Active-set convergence is also mentioned in Meier
et al. [2008] and Krishnapuram and Hartemink [2005].

We could very likely speed up our implementation by incorporating this procedure.

@jeremyrcoyle -- This is already incorporated in an un-pushed commit, yes?

Yes, but a kludgey version, definitely be more work to be done on this one

Fixed in #23