supporting active-set convergence
Closed this issue · 3 comments
nhejazi commented
In their Lasso implementation in the glmnet
package, Hastie et al. note that
Considerable speedup is obtained by organizing the iterations around the
active set of features—those with nonzero coefficients. After a complete cycle
through all the variables, we iterate on only the active set till convergence. If
another complete cycle does not change the active set, we are done, otherwise
the process is repeated. Active-set convergence is also mentioned in Meier
et al. [2008] and Krishnapuram and Hartemink [2005].
We could very likely speed up our implementation by incorporating this procedure.
nhejazi commented
@jeremyrcoyle -- This is already incorporated in an un-pushed commit, yes?
jeremyrcoyle commented
Yes, but a kludgey version, definitely be more work to be done on this one
jeremyrcoyle commented
Fixed in #23