dtch1997/tms-kit

Dead features in SAE

dtch1997 opened this issue · 1 comments

dtch1997 commented

This has come up in two different ways:

  • Firstly, the SAEs I train on the TMS consistently have one dead feature
  • Secondly, the SAEs I train on the feature absorption setting also consistently have a dead feature

Not sure why this happens at the moment. They're very likely to be related though.

dtch1997 commented

Solved by tuning L1 coefficient