JRC1995/Virtues-of-Sparsity

Attempted implementation and experiment with continuous sparsification and sparse representaions (with k-winner activation along with duty cycles and everything) with Transformers on Named Entity Recognition (CoNLL 2003).

Python