/Cutoff_with_Attribution

2022-2 창의적 통합 설계 1 LDI LAB

Primary LanguagePython

Cutoff_with_Attribution

2022-2 창의적 통합 설계 1 LDI LAB

Activating virtual environment

$ conda activate cutoff   # activate
$ conda deactivate

Training

$ ./run_glue {dataset name} {GPU number} {train batch size}
# ./run_glue CoLA 0 16

Cutoff types

span_cutoff, token_cutoff, dim_cutoff

Subprojects

Attention Attribution + Cutoff AttAttr-Cutoff

References

Cutoff github

Attention Attribution github

Transformer Explainability github / Colab