/Pool_PaRTI

Pooling by PageRank Token Importance. This is a weighted average pooling method where the weights are derived from the internal attention matrices of the encoder.

Primary LanguageJupyter NotebookApache License 2.0Apache-2.0

Watchers