fheinsen

Pinned Repositories

• git-gpg

  Use git on an untrusted server via a GPG-encrypted repository.

  Language:Python32524

• heinsen_attention

  Reference implementation of "Softmax Attention with Constant Cost per Token" (Heinsen, 2024)

  Language:Python220

• heinsen_routing

  Reference implementation of "An Algorithm for Routing Vectors in Sequences" (Heinsen, 2022) and "An Algorithm for Routing Capsules in All Domains" (Heinsen, 2019), for composing deep neural networks.

  Language:Python16110317

• heinsen_routing_2022_paper

  Instructions for replicating the results in "An Algorithm for Routing Vectors in Sequences" (Heinsen, 2022).

  Language:Jupyter Notebook0210

• heinsen_sequence

  Code implementing "Efficient Parallelization of a Ubiquitious Sequential Computation" (Heinsen, 2023)

  71213

• heinsen_tree

  Reference implementation of "Tree Methods for Hierarchical Classification in Parallel" (Heinsen, 2022) in PyTorch.

  Language:Python14300

• torch_lsuv_init

  Layer Sequential Unit Variance (LSUV) Initialization for PyTorch

  Language:Python21

• torch_train_test_loop

  Composable training/testing of PyTorch models with minimal overhead

  Language:Python1400

• fft-scan

  Efficient PScan implementation in PyTorch

  Language:Jupyter Notebook16121

fheinsen's Repositories