shmap

There are 2 repositories under shmap topic.

fattorib/transformer_shmap
Tensor Parallelism with JAX + Shard Map
Language:Python10 1 01
azzeddineCH/flash-nanoGPT
Jax/Flax re-write of @karpathy 🐐 NanoGPT using some of the common Jax libraries/features (shmap, pallas, jmp, optax, orbax)
Language:Python3 2 11