Easy to use model parallel large language models in JAX/Flax with pjit support on cloud TPU pods.
Primary LanguagePythonApache License 2.0Apache-2.0