kingoflolz/swarm-jax
Swarm training framework using Haiku + JAX + Ray for layer parallel transformer language models on unreliable, heterogeneous nodes
Python
Stargazers
- AmrMKayidco:X
- aowen14
- chengchingwen
- ClashLuke@deepjudge-ai
- DevSinghSachanMontreal
- dmrd
- DonsetPGMINES Paristech
- fly51flyPRIS
- gbennett71
- generic-github-userUnited States
- jacksonwbPortland, OR
- jeanru
- jeffhsu3Ivy Natal
- jekbradburyGoogle
- jmerizia
- joaogui1
- JorgeCejaStealth
- jvalinsky
- Lev1ty@google
- lucidrainsSan Francisco
- ludgerpaehlerTechnical University of Munich
- luiscape@modal-labs
- ninfueng@tamukohlaboratory
- odellus@phytomech
- phinate@alan-turing-institute
- planetceresSan Francisco Bay Area
- rahulbhadaniThe University of Alabama in Huntsville
- rcshubhadeepGoa
- rish-16@KrishnaswamyLab @caraml-group
- shyamsn97
- srihari-humbarwadi@intel
- srk97@cohere-ai @proteinqure @for-ai
- stephengouUniversity of Toronto
- swcrazyfan
- vicgalleKomorebi AI & ICMAT-CSIC
- vladdy