lunabrain-ai/dolly-v2-12b-8bit-example
This repo loads the Dolly V2 12b model (databricks/dolly-v2-12b) using the `transformers` library. The code loads it in 8-bit quantized mode.
PythonApache-2.0
Stargazers
- alaypanov
- breadchrisLunaSec
- Evie-Fox
- freeqaz@lunasec-io
- guybarnardSynchronous Health
- iseanstevensSF
- jatencio
- jaytimmUniversity of New Mexico
- jclark-sda
- jgmizeTulsa, OK
- kai-ten
- kartikmehta09
- Kom60
- kwartler
- llIllIllllIIIlllllll
- lxe@netflix
- m1chae1bx
- MilleniumSpark
- montumodiLondon
- n2em
- quietguyproductions?
- Ryqsky广州
- silenceonthelamNew York, NY
- sneheshtCharlotte, NC
- spencerTL
- ViktorDolezel
- zwolftech