Pinned Repositories
DRUGS
Stop messing around with finicky sampling parameters and just use DRµGS!
json_repair
A python module to repair invalid JSON, commonly used to parse the output of LLMs
exllamav2
A fast inference library for running LLMs locally on modern consumer-class GPUs
xonfour's Repositories
xonfour doesn’t have any repository yet.