/falcon-tools

tools for falcon model

Primary LanguagePython

falcon-tools

Tools to run and finetune falcon models

To run the code:

# if you are using AMD gpu, install bitsandbytes from https://github.com/Lzy17/bitsandbytes-rocm

pip install -r bitsandbytes

# Model inferecne
python inference.py

# Model finetune
python finetune.py

# You could change your model in both codes.