georgian-io/LLM-Finetuning-Toolkit
Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.
PythonApache-2.0
Issues
- 0
UnicodeDecodeError: 'charmap' codec can't decode byte 0x8d in position 101: character maps to <undefined>
#193 opened by jeetendraabvv - 1
- 0
Eval Step - Give Throughput Statistics
#188 opened by benjaminye - 1
- 0
Allow custom train/test datasets
#140 opened by akashsaravanan-georgian - 0
[RichUI] Better Dataset Generation Display
#98 opened by benjaminye - 3
Add GitHub Actions CI for checking style, running tests, publishing Docker images, PyPI packages, and documentation.
#106 opened by truskovskiyk - 0
Add data distributed training capabilities.
#113 opened by truskovskiyk - 1
- 0
- 3
- 0
[LLM Test] Exact Match
#179 opened by benjaminye - 2
- 1
- 0
Allow users to set verbosity of outputs
#147 opened by benjaminye - 0
- 2
How do you handle history?
#133 opened by angeliney - 2
UnicodeEncodeError: 'charmap' codec can't encode character '\u2264' in position in command prompt
#175 opened by jeetendraabvv - 8
UnicodeEncodeError: 'charmap' codec can't encode character '\U0001f648' in position 0: character maps to <undefined>
#174 opened by jeetendraabvv - 1
Add ROADMAP section to the Readme
#141 opened by truskovskiyk - 0
[LoRA] Use Validation Set
#119 opened by benjaminye - 2
Publish the documentation on Netlify or GitHub Pages instead of the current solution.
#111 opened by truskovskiyk - 2
Add a Makefile to simplify the execution of tests, styling, and other Bash commands.
#105 opened by truskovskiyk - 4
cuda device-side runtime error when training on custom dataset for JSON outputs
#170 opened by SinclairHudson - 1
JSON output test
#169 opened by SinclairHudson - 2
quickstart basic - missing qa/llm_tests:?
#159 opened by richardehughes - 1
- 1
Add unit tests for the code.
#143 opened by truskovskiyk - 0
[CLI] Add `llmtune inference [experiment_dir]`
#161 opened by benjaminye - 1
`pipx` installation doesn't work
#135 opened by angeliney - 2
- 0
Remove unused `accelerate` code
#144 opened by benjaminye - 1
- 0
CLI to Generate Example `config.yml`
#129 opened by benjaminye - 0
`jsonl` support
#132 opened by benjaminye - 0
[README] Image not showing up on PyPI
#124 opened by benjaminye - 1
Rename the current Installation section to the Development section, and add a new Installation section with simplified instructions for installing the PyPI package
#112 opened by truskovskiyk - 0
Update README with instructions ho-to pull docker image and install pipy package.
#110 opened by truskovskiyk - 0
Add docker image package.
#109 opened by truskovskiyk - 1
Add versioning convention for the package.
#114 opened by truskovskiyk - 3
- 0
Update Entrypoint of the CLI
#117 opened by benjaminye - 0
Add pipy package.
#108 opened by truskovskiyk - 0
- 0
[Toolkit] Parameterize config file path
#90 opened by benjaminye - 1
- 1
Training of FlanT5 for summarization
#75 opened by kel-varnsen - 4
- 3
question about fine tuning falcon
#57 opened by charlesmartin14 - 2
Latency and Throughput Calculation
#58 opened by jerin-scalers-ai