georgian-io/LLM-Finetuning-Toolkit

`jsonl` support

benjaminye opened this issue 7 months ago · 0 comments

benjaminye commented 7 months ago

see related issue: ICRAR/ijson#96

Change this file to include JSONL and pass the correct parameter as mentioned above. https://github.com/georgian-io/LLM-Finetuning-Toolkit/blob/main/llmtune/data/ingestor.py