How can I fine tune sqlcoder-7b 2 model over my onw query?

Question

How can I fine tune sqlcoder-7b 2 model over my onw query?

kasldsaknf opened this issue a year ago · 6 comments

Answer 1 · 2024-02-23T07:25:55.000Z

Hi there, you can use any of the fine-tuning approaches made available by open-source libraries. For instance, using TRL or axolotl

Please remember to open-source any fine-tunes you make, to comply with the model's cc-by-sa-4.0 license

Answer 2 · 2024-02-23T07:56:36.000Z

Thank you very much for the open source work and models. I dont know it well. Should I use the Llama finetuning script and instructions for defog/sqlcoder-7b-2? I see "llama" tag on the huggingface :)

Answer 3 · 2024-02-23T10:20:29.000Z

Yup - the Llama finetuning script should work well!

Answer 4 · 2024-03-02T13:04:12.000Z

@kasldsaknf did you have a chance to establish a new finetuning on top of sqlcoder model using your own dataset? if yes please share your script/code.

Thank you.

Answer 5 · 2024-03-08T01:00:24.000Z

@mellahysf I haven't fine tune sqlcoder over my own dataset. I think Llama's fine tune code should work. Did you meet some probelms now?

Answer 6 · 2024-03-08T01:01:01.000Z

Yup - the Llama finetuning script should work well!

Thank you. I will try.