Specific model TheBloke/WizardLM-Uncensored-Falcon-7B-GGML:q4_k_m doesn't use a specific folder
Closed this issue · 3 comments
It will be nice to have a specific folder name when a specific model file is requested through filtering.
-m TheBloke/WizardLM-33B-V1.0-Uncensored-GGML:q4_K_M
Will create this specific folder TheBloke_WizardLM-33B-V1.0-Uncensored-GGML-q4_K_M
and not TheBloke_WizardLM-33B-V1.0-Uncensored-GGML
So it is easier to select it in the text-generation-webui.
Sure this can easily be done, but what about when you select multiple filters? What about the other files inlcuded with the model?
ok found a nice solution to this
I see the value of your request and really appreciate this awesome idea, I'm done with implementing it, just testing out now all scenarios
its ready, test it out in release 1.1.7
you can use it by adding flag: -f
or directly run latest:
bash <(curl -sSL https://g.bodaay.io/hfd) -f -m TheBloke/vicuna-13b-v1.3.0-GGML:q4_0,q5_0
it will create two folders:
TheBloke/vicuna-13b-v1.3.0-GGML_f_q4_0
TheBloke/vicuna-13b-v1.3.0-GGML_f_q5_0
each folder will contain any non-lfs file as well, liek README.md, it will be available in both
the idea is simple, I'm just re-running the same logic, but passing one filter at a time