microsoft/Olive

[Question]: How do you use a finetuned model for mobile

shaon-chowdhury opened this issue · 1 comments

I've created a fine-tuned model using the examples (target had to be CUDA) and would would now like to use it for mobile. How do I go about this?

Could you give us some background on what model and what fine tuning method you used?

We have an example for phi3 https://github.com/microsoft/Olive/tree/main/examples/phi3. Does that help?