[Question]: How do you use a finetuned model for mobile
shaon-chowdhury opened this issue · 1 comments
shaon-chowdhury commented
I've created a fine-tuned model using the examples (target had to be CUDA) and would would now like to use it for mobile. How do I go about this?
jambayk commented
Could you give us some background on what model and what fine tuning method you used?
We have an example for phi3 https://github.com/microsoft/Olive/tree/main/examples/phi3. Does that help?