Fill in the middle syntax request
vishagar81 opened this issue · 2 comments
vishagar81 commented
Hello,
I have been trying to get the inline coding suggestions to work. However, I keep getting an error (Status code: 422, Unprocessable entity). Would you be able to share the format of the request (with JSON payload)?
Thanks
mzbac commented
Here is the code that sends the fill in the middle request -> https://github.com/mzbac/wizardCoder-vsc/blob/main/src/WizardCoderInlineCompletionItemProvider.ts#L56
vishagar81 commented
Thanks for sharing the line - I had checked that. But for some reason it still doesn't seem to work. But one thing to point is that I am not running the API locally, instead I am pointing at HF API - https://huggingface.co/WizardLM/WizardCoder-Python-34B-V1.0 model.