tgi inference provides incomplete information
allendred opened this issue · 0 comments
allendred commented
First of all, it is definitely impossible to complete the inference using the official tgi image. You need to compile the cog version tgi. This is not an out-of-the-box version, and there is no explanation for this.