xusenlinzy/api-for-open-llm

💡 [REQUEST] - 请求支持CodeLlama-70b-Instruct-hf

Reset816 opened this issue · 0 comments

起始日期 | Start Date

实现PR | Implementation PR

相关Issues | Reference Issues

摘要 | Summary

基本示例 | Basic Example

缺陷 | Drawbacks

未解决问题 | Unresolved questions

Chat use: The 70B Instruct model uses a [different prompt template](https://huggingface.co/codellama/CodeLlama-70b-Instruct-hf#chat_prompt) than the smaller versions. To use it with transformers, we recommend you use the built-in chat template:

70B的 prompt template 和现在已经支持的7/13/34B不一样。不知道能否直接用