Exemplos de como executar o llama2-langchain-chat usando llama.cpp
Colab | Modelo | Tamanho | Quantização |
---|---|---|---|
lucianosb/llama-2-7b-langchain-chat-GGUF | 3.56 GB | 4.0 | |
lucianosb/llama-2-7b-langchain-chat-GGUF | 3.95 GB | 4.1 | |
lucianosb/llama-2-7b-langchain-chat-GGUF | 4.33 GB | 5.0 | |
lucianosb/llama-2-7b-langchain-chat-GGUF | 4.72 GB | 5.1 | |
lucianosb/llama-2-7b-langchain-chat-GGUF | 6.67 GB | 8.0 |