petals-infra/chat.petals.dev
💬 Chatbot web app + HTTP and Websocket endpoints for LLM inference with the Petals client
Python
Issues
- 0
ValueError: extra_stop_sequences require stop_sequence length to be exactly 1 token
#60 opened by jeremyzhangsq - 3
Request failed. - Benjamin
#59 opened by lipere123 - 0
Add support for new models
#58 opened by AmgadHasan - 1
providing a system prompt
#44 opened by arthurwolf - 3
OSError: meta-llama/Llama-2-70b-hf is not a local folder and is not a valid model identifier
#35 opened by Sharpz7 - 0
- 22
OpenAI-compatible API
#20 opened by apcameron - 0
- 2
resume model downloads
#49 opened by lightningorb - 2
Integrate with Langchain
#36 opened by Sharpz7 - 3
- 2
- 2
Chat gets slower when multiple people use it
#7 opened by borzunov - 1
[Firefox only] SyntaxError: JSON.parse: unexpected character at line 51 column 73 of the JSON data
#46 opened by tiero - 1
- 3
Integration in Oobabooga webui?
#37 opened by Vincent-Stragier - 1
Add YaLM-100B
#45 opened by Aspect004 - 1
- 1
- 2
- 0
- 3
- 3
Stop sequence missed
#32 opened by Webifi - 3
Token decode issues with Unicode characters
#30 opened by Webifi - 4
4096 context length
#26 opened by vadi2 - 4
How to remove the installation
#28 opened by DewiarQR - 0
Import : import md and most files on GitHub
#29 opened by X-oss-byte - 4
Is there any difference between the BLOOMZ-176B accessible through WebSocket API and the original BLOOMZ-176B?
#24 opened by lexzhou - 2
Site not available.
#22 opened by gspitman - 1
HTTP API fails
#21 opened by apcameron - 1
- 3
python setup.py bdist_wheel did not run successfully / Failed building wheel for grpcio-tools
#18 opened by finnishbroccoli - 2
- 2
Server don't stop properly, hangs indefinitely
#8 opened by slush0