Issues
- 3
Use LitServe instead of FastAPI (enhancement)
#58 opened by Youho99 - 2
- 1
How to add custom endpoint?
#56 opened by Youho99 - 6
How to implement phi-3-vision-128k-instruct (onnx_runtime_genai) with simpleAI ?
#54 opened by Youho99 - 2
Adding falcon gpt model - howto?
#51 opened by NicoJuicy - 1
Incompatiable with Ray
#52 opened by Nintorac - 2
[QUESTION] - Other use cases
#50 opened by talvasconcelos - 7
- 0
Types should be specified in __main__.py parsers
#44 opened by lhenault - 12
alpaca-lora-7b gives method not found exception
#41 opened by urbien - 1
- 0
- 0
Endpoints should not have trailing slashes
#37 opened by lhenault - 7
Parallelism
#33 opened by Nintorac - 15
- 5
- 1
- 1
Examples use Python3.8, SimpleAI requires 3.9+
#27 opened by lhenault - 1
ModuleNotFoundError when installing from source
#14 opened by lhenault - 1
Token usage missing
#18 opened by Nintorac - 1
missing requirement - protobuf
#17 opened by Nintorac - 0
Support streaming on the chat interface
#12 opened by Nintorac - 10
Module not found error after pip install
#13 opened by SupreethRao99 - 3
Annotated not available until python 3.9
#9 opened by Nintorac - 1
Styling configuration
#5 opened by Nintorac - 5
format_chat_log formats incorrectly
#4 opened by Nintorac - 0
Stop should be optional
#1 opened by Nintorac