defenseunicorns/leapfrogai-backend-ctransformers
ctransformers wrapper for model inferencing
PythonApache-2.0
Issues
- 0
Public archive repository
#44 opened by justinthelaw - 0
Add hyperparam configuration
#3 opened by gerred - 0
Restore hashes for dependencies
#5 opened by gerred - 0
Convert to multi-architecture (AMD64 & ARM64)
#39 opened by gphorvath - 0
- 0
Update for Python API Model Skeleton Update
#28 opened by justinthelaw - 0
Add ChatComplete/ChatCompleteStream
#1 opened by gerred - 0
CI for ctransformers
#19 opened by gphorvath - 0
Modify backend to support batch summarization
#17 opened by gphorvath - 0
Switch mpt-7b for Mistral
#10 opened by gphorvath - 0
- 0
Fix Makefile
#11 opened by gphorvath - 0
Fix typo in README.md
#7 opened by gphorvath - 1
Add model caching / configuration
#2 opened by gerred