Pinned Repositories
falcon-deployment
This project automates the deployment of the Falcon 7B language model, combining a Flask API and a Streamlit interface for interactive use. It includes features like dynamic quantization, resource monitoring, and detailed logging for efficient performance and troubleshooting.
kaoshonen's Repositories
kaoshonen doesn’t have any repository yet.