Pinned Repositories
nvidia_oc
A simple command line tool to overclock Nvidia GPUs using the NVML library on Linux. This supports both X11 and Wayland.
perftest
Infiniband Verbs Performance Tests
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
inference
Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.
ilovesouthpark's Repositories
ilovesouthpark doesn’t have any repository yet.