shubham-bnxt

Pinned Repositories

• infinity

  Infinity is a high-throughput, low-latency REST API for serving text-embeddings, reranking models and clip

  Language:Python1.3k1814896

• Phi-3CookBook

  This is a Phi-3 book for getting started with Phi-3. Phi-3, a family of open AI models developed by Microsoft. Phi-3 models are the most capable and cost-effective small language models (SLMs) available, outperforming models of the same size and next size up across a variety of language, reasoning, coding, and math benchmarks.

  Language:Jupyter Notebook2.3k1667230

• pipableAI

  Language:Python10

• vllm

  A high-throughput and memory-efficient inference and serving engine for LLMs

  Language:Python27.6k2264.6k4.1k

shubham-bnxt's Repositories