Pinned Repositories
cog
Containers for machine learning
deepctl
Command line tool for Deep Infra cloud ML inference service
deepinfra-node
Official TypeScript wrapper for DeepInfra Inference API
fetch-event-source
A better API for making Event Source requests, with all the features of fetch()
full-stack-deep-learning-website
Source for https://fullstackdeeplearning.com
langchain
âš¡ Building applications with LLMs through composability âš¡
langchainjs
🦜🔗 Build context-aware reasoning applications 🦜🔗
lm-evaluation-harness
A framework for few-shot evaluation of language models.
text-generation-inference
Large Language Model Text Generation Inference
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
Deep Infra's Repositories
deepinfra/deepctl
Command line tool for Deep Infra cloud ML inference service
deepinfra/text-generation-inference
Large Language Model Text Generation Inference
deepinfra/deepinfra-node
Official TypeScript wrapper for DeepInfra Inference API
deepinfra/langchain
âš¡ Building applications with LLMs through composability âš¡
deepinfra/cog
Containers for machine learning
deepinfra/fetch-event-source
A better API for making Event Source requests, with all the features of fetch()
deepinfra/full-stack-deep-learning-website
Source for https://fullstackdeeplearning.com
deepinfra/langchainjs
🦜🔗 Build context-aware reasoning applications 🦜🔗
deepinfra/lm-evaluation-harness
A framework for few-shot evaluation of language models.
deepinfra/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
deepinfra/cog-llama-2
A cog for running llama-2 using llama.cpp server
deepinfra/fetch-stream-parser
fetch-stream
deepinfra/litellm
Call all LLM APIs using the OpenAI format. Use Azure, OpenAI, Cohere, Anthropic, Ollama, VLLM, Sagemaker, HuggingFace, Replicate (100+ LLMs)
deepinfra/ngx-http-auth-jwt-module
Secure your NGINX locations with JWT
deepinfra/sentence-transformers
Multilingual Sentence & Image Embeddings with BERT
deepinfra/superfans-gpu-controller
NVIDIA GPU-based FAN controller for SUPERMICRO server
deepinfra/TensorRT-LLM
TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.
deepinfra/tensorrtllm_backend
The Triton TensorRT-LLM Backend
deepinfra/transformers
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
deepinfra/whisper-timestamped
Multilingual Automatic Speech Recognition with word-level timestamps and confidence