kannan-scalers-ai

Senior AI Engineer @scalers-ai

Scalers AIIndia

Pinned Repositories

distributed-inference-llm
Serve Llama 2 (7B/13B/70B) Large Language Models efficiently at scale by leveraging heterogeneous Dell™ PowerEdge™ Rack servers in a distributed manner.
Language:Python7 1 01
coco-labels
The labels for object categories in COCO dataset
Language:Python0 0 00
librdkafka
The Apache Kafka C/C++ library
Language:C0 0 00
ROCm
AMD ROCm™ Software - GitHub Home
Language:Shell4.8k 221 2.5k393
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
Language:Python32.4k 265 5.7k4.9k

kannan-scalers-ai's Repositories

kannan-scalers-ai/coco-labels
The labels for object categories in COCO dataset
Language:Python0 0 00
kannan-scalers-ai/librdkafka
The Apache Kafka C/C++ library
Language:C0 0 00