kannon92

kannon92's Stars

• ollama/ollama

  Get up and running with Llama 3.3, Mistral, Gemma 2, and other large language models.

  Language:Go102k5945.2k8.2k

• ggerganov/llama.cpp

  LLM inference in C/C++

  Language:C++69.2k5514.2k9.9k

• vllm-project/vllm

  A high-throughput and memory-efficient inference and serving engine for LLMs

  Language:Python31.8k2555.6k4.8k

• Mozilla-Ocho/llamafile

  Distribute and run LLMs with a single file.

  Language:C++20.9k1774411.1k

• ggerganov/ggml

  Tensor library for machine learning

  Language:C++11.4k1324271.1k

• marimo-team/marimo

  A reactive notebook for Python — run reproducible experiments, execute as a script, deploy as an app, and version with git.

  Language:Python8.4k43844304

• aws/containers-roadmap

  This is the public roadmap for AWS container services (ECS, ECR, Fargate, and EKS).

  Language:Shell5.2k6742.4k320

• EricLBuehler/mistral.rs

  Blazingly fast LLM inference.

  Language:Rust4.6k34294325

• karmada-io/karmada

  Open, Multi-Cloud, Multi-Cluster Kubernetes Orchestration

  Language:Go4.5k711.7k891

• kubernetes-sigs/kwok

  Kubernetes WithOut Kubelet - Simulates thousands of Nodes and Clusters.

  Language:Go2.6k20219209

• kubernetes-sigs/cri-tools

  CLI and validation tools for Kubelet Container Runtime Interface (CRI) .

  Language:Go1.7k37385456

• premAI-io/state-of-open-source-ai

  :closed_book: Clarity in the current fast-paced mess of Open Source innovation

  Language:TeX1.5k224190

• kuasar-io/kuasar

  A multi-sandbox container runtime that provides cloud-native, all-scenario multiple sandbox container solutions.

  Language:Rust1.3k234192

• Project-HAMi/HAMi

  Heterogeneous AI Computing Virtualization Middleware

  Language:Go1.1k22320218

• vllm-project/llm-compressor

  Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

  Language:Python7891311366

• open-cluster-management-io/ocm

  Core components in the OCM project. Report here if you found any issues in OCM.

  Language:Go7801218594

• sosreport/sos

  A unified tool for collecting system logs and other debug information

  Language:Python514421.1k543

• armadaproject/armada

  A multi-cluster batch queuing system for high-throughput workloads on Kubernetes.

  Language:Go48827732136

• containers/conmon

  An OCI container runtime monitor.

  Language:C42123127126

• cncf-tags/container-device-interface

  Language:Go216188638

• kubernetes-sigs/kubectl-validate

  Language:Go16785041

• kubernetes-sigs/jobset

  JobSet: a k8s native API for distributed ML training and HPC workloads

  Language:Go1531124950

• kubernetes-sigs/lws

  LeaderWorkerSet: An API for deploying a group of pods as a unit of replication

  Language:Go14879531

• G-Research/fasttrackml

  Experiment tracking server focused on speed and scalability

  Language:Go981443320

• google/xpk

  xpk (Accelerated Processing Kit, pronounced x-p-k,) is a software tool to help Cloud developers to orchestrate training jobs on accelerators such as TPUs and GPUs on GKE.

  Language:Python70162218

• kubernetes-sigs/dra-example-driver

  Example DRA driver that developers can fork and modify to get them started writing their own.

  Language:Go5362035

• openshift-eng/ocp-build-data

  Configuration data used to build OCP images

  38224208

• IBM/autopilot

  A tool to detect infrastructure issues on cloud native AI systems

  Language:Python1972115

• dejanzele/batch-simulator

  batch-simulator is a Golang CLI tool that simulates the lifecycle of Kubernetes API resources, such as Nodes, Pods, etc. using KWOK

  Language:Go4110

• openshift-virtualization/wasp-agent

  Language:Go38