honggyukim

honggyukim's Stars

• milvus-io/milvus

  Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search

  Language:Go33.3k29213k3.1k

• Mozilla-Ocho/llamafile

  Distribute and run LLMs with a single file.

  Language:C++22k1794801.2k

• microsoft/onnxruntime

  ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

  Language:C++16k2547.1k3.1k

• NVIDIA/open-gpu-kernel-modules

  NVIDIA Linux open GPU kernel module source

  Language:C15.6k1803981.4k

• giampaolo/psutil

  Cross-platform lib for process and system monitoring in Python

  Language:Python10.5k2311.8k1.4k

• grafana/pyroscope

  Continuous Profiling Platform. Debug performance issues down to a single line of code

  Language:Go10.4k971.3k637

• abetlen/llama-cpp-python

  Python bindings for llama.cpp

  Language:Python8.8k771.2k1.1k

• intel-analytics/ipex-llm

  Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, GraphRAG, DeepSpeed, Axolotl, etc

  Language:Python7k2542.7k1.3k

• NVIDIA/FasterTransformer

  Transformer related optimization, including BERT, GPT

  Language:C++6.1k61625901

• XuehaiPan/nvitop

  An interactive NVIDIA-GPU process viewer and beyond, the one-stop solution for GPU process management.

  Language:Python5.3k2596162

• SchedMD/slurm

  Slurm: A Highly Scalable Workload Manager

  Language:C3k1320691

• util-linux/util-linux

  Language:C2.8k1081.4k1.2k

• GStreamer/gstreamer

  GStreamer open-source multimedia framework

  Language:C2.6k1280627

• linux-rdma/rdma-core

  RDMA core userspace libraries and daemons

  Language:C1.7k1140724

• dstat-real/dstat

  Versatile resource statistics tool (the real one, not the Red Hat clone)

  Language:Python1.4k8891328

• likejazz/llama3.np

  llama3.np is a pure NumPy implementation for Llama 3 model.

  Language:Python97412480

• tenstorrent/tt-metal

  :metal: TT-NN operator library, and TT-Metalium low level kernel programming model.

  Language:C++669248.8k118

• TPC-Council/HammerDB

  HammerDB Database Load Testing and Benchmarking Tool

  Language:Tcl63729294125

• gregkh/kernel-development

  Presentation on how the Linux kernel is developed

  Language:TeX630601127

• UpstageAI/dataverse

  The Universe of Data. All about data, data science, and data engineering

  Language:Python545102352

• scottchiefbaker/dool

  Python3 compatible fork of dstat

  Language:Python395134867

• likejazz/llama3.cuda

  llama3.cuda is a pure C/CUDA implementation for Llama 3 model.

  Language:Cuda3296524

• huggingface/optimum-benchmark

  🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of Optimum's hardware optimizations & quantization schemes.

  Language:Python28948756

• UpstageAI/evalverse

  The Universe of Evaluation. All about the evaluation for LLMs.

  Language:Python22381025

• kaistAI/FLASK

  [ICLR 2024 Spotlight] FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Sets

  Language:Python2142418

• csl-ajou/DeepPlan

  Fast and Efficient Model Serving Using Multi-GPUs with Direct-Host-Access (ACM EuroSys '23)

  Language:C++50248

• hygoni/precise-leak-sanitizer

  A dynamic memory leak detector that can pinpoint where memory is lost, using LLVM pass

  Language:LLVM184722

• NVIDIA/grace-kernel

  Upstream Kernel with Grace upstream pending patches for partners. Patches include any bug fixes during Grace production while they await upstreaming.

  Language:C15601

• sjp38/idle_page_tracking

  Language:C114110

• schwabe/tglx-history

  Language:C10302