xvanQ

Pinned Repositories

• dlio_benchmark

  An I/O benchmark for deep Learning applications

  Language:Python72168030

• fio

  Flexible I/O Tester

  Language:C5.4k1591k1.3k

• Heterogeneous-Memory-Management

  Language:Python11

• FlexiGen

  Running large language models on a single GPU for throughput-oriented scenarios.

  Language:Python9.2k11282548

• lit-llama

  Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

  Language:Python6k71270518

• DeepSpeed

  DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

  Language:Python36.2k3482.9k4.2k

• Megatron-DeepSpeed

  Ongoing research training transformer language models at scale, including: BERT & GPT-2

  Language:Python2k25184345

• pmem-redis

  A version of Redis that uses persistent memory

  Language:C113101547

• helm

  Holistic Evaluation of Language Models (HELM), a framework to increase the transparency of language models (https://arxiv.org/abs/2211.09110). This framework is also used to evaluate text-to-image models in HEIM (https://arxiv.org/abs/2311.04287) and vision-language models in VHELM (https://arxiv.org/abs/2410.07112).

  Language:Python2k361.1k264

xvanQ's Repositories