xvanQ

Pinned Repositories

• dlio_benchmark

  An I/O benchmark for deep Learning applications

  Language:Python61167428

• fio

  Flexible I/O Tester

  Language:C5.2k1579901.3k

• Heterogeneous-Memory-Management

  Language:Python11

• FlexGen

  Running large language models on a single GPU for throughput-oriented scenarios.

  Language:Python9.1k11181540

• lit-llama

  Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

  Language:Python6k67269518

• DeepSpeed

  DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

  Language:Python34.9k3422.7k4.1k

• Megatron-DeepSpeed

  Ongoing research training transformer language models at scale, including: BERT & GPT-2

  Language:Python1.8k24182342

• pmem-redis

  A version of Redis that uses persistent memory

  Language:C113101547

• helm

  Holistic Evaluation of Language Models (HELM), a framework to increase the transparency of language models (https://arxiv.org/abs/2211.09110). This framework is also used to evaluate text-to-image models in Holistic Evaluation of Text-to-Image Models (HEIM) (https://arxiv.org/abs/2311.04287).

  Language:Python1.9k341.1k243

xvanQ's Repositories