hongsunjang

hongsunjang's Stars

• 01-ai/Yi

  A series of large language models trained from scratch by developers @01-ai

  Language:Jupyter Notebook7.8k107290486

• meta-llama/llama-models

  Utilities intended for use with Llama models.

  Language:Python5.4k76148904

• pytorch/torchtune

  PyTorch native post-training library

  Language:Python4.5k48804468

• DefTruth/Awesome-LLM-Inference

  📖A curated list of Awesome LLM/VLM Inference Papers with codes, such as FlashAttention, PagedAttention, Parallelism, etc. 🎉🎉

  3.1k1046207

• stanford-crfm/helm

  Holistic Evaluation of Language Models (HELM), a framework to increase the transparency of language models (https://arxiv.org/abs/2211.09110). This framework is also used to evaluate text-to-image models in HEIM (https://arxiv.org/abs/2311.04287) and vision-language models in VHELM (https://arxiv.org/abs/2410.07112).

  Language:Python2k361.1k265

• Xnhyacinth/Awesome-LLM-Long-Context-Modeling

  📰 Must-read papers and blogs on LLM based Long Context Modeling 🔥

  1.1k47841

• dhm2013724/yolov2_xilinx_fpga

  A demo for accelerating YOLOv2 in xilinx's fpga pynq/zedboard

  Language:C80222126236

• NVIDIA/RULER

  This repo contains the source code for RULER: What’s the Real Context Size of Your Long-Context Language Models?

  Language:Python797176053

• jzhang38/EasyContext

  Memory optimization and training recipes to extrapolate language models' context length to 1 million tokens, with minimal hardware.

  Language:Python67884648

• feifeibear/long-context-attention

  USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference

  Language:Python38952028

• Cornell-RelaxML/QuIP

  Code for paper: "QuIP: 2-Bit Quantization of Large Language Models With Guarantees"

  Language:Python354101232

• Maratyszcza/FP16

  Conversion to/from half-precision floating point formats

  Language:C++337212192

• spcl/gemm_hls

  Scalable systolic array-based matrix-matrix multiplication implemented in Vivado HLS for Xilinx FPGAs.

  Language:C++315173055

• UCLA-VAST/AutoSA

  AutoSA: Polyhedral-Based Systolic Array Compiler

  Language:C++20591833

• AminRezaei0x443/memory-efficient-attention

  Memory Efficient Attention (O(sqrt(n)) for Jax and PyTorch

  Language:Python1816419

• GFNOrg/gfn-lm-tuning

  Language:Jupyter Notebook16841022

• Xilinx/Vitis_Embedded_Platform_Source

  Language:Tcl119212769

• microsoft/LongRoPE

  LongRoPE is a novel method that can extends the context window of pre-trained LLMs to an impressive 2048k tokens.

  Language:Python1163912

• HLSTransform/submission

  Language:C786212

• linghaosong/Sextans

  An FPGA accelerator for general-purpose Sparse-Matrix Dense-Matrix Multiplication (SpMM).

  Language:C++742113

• cathalmccabe/PYNQ_tutorials

  Language:Jupyter Notebook724316

• MicrochipTech/fpga-hls-examples

  Open-Source HLS Examples for Microchip FPGAs

  Language:C391017

• Sibylau/HLS_designs

  Systolic array implementations for Cholesky, LU, and QR decomposition

  Language:C++39126

• mesham/pynq_api

  C API drivers for PYNQ FPGA board

  Language:C31525

• twaclaw/matmult

  A floating-point matrix multiplication implemented in hardware

  Language:Tcl302313

• PSCLab-ASU/Systolic-CNN

  Language:C15604

• Xilinx/libdfx

  Language:C10634

• tzuj6/Object-detection-accelerator-in-Xilinx-PYNQ-z2

  Language:C7113

• berkekisin/Pytorch_spmm_COO

  Pytorch extension library of Sparse Dense Matrix Multiplication in COO format

  Language:Cuda5100

• Edgecortix-Inc/fp_reduce_vitis

  Full implementation of optimized floating-point reduction targeting any board supported in Vitis flow (Alveo, Zynq MPSoC, etc.)

  Language:C++3502