qescccczmr
Student of University of Chinese Academy of Sciences
University of Chinese Academy of Sciencesshenzhen
qescccczmr's Stars
karpathy/nano-llama31
nanoGPT style version of Llama 3.1
adam-maj/tiny-gpu
A minimal GPU design in Verilog to learn how GPUs work from the ground up
NVIDIA/TensorRT-LLM
TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.
ModelTC/lightllm
LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.
premAI-io/benchmarks
🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.
Liu-xiandong/How_to_optimize_in_GPU
This is a series of GPU optimization topics. Here we will introduce how to optimize the CUDA kernel in detail. I will introduce several basic kernel optimizations, including: elementwise, reduce, sgemv, sgemm, etc. The performance of these kernels is basically at or near the theoretical limit.
karpathy/LLM101n
LLM101n: Let's build a Storyteller
cuda-mode/lectures
Material for cuda-mode lectures
NVIDIA/cutlass
CUDA Templates for Linear Algebra Subroutines
karpathy/build-nanogpt
Video+code lecture on building nanoGPT from scratch
talhasaruhan/cpp-matmul
Fast, multithreaded, AVX/FMA matrix multiplication kernel in C++ 17
wang-xinyu/tensorrtx
Implementation of popular deep learning networks with TensorRT network definition API
BBuf/tvm_mlir_learn
compiler learning resources collect.
chenzomi12/AISystem
AISystem 主要是指AI系统,包括AI芯片、AI编译器、AI推理和训练框架等AI全栈底层技术
ggerganov/ggml
Tensor library for machine learning
cyrusbehr/tensorrt-cpp-api
TensorRT C++ API Tutorial
ShiqiYu/libfacedetection
An open source library for face detection in images. The face detection speed can reach 1000FPS.
RussWong/CUDATutorial
A CUDA tutorial to make people learn CUDA program from 0
Jeangowhy/Tour-of-C-2023
The next years will be a wonderful world of C++.
liguodongiot/llm-action
本项目旨在分享大模型相关技术原理以及实战经验。
zweix123/CS-notes
Notes taken by zweix while learning computer related knowledge
Mooler0410/LLMsPracticalGuide
A curated list of practical guide resources of LLMs (LLMs Tree, Examples, Papers)
ChambinLee/CUDA_with_PyTorch
这个项目介绍了简单的CUDA入门,涉及到CUDA执行模型、线程层次、CUDA内存模型、核函数的编写方式以及PyTorch使用CUDA扩展的两种方式。通过该项目可以基本入门基于PyTorch的CUDA扩展的开发方式。
explosion/spacy-models
💫 Models for the spaCy Natural Language Processing (NLP) library
TOMO-CAT/CppDesignPattern
22种设计模式的C++实现
zjhellofss/KuiperInfer
校招、秋招、春招、实习好项目!带你从零实现一个高性能的深度学习推理库,支持大模型 llama2 、Unet、Yolov5、Resnet等模型的推理。Implement a high-performance deep learning inference library step by step
Sunt-ing/stick
:innocent: A PyTorch-like deep learning framework. Just for fun.
ShiqiYu/CPP
Lecture notes, projects and other materials for Course 'CS205 C/C++ Program Design' at Southern University of Science and Technology.
parallel101/course
高性能并行编程与优化 - 课件
taichi-dev/taichi
Productive, portable, and performant GPU programming in Python.