jikechao

jikechao's Stars

• ggerganov/llama.cpp

  LLM inference in C/C++

  Language:C++74.3k5714.5k10.7k

• lm-sys/FastChat

  An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

  Language:Python38.1k3541.9k4.7k

• mlc-ai/web-llm

  High-performance In-browser LLM Inference Engine

  Language:TypeScript15k133343976

• NVIDIA/TensorRT

  NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.

  Language:C++11.3k1543.9k2.2k

• alibaba/MNN

  MNN is a blazing fast, lightweight deep learning framework, battle-tested by business-critical use cases in Alibaba. Full multimodal LLM Android App:[MNN-LLM-Android](./apps/Android/MnnLlmChat/README.md)

  Language:C++10k2062.7k1.8k

• NVIDIA/TensorRT-LLM

  TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.

  Language:C++9.7k1152.3k1.2k

• dusty-nv/jetson-inference

  Hello AI World guide to deploying deep-learning inference networks and deep vision primitives with TensorRT and NVIDIA Jetson.

  Language:C++8.2k2741.8k3k

• openvinotoolkit/openvino

  OpenVINO™ is an open source toolkit for optimizing and deploying AI inference

  Language:C++8k1932.8k2.5k

• nedbat/coveragepy

  The code coverage tool for Python

  Language:Python3.1k351.5k442

• open-mmlab/mmdeploy

  OpenMMLab Model Deployment Framework

  Language:Python2.9k341.6k655

• linyiLYi/pose-monitor

  “让爷康康”是一款手机 AI 应用程序，可以监测不良坐姿并进行语音提示

  Language:Jupyter Notebook2.6k2933388

• joernio/joern

  Open-source code analysis platform for C/C++/Java/Binary/Javascript/Python/Kotlin based on code property graphs. Discord https://discord.gg/vv4MH284Hc

  Language:Scala2.3k401.2k310

• microsoft/DeepSpeed-MII

  MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.

  Language:Python2k42315176

• egraphs-good/egg

  egg is a flexible, high-performance e-graph library

  Language:Rust1.4k23143151

• onnx/onnxmltools

  ONNXMLTools enables conversion of models to ONNX

  Language:Python1.1k44295192

• openvinotoolkit/nncf

  Neural Network Compression Framework for enhanced OpenVINO™ inference

  Language:Python98430348249

• onnx/onnx-mlir

  Representation and Reference Lowering of ONNX Models in MLIR Compiler Infrastructure

  Language:C++82935726341

• hyperai/tvm-cn

  TVM Documentation in Chinese Simplified / TVM 中文文档

  Language:TypeScript8127042156

• saltudelft/ml4se

  A curated list of papers, theses, datasets, and tools related to the application of Machine Learning for Software Engineering

  70842193

• strongcourage/awesome-directed-fuzzing

  A curated list of awesome directed fuzzing research papers

  50328446

• MegEngine/MegCC

  MegCC是一个运行时超轻量，高效，移植简单的深度学习模型编译器

  Language:C++480182259

• microsoft/onnxconverter-common

  Common utilities for ONNX converters

  Language:Python259136666

• LeonYang95/PLELog

  Implementation of PLELog in ICSE 2021 accepted paper:Semi-supervised Log-based Anomaly Detection via Probabilistic Label Estimation.

  Language:Python7412227

• fabsx00/python-joern

  A python interface to joern (deprecated).

  Language:Groovy34111021

• DLFrameworkBug/DLFrameworkBugsData

  a data collection of related work: Toward Understanding Deep Learning Framework Bugs

  15104

• wzh99/GenCoG

  GenCoG: A DSL-Based Approach to Generating Computation Graphs for TVM Testing (ISSTA‘23)

  Language:Python15112

• haoyang9804/HirGen

  A Computational Graph Generator for AI Compiler Fuzzing

  Language:C++14111

• mlc-ai/docs

  The documents for TVM Unity

  Language:Shell11302

• SeekingDream/ISSTA23_DyCL

  Language:Python6100

• Deelvin/tvm-tools

  1500