Pinned Repositories
Dipoorlet
Offline Quantization Tools for Deploy.
inferdet
lightllm
LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.
llmc
MQBench
Model Quantization Benchmark
nanodet
NanoDet-Plus⚡Super fast and lightweight anchor-free object detection model. 🔥Only 980 KB(int8) / 1.8MB (fp16) and run 97FPS on cellphone🔥
onnx
Open standard for machine learning interoperability
opencompass
OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.
ppl.pmx
test
This is my first github repository.
helloyongyang's Repositories
helloyongyang/Dipoorlet
Offline Quantization Tools for Deploy.
helloyongyang/inferdet
helloyongyang/lightllm
LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.
helloyongyang/llmc
helloyongyang/MQBench
Model Quantization Benchmark
helloyongyang/nanodet
NanoDet-Plus⚡Super fast and lightweight anchor-free object detection model. 🔥Only 980 KB(int8) / 1.8MB (fp16) and run 97FPS on cellphone🔥
helloyongyang/onnx
Open standard for machine learning interoperability
helloyongyang/opencompass
OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.
helloyongyang/ppl.pmx
helloyongyang/test
This is my first github repository.
helloyongyang/ultralytics
NEW - YOLOv8 🚀 in PyTorch > ONNX > OpenVINO > CoreML > TFLite