NeoZhangJianyu

NeoZhangJianyu's Stars

• ggml-org/llama.cpp

  LLM inference in C/C++

  Language:C++77.7k5814.8k11.3k

• intel/ipex-llm

  Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.

  Language:Python7.7k2592.8k1.3k

• intel/intel-extension-for-transformers

  ⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡

  Language:Python2.2k26166210

• intel/intel-extension-for-pytorch

  A Python package for extending the official PyTorch that can easily obtain performance on Intel platform

  Language:Python1.8k35615265

• intel/intel-extension-for-tensorflow

  Intel® Extension for TensorFlow*

  Language:C++336167643