dwzhu-pku

dwzhu-pku's Stars

• mem0ai/mem0

  The Memory layer for your AI apps

  Language:Python22.1k1266542k

• Dao-AILab/flash-attention

  Fast and memory-efficient exact attention

  Language:Python13.6k1151k1.2k

• intel-analytics/ipex-llm

  Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, Baichuan, Mixtral, Gemma, Phi, MiniCPM, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, GraphRAG, DeepSpeed, vLLM, FastChat, Axolotl, etc.

  Language:Python6.5k2502.6k1.3k

• bitsandbytes-foundation/bitsandbytes

  Accessible large language models via k-bit quantization for PyTorch.

  Language:Python6.1k501k613

• hijkzzz/Awesome-LLM-Strawberry

  A collection of LLM papers, blogs, and projects, with a focus on OpenAI o1 and reasoning techniques.

  4k656214

• jbhuang0604/awesome-tips

  3.4k994190

• deepseek-ai/DeepSeek-Coder-V2

  DeepSeek-Coder-V2: Breaking the Barrier of Closed-Source Models in Code Intelligence

  2k2250100

• multimodal-art-projection/MAP-NEO

  Language:Python845103480

• zhijing-jin/nlp-phd-global-equality

  A repo for open resources & information for people to succeed in PhD in CS & career in AI / NLP

  84519072

• microsoft/MInference

  To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention, which reduces inference latency by up to 10x for pre-filling on an A100 while maintaining accuracy.

  Language:Python71765328

• okhat/blog

  195814

• TIGER-AI-Lab/LongRAG

  Official repo for "LongRAG: Enhancing Retrieval-Augmented Generation with Long-context LLMs".

  Language:Python1723415

• HaozheZhao/UltraEdit

  Language:Python1543188

• metame-ai/awesome-llm-plaza

  awesome llm plaza: daily tracking all sorts of awesome topics of llm, e.g. llm for coding, robotics, reasoning, multimod etc.

  1338011

• google-deepmind/loft

  LOFT: A 1 Million+ Token Long-Context Benchmark

  Language:Python1321148

• KbsdJames/Awesome-LLM-Preference-Learning

  The official repository of our survey paper: "Towards a Unified View of Preference Learning for Large Language Models: A Survey"

  124101

• hkust-nlp/llm-compression-intelligence

  Official github repo for the paper "Compression Represents Intelligence Linearly" [COLM 2024]

  Language:Python123376

• AI21Labs/Parallel-Context-Windows

  Language:Python992612

• llyx97/TempCompass

  [ACL 2024 Findings] "TempCompass: Do Video LLMs Really Understand Videos?", Yuanxin Liu, Shicheng Li, Yi Liu, Yuxiang Wang, Shuhuai Ren, Lei Li, Sishuo Chen, Xu Sun, Lu Hou

  Language:Python76433

• MozerWang/Loong

  [EMNLP 2024 Main]Leave No Document Behind: Benchmarking Long-Context LLMs with Extended Multi-Doc QA

  Language:Python70143

• zhiyuanhubj/LongRecipe

  LongRecipe: Recipe for Efficient Long Context Generalization in Large Language Models

  Language:Python60134

• alonj/Same-Task-More-Tokens

  The code for the paper: "Same Task, More Tokens: the Impact of Input Length on the Reasoning Performance of Large Language Models"

  Language:Jupyter Notebook46102

• Zefan-Cai/Awesome-LLM-KV-Cache

  Awesome-LLM-KV-Cache: A curated list of 📙Awesome LLM KV Cache Papers with Codes.

  33101

• mutonix/pyramidinfer

  Language:Python270

• Yifan-Song793/GoodBadGreedy

  The Good, The Bad, and The Greedy: Evaluation of LLMs Should Not Ignore Non-Determinism

  Language:Python24211

• WeiminXiong/IPR

  Watch Every Step! LLM Agent Learning via Iterative Step-level Process Refinement

  Language:Python23330

• KbsdJames/Omni-MATH

  The official repository of the Omni-MATH benchmark.

  Language:Python2222

• chenllliang/MMEvalPro

  Source code for MMEvalPro, a more trustworthy and efficient benchmark for evaluating LMMs

  Language:Python21122

• FranxYao/Retrieval-Head-with-Flash-Attention

  Efficient retrieval head analysis with triton flash attention that supports topK probability

  Language:Jupyter Notebook1220

• geronimi73/accelerate_tricks

  Language:Jupyter Notebook8101