tongyao-zhu

tongyao-zhu's Stars

• meta-llama/llama-recipes

  Scripts for fine-tuning Meta Llama with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment. Demo apps to showcase Meta Llama for WhatsApp & Messenger.

  Language:Jupyter Notebook15.1k1923782.2k

• RUCAIBox/LLMSurvey

  The official GitHub page for the survey paper "A Survey of Large Language Models".

  Language:Python10.5k15864820

• arcee-ai/mergekit

  Tools for merging pretrained large language models.

  Language:Python4.8k52317439

• open-compass/opencompass

  OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

  Language:Python4.1k26549437

• microsoft/LMOps

  General technology for enabling AI capabilities w/ LLMs and MLLMs

  Language:Python3.7k54124282

• lucidrains/vector-quantize-pytorch

  Vector (and Scalar) Quantization, in Pytorch

  Language:Python2.6k32129211

• RUC-NLPIR/FlashRAG

  ⚡FlashRAG: A Python Toolkit for Efficient RAG Research

  Language:Python1.3k1283108

• Xnhyacinth/Awesome-LLM-Long-Context-Modeling

  📰 Must-read papers and blogs on LLM based Long Context Modeling 🔥

  99244636

• THUDM/LongBench

  [ACL 2024] LongBench: A Bilingual, Multitask Benchmark for Long Context Understanding

  Language:Python66277454

• datamllab/LongLM

  [ICML'24 Spotlight] LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning

  Language:Python610103762

• texttron/tevatron

  Tevatron - A flexible toolkit for neural retrieval research and development.

  Language:Python5241299100

• catid/self-discover

  Implementation of Google's SELF-DISCOVER

  Language:Python2823431

• neulab/knn-transformers

  PyTorch + HuggingFace code for RetoMaton: "Neuro-Symbolic Language Modeling with Automaton-augmented Retrieval" (ICML 2022), including an implementation of kNN-LM and kNN-MT

  Language:Python26941422

• booydar/babilong

  BABILong is a benchmark for LLM evaluation using the needle-in-a-haystack approach.

  Language:Jupyter Notebook1525316

• chentong0/factoid-wiki

  Dense X Retrieval: What Retrieval Granularity Should We Use?

  1319109

• RulinShao/retrieval-scaling

  Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".

  Language:Python1284111

• sail-sg/sailor-llm

  [EMNLP-2024] ⚓️ Sailor: Open Language Models for South-East Asia

  Language:Python109719

• jxmorris12/bm25_pt

  minimal pytorch implementation of bm25 (with sparse tensors)

  Language:Python88444

• nkandpa2/long_tail_knowledge

  Repo for the paper "Large Language Models Struggle to Learn Long-Tail Knowledge"

  Language:Python73317

• joeljang/temporalwiki

  [EMNLP 2022] TemporalWiki: A Lifelong Benchmark for Training and Evaluating Ever-Evolving Language Models

  Language:Python66135

• frankxu2004/knnlm-why

  Repo for ICML23 "Why do Nearest Neighbor Language Models Work?"

  Language:Python56503

• October2001/ProLong

  [ACL 2024 (Oral)] A Prospector of Long-Dependency Data for Large Language Models

  Language:Python53230

• bbuing9/ICLR24_SuRe

  Official Code for the paper "SuRe: Summarizing Retrievals using Answer Candidates for Open-domain QA of LLMs" (ICLR 2024)

  Language:Python21110

• yuzhaouoe/pretraining-data-packing

  [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training

  Language:Python18205

• yasumasaonoe/entity_knowledge_propagation

  Language:Python16342

• YisongMiao/DiSQ-Score

  The Dataset and Official Implementation for <Discursive Socratic Questioning: Evaluating the Faithfulness of Language Models’ Understanding of Discourse Relations> @ ACL 2024

  Language:Python14103

• trestad/mitigating-reversal-curse

  Code for paper 'Are We Falling in a Middle-Intelligence Trap? An Analysis and Mitigation of the Reversal Curse'

  Language:Python12110

• amy-hyunji/lora-for-retrieval

  Language:Python9400

• xiangyue9607/C-MORE

  Code for the ACL2022 paper "C-MORE: Pretraining to Answer Open-Domain Questions by Consulting Millions of References"

  7400

• Fantabulous-J/Self-Training-DPR

  Language:Python4110