innerfirexy

innerfirexy's Stars

• karpathy/llm.c

  LLM training in simple, raw C/CUDA

  Language:Cuda24.9k2521412.8k

• eugeneyan/open-llms

  📋 A list of open LLMs available for commercial use.

  11.4k24437765

• RUCAIBox/LLMSurvey

  The official GitHub page for the survey paper "A Survey of Large Language Models".

  Language:Python10.7k15965833

• statsmodels/statsmodels

  Statsmodels: statistical modeling and econometrics in Python

  Language:Python10.3k2875.5k3.2k

• karpathy/minbpe

  Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.

  Language:Python9.3k8538877

• lancopku/pkuseg-python

  pkuseg多领域中文分词工具; The pkuseg toolkit for multi-domain Chinese word segmentation

  Language:Python6.6k208167988

• CLUEbenchmark/CLUEDatasetSearch

  搜索所有中文NLP数据集，附常用英文NLP数据集

  Language:Python4.2k6212614

• baidu/lac

  百度NLP：分词，词性标注，命名实体识别，词重要性

  Language:C++3.9k105248595

• LnL7/nix-darwin

  nix modules for darwin

  Language:Nix3.4k35587472

• ownthink/Jiagu

  Jiagu深度学习自然语言处理工具 知识图谱关系抽取 中文分词 词性标注 命名实体识别 情感分析 新词发现 关键词 文本摘要 文本聚类

  Language:Python3.3k8771614

• hankcs/pyhanlp

  中文分词

  Language:Python3.1k850810

• google/BIG-bench

  Beyond the Imitation Game collaborative benchmark for measuring and extrapolating the capabilities of language models

  Language:Python2.9k51151595

• EleutherAI/pythia

  The hub for EleutherAI's work on interpretability and learning dynamics

  Language:Jupyter Notebook2.3k33109176

• thunlp/UltraChat

  Large-scale, Informative, and Diverse Multi-round Chat Data (and Models)

  Language:Python2.3k4030117

• HillZhang1999/llm-hallucination-survey

  Reading list of hallucination in LLMs. Check out our new survey paper: "Siren’s Song in the AI Ocean: A Survey on Hallucination in Large Language Models"

  96012352

• rowanz/grover

  Code for Defending Against Neural Fake News, https://rowanzellers.com/grover/

  Language:Python9183558222

• stanfordnlp/pyvene

  Stanford NLP Python Library for Understanding and Improving PyTorch Models via Interventions

  Language:Python67196169

• mapull/chinese-dictionary

  中文汉语拼音辞典，汉字拼音字典，词典，成语词典，常用字、多音字字典数据库

  514612123

• likenneth/honest_llama

  Inference-Time Intervention: Eliciting Truthful Answers from a Language Model

  Language:Python48993838

• jlko/semantic_uncertainty

  Codebase for reproducing the experiments of the semantic uncertainty paper (short-phrase and sentence-length experiments).

  Language:Python26431025

• FreedomIntelligence/Huatuo-26M

  The Largest-scale Chinese Medical QA Dataset： with 26,000,000 question answer pairs.

  23091024

• gmftbyGMFTBY/Copyisallyouneed

  [ICLR 2023] Codebase for Copy-Generator model, including an implementation of kNN-LM

  Language:Python18441422

• ttzHome/AnchiBERT

  AnchiBERT: A Pre-Trained Model for Ancient Chinese Language Understanding and Generation(古文预训练模型)

  62134

• gpoesia/minbert-default-final-project

  CS 224N Winter 2023 Default Final Project: Multitask BERT

  Language:Python254049

• GongFuXiong/Chinese-Medical-Question-Answering-System

  TensorFlow for Chinese Medical Question Answering(question Answer matching) by LSTM/CNN/LSTM_ATTENTION/IARNN-GATE

  Language:Python23329

• dayihengliu/a2m_chineseNMT

  Dataset for TALLIP2019 paper "Ancient-Modern Chinese Translation with a New Large Training Dataset"

  224

• viking-sudo-rm/rusty-dawg

  Rust library for indexing and quickly searching large pretraining corpora

  Language:Rust223163

• Andrea-de-Varda/surprisal-across-languages

  Code to calculate surprisal values from multilingual XGLM models.

  Language:Python4101

• bstee615/shared-hf-cache

  Language:Shell4200

• tpimentelms/probability-of-a-word

  Code to compute a word's probability using the fixes from "How to Compute the Probability of a Word"

  Language:Python4102