language-models
There are 212 repositories under language-models topic.
huggingface/transformers
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
bigscience-workshop/petals
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
argosopentech/argos-translate
Open-source offline translation library written in Python
atfortes/Awesome-LLM-Reasoning
Reasoning in Large Language Models: Papers and Resources, including Chain-of-Thought and OpenAI o1 🍓
jalammar/ecco
Explain, analyze, and visualize NLP language models. Ecco creates interactive visualizations directly in Jupyter notebooks explaining the behavior of Transformer-based language models (like GPT2, BERT, RoBERTA, T5, and T0).
deepset-ai/FARM
:house_with_garden: Fast & easy transfer learning for NLP. Harvesting language models for the industry. Focus on Question Answering.
zjukg/KG-LLM-Papers
[Paper List] Papers integrating knowledge graphs (KGs) and large language models (LLMs)
facebookresearch/large_concept_model
Large Concept Models: Language modeling in a sentence representation space
curiousily/Get-Things-Done-with-Prompt-Engineering-and-LangChain
LangChain & Prompt Engineering tutorials on Large Language Models (LLMs) such as ChatGPT with custom data. Jupyter notebooks on loading and indexing data, creating prompt templates, CSV agents, and using retrieval QA chains to query the custom data. Projects for using a private LLM (Llama 2) for chat with PDF files, tweets sentiment analysis.
declare-lab/tango
A family of diffusion models for text-to-audio generation.
llm-jp/awesome-japanese-llm
日本語LLMまとめ - Overview of Japanese LLMs
kennethleungty/Llama-2-Open-Source-LLM-CPU-Inference
Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A
ashishpatel26/Treasure-of-Transformers
💁 Awesome Treasure of Transformers Models for Natural Language processing contains papers, videos, blogs, official repo along with colab Notebooks. 🛫☑️
zjunlp/Prompt4ReasoningPapers
[ACL 2023] Reasoning with Language Model Prompting: A Survey
princeton-nlp/LM-BFF
[ACL 2021] LM-BFF: Better Few-shot Fine-tuning of Language Models https://arxiv.org/abs/2012.15723
VinAIResearch/PhoBERT
PhoBERT: Pre-trained language models for Vietnamese (EMNLP-2020 Findings)
monarch-initiative/ontogpt
LLM-based ontological extraction tools, including SPIRES
HazyResearch/hyena-dna
Official implementation for HyenaDNA, a long-range genomic foundation model built with Hyena
webis-de/small-text
Active Learning for Text Classification in Python
jeffhj/LM-reasoning
This repository contains a collection of papers and resources on Reasoning in Large Language Models.
EricFillion/happy-transformer
Happy Transformer makes it easy to fine-tune and perform inference with NLP Transformer models.
bigscience-workshop/xmtf
Crosslingual Generalization through Multitask Finetuning
neurocult/agency
🕵️♂️ Library designed for developers eager to explore the potential of Large Language Models (LLMs) and other generative AI through a clean, effective, and Go-idiomatic approach.
cedrickchee/chatgpt-universe
ChatGPT Universe is fleeting notes on ChatGPT, GPT, and large language models (LLMs)
cli99/llm-analysis
Latency and Memory Analysis of Transformer Models for Training and Inference
hooshvare/parsbert
🤗 ParsBERT: Transformer-based Model for Persian Language Understanding
sdadas/polish-nlp-resources
Pre-trained models and language resources for Natural Language Processing in Polish
huggingface/datablations
Scaling Data-Constrained Language Models
agencyenterprise/PromptInject
PromptInject is a framework that assembles prompts in a modular fashion to provide a quantitative analysis of the robustness of LLMs to adversarial prompt attacks. 🏆 Best Paper Awards @ NeurIPS ML Safety Workshop 2022
helallao/perplexity-ai
Unofficial API Wrapper for Perplexity.ai + Account Generator
petals-infra/chat.petals.dev
💬 Chatbot web app + HTTP and Websocket endpoints for LLM inference with the Petals client
extreme-bert/extreme-bert
ExtremeBERT is a toolkit that accelerates the pretraining of customized language models on customized datasets, described in the paper “ExtremeBERT: A Toolkit for Accelerating Pretraining of Customized BERT”.
neulab/knn-transformers
PyTorch + HuggingFace code for RetoMaton: "Neuro-Symbolic Language Modeling with Automaton-augmented Retrieval" (ICML 2022), including an implementation of kNN-LM and kNN-MT
bhattbhavesh91/voice-assistant-whisper-chatgpt
This repository will guide you to create your own Smart Virtual Assistant like Google Assistant using Open AI's ChatGPT, Whisper. The entire solution is created using Python & Gradio.
epfl-dlab/aiflows
🤖🌊 aiFlows: The building blocks of your collaborative AI
p-lambda/dsir
DSIR large-scale data selection framework for language model training