Pinned Repositories
AI-Writer
AI 写小说，生成玄幻和言情网文等等。中文预训练生成模型。采用我的 RWKV 模型，类似 GPT-2 。AI写作。RWKV for Chinese novel generation.
BlinkDL.github.io
A collection of State of the Art results in AI / ML / DL / RL / CV / NLP.
ChatRWKV
ChatRWKV is like ChatGPT but powered by RWKV (100% RNN) language model, and open source.
Hua
Hua is an AI image editor with Stable Diffusion (and more).
LinearAttentionArena
Here we will test various linear attention designs.
minGPT-tuned
A *tuned* minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training
nanoRWKV
RWKV in nanoGPT style
RWKV-CUDA
The CUDA version of the RWKV language model ( https://github.com/BlinkDL/RWKV-LM )
RWKV-LM
RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.
SmallInitEmb
LayerNorm(SmallInit(Embedding)) in a Transformer to improve convergence
BlinkDL's Repositories
BlinkDL/RWKV-LM
RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.
BlinkDL/ChatRWKV
ChatRWKV is like ChatGPT but powered by RWKV (100% RNN) language model, and open source.
BlinkDL/AI-Writer
AI 写小说，生成玄幻和言情网文等等。中文预训练生成模型。采用我的 RWKV 模型，类似 GPT-2 。AI写作。RWKV for Chinese novel generation.
BlinkDL/Hua
Hua is an AI image editor with Stable Diffusion (and more).
BlinkDL/RWKV-CUDA
The CUDA version of the RWKV language model ( https://github.com/BlinkDL/RWKV-LM )
BlinkDL/nanoRWKV
RWKV in nanoGPT style
BlinkDL/minGPT-tuned
A *tuned* minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training
BlinkDL/BlinkDL.github.io
A collection of State of the Art results in AI / ML / DL / RL / CV / NLP.
BlinkDL/BlinkDL
A minimalist deep learning library in Javascript using WebGL + asm.js. Run convolutional neural network in your browser.
BlinkDL/RWKV-v2-RNN-Pile
RWKV-v2-RNN trained on the Pile. See https://github.com/BlinkDL/RWKV-LM for details.
BlinkDL/BookCNN
《深度卷积网络：原理与实践》现已在淘宝天猫京东当当发售. 这里是其中的代码下载.
BlinkDL/LinearAttentionArena
Here we will test various linear attention designs.
BlinkDL/SmallInitEmb
LayerNorm(SmallInit(Embedding)) in a Transformer to improve convergence
BlinkDL/WorldModel
Let us make Psychohistory (as in Asimov) a reality, and accessible to everyone. Useful for LLM grounding and games / fiction / business / finance / governance, and can align agents with human too.
BlinkDL/LM-Trick-Questions
Here we collect trick questions and failed tasks for open source LLMs to improve them.
BlinkDL/Basis
The Basis Programming Language
BlinkDL/BlinkToDo
A minimalist ToDo.txt page. 如果你的ToDo有一百项以上，试试这个基于txt的极简事项管理工具。
BlinkDL/AntiAging
List of Anti-aging Research
BlinkDL/RWKV.com
BlinkDL/Nala
The Nala markup, to turn a "Natural Language" sentence into a code-like statement. Nala 标注，将自然语言变为编程语言。
BlinkDL/PathTracingJS
Path tracing demo with JS in your web browser. 用浏览器JS做路径跟踪渲染。
BlinkDL/BlinkColorTheme
A colorful theme for HTML+JS+CSS.
BlinkDL/Model_Leaderboard
Leaderboard of AI models.
BlinkDL/FastChat
An open platform for training, serving, and evaluating large languages. Release repo for Vicuna and FastChat-T5.
BlinkDL/MathBook
一个较为系统的数学笔记（graduate level）
BlinkDL/BasisLang.com
BasisLang.com
BlinkDL/gpt-neox
An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.
BlinkDL/libai
LiBai(李白): A Toolbox for Large-Scale Distributed Parallel Training
BlinkDL/OpenAudioTest
BlinkDL/ProjectIvory
Project Ivory is a simple forum written a few years ago.