jiahe7ay
A postgraduate student studying natural language processing.
South China Normal UniversityGuangzhou,Guangdong,China
Pinned Repositories
ChatGLM-6B
ChatGLM-6B: An Open Bilingual Dialogue Language Model | 开源双语对话语言模型
ChatGLM-RLHF
对ChatGLM直接使用RLHF提升或降低目标输出概率|Modify ChatGLM output with only RLHF
Chinese-miniMamba
This is a project on training a large language model on Chinese corpora using the Mamba architecture. Its aim is to explore the potential capabilities of the Mamba architecture on Chinese corpora.
infini-mini-transformer
This is a personal reimplementation of Google's Infini-transformer, utilizing a small 2b model. The project includes both model and training code.
llm_learning
这是个人关于llm的学习归纳，把我学到的知识分享给大家，让大家也能系统和简单学习llm理论及应用实战
MINI_LLM
This is a repository used by individuals to experiment and reproduce the pre-training process of LLM.
MiniCharacterLLM
这是一个一键让小参数大模型进行角色扮演的项目，从数据构成和训练都包含在这项目中
Phi2-mini-Chinese
Phi2-Chinese-0.2B 从0开始训练自己的Phi2中文小模型，支持加载本地知识库做检索增强生成RAG。Training your own Phi2 small chat model from scratch.
Pretrained-Language-Model
Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.
python
Python学习
jiahe7ay's Repositories
jiahe7ay/MINI_LLM
This is a repository used by individuals to experiment and reproduce the pre-training process of LLM.
jiahe7ay/infini-mini-transformer
This is a personal reimplementation of Google's Infini-transformer, utilizing a small 2b model. The project includes both model and training code.
jiahe7ay/MiniCharacterLLM
这是一个一键让小参数大模型进行角色扮演的项目，从数据构成和训练都包含在这项目中
jiahe7ay/llm_learning
这是个人关于llm的学习归纳，把我学到的知识分享给大家，让大家也能系统和简单学习llm理论及应用实战
jiahe7ay/python
Python学习
jiahe7ay/ChatGLM-6B
ChatGLM-6B: An Open Bilingual Dialogue Language Model | 开源双语对话语言模型
jiahe7ay/ChatGLM-RLHF
对ChatGLM直接使用RLHF提升或降低目标输出概率|Modify ChatGLM output with only RLHF
jiahe7ay/Chinese-miniMamba
This is a project on training a large language model on Chinese corpora using the Mamba architecture. Its aim is to explore the potential capabilities of the Mamba architecture on Chinese corpora.
jiahe7ay/Phi2-mini-Chinese
Phi2-Chinese-0.2B 从0开始训练自己的Phi2中文小模型，支持加载本地知识库做检索增强生成RAG。Training your own Phi2 small chat model from scratch.
jiahe7ay/Pretrained-Language-Model
Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.
jiahe7ay/Swin-Transformer
This is an official implementation for "Swin Transformer: Hierarchical Vision Transformer using Shifted Windows".
jiahe7ay/transformers
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.