Shawn-Guo-CN

Alignment_with_Huggingface

EmergentNumerals

This is the repository for in progress project, Emergence of Numerals in Multi-Agent Autonomous Communication

GameBias-EmeCom2020

LeetCodePy3

My python3 code snippets for leetcode questions

LLM_Annotation_Reliability

Lossless_Text_Compression_with_Transformer

This repo is to demo the concept of lossless compression with Transformers as encoder and decoder.

lpNTK

ReinforcementLearningBookExamples

Example codes to implement the examples in Richard's book, Reinforcement Learning: An Introduction.

SFT_function_learning

Reference implementation for DPO (Direct Preference Optimization)

theano_tutorial

This is the source code of my Theano tutorial. You can browse it at http://www.shawnguo.cn/2016/07/26/theano-tutorial/

Shawn-Guo-CN/Lossless_Text_Compression_with_Transformer

This repo is to demo the concept of lossless compression with Transformers as encoder and decoder.

Shawn-Guo-CN/GameBias-EmeCom2020

Shawn-Guo-CN/SFT_function_learning

Reference implementation for DPO (Direct Preference Optimization)

Shawn-Guo-CN/lpNTK

Shawn-Guo-CN/Multiple-Generation-Based-Knowledge-Distillation

Multiple Generation Based Knowledge Distillation: A Roadmap

Shawn-Guo-CN/Alignment_with_Huggingface

Shawn-Guo-CN/Domain_Adaptation_LLMs

A library for exploaring the domain adapatation probelm in the alignment of LLMs

Shawn-Guo-CN/IteratedLearning

Neural Iterated Learning

Shawn-Guo-CN/JAX-vs-PyTorch-on-GPU

This project aims to compare between the computing speed of JAX and PyTorch on a various models of Nvidia GPUs.

Shawn-Guo-CN/Python-WCS-Palette

Shawn-Guo-CN/LLM_Annotation_Reliability

Shawn-Guo-CN/a-reproducible-research-workflow

Shawn-Guo-CN/beamer_theme_cdtnlp

Shawn-Guo-CN/Deep-Generative-Models-for-Natural-Language-Processing

DGMs for NLP. A roadmap.

Shawn-Guo-CN/Demo_Extend_Context_Window_LLMs

This repo is to demo how to extend the context window size of Transformer-based language models.

Shawn-Guo-CN/detr

End-to-End Object Detection with Transformers

Shawn-Guo-CN/doom.d

my doom.d configs

Shawn-Guo-CN/EasyLM

Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Flax.

Shawn-Guo-CN/GLM

GLM (General Language Model)

Shawn-Guo-CN/Hierarchical-Clustering

Hierarchical Clustering Python Implementation

Shawn-Guo-CN/JAX-Finetune-LLMs-Demo

This repository implements a demo system for fine-tuning large language models on JAX.

Shawn-Guo-CN/LIGHT

LIGHT is a platform for text-situated dialogue research. We originally hosted LIGHT as a live game with dialogue models in a grounded setting. This repo contains all of the code to get the LIGHT game running, as well as reproducible code for the research projects along the way of getting LIGHT to where it was.

Shawn-Guo-CN/Megatron-LM

Ongoing research training transformer models at scale

Shawn-Guo-CN/nanotron

Minimalistic large language model 3D-parallelism training

Shawn-Guo-CN/pytorch-cifar

95.47% on CIFAR10 with PyTorch

Shawn-Guo-CN/rpi4-osdev

Tutorial: Writing a "bare metal" operating system for Raspberry Pi 4

Shawn-Guo-CN/toha

A Hugo theme for personal portfolio

Shawn-Guo-CN/torchtitan

A native PyTorch Library for large model training

Shawn-Guo-CN/Unsupervised_Parsing

Shawn-Guo-CN/uoe-rl2023

Codebase for the coursework of the Reinforcement Learning (2022-23) course at the University of Edinburgh