Kyriection
I am a Ph.D. student at @VITA-Group, University of Texas at Austin. My research interests include trustworthy, efficient, and quantum machine learning.
The University of Texas at AustinAustin, TX, USA
Pinned Repositories
H2O
[NeurIPS'23] H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models.
GaLore
GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection
Adv-SS-Pretraining
[CVPR 2020] Adversarial Robustness: From Self-Supervised Pre-Training to Fine-Tuning
Awesome-Distributed-Quantum-Computing
An awesome list of references for distributed quantum computing
Awesome-Quantum-Compiler
An awesome list of references for quantum compiler
llama-recipes
Scripts for fine-tuning Llama2 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization & question answering. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment.Demo apps to showcase Llama2 for WhatsApp & Messenger
llama-recipes
Scripts for fine-tuning Meta Llama with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment. Demo apps to showcase Meta Llama for WhatsApp & Messenger.
BNN_NoBN
[CVPRW 21] "BNN - BN = ? Training Binary Neural Networks without Batch Normalization", Tianlong Chen, Zhenyu Zhang, Xu Ouyang, Zechun Liu, Zhiqiang Shen, Zhangyang Wang
PrAC-LTH
[ICML 2021] "Efficient Lottery Ticket Finding: Less Data is More" by Zhenyu Zhang*, Xuxi Chen*, Tianlong Chen*, Zhangyang Wang
Q-GaLore
Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.
Kyriection's Repositories
Kyriection/Awesome-Distributed-Quantum-Computing
An awesome list of references for distributed quantum computing
Kyriection/Awesome-Quantum-Compiler
An awesome list of references for quantum compiler
Kyriection/DoRA
[ICML2024 (Oral)] Official PyTorch implementation of DoRA: Weight-Decomposed Low-Rank Adaptation
Kyriection/LLaMA-Factory
Unified Efficient Fine-Tuning of 100+ LLMs (ACL 2024)
Kyriection/llama-recipes
Scripts for fine-tuning Llama2 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization & question answering. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment.Demo apps to showcase Llama2 for WhatsApp & Messenger
Kyriection/auto_LiRPA
[NeurIPS 2020]auto_LiRPA: An Automatic Linear Relaxation based Perturbation Analysis Library for Neural Networks
Kyriection/compexp
Compositional Explanations of Neurons https://arxiv.org/abs/2006.14032
Kyriection/CV-Backbones
CV backbones including GhostNet, TinyNet and TNT.
Kyriection/autogen
Enable Next-Gen Large Language Model Applications. Join our Discord: https://discord.gg/pAbnFJrkgZ
Kyriection/CATS
Kyriection/CV_LTH_Pre-training
[CVPR 2021] "The Lottery Tickets Hypothesis for Supervised and Self-supervised Pre-training in Computer Vision Models" Tianlong Chen, Jonathan Frankle, Shiyu Chang, Sijia Liu, Yang Zhang, Michael Carbin, Zhangyang Wang
Kyriection/deit
Official DeiT repository
Kyriection/fairseq
Facebook AI Research Sequence-to-Sequence Toolkit written in Python.
Kyriection/FastChat
An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
Kyriection/FasterMoE
Kyriection/fastmoe
A fast MoE impl for PyTorch
Kyriection/flash-linear-attention
Efficient implementations of state-of-the-art linear attention models in Pytorch and Triton
Kyriection/GaLore
GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection
Kyriection/H2O
Kyriection/Kyriection
Kyriection/LLaGA
Official code for LLaGA: Large Language and Graph Assistant
Kyriection/llm-ft-challenge
Kyriection/lm-evaluation-harness
A framework for few-shot evaluation of autoregressive language models.
Kyriection/loss-landscape
Code for visualizing the loss landscape of neural nets
Kyriection/mamba
Kyriection/models
Models and examples built with TensorFlow
Kyriection/open_lth
A repository in preparation for open-sourcing lottery ticket hypothesis code.
Kyriection/RecSys22_CommunityDetectionQuantumComputing
This repository contains the source code for the LBR article "Towards Recommender Systems with Community Detection and Quantum Computing" soon to be published at RecSys 2022.
Kyriection/stanford_alpaca
Code and documentation to train Stanford's Alpaca models, and generate the data.
Kyriection/volo
VOLO: Vision Outlooker for Visual Recognition