Kyriection
I am a Ph.D. student at @VITA-Group, University of Texas at Austin. My research interests include trustworthy, efficient, and quantum machine learning.
The University of Texas at AustinAustin, TX, USA
Pinned Repositories
H2O
[NeurIPS'23] H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models.
GaLore
GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection
Adv-SS-Pretraining
[CVPR 2020] Adversarial Robustness: From Self-Supervised Pre-Training to Fine-Tuning
Awesome-Distributed-Quantum-Computing
An awesome list of references for distributed quantum computing
Awesome-Quantum-Compiler
An awesome list of references for quantum compiler
llama-recipes
Scripts for fine-tuning Llama2 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization & question answering. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment.Demo apps to showcase Llama2 for WhatsApp & Messenger
llama-recipes
Scripts for fine-tuning Meta Llama3 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment. Demo apps to showcase Meta Llama3 for WhatsApp & Messenger.
Adv-SS-Pretraining
[CVPR 2020] Adversarial Robustness: From Self-Supervised Pre-Training to Fine-Tuning
BNN_NoBN
[CVPRW 21] "BNN - BN = ? Training Binary Neural Networks without Batch Normalization", Tianlong Chen, Zhenyu Zhang, Xu Ouyang, Zechun Liu, Zhiqiang Shen, Zhangyang Wang
SViTE
[NeurIPS'21] "Chasing Sparsity in Vision Transformers: An End-to-End Exploration" by Tianlong Chen, Yu Cheng, Zhe Gan, Lu Yuan, Lei Zhang, Zhangyang Wang
Kyriection's Repositories
Kyriection/Awesome-Distributed-Quantum-Computing
An awesome list of references for distributed quantum computing
Kyriection/Awesome-Quantum-Compiler
An awesome list of references for quantum compiler
Kyriection/llama-recipes
Scripts for fine-tuning Llama2 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization & question answering. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment.Demo apps to showcase Llama2 for WhatsApp & Messenger
Kyriection/Adv-SS-Pretraining
[CVPR 2020] Adversarial Robustness: From Self-Supervised Pre-Training to Fine-Tuning
Kyriection/auto_LiRPA
[NeurIPS 2020]auto_LiRPA: An Automatic Linear Relaxation based Perturbation Analysis Library for Neural Networks
Kyriection/compexp
Compositional Explanations of Neurons https://arxiv.org/abs/2006.14032
Kyriection/CV-Backbones
CV backbones including GhostNet, TinyNet and TNT.
Kyriection/autogen
Enable Next-Gen Large Language Model Applications. Join our Discord: https://discord.gg/pAbnFJrkgZ
Kyriection/CV_LTH_Pre-training
[CVPR 2021] "The Lottery Tickets Hypothesis for Supervised and Self-supervised Pre-training in Computer Vision Models" Tianlong Chen, Jonathan Frankle, Shiyu Chang, Sijia Liu, Yang Zhang, Michael Carbin, Zhangyang Wang
Kyriection/deit
Official DeiT repository
Kyriection/fairseq
Facebook AI Research Sequence-to-Sequence Toolkit written in Python.
Kyriection/FastChat
An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
Kyriection/FasterMoE
Kyriection/fastmoe
A fast MoE impl for PyTorch
Kyriection/flash-linear-attention
Efficient implementations of state-of-the-art linear attention models in Pytorch and Triton
Kyriection/H2O
Kyriection/Kyriection
Kyriection/LLaGA
Official code for LLaGA: Large Language and Graph Assistant
Kyriection/llm-ft-challenge
Kyriection/lm-evaluation-harness
A framework for few-shot evaluation of autoregressive language models.
Kyriection/loss-landscape
Code for visualizing the loss landscape of neural nets
Kyriection/mamba
Kyriection/models
Models and examples built with TensorFlow
Kyriection/open_lth
A repository in preparation for open-sourcing lottery ticket hypothesis code.
Kyriection/RecSys22_CommunityDetectionQuantumComputing
This repository contains the source code for the LBR article "Towards Recommender Systems with Community Detection and Quantum Computing" soon to be published at RecSys 2022.
Kyriection/SSE-Net-Update
Kyriection/stanford_alpaca
Code and documentation to train Stanford's Alpaca models, and generate the data.
Kyriection/volo
VOLO: Vision Outlooker for Visual Recognition