pkulium

6.828-1

Solution to homework and assignments from MIT's 6.828 (Operating Systems Engineering).

6.828mit

The source of lab and assignment for 6.828 of MIT

admm_lora

amc

[ECCV 2018] AMC: AutoML for Model Compression and Acceleration on Mobile Devices

ANP_backdoor

Codes for NeurIPS 2021 paper "Adversarial Neuron Pruning Purifies Backdoored Deep Models"

lockdown

modelpruning-devNxM

notes

Robustness-Aware-Pruning-ADMM

Code release for "Adversarial Robustness vs Model Compression, or Both?"

sparsegpt_admm

Code for the ICML 2023 paper "SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot".

pkulium/lockdown

pkulium/notes

pkulium/Robustness-Aware-Pruning-ADMM

Code release for "Adversarial Robustness vs Model Compression, or Both?"

pkulium/sparsegpt_admm

Code for the ICML 2023 paper "SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot".

pkulium/admm_lora

pkulium/amc

[ECCV 2018] AMC: AutoML for Model Compression and Acceleration on Mobile Devices

pkulium/ANP_backdoor

Codes for NeurIPS 2021 paper "Adversarial Neuron Pruning Purifies Backdoored Deep Models"

pkulium/modelpruning-devNxM

pkulium/AutoGPT

AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.

pkulium/BetterChatGPT

An amazing UI for OpenAI's ChatGPT (Website + Windows + MacOS + Linux)

pkulium/Black-Box-Defense-Linear

Robustify Black-Box Models (ICLR'22 - Spotlight)

pkulium/BlackBox

pkulium/client_defense

Github Repo for AAAI 2023 paper: On the Vulnerability of Backdoor Defenses for Federated Learning

pkulium/DBA

DBA: Distributed Backdoor Attacks against Federated Learning (ICLR 2020)

pkulium/Defending-Against-Backdoors-with-Robust-Learning-Rate

The code of AAAI-21 paper titled "Defending against Backdoors in Federated Learning with Robust Learning Rate".

pkulium/HIER

pkulium/I-BAU

Official Implementation of ICLR 2022 paper, ``Adversarial Unlearning of Backdoors via Implicit Hypergradient''

pkulium/Inference_withTorchTensorRT

Comparing Deep Learning Inference of Pytorch models running on CPU, CUDA and TensorRT

pkulium/layer-adaptive-sparsity

In progress.

pkulium/LoRA

Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

pkulium/Mezo_NM

pkulium/NMFADMM

A sparsity aware implementation of "Alternating Direction Method of Multipliers for Non-Negative Matrix Factorization with the Beta-Divergence" (ICASSP 2014).

pkulium/PNP_BlackBox

pkulium/ProbMask-official

Implementation of Effective Sparsification of Neural Networks with Global Sparsity Constraint

pkulium/PyTorch-CIFAR-10-autoencoder

This is a reimplementation of the blog post "Building Autoencoders in Keras". Instead of using MNIST, this project uses CIFAR10.

pkulium/QMeZO

MeZO: Fine-Tuning Language Models with Just Forward Passes. https://arxiv.org/abs/2305.17333

pkulium/RNP

Reconstructive Neuron Pruning for Backdoor Defense (ICML 2023)

pkulium/TensorRT

PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT

pkulium/VRPGE-Sparse-Training

Implementation of Efficient Neural Network Training via Forward and Backward Propagation Sparsification

pkulium/wanda

A simple and effective LLM pruning approach.