Pinned Repositories
a-tour-of-pytorch-optimizers
A tour of different optimization algorithms in PyTorch.
academicpages.github.io
Github Pages template for academic personal websites, forked from mmistakes/minimal-mistakes
awesome-causality-algorithms
An index of algorithms for learning causality with data
awesome-causality-data
A data index for learning causality.
Awesome-Efficient-LLM
A curated list for Efficient Large Language Models
awesome-mixture-of-experts
A collection of AWESOME things about mixture-of-experts
eda-for-text-classification
使用EDA技术对小型的不均衡的数据集做增强，验证其效果提升
Efficient_Foundation_Model_Survey
Survey Paper List - Efficient LLM and Foundation Models
QuestForMachineLearning-Camp
深度之眼《百面机器学习》训练营
Rationale4CDECR
Danield21's Repositories
Danield21/Rationale4CDECR
Danield21/academicpages.github.io
Github Pages template for academic personal websites, forked from mmistakes/minimal-mistakes
Danield21/AISystem
AISystem 主要是指AI系统，包括AI芯片、AI编译器、AI推理和训练框架等AI全栈底层技术
Danield21/AQLM
Official Pytorch repository for Extreme Compression of Large Language Models via Additive Quantization https://arxiv.org/pdf/2401.06118.pdf
Danield21/Awesome-LLM-Compression
Awesome LLM compression research papers and tools.
Danield21/Awesome-LLM-Survey
An Awesome Collection for LLM Survey
Danield21/awsome-distributed-training
Collection of best practices, reference architectures, model training examples and utilities to train large models on AWS.
Danield21/BAdam
Danield21/calculate-flops.pytorch
The calflops is designed to calculate FLOPs、MACs and Parameters in all various neural networks, such as Linear、 CNN、 RNN、 GCN、Transformer(Bert、LlaMA etc Large Language Model)
Danield21/compute-better-spent
Danield21/DynMoE
[Preprint] Dynamic Mixture of Experts: An Auto-Tuning Approach for Efficient Transformer Models
Danield21/Hyper_MoE
Danield21/Jetson-NANO-4GB
Jetson NANO 4GB B01/SUB Developer Kit
Danield21/Lamini-Memory-Tuning
Banishing LLM Hallucinations Requires Rethinking Generalization
Danield21/llm-compression-intelligence
Official github repo for the paper "Compression Represents Intelligence Linearly"
Danield21/LoRA-GA
Danield21/LoRA-Pro
Official code for our paper, "LoRA-Pro: Are Low-Rank Adapters Properly Optimized? "
Danield21/MC-SMoE
[ICLR 2024 Spotlight] Code for the paper "Merge, Then Compress: Demystify Efficient SMoE with Hints from Its Routing Policy"
Danield21/MEFT
Danield21/MoRA
Danield21/MoSLoRA
Danield21/MultimodalOCR
On the Hidden Mystery of OCR in Large Multimodal Models (OCRBench)
Danield21/nanotron
Minimalistic large language model 3D-parallelism training
Danield21/Qwen2-Audio
The official repo of Qwen2-Audio chat & pretrained large audio language model proposed by Alibaba Cloud.
Danield21/redco
NAACL '24 (Demo) / MlSys @ NeurIPS '23 - RedCoast: A Lightweight Tool to Automate Distributed Training and Inference
Danield21/SECURE
ACL'2024-Main: Synergetic Event Understanding: A Collaborative Approach to Cross-Document Event Coreference Resolution with Large Language Models
Danield21/strictjson
A Strict JSON Framework for LLM Outputs
Danield21/StructuredFFN
The official code of "Building on Efficient Foundations: Effectively Training LLMs with Structured Feedforward Layers"
Danield21/Subspace-Tuning
A generalized framework for subspace tuning methods in parameter efficient fine-tuning.
Danield21/unsloth
Finetune Llama 3, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory