scaling-laws
There are 13 repositories under scaling-laws topic.
huggingface/datablations
Scaling Data-Constrained Language Models
LAION-AI/scaling-laws-openclip
Reproducible scaling laws for contrastive language-image learning (https://arxiv.org/abs/2212.07143)
kyo-takano/chinchilla
A toolkit for scaling law research ⚖
xiaoyuxie-vico/PyDimension
Dimensionless learning codes for our paper called "Data-driven discovery of dimensionless numbers and governing laws from scarce measurements".
SLAMPAI/large-scale-pretraining-transfer
Code for reproducing the experiments on large-scale pre-training and transfer learning for the paper "Effect of large-scale pre-training on full and few-shot transfer learning for natural and medical images" (https://arxiv.org/abs/2106.00116)
machinelearningnuremberg/DPL
[NeurIPS 2023] Multi-fidelity hyperparameter optimization with deep power laws that achieves state-of-the-art results across diverse benchmarks.
VITA-Group/Data-Efficient-Scaling
[ICML 2023] "Data Efficient Neural Scaling Law via Model Reusing" by Peihao Wang, Rameswar Panda, Zhangyang Wang
christinakim/scaling-laws-for-language-transfer
code for Scaling Laws for Language Transfer Learning
benjaminnNgo/ScalingTGNs
First temporal graph foundation model dataset and benchmark
supersimple33/Scaling-Laws
A method for calculating scaling laws for LLMs from publicly available models
linhaowei1/Fine-tuning-Scaling-Law
🌹[ICML 2024] Selecting Large Language Model to Fine-tune via Rectified Scaling Law
upunaprosk/small-language-models
Code for CoNLL BabyLM workshop Mini Minds: Exploring Bebeshka and Zlata Baby Models
tanaydesai/scaling-laws
Scaling laws web calculator to get a model's training compute flops, costs and energy utilization.