mrsteyk/tiger-pytorch

🐯 Tiger - PyTorch

🐯 Tiger, Tight-fisted Optimizer, an optimizer that is extremely budget-conscious, in PyTorch! This is reimplementation of the original based on gh:lucidrains/lion-pytorch

WIP idk

Not fully tested!

Citation

@misc{tigeropt,
  title={Tiger: A Tight-fisted Optimizer},
  author={Jianlin Su},
  year={2023},
  howpublished={\url{https://github.com/bojone/tiger}},
}

@online{kexuefm-9512,
        title={Tiger：一个“抠”到极致的优化器},
        author={苏剑林},
        year={2023},
        month={Mar},
        url={\url{https://kexue.fm/archives/9512}},
}

@misc{https://doi.org/10.48550/arxiv.2302.06675,
    url     = {https://arxiv.org/abs/2302.06675},
    author  = {Chen, Xiangning and Liang, Chen and Huang, Da and Real, Esteban and Wang, Kaiyuan and Liu, Yao and Pham, Hieu and Dong, Xuanyi and Luong, Thang and Hsieh, Cho-Jui and Lu, Yifeng and Le, Quoc V.},
    title   = {Symbolic Discovery of Optimization Algorithms},
    publisher = {arXiv},
    year = {2023}
}