This repo contains the activation functions code for different tasks.
Please cite following paper, if it is helpful to you:
Shiv Ram Dubey, Satish Kumar Singh and Bidyut Baran Chaudhuri, Activation Functions in Deep Learning: A Comprehensive Survey and Benchmark, Neurocomputing, 503:92-108, Sept 2022. (Elsevier) [link] [pdf] [Code]