/TIUD

The new type of activation function in the machine learning.

Primary LanguagePython

TIUD(Tuning Input Unit from Distribution)

  • It is my personal old side project and i don't work with it anymore.
  • It is about new type of activation function in the deep neural network.
  • I just posted it to show my history(What i did).
  • (6. 11. 2019 ~ 11. 6. 2019)

The evolution

  • APReLU -> TIUD -> ...

    • APReLU Architecture APReLU

    • TIUD Architecture TIUD

The performance

  • Inception Model

    • ReLU

      INCEPTION_RELU

    • TIUD

      INCEPTION_TIUD

  • Resnet Model

    • ReLU

      RESNET_RELU

    • TIUD

      RESNET_TIUD


License

ⓒ 2019 All rights reserved by Hwakyeom Kim