gelu

There are 6 repositories under gelu topic.

  • knotgrass/Griffin

    Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models

    Language:Python9211

  • dcarpintero/transformer101

    Annotated vanilla implementation in PyTorch of the Transformer model introduced in 'Attention Is All You Need'.

    Language:Jupyter Notebook1200

  • himanshuvnm/PyTorch-regime-for-Deep-Kolmogorov-Method-for-Heat-Equation

    Here, we will provide a PyTorch regime to handle the partial differential equation solution of the heat equation by executing Deep Kolmogorov Method of Beck et. al.

    Language:Jupyter Notebook1100

  • jElhamm/Activation-Functions

    "The 'Activation Functions' project repository contains implementations of various activation functions commonly used in neural networks. "

    Language:Python1200

  • NamanMakkar/UoE-INFR11031-Advanced-Vision-CW-21-22

    This repository contains the code and the report for the coursework of INFR11031 Advanced Vision, a postgraduate course offered at The University of Edinburgh. The task was to train on limited and improve the accuracy of the ResNet-50 classifier on a small subset of the ImageNet dataset containing 50K training images and 50K test images. Achieved a mark of 74%

    Language:Jupyter Notebook10

  • Nandan91/relu-revival-normfree

    PyTorch implementation of normalization-free LLMs investigating entropic behavior to find desirable activation functions

    Language:Python