Module containg functions and tools for constructing a Neural Network and perform forward propagation.
Utils.py contains the following:
- DenseLayer: Construction of Neural Network Dense layer
- ActivationReLU: Rectified Linear activation class as follows - max(0,X)
- ActivationSoftMax: Soft Max activation class - exp(X)/sum(exp(X)) where X is an array of inputs.
- Loss: Parent class for loss calculations.
- CCE: Class to calculate Catagorical Cross-Entropy.
Utils.py also contains an example script showing how above tools can be chained to perfom construction and forward propagation.
🔔 Note: Utils.py requires Numpy Python library