Implementation for: An Analysis of Single-Layer Networks in Unsupervised Feature Learning
Adam Coates, Andrew Ng, Honglak Lee ; Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics, PMLR 15:215-223, 2011.
Single Layer neural network's performence is not so good, which have accuracy of 55% on CIFAR-10.
However, with two images preprocessing techniques(PCA whintening and Kmeans), it can reach 75% on CIFAR-10 (Detailed report in here)
- Put cifar-10 dataset in ./dataset
- run python redo.py dataset
neural_net.py implement the neural net
redo.py implement preprocessing
The accuracy of different combinations of hyperparameters without preprocessing are shown in two .csv files
here and here
Other files are not important, written for comparing different techniques and searching for parameters