musikalkemist/pytorchforaudio

Loss stays same throught training

Closed this issue · 4 comments

I trained this urban sound classifier for 10 epochs, but there one problem
The loss stays extactly same except for 1st epochs. What could be the reason?

image

I trained this urban sound classifier for 10 epochs, but there one problem The loss stays extactly same except for 1st epochs. What could be the reason?

image

Hello. I had met the same problem with yours. Have you solved the problem?

I trained this urban sound classifier for 10 epochs, but there one problem The loss stays extactly same except for 1st epochs. What could be the reason?
image

Hello. I had met the same problem with yours. Have you solved the problem?

Try changing cnn architecture. I tried completely different one and loss changes starts to decrease

image

Thanks for your answer! I solved the problem after looking through the comments under the Author's lessons on YouTube. The viewers had the same problems. It seems to be the conflict between the loss function CrossEntropyLoss and the softmax layer. After I removed the softmax layer, training became normal and the model works well.
image

Thanks for doing that digging pgq18! I was facing the same problem.