why it stop in first trian step when i train it in my dataset
FENGShuanglang opened this issue · 5 comments
The training is happening, the output is printed every 50 steps, so it might take some time until you see the next step, you can modify the train function to remove this 50 step output condition as needed.
yes,you are right!,but i think it is so slow for me ,It takes about 20 seconds to process a picture，I wonder if it is normal？I have used GPU
The tiramisu is a deep network, and it's memory consumption is quadratic because of how tensorflow computes gradients. Also, your images are high resolution. Combined all these facts, it will be slow. You can either try reducing the dense blocks, number of layers or your image size to make it faster.
If you have access to a better GPU (V100s), that should also help, but I realize not everyone does.
OK,thank you very much ,but I wonder Why does the loss not converge? I am doing multi-class segmentation.
60 iterations is too low, the Tiramisu is known to be difficult to optimize, see, try training it longer.