About the details of inference!!!
ljy1234-special opened this issue · 1 comments
ljy1234-special commented
When I debug the program to the model input, I found that the result obtained by inputting the data one by one (batchsize=1) is different from the result obtained by inputting all the data at the same time (batchsize=3 or a bigger number), may I know the reason for this? The process is as follows:
Experimentally, I found that the output of these two corresponding batch is inconsistent and has a large gap. What is the reason for this situation? (random seed is fixed)
ljy1234-special commented
I'm sorry, the above problem still exists.