ASSERT-KTH/CodRep

Add explanation about loss function in case of several predictions

EgorBu opened this issue · 2 comments

Hello,
Thank you for a great competition!
One thing is not very clear to me - how loss function is computed in case of prediction several lines per file here.
As I understand it will be minimal loss among all predictions from here. Is it correct?

Yes, when the algorithm predicts several lines, the minimal loss of all prediction will be chosen when calculating the average line error.

This is from the intuition that the user will only choose the most relevant answers and the rest does not really matter. As long as the number of predictions per files is limited to some small number, like outputting top 5 predictions.

I would add an explanation for loss function in case of multiline predictions. Thanks.

Added explanation for loss function in case of multiline predictions in commit 697bfcf