Submissions will need to be sorted before ensembled.
lenguyenthedat opened this issue · 3 comments
lenguyenthedat commented
Often time, submissions can come from different language / libraries that might affect their orders.
I think we should have an option (or by default) to sort them beforehand to make sure we ensemble the right ids together 😃
MLWave commented
Yes, this bit me a few times already :). I have a script now that reorders submissions to make sure this doesn't happen, but I agree we should do this by default. I think it's possible to do without creating new files, but it would change all scripts.
I'll have a look later this week. In the meantime if you make any changes (always very welcome) I'll merge them in the repo.
Thanks for the feedback!
lenguyenthedat commented
I have a script to do that myself too! Will do it!
MLWave commented
Thank you very much!