Plot error
Closed this issue · 4 comments
Hi!
I ran autorank to rank algorithms and the last sentence of the result is: "Based on the post-hoc Nemenyi test, we assume that there are no significant differences within the following groups: sobel and random; random and guidedbackprop; guidedbackprop and smoothgrad; smoothgrad and rise; rise, scorecam, and layercam. All other differences are significant.".
However, this does not reflect on the plot (see figure). It seems that the plot function has a problem
.
Could you provide data to replicate this?
I just negated reverse in the call to get_sorted_rank_groups and it worked for my case... not sure if in general.
The issue seems to be that the sorting from one of the used libraries is unreliable or was changed at some point. At least this is what it looks like based on what @AlexandreAbraham found in #11. When I have time (so definitively after the current lecture period), I will look at rewriting that part to not assume sorting behavior, hoping that this would then be fixed.
This should now be fixed. I will push a release in the next days as well. If the issue still exists, please reopen.