The affine transform I'm using in rectify() seems to introduce a lot of 'spreading', not sure why. E.g. compare it to the skimage version with rectify_skimage() (at the edges -- look at a really small image to see the diff).
On the other hand, see #2