d-li14/involution

[feature request] involution 3D

baibaidj opened this issue · 2 comments

Hi. The work on involution is awesome and I'd like to try them on medical imaging that requires 3D operation.
I was wondering if you could spare some time to implement the 3D version fo involution_cuda?
I found the involution_naive could not be extended to 3D because the torch.fold and torch.unfold only support 4d tensor.
In previous issues, authors also mentioned that the naive version was slower and consumed more memory. I guess that the problem will be aggravated for 3D version.
Looking forward to trying this new ops. Thank you.

@memmelma and I implemented a pure PyTorch version of a 3D Involution which you could try out. However, the native PyTorch implementation is kinda GPU memory hungry due to the unfold operation, which was also pointed out by the author in issue #1. Very awesome work by the way @d-li14!

@memmelma and I implemented a pure PyTorch version of a 3D Involution which you could try out. However, the native PyTorch implementation is kinda GPU memory hungry due to the unfold operation, which was also pointed out by the author in issue #1. Very awesome work by the way @d-li14!

Wonderful work. I will try it.