hkchengrex/CascadePSP

Tree leaves boundary refinement

lknnnli opened this issue · 5 comments

Dear Author,

I'm currently looking into your work to refine my coarse mask.

when I test your pipeline, straight lines and building border are very well refined, however, when there is tree leaves, the refinement look not quite good, you can see one example result from the following figure.My purpose is to perform sky segmentation. May I know your option about this issue? Is it because generalization? Do I need to train the model again with dataset contains more tree leaves?

DSC_9265

Thanks a lot for your kind help
With warm regards
Kangning Li

Might work better if you zoom into the tree region since there are different semantics in this scene. You can also try making trees the foreground. Re-training might help but there is no guarantee that it will work for all cases.

Dear Author,
Thanks for your kind reply,
I test again following your suggestions, this time I only segment tree, and I make tree as foreground
test

test

The image on top, is I get from Unreal Engine, tree as foreground, and the bottom one is I refine with your algorithm. It seems that CascadePSP behaves a little bit over-masking?

I'm not sure whether this speculate is correct, do you have any suggestion?
Thanks a lot for you help
With warm regards
Kangning LI

What's the input image/mask?

What's the input image/mask?
img_ComputerVision_0_0_1655866627430303800

test

The top image is my input image, I got from Unreal Engine.
And The bottom image is my mask, I just Implemented a very simple segmentation tool to extract foreground tree.

Thanks a lot for you help
Best
Kangning Li

If I zoom into the image I see a lot of noises and artifacts. No surprise to me that it kind of failed in this case.