Getting random output

[charisoudis]

Hi and thanks for publishing the code of this great work!

I am getting the following weird output from a 3DPW frame:

Seeing the contact probs, it seems that most are between [0.4, 0.55], so it is like a pseudo-random prediction.
I am following your code for loading the model, and preparing the input.

Do you think that this is related to the checkpoint loading of the BSTRO model (I used the metro_3dpw_state_dict.bin)?

Best,
Thanos

[paulchhuang]

Hi,
If you are following the instructions here: https://github.com/paulchhuang/bstro/blob/main/docs/DEMO.md#human-scene-contact-detection, you should load the hsi_hrnet_3dpw_b32_checkpoint_15.bin downloaded from the RICH website ( hyperlink "BSTRO pre-trained checkpoint"), not metro_3dpw_state_dict.bin.
metro_3dpw_state_dict.bin is from another work METRO, which estimates joint positions, not contact. Two models share the same HRNet backbones so we used metro_3dpw_state_dict.bin to initialize its weight during training, but for inference you need only hsi_hrnet_3dpw_b32_checkpoint_15.bin if my memory serves me correctly.

[charisoudis]

That's right, thanks for the response. I got that fixed now!