MarilynKeller/OSSO

Issue with Intersection of Segments in Exported Skeleton Model and Potential Manually Modification

Opened this issue · 4 comments

I have encountered an issue with the exported skeleton model where the model segments appear to intersect. The involved program components are register_star, infer_skeleton, and pose_skeleton.
image
image

I'm considering a potential workaround and need some guidance: Is it possible to manually edit the skeleton model to resolve the intersection problem and then use this modified model as an input for the pose_skeleton function? Would this approach create any unforeseen issues? Looking forward to your insights.

We don't have a loss to avoid those specific interpenetrations. You could edit the final skeleton mesh to correct for those interpenetrations.
If you edit the lying down inferred skeleton before reposing, it should help for the spine, but no guarranty that the scapula will not intersect with the thorax at all after reposing.
I think a way to do would be to add a loss to avoid interpenetration between the scapula and the thorax by fitting ellipsoids to them.

@MarilynKeller It seems that the ribs sometimes are not in the correct position, as shown in the images...
image
image

Can you specify what you mean with "Not in the correct position" ?
We do have light interpenetrations between the ribs and the skin in some poses as our rib cage is rigid.
For T12 and Rib 12, their relative position is the one that was in the template we used from Anatomy Transfer.

I mean T12 and Rib12.... For some results, the Rib12 may stick to T11, because of the scale and translation.... I check the template. It is correct.