demo doesn't create 6D pose annotations while it creates 3D cuboid

[monajalal]

(oneposeplus) mona@ard-gpu-01:~/OnePose_Plus_Plus$ bash scripts/demo_pipeline.sh $OBJ_NAME

So, I was not able to capture the Test images using the OnePose Capture app however I was able to get annotations data. What I did was removing the annotations for a new capture and use it as Test.

That said, when I use it for test, it does create the 3D cuboid but not the 6D poses let's say as in ARposes.txt in the annotations

This is what I see after running the inference.

(base) mona@ard-gpu-01:~/OnePose_Plus_Plus/data/demo/OBJ/OBJ-test$ tree -L 1 .
.
├── color_full
├── Confidence
├── demo_video.mp4
├── Depth
├── detector_vis
├── Frames.m4v
├── Frames.txt
├── intrinsics.txt
├── pred_vis
└── Snapshot.png

5 directories, 5 files

The capture I used (annotated) for OBJ-test folder, initially had all these:

(base) mona@ard-gpu-01:~/Downloads/2023-06-19T16-25-50$ tree -L 1 .
.
├── ARposes.txt
├── Box.txt
├── Confidence
├── Depth
├── Frames.m4v
├── Frames.txt
└── Snapshot.png

2 directories, 5 files

Then I dropped the following from it:
ARposes.txt

# timestamp, tx, ty, tz, qw, qx, qy qz
1687206350.932255,-0.029750941,0.047298048,-0.010886715,0.9446257,-0.32589737,-0.011759505,-0.03653703
1687206350.9822595,-0.029865185,0.047297176,-0.010619384,0.9444917,-0.3263862,-0.011976792,-0.035552267
1687206351.0322642,-0.02974034,0.047707926,-0.009946389,0.94484186,-0.32537258,-0.011555501,-0.035679717
1687206351.0822682,-0.029597593,0.04785826,-0.00964065,0.9453842,-0.32379487,-0.011773704,-0.03559401
1687206351.1322727,-0.029326074,0.048182685,-0.009261744,0.9455981,-0.32314074,-0.0119062895,-0.03581094

I didn't remove the Frames.txt since it only have camera calibration information.

That said, are you able to modify the repo so that it also drops the ARposes.txt after the demo is run on the test video? This would enables us to calculate the errors. I think this might be doable given you are able to drop the 3D cuboid in blue for the OBJ-test.

Also, could you please let us know what your test capture $ tree . looks like since I see a couple other people having issue with capture for test data. I have iPhone 14 Pro Max.

Thanks a lot for any feedback.