Extension - Add Hrnet as 2D detector
Closed this issue · 13 comments
timtensor commented
Apparently HrNET , for 2d pose estimation has higher accuracy and i guess that will improve the lifting from the 2D keypoints much better. However the joint order is COCO keypoints order and thus the lifting fails. Is it possible to add it as an extension.
Hrnet Keypoints output
2d keypoints
which returns 1x17x3 where 1 is single person , followed by 17 keypoints and confidnce scores. The output was modified a bit to match with the input required for json files in openpose but i think , there has to be some more modifications to be done ?
ArashHosseini commented
timtensor commented
Hello if i output the keypoints per frame and output it to the following format. I guess we can it 2D lifting . My only concern is that the keypoint order for COCO and OpenPose COCO is quite different do you think that would matter ?
{"people": [{"pose_keypoints_2d": [374, 460, 374, 516, 324, 518, 296, 596, 336, 636, 424, 512, 446, 590, 424, 604, 340, 660, 324, 776, 308, 890, 400, 660, 402, 792, 400, 904, 364, 448, 382, 450, 348, 450, 396, 450]}]}
ArashHosseini commented
@timtensor don't worry, COCO has always the same format, there is also body_25, see we can feed 3d-pose with the json above without problems, did you test it already?
timtensor commented
I will modify the code a bit and try to get the json files perhaps . in the format mentioned above. The keypoint ordering for HrNET is as folllows I tried sometime ago in posenet which outputs the same keypoint order and it was quite bad , so i was wondering if the keypoint ordering mattered a lot
joints = {
"coco": {
"keypoints": {
0: "nose",
1: "left_eye",
2: "right_eye",
3: "left_ear",
4: "right_ear",
5: "left_shoulder",
6: "right_shoulder",
7: "left_elbow",
8: "right_elbow",
9: "left_wrist",
10: "right_wrist",
11: "left_hip",
12: "right_hip",
13: "left_knee",
14: "right_knee",
15: "left_ankle",
16: "right_ankle"
},
"skeleton": [
# # [16, 14], [14, 12], [17, 15], [15, 13], [12, 13], [6, 12], [7, 13], [6, 7], [6, 8],
# # [7, 9], [8, 10], [9, 11], [2, 3], [1, 2], [1, 3], [2, 4], [3, 5], [4, 6], [5, 7]
# [15, 13], [13, 11], [16, 14], [14, 12], [11, 12], [5, 11], [6, 12], [5, 6], [5, 7],
# [6, 8], [7, 9], [8, 10], [1, 2], [0, 1], [0, 2], [1, 3], [2, 4], [3, 5], [4, 6]
[15, 13], [13, 11], [16, 14], [14, 12], [11, 12], [5, 11], [6, 12], [5, 6], [5, 7],
[6, 8], [7, 9], [8, 10], [1, 2], [0, 1], [0, 2], [1, 3], [2, 4], # [3, 5], [4, 6]
[0, 5], [0, 6]
]
},
timtensor commented
I modified the output of the 2d joints to have it as a input to 3d pose baseline. I have a following directory
├── openpose_output_dir
│ ├── 000000000000_keypoints.json
│ ├── 000000000001_keypoints.json
│ ├── 000000000002_keypoints.json
│ ├── 000000000003_keypoints.json
│ ├── 000000000004_keypoints.json
│ ├── 000000000005_keypoints.json
│ ├── 000000000006_keypoints.json
When i execute the command
python src/openpose_3dpose_sandbox.py --camera_frame --residual --batch_norm --dropout 0.5 --max_norm --evaluateActionWise --use_sh --epochs 200 --load 4874200 --pose_estimation_json ./openpose_output_dir/ --write_gif --gif_fps 24
I get the following error in the flag
name, value, suggestions=suggestions)
absl.flags._exceptions.UnrecognizedFlagError: Unknown command line flag 'pose_estimation_json'
Using p```
ython3.7 and anaconda
tensorflow 1.14.0 mkl_py37h45c423b_0
ArashHosseini commented
check /src/predict_3dpose.py file for this arg "pose_estimation_json", can you see it?
timtensor commented
Hi I have this other issue that comes up , since the number of keypoints is 17x2 and that results in a json file of length 1x34 which i think results in the following error I think all the json files from open pose are of the size 1x36
Could that be the reason ?
Traceback (most recent call last):
File "src/openpose_3dpose_sandbox.py", line 447, in <module>
tf.app.run()
File "/home/test/.local/lib/python3.6/site-packages/tensorflow/python/platform/app.py", line 48, in run
_sys.exit(main(_sys.argv[:1] + flags_passthrough))
File "src/openpose_3dpose_sandbox.py", line 230, in main
smoothed = read_openpose_json()
File "src/openpose_3dpose_sandbox.py", line 128, in read_openpose_json
drop_curves_plot = show_anim_curves(cache, plt)
File "src/openpose_3dpose_sandbox.py", line 31, in show_anim_curves
x = val[:,o]
A sample json output
{"people": [{"pose_keypoints_2d": [288.9479064941406, 664.888916015625, 276.7291564941406, 681.111083984375, 276.7291564941406, 660.8333129882812, 280.8020935058594, 701.388916015625, 276.7291564941406, 648.6666870117188, 337.8229064941406, 725.7222290039062, 325.6041564941406, 636.5, 407.0625, 713.5555419921875, 398.9166564941406, 583.7777709960938, 358.1875, 668.9444580078125, 358.1875, 604.0555419921875, 415.2083435058594, 733.8333129882812, 419.28125, 673.0, 476.3020935058594, 717.611083984375, 472.2291564941406, 612.1666870117188, 586.2708129882812, 741.9444580078125, 574.0520629882812, 616.2222290039062]}]}
Executed command
python3.6 src/openpose_3dpose_sandbox.py --camera_frame --residual --batch_norm --dropout 0.5 --max_norm --evaluateActionWise --use_sh --epochs 200 --load 4874200 --pose_estimation_json ./openpose_output_dir/ --write_gif --gif_fps 24
ArashHosseini commented
can you show me the output of cache please?
timtensor commented
I tried to do a printout of cache but i could not find anything . But i ran next time with the verbose option set to 3
DEBUG:__main__:reading 000000000319_keypoints.json
DEBUG:__main__:found [109.625, 673.9444580078125, 103.66666412353516, 685.8333129882812, 97.70833587646484, 668.0, 109.625, 709.611083984375, 103.66666412353516, 656.111083984375, 175.1666717529297, 733.388916015625, 169.2083282470703, 632.3333129882812, 258.5833435058594, 739.3333129882812, 246.6666717529297, 596.6666870117188, 282.4166564941406, 697.7222290039062, 264.5416564941406, 590.7222290039062, 330.0833435058594, 727.4444580078125, 330.0833435058594, 656.111083984375, 461.1666564941406, 727.4444580078125, 455.2083435058594, 620.4444580078125, 580.3333129882812, 745.2777709960938, 568.4166870117188, 614.5] for frame 319
DEBUG:__main__:reading 000000000320_keypoints.json
DEBUG:__main__:found [116.4375, 673.9444580078125, 104.5625, 685.8333129882812, 104.5625, 668.0, 116.4375, 709.611083984375, 110.5, 656.111083984375, 175.8125, 733.388916015625, 175.8125, 632.3333129882812, 264.875, 739.3333129882812, 247.0625, 596.6666870117188, 282.6875, 691.7777709960938, 264.875, 590.7222290039062, 336.125, 727.4444580078125, 336.125, 656.111083984375, 460.8125, 727.4444580078125, 454.875, 620.4444580078125, 585.5, 745.2777709960938, 567.6875, 614.5] for frame 320
DEBUG:__main__:reading 000000000321_keypoints.json
DEBUG:__main__:found [127.0625, 676.7777709960938, 115.25, 688.5555419921875, 115.25, 665.0, 121.15625, 706.2222290039062, 121.15625, 653.2222290039062, 186.125, 729.7777709960938, 180.21875, 635.5555419921875, 268.8125, 735.6666870117188, 251.09375, 594.3333129882812, 280.625, 688.5555419921875, 262.90625, 588.4444580078125, 339.6875, 729.7777709960938, 339.6875, 659.111083984375, 463.71875, 729.7777709960938, 457.8125, 617.888916015625, 587.75, 747.4444580078125, 570.03125, 612.0] for frame 321
DEBUG:__main__:reading 000000000322_keypoints.json
DEBUG:__main__:found [134.75, 671.861083984375, 123.0, 683.5833129882812, 123.0, 666.0, 128.875, 707.0277709960938, 128.875, 654.2777709960938, 193.5, 730.4722290039062, 187.625, 630.8333129882812, 275.75, 736.3333129882812, 258.125, 595.6666870117188, 287.5, 689.4444580078125, 264.0, 583.9444580078125, 340.375, 724.611083984375, 340.375, 654.2777709960938, 469.625, 730.4722290039062, 457.875, 613.25, 587.125, 748.0555419921875, 569.5, 613.25] for frame 322
DEBUG:__main__:reading 000000000323_keypoints.json
DEBUG:__main__:found [146.6875, 675.0555419921875, 130.125, 686.111083984375, 130.125, 664.0, 135.6458282470703, 708.2222290039062, 135.6458282470703, 652.9444580078125, 201.8958282470703, 730.3333129882812, 196.375, 630.8333129882812, 279.1875, 730.3333129882812, 262.625, 597.6666870117188, 284.7083435058594, 686.111083984375, 268.1458435058594, 586.611083984375, 345.4375, 724.8055419921875, 345.4375, 658.4722290039062, 466.8958435058594, 724.8055419921875, 461.375, 614.25, 582.8333129882812, 741.388916015625, 571.7916870117188, 614.25] for frame 323
DEBUG:__main__:reading 000000000324_keypoints.json
DEBUG:__main__:found [150.625, 672.7222290039062, 139.875, 683.4444580078125, 139.875, 662.0, 150.625, 704.888916015625, 145.25, 651.2777709960938, 209.75, 731.6944580078125, 204.375, 629.8333129882812, 290.375, 731.6944580078125, 279.625, 586.9444580078125, 290.375, 678.0833129882812, 274.25, 581.5833129882812, 349.5, 731.6944580078125, 344.125, 662.0, 473.125, 726.3333129882812, 462.375, 613.75, 586.0, 742.4166870117188, 569.875, 613.75] for frame 324
DEBUG:__main__:reading 000000000325_keypoints.json
DEBUG:__main__:found [162.5, 667.5, 151.5, 684.0, 151.5, 662.0, 162.5, 700.5, 157.0, 651.0, 223.0, 728.0, 212.0, 629.0, 300.0, 728.0, 289.0, 590.5, 294.5, 678.5, 283.5, 585.0, 349.5, 728.0, 349.5, 662.0, 470.5, 728.0, 459.5, 612.5, 586.0, 744.5, 569.5, 612.5] for frame 325
DEBUG:__main__:reading 000000000326_keypoints.json
DEBUG:__main__:found [175.9583282470703, 668.7777709960938, 165.1666717529297, 679.5555419921875, 165.1666717529297, 658.0, 170.5625, 701.111083984375, 170.5625, 647.2222290039062, 229.9166717529297, 728.0555419921875, 224.5208282470703, 631.0555419921875, 305.4583435058594, 728.0555419921875, 300.0625, 582.5555419921875, 300.0625, 674.1666870117188, 283.875, 582.5555419921875, 359.4166564941406, 728.0555419921875, 359.4166564941406, 663.388916015625, 472.7291564941406, 728.0555419921875, 467.3333435058594, 609.5, 586.0416870117188, 744.2222290039062, 575.25, 614.888916015625] for frame 326
DEBUG:__main__:reading 000000000327_keypoints.json
DEBUG:__main__:found [192.75, 668.611083984375, 182.125, 679.2222290039062, 176.8125, 658.0, 187.4375, 700.4444580078125, 182.125, 647.388916015625, 245.875, 726.9722290039062, 235.25, 631.4722290039062, 320.25, 726.9722290039062, 314.9375, 578.4166870117188, 304.3125, 673.9166870117188, 288.375, 594.3333129882812, 362.75, 726.9722290039062, 362.75, 663.3055419921875, 474.3125, 726.9722290039062, 463.6875, 610.25, 585.875, 742.888916015625, 575.25, 615.5555419921875] for frame 327
DEBUG:__main__:reading 000000000328_keypoints.json
DEBUG:__main__:found [203.34375, 667.0555419921875, 193.28125, 677.111083984375, 193.28125, 657.0, 198.3125, 702.25, 193.28125, 646.9444580078125, 253.65625, 727.388916015625, 248.625, 631.861083984375, 329.125, 727.388916015625, 324.09375, 576.5555419921875, 309.0, 672.0833129882812, 298.9375, 591.638916015625, 369.375, 732.4166870117188, 369.375, 662.0277709960938, 475.03125, 727.388916015625, 470.0, 611.75, 585.71875, 742.4722290039062, 570.625, 616.7777709960938] for frame 328
DEBUG:__main__:reading 000000000329_keypoints.json
DEBUG:__main__:found [218.75, 666.7777709960938, 208.9583282470703, 676.5555419921875, 204.0625, 657.0, 208.9583282470703, 701.0, 208.9583282470703, 647.2222290039062, 267.7083435058594, 725.4444580078125, 257.9166564941406, 627.6666870117188, 341.1458435058594, 725.4444580078125, 331.3541564941406, 573.888916015625, 311.7708435058594, 671.6666870117188, 306.875, 593.4444580078125, 375.4166564941406, 730.3333129882812, 375.4166564941406, 661.888916015625, 478.2291564941406, 725.4444580078125, 468.4375, 608.111083984375, 585.9375, 745.0, 571.25, 613.0] for frame 329
DEBUG:__main__:reading 000000000330_keypoints.json
DEBUG:__main__:found [231.625, 662.888916015625, 221.8541717529297, 677.5555419921875, 221.8541717529297, 658.0, 221.8541717529297, 697.111083984375, 221.8541717529297, 643.3333129882812, 280.4791564941406, 726.4444580078125, 270.7083435058594, 628.6666870117188, 348.875, 721.5555419921875, 343.9895935058594, 574.888916015625, 319.5625, 672.6666870117188, 319.5625, 594.4444580078125, 387.9583435058594, 731.3333129882812, 383.0729064941406, 662.888916015625, 480.78125, 726.4444580078125, 475.8958435058594, 609.111083984375, 588.2604370117188, 741.111083984375, 573.6041870117188, 614.0] for frame 330
DEBUG:__main__:reading 000000000331_keypoints.json
DEBUG:__main__:found [243.75, 662.7222290039062, 234.2916717529297, 676.888916015625, 234.2916717529297, 653.2777709960938, 234.2916717529297, 695.7777709960938, 234.2916717529297, 643.8333129882812, 291.0416564941406, 724.111083984375, 286.3125, 624.9444580078125, 361.9791564941406, 724.111083984375, 357.25, 573.0, 328.875, 672.1666870117188, 324.1458435058594, 596.611083984375, 395.0833435058594, 728.8333129882812, 390.3541564941406, 662.7222290039062, 480.2083435058594, 724.111083984375, 475.4791564941406, 606.0555419921875, 588.9791870117188, 743.0, 574.7916870117188, 615.5] for frame 331
DEBUG:__main__:reading 000000000332_keypoints.json
DEBUG:__main__:found [258.625, 660.5555419921875, 244.96875, 674.2222290039062, 244.96875, 651.4444580078125, 249.5208282470703, 697.0, 244.96875, 642.3333129882812, 304.1458435058594, 724.3333129882812, 295.0416564941406, 624.111083984375, 372.4270935058594, 719.7777709960938, 363.3229064941406, 574.0, 336.0104064941406, 669.6666870117188, 331.4583435058594, 596.7777709960938, 395.1875, 728.888916015625, 399.7395935058594, 665.111083984375, 481.6770935058594, 719.7777709960938, 477.125, 605.888916015625, 586.375, 742.5555419921875, 572.71875, 615.0] for frame 332
DEBUG:__main__:reading 000000000333_keypoints.json
DEBUG:__main__:found [267.7708435058594, 661.5277709960938, 258.7291564941406, 675.111083984375, 254.2083282470703, 652.4722290039062, 258.7291564941406, 693.2222290039062, 254.2083282470703, 643.4166870117188, 312.9791564941406, 724.9166870117188, 308.4583435058594, 625.3055419921875, 380.7916564941406, 720.388916015625, 371.75, 575.5, 344.625, 670.5833129882812, 335.5833435058594, 598.138916015625, 407.9166564941406, 729.4444580078125, 403.3958435058594, 666.0555419921875, 484.7708435058594, 720.388916015625, 480.25, 607.1944580078125, 588.75, 743.0277709960938, 575.1875, 616.25] for frame 333
DEBUG:__main__:reading 000000000334_keypoints.json
DEBUG:__main__:found [280.1041564941406, 661.0, 267.0104064941406, 674.0833129882812, 267.0104064941406, 652.2777709960938, 267.0104064941406, 695.888916015625, 267.0104064941406, 643.5555419921875, 323.75, 722.0555419921875, 315.0208435058594, 626.111083984375, 389.21875, 717.6944580078125, 380.4895935058594, 573.7777709960938, 349.9375, 669.7222290039062, 345.5729064941406, 599.9444580078125, 411.0416564941406, 730.7777709960938, 406.6770935058594, 665.361083984375, 485.2395935058594, 722.0555419921875, 480.875, 608.6666870117188, 589.9895629882812, 743.861083984375, 576.8958129882812, 617.388916015625] for frame 334
DEBUG:__main__:reading 000000000335_keypoints.json
DEBUG:__main__:found [288.3541564941406, 661.2222290039062, 275.6354064941406, 673.888916015625, 275.6354064941406, 648.5555419921875, 279.875, 695.0, 275.6354064941406, 640.111083984375, 330.75, 720.3333129882812, 322.2708435058594, 623.2222290039062, 398.5833435058594, 720.3333129882812, 385.8645935058594, 572.5555419921875, 356.1875, 669.6666870117188, 347.7083435058594, 597.888916015625, 415.5416564941406, 733.0, 415.5416564941406, 665.4444580078125, 487.6145935058594, 724.5555419921875, 483.375, 606.3333129882812, 589.3645629882812, 741.4444580078125, 576.6458129882812, 614.7777709960938] for frame 335
DEBUG:__main__:reading 000000000336_keypoints.json
DEBUG:__main__:found [294.4791564941406, 658.0, 281.9479064941406, 670.5, 281.9479064941406, 649.6666870117188, 286.125, 691.3333129882812, 281.9479064941406, 641.3333129882812, 336.25, 720.5, 332.0729064941406, 624.6666870117188, 403.0833435058594, 716.3333129882812, 394.7291564941406, 574.6666870117188, 361.3125, 670.5, 352.9583435058594, 599.6666870117188, 419.7916564941406, 733.0, 419.7916564941406, 666.3333129882812, 482.4479064941406, 720.5, 482.4479064941406, 603.8333129882812, 586.875, 741.3333129882812, 574.34375, 616.3333129882812] for frame 336
DEBUG:__main__:reading 000000000337_keypoints.json
DEBUG:__main__:found [300.3125, 658.0, 288.03125, 670.25, 288.03125, 649.8333129882812, 292.125, 690.6666870117188, 288.03125, 641.6666870117188, 341.25, 719.25, 337.15625, 621.25, 406.75, 715.1666870117188, 398.5625, 572.25, 361.71875, 670.25, 357.625, 596.75, 423.125, 731.5, 423.125, 666.1666870117188, 484.53125, 723.3333129882812, 480.4375, 604.9166870117188, 586.875, 739.6666870117188, 574.59375, 617.1666870117188] for frame 337
DEBUG:__main__:reading 000000000338_keypoints.json
DEBUG:__main__:found [304.5833435058594, 657.0, 292.4583435058594, 669.0833129882812, 292.4583435058594, 648.9444580078125, 292.4583435058594, 693.25, 292.4583435058594, 640.888916015625, 345.0, 717.4166870117188, 340.9583435058594, 620.75, 409.6666564941406, 717.4166870117188, 401.5833435058594, 572.4166870117188, 365.2083435058594, 669.0833129882812, 361.1666564941406, 596.5833129882812, 425.8333435058594, 733.5277709960938, 425.8333435058594, 665.0555419921875, 486.4583435058594, 721.4444580078125, 482.4166564941406, 608.6666870117188, 587.5, 741.5833129882812, 575.375, 616.7222290039062] for frame 338
DEBUG:__main__:reading 000000000339_keypoints.json
DEBUG:__main__:found [307.4375, 656.0, 295.34375, 668.0833129882812, 295.34375, 647.9444580078125, 295.34375, 692.25, 295.34375, 639.888916015625, 347.75, 720.4444580078125, 339.6875, 623.7777709960938, 412.25, 716.4166870117188, 404.1875, 571.4166870117188, 367.90625, 668.0833129882812, 359.84375, 595.5833129882812, 428.375, 732.5277709960938, 428.375, 664.0555419921875, 484.8125, 720.4444580078125, 484.8125, 607.6666870117188, 589.625, 740.5833129882812, 577.53125, 615.7222290039062] for frame 339
DEBUG:__main__:reading 000000000340_keypoints.json
DEBUG:__main__:found [312.3125, 656.0, 296.2291564941406, 668.0833129882812, 296.2291564941406, 647.9444580078125, 296.2291564941406, 692.25, 296.2291564941406, 639.888916015625, 348.5, 720.4444580078125, 344.4791564941406, 623.7777709960938, 412.8333435058594, 712.388916015625, 404.7916564941406, 575.4444580078125, 368.6041564941406, 668.0833129882812, 360.5625, 595.5833129882812, 428.9166564941406, 732.5277709960938, 428.9166564941406, 664.0555419921875, 489.2291564941406, 724.4722290039062, 481.1875, 607.6666870117188, 589.75, 740.5833129882812, 577.6875, 615.7222290039062] for frame 340
DEBUG:__main__:reading 000000000341_keypoints.json
DEBUG:__main__:found [312.15625, 656.0, 296.1145935058594, 668.0, 296.1145935058594, 648.0, 296.1145935058594, 692.0, 296.1145935058594, 640.0, 348.25, 720.0, 340.2291564941406, 624.0, 412.4166564941406, 712.0, 404.3958435058594, 572.0, 364.2916564941406, 668.0, 360.28125, 596.0, 428.4583435058594, 732.0, 428.4583435058594, 664.0, 484.6041564941406, 724.0, 484.6041564941406, 608.0, 588.875, 740.0, 576.84375, 616.0] for frame 341
DEBUG:__main__:reading 000000000342_keypoints.json
DEBUG:__main__:found [309.0, 656.0, 297.0, 668.0, 297.0, 648.0, 297.0, 692.0, 297.0, 640.0, 345.0, 720.0, 341.0, 624.0, 413.0, 712.0, 405.0, 576.0, 365.0, 668.0, 361.0, 596.0, 429.0, 732.0, 429.0, 664.0, 485.0, 724.0, 481.0, 604.0, 589.0, 740.0, 577.0, 616.0] for frame 342
DEBUG:__main__:reading 000000000343_keypoints.json
DEBUG:__main__:found [309.3125, 657.0, 293.2291564941406, 669.0833129882812, 293.2291564941406, 648.9444580078125, 297.25, 693.25, 293.2291564941406, 640.888916015625, 345.5, 717.4166870117188, 337.4583435058594, 624.7777709960938, 409.8333435058594, 713.388916015625, 401.7916564941406, 572.4166870117188, 361.5833435058594, 665.0555419921875, 357.5625, 596.5833129882812, 425.9166564941406, 733.5277709960938, 429.9375, 665.0555419921875, 486.2291564941406, 721.4444580078125, 478.1875, 604.638916015625, 586.75, 741.5833129882812, 574.6875, 616.7222290039062] for frame 343
DEBUG:__main__:reading 000000000344_keypoints.json
DEBUG:__main__:found [304.2916564941406, 658.0, 292.2291564941406, 670.0833129882812, 292.2291564941406, 649.9444580078125, 292.2291564941406, 694.25, 292.2291564941406, 641.888916015625, 344.5, 718.4166870117188, 336.4583435058594, 625.7777709960938, 408.8333435058594, 714.388916015625, 400.7916564941406, 573.4166870117188, 360.5833435058594, 666.0555419921875, 356.5625, 597.5833129882812, 424.9166564941406, 734.5277709960938, 428.9375, 666.0555419921875, 485.2291564941406, 722.4444580078125, 477.1875, 605.638916015625, 585.75, 742.5833129882812, 573.6875, 617.7222290039062] for frame 344
DEBUG:__main__:reading 000000000345_keypoints.json
DEBUG:__main__:found [300.875, 658.0, 288.6875, 670.1666870117188, 288.6875, 649.888916015625, 288.6875, 694.5, 288.6875, 641.7777709960938, 341.5, 718.8333129882812, 333.375, 625.5555419921875, 406.5, 714.7777709960938, 394.3125, 576.888916015625, 357.75, 666.111083984375, 353.6875, 597.1666870117188, 422.75, 735.0555419921875, 426.8125, 666.111083984375, 487.75, 722.888916015625, 479.625, 605.2777709960938, 589.3125, 743.1666870117188, 577.125, 617.4444580078125] for frame 345
DEBUG:__main__:reading 000000000346_keypoints.json
DEBUG:__main__:found [296.1666564941406, 658.0, 283.9166564941406, 670.25, 283.9166564941406, 649.8333129882812, 288.0, 694.75, 283.9166564941406, 641.6666870117188, 337.0, 719.25, 328.8333435058594, 625.3333129882812, 402.3333435058594, 715.1666870117188, 390.0833435058594, 576.3333129882812, 353.3333435058594, 666.1666870117188, 349.25, 596.75, 418.6666564941406, 731.5, 422.75, 666.1666870117188, 484.0, 723.3333129882812, 479.9166564941406, 604.9166870117188, 590.1666870117188, 739.6666870117188, 573.8333129882812, 617.1666870117188] for frame 346
DEBUG:__main__:reading 000000000347_keypoints.json
DEBUG:__main__:found [290.1875, 658.861083984375, 277.71875, 671.2777709960938, 277.71875, 650.5833129882812, 281.875, 696.111083984375, 277.71875, 642.3055419921875, 331.75, 720.9444580078125, 327.59375, 625.75, 398.25, 712.6666870117188, 385.78125, 571.9444580078125, 352.53125, 667.138916015625, 348.375, 596.7777709960938, 414.875, 733.361083984375, 419.03125, 663.0, 481.375, 720.9444580078125, 477.21875, 605.0555419921875, 589.4375, 741.638916015625, 576.96875, 617.4722290039062] for frame 347
DEBUG:__main__:reading 000000000348_keypoints.json
DEBUG:__main__:found [281.84375, 658.7777709960938, 273.40625, 671.4444580078125, 269.1875, 650.3333129882812, 273.40625, 696.7777709960938, 273.40625, 641.888916015625, 328.25, 722.111083984375, 319.8125, 629.2222290039062, 391.53125, 713.6666870117188, 383.09375, 574.3333129882812, 349.34375, 667.2222290039062, 345.125, 595.4444580078125, 412.625, 734.7777709960938, 408.40625, 667.2222290039062, 484.34375, 717.888916015625, 475.90625, 608.111083984375, 589.8125, 743.2222290039062, 577.15625, 616.5555419921875] for frame 348
DEBUG:__main__:reading 000000000349_keypoints.json
DEBUG:__main__:found [276.8333435058594, 659.5833129882812, 263.5833435058594, 672.8333129882812, 263.5833435058594, 650.75, 268.0, 694.9166870117188, 263.5833435058594, 641.9166870117188, 321.0, 721.4166870117188, 312.1666564941406, 628.6666870117188, 387.25, 717.0, 374.0, 575.6666870117188, 347.5, 668.4166870117188, 347.5, 588.9166870117188, 409.3333435058594, 734.6666870117188, 404.9166564941406, 668.4166870117188, 480.0, 721.4166870117188, 480.0, 611.0, 586.0, 743.5, 577.1666870117188, 615.4166870117188] for frame 349
DEBUG:__main__:reading 000000000350_keypoints.json
DEBUG:__main__:found [263.625, 661.4722290039062, 254.6875, 674.888916015625, 250.21875, 652.5277709960938, 259.15625, 697.25, 254.6875, 643.5833129882812, 312.78125, 724.0833129882812, 303.84375, 625.6944580078125, 384.28125, 719.611083984375, 370.875, 576.5, 348.53125, 670.4166870117188, 344.0625, 589.9166870117188, 406.625, 733.0277709960938, 402.15625, 665.9444580078125, 478.125, 719.611083984375, 473.65625, 607.8055419921875, 585.375, 741.9722290039062, 576.4375, 616.75] for frame 350
DEBUG:__main__:reading 000000000351_keypoints.json
DEBUG:__main__:found [254.875, 665.111083984375, 241.15625, 674.2222290039062, 241.15625, 656.0, 245.7291717529297, 697.0, 245.7291717529297, 642.3333129882812, 300.6041564941406, 724.3333129882812, 291.4583435058594, 628.6666870117188, 373.7708435058594, 719.7777709960938, 364.625, 574.0, 346.3333435058594, 669.6666870117188, 346.3333435058594, 587.6666870117188, 401.2083435058594, 733.4444580078125, 392.0625, 665.111083984375, 478.9479064941406, 719.7777709960938, 474.375, 610.4444580078125, 588.6979370117188, 742.5555419921875, 574.9791870117188, 615.0] for frame 351
DEBUG:__main__:reading 000000000352_keypoints.json
DEBUG:__main__:found [240.875, 663.4444580078125, 231.3958282470703, 677.611083984375, 231.3958282470703, 654.0, 236.1354217529297, 696.5, 236.1354217529297, 644.5555419921875, 293.0104064941406, 724.8333129882812, 283.53125, 630.388916015625, 368.84375, 720.111083984375, 359.3645935058594, 573.7222290039062, 345.1458435058594, 677.611083984375, 335.6666564941406, 583.1666870117188, 392.5416564941406, 734.2777709960938, 383.0625, 663.4444580078125, 477.8541564941406, 720.111083984375, 473.1145935058594, 611.5, 586.8645629882812, 743.7222290039062, 572.6458129882812, 616.2222290039062] for frame 352
DEBUG:__main__:reading 000000000353_keypoints.json
DEBUG:__main__:found [228.9375, 665.611083984375, 219.3125, 675.2222290039062, 219.3125, 656.0, 224.125, 699.25, 224.125, 646.388916015625, 281.875, 723.2777709960938, 272.25, 627.1666870117188, 358.875, 723.2777709960938, 344.4375, 579.111083984375, 344.4375, 675.2222290039062, 334.8125, 579.111083984375, 387.75, 732.888916015625, 378.125, 665.611083984375, 474.375, 718.4722290039062, 469.5625, 612.75, 585.0625, 742.5, 570.625, 617.5555419921875] for frame 353
DEBUG:__main__:reading 000000000354_keypoints.json
DEBUG:__main__:found [218.1666717529297, 666.6666870117188, 208.5, 676.3333129882812, 208.5, 657.0, 213.3333282470703, 700.5, 208.5, 647.3333129882812, 271.3333435058594, 724.6666870117188, 261.6666564941406, 628.0, 353.5, 724.6666870117188, 324.5, 589.3333129882812, 343.8333435058594, 681.1666870117188, 329.3333435058594, 579.6666870117188, 377.6666564941406, 729.5, 372.8333435058594, 661.8333129882812, 474.3333435058594, 719.8333129882812, 469.5, 613.5, 585.5, 744.0, 575.8333129882812, 613.5] for frame 354
DEBUG:__main__:reading 000000000355_keypoints.json
DEBUG:__main__:found [205.1666717529297, 668.75, 195.3333282470703, 678.5833129882812, 190.4166717529297, 658.9166870117188, 200.25, 698.25, 200.25, 649.0833129882812, 259.25, 727.75, 254.3333282470703, 629.4166870117188, 342.8333435058594, 727.75, 308.4166564941406, 595.0, 342.8333435058594, 683.5, 328.0833435058594, 575.3333129882812, 372.3333435058594, 732.6666870117188, 362.5, 663.8333129882812, 470.6666564941406, 717.9166870117188, 465.75, 614.6666870117188, 583.75, 742.5, 573.9166870117188, 614.6666870117188] for frame 355
DEBUG:__main__:reading 000000000356_keypoints.json
DEBUG:__main__:found [190.5625, 670.4166870117188, 180.25, 680.6944580078125, 180.25, 660.138916015625, 185.40625, 701.25, 185.40625, 649.861083984375, 247.28125, 726.9444580078125, 242.125, 629.3055419921875, 334.9375, 732.0833129882812, 298.84375, 593.3333129882812, 340.09375, 690.9722290039062, 319.46875, 577.9166870117188, 365.875, 732.0833129882812, 355.5625, 660.138916015625, 469.0, 721.8055419921875, 463.84375, 613.888916015625, 587.59375, 742.361083984375, 572.125, 619.0277709960938] for frame 356
DEBUG:__main__:reading 000000000357_keypoints.json
DEBUG:__main__:found [177.25, 671.75, 166.75, 682.25, 166.75, 661.25, 177.25, 703.25, 172.0, 650.75, 235.0, 724.25, 229.75, 635.0, 324.25, 734.75, 282.25, 593.0, 340.0, 698.0, 313.75, 577.25, 361.0, 729.5, 350.5, 661.25, 471.25, 719.0, 460.75, 614.0, 586.75, 740.0, 571.0, 614.0] for frame 357
DEBUG:__main__:reading 000000000358_keypoints.json
DEBUG:__main__:found [162.9166717529297, 667.7222290039062, 152.1875, 683.8055419921875, 152.1875, 662.361083984375, 162.9166717529297, 705.25, 157.5520782470703, 651.638916015625, 227.2916717529297, 726.6944580078125, 216.5625, 635.5555419921875, 313.125, 737.4166870117188, 286.3020935058594, 592.6666870117188, 334.5833435058594, 710.611083984375, 313.125, 576.5833129882812, 356.0416564941406, 732.0555419921875, 345.3125, 662.361083984375, 468.6979064941406, 721.3333129882812, 457.96875, 614.111083984375, 586.71875, 742.7777709960938, 570.625, 614.111083984375] for frame 358
DEBUG:__main__:reading 000000000359_keypoints.json
DEBUG:__main__:found [150.84375, 672.1666870117188, 140.03125, 682.9444580078125, 140.03125, 661.388916015625, 150.84375, 704.5, 145.4375, 650.611083984375, 215.71875, 726.0555419921875, 204.90625, 634.4444580078125, 302.21875, 742.2222290039062, 280.59375, 591.3333129882812, 334.65625, 715.2777709960938, 307.625, 580.5555419921875, 350.875, 731.4444580078125, 340.0625, 661.388916015625, 469.8125, 720.6666870117188, 453.59375, 612.888916015625, 583.34375, 742.2222290039062, 572.53125, 618.2777709960938] for frame 359
Traceback (most recent call last):
File "src/openpose_3dpose_sandbox.py", line 449, in <module>
tf.app.run()
File "/home/test/.local/lib/python3.6/site-packages/tensorflow/python/platform/app.py", line 48, in run
_sys.exit(main(_sys.argv[:1] + flags_passthrough))
File "src/openpose_3dpose_sandbox.py", line 232, in main
smoothed = read_openpose_json()
File "src/openpose_3dpose_sandbox.py", line 128, in read_openpose_json
drop_curves_plot = show_anim_curves(cache, plt)
File "src/openpose_3dpose_sandbox.py", line 31, in show_anim_curves
x = val[:,o]
IndexError: index 34 is out of bounds for axis 1 with size 34
ArashHosseini commented
can you upload the use json directory please, i will check it if i am out of work
timtensor commented
Hi @ArashHosseini , were you able to run it or had the same issues ?
una-dinosauria commented
Closing due to lack of activity.