Apart from human action can we also detect the objects in the frame??

Question

Apart from human action can we also detect the objects in the frame??

BakingBrains opened this issue 3 years ago · 6 comments

Answer 1 · 2021-10-04T06:41:52.000Z

Thanks for playing with Activity2Vec!

Activity2Vec aims at understanding human actions in general scenarios (w/ or w/o interacted objects). Therefore, we simplified the codebase and excluded the object detection module. See our previous codebase HAKE-Action if you need it.

Answer 2 · 2021-10-04T15:29:38.000Z

Thanks for the reply. There are many repo's in HAKE-Action, can you please specify any. I have gone through TIN from HAKE. I found it very interesting. Is there any better guide to setup and train or inferencing.

Answer 3 · 2021-10-05T06:45:43.000Z

Can I use it for real-time action detection and also is there any way to optimize the time to process frames??

Answer 4 · 2021-10-06T12:37:20.000Z

Thanks for the reply. There are many repo's in HAKE-Action, can you please specify any. I have gone through TIN from HAKE. I found it very interesting. Is there any better guide to setup and train or inferencing.

If you want to use TIN as your pipeline, you can follow the independent codebase Transferable-Interactiveness-Network.

Answer 5 · 2021-10-06T12:41:22.000Z

Can I use it for real-time action detection and also is there any way to optimize the time to process frames??

We've given a demo program in Activity2Vec, and you can analyze the bottleneck of it in your scenario for optimization, since I have no knowledge about your application.

Answer 6 · 2021-10-08T09:16:06.000Z

Thanks a lot @hwfan, will get back if any doubts.