Inaccurate tracking of animal's legs

Question

Inaccurate tracking of animal's legs

WinKawaks opened this issue a year ago · 8 comments

Hi, I tried this work for some videos of moving animals (https://www.youtube.com/watch?v=DaYXX-68jSM). I found the model's prediction fits the body well but works poorly for legs. The tracking points of two legs often changes to those of one leg. Is there a good solution here? Thanks you!

Answer 1 · 2023-08-21T15:04:30.000Z

Hi @WinKawaks, could you please send a video with visualized tracks?

Answer 2 · 2023-08-22T14:43:09.000Z

Hi @nikitakaraevv, I upload two videos cat and dance. I set some tracking points manually. Could you please help me check the error? Thank you.

Answer 3 · 2023-09-01T14:59:27.000Z

Hi @WinKawaks, thank you for sending these videos! I currently don't have a solution, but we're working on it. I'll let you know when we have an update.

Answer 4 · 2023-10-24T15:30:52.000Z

Hi ! Any news on this ? I'm currently trying to track a horse movements and its doing great with the body but not at all with the legs. Hope you guys find a fix to that soon 😊!

Answer 5 · 2023-10-30T11:51:14.000Z

Hi @mrinuccini, we plan to release a new model in late November. Hopefully, it'll be better at tracking legs :)

Answer 6 · 2023-10-30T17:07:28.000Z

Oh that's great ! Will be looking forward to that then !

Answer 7 · 2023-12-08T07:10:21.000Z

Hi, any update on a better model trained with more datasets? Thanks.

Answer 8 · 2023-12-28T18:06:26.000Z

Hi @Immocat, @mrinuccini, @WinKawaks, we just released a new model that can track 10X more points and is more memory efficient, but it is still trained on the same dataset. We tried to train CoTracker on PointOdyssey as well, but it did not seem to solve the problem. We are going to work on that next.