Hugging Face Space Demo

Question

Hugging Face Space Demo

aandyw opened this issue 2 years ago · 12 comments

aandyw commented 2 years ago

Hi there, thank you for creating such a cool project/paper.

I have implemented your work as a Hugging Face Space Demo.

https://huggingface.co/spaces/Pie31415/rome

I have not had the chance to implement the video inference using ROME but will do so asap.

Answer 1 · 2023-01-03T04:38:19.000Z

This is great @pie31415! Any chance to add way for users to download the generated 3d mesh?

Answer 2 · 2023-01-03T05:19:13.000Z

That's a good idea I didn't think about that. I'll look on adding that as well. Do you have suggestions for how to retrieve the mesh?

Answer 3 · 2023-01-04T02:35:55.000Z

@pie31415 I am not very familiar with the code but if you can access the vertices (position and texels) shouldn't be hard to generate an .obj

Answer 4 · 2023-01-04T06:17:08.000Z

@pie31415 Thanks. When can the video inference be done?

Answer 5 · 2023-01-04T19:28:57.000Z

@Ha0Tang I'll try to get both the 3d mesh downloading and video inference done by the end of this week.

Answer 6 · 2023-01-05T04:20:43.000Z

@pie31415 Please let me know if you need some assistant in getting the 3d mesh I have a particular interest on that.

Answer 7 · 2023-01-05T06:23:44.000Z

@yuripourre For sure. Feel free to open a PR to the space demo if you have any suggestions.

Answer 8 · 2023-01-07T08:09:15.000Z

I've gotten the video inference to work now. @Ha0Tang

You can try the video inference on the demo space.

Answer 9 · 2023-01-07T09:20:54.000Z

@pie31415 Thanks a lot, but we can't upload the driver videos.

Answer 10 · 2023-01-07T09:43:14.000Z

@Ha0Tang I separated the inference into video and webcam inference tabs. You should be able to upload driver videos now to the 'Video Inference.'

Answer 11 · 2023-01-19T14:22:56.000Z

Is there a way of downloading mp4 files instead of GIFs? Bit difficult to assess the quality of the output

Answer 12 · 2023-01-19T17:16:34.000Z

@anwoflow For sure, GIF was mainly just so I could get something up and running quickly. I'll try to get a download video format ready as soon as possible.

@yuripourre Also, I've been having some issues with loading up the 3d downloadable mesh. If it's something you're still interested in I would love some help on that since I'm not too familiar with the graphics side of things.