ruyo/VRM4U

VMC Protocol in Standalone mode is not receiving motion data

stillsameshark opened this issue · 10 comments

Describe the bug
I tried streaming motion data from Vseeface into UE via VMC, and it worked fine in the editor, including the "simulate" and "PIE" modes. However, the motion data was not streamed in"Standalone" mode.

[UE5.4.4]

I encounter similar issues with Livelink Face and another body motion capture solution plugin.

For the Livelink face, I realized the motion data was streaming into the editor and blocked by it. I have to delete the preset in the editor and assign the Livelink preset in the project set to make UE receive Livelink data only until I launch standalone.

Another Mocap plugin has a function called "Connect Mocap Server," which runs the motion data source server IP connection in Event Begin Play when the standalone launches.

Does VRM4U VMC have a similar function or setting about this?

As always, thank you for your kind help.

syui commented

I am having a similar problem.

  • vseeface(vmc) works in the editor and standalone.
  • webcam motion capture(vmc) doesn't work in the editor or standalone.
  • webcam motion capture(vmc) -> vseeface(vmc), works in the editor and standalone.
  • Model facial expressions don't work in package build. #408

webcam motion capture(vmc) -> vseeface(vmc) -> vrm4u(vmc)

example

vseeface port:39539, >39501
issue-9-0002

webcam port:39501
issue-9-0003

ue5.4.4 vmc:39539
issue-9-0004

Note: Launch the build exe and check after shutting down Unreal Engine.
When unrealengine is running, vmc will not work with standalone or build(exe).

Hi syui, thanks for sharing your experience.
webcam(vmc) -> vseeface(vmc) is a interesting workaround, I will try on it.

I also have another frequent issue, VMC always suddenly stops working on a vrm. But whenever I reimport the vrm, and set up the exact same Animation blueprint, the VMC streaming will work again.

Have you ever encountered similar issues?

syui commented

When used simultaneously with the rvc client, it would periodically stop working.

syui commented

@haukakei
issue of vmc face expressions not working in standalone mode, remove LiveLink presets to avoid this?

ref

@syui Thanks for help!

I followed this ref vide which did solve my issue for Livelink face, I read similar article from Rokoko as well, seems like all mocap solution working via UE Linklink plugin can be solved with this LiveLink presets workaround. I will read the Vicon article to see whether there's something new.

I am not using rvc, this is weird.

syui commented

Thanks for help

syui commented

@haukakei Does this work?

  1. run package build(exe)
  2. shutdown unreal engine (editor)
  3. run exe

It seems that it is not possible for both apps to receive the vmc.

ruyo commented

Thanks for the report.
It will be fixed in the next release.

When starting Standalone, Port was already being used by the editor, so it was not possible to bind Port on the new process side.
In the next release, Port Bind in the editor will be released when the standalone process starts.

syui

Hi Syui, Thank you for your solution. I am working on a Live project, which made it difficult for me to build a package, but it is nice to know where the problem is; I will try it!

Thanks for the report. It will be fixed in the next release.

When starting Standalone, Port was already being used by the editor, so it was not possible to bind Port on the new process side. In the next release, Port Bind in the editor will be released when the standalone process starts.

Hi Ruyo, Thank you so much for the new update!!!