User-friendly way of quickly testing face/eye tracking shapes
Casuallynoted opened this issue · 8 comments
Hello!
It would be useful to have a menu for simulating face/eye tracking input from OSC, to test and see what about an avatar is working and not working. ATM, AV3emu has OSC implementation, which is great- but still kind of wonky to set up with real hardware.
I use VRCFaceTracking, and it works fine for me to just enable OSC and have it talk to VRCFaceTracking. What kind of changes would you want to see?
I use VRCFaceTracking, and it works fine for me to just enable OSC and have it talk to VRCFaceTracking. What kind of changes would you want to see?
Honestly just drop down menu with face expression OSC options to toggle through and test to make sure each expression is working would be great.
I'm not too into the face tracking scene, but I believe the main issue with that is that we have to keep up with the different types of expressions and parameters that people use. It's far from standardized, and people sometimes only use subsets of the OSC parameters, so we'd have to perform some form of detection which OSC parameters would work for your avatar, and I think this is kinda out of scope for the AV3 Emulator. I recommend using an OSC tool to emit standardized values that are tuned to your avatar instead. (Maybe something like https://github.com/Duinrahaic/dOSC might work for that? Unsure, as I havent used it myself)
Nowadays a lot of people will be using VRCFT's OSC implementation, I don't fully understand the intricacies of OSC but I would imagine covering those with something like this would cover the majority of use cases, at least for VRC users.
Hm, it does seem they only use a single expression list (the Unified Expressions), but there is a bit of complexity due to them being able to detect prefixed parameters, and bool-based multiplexed parameters as well as float based parameters. I'll keep the issue open as it seems doable, but personally don't expect it to be implemented soon