An OSVR plugin that creates trackers from different sources of data. For example, taking the orientation data from an HMD with no positional tracking, and the position data from a motion controller with no orientation data.
It can also combine axes from different trackers, eg taking pitch and roll from an accelerometer and yaw from a magnetometer, or x and y position from a video tracker and z position from a depth camera.
Build following the standard OSVR plugin build instructions.
The orientation and position data will likely be misaligned, eg, you are facing forward and leaning forward, but your tracked position instead moves to the side. To correct this, align the orientation tracker with the position tracker's axes and run osvr_reset_yaw on the orientation tracker.
For example, with the OSVR HDK and a Kinect, you would place the HDK in front of the Kinect, pointing towards it, then run
osvr_reset_yaw.exe --path "/com_osvr_Multiserver/OSVRHackerDevKitPrediction0/semantic/hmd"
This replaces the alignInitialOrientation option in previous versions.
{
"drivers": [
// Combine Oculus DK1 orientation with Kinect position
{
"plugin": "je_nourish_fusion",
"driver": "FusionDevice",
"params": {
"name": "DK1_Kinectv2",
"position": "/je_nourish_kinect/KinectV2/semantic/body1/head",
"orientation": "/je_nourish_openhmd/Oculus Rift (Devkit)/semantic/hmd",
// Eyes are above and in front of the center of the head
"offsetFromRotationCenter": {
"x": 0,
"y": 0.01,
"z": -0.05
},
// Pass the timestamp from the Kinect skeleton data to OSVR
"timestamp": "position"
}
},
// Combine more accurate pitch and roll from Wii Nunchuk with yaw and position from Kinect
{
"plugin": "je_nourish_fusion",
"driver": "FusionDevice",
"params": {
"name": "Wii_Kinect_Right",
"position": "/je_nourish_kinect/KinectV2/semantic/body1/arms/right/hand",
"orientation": {
"roll": "/je_nourish_wiimote/WiimoteDevice/semantic/wiimote1/nunchuk",
"pitch": "/je_nourish_wiimote/WiimoteDevice/semantic/wiimote1/nunchuk",
"yaw": "/je_nourish_kinectv2/KinectV2/semantic/body1/arms/right/hand"
}
}
}
],
"aliases": {
"/me/head": "/je_nourish_fusion/DK1_Kinectv2/tracker/0",
"/me/hands/right": "/je_nourish_fusion/Wii_Kinect_Right/tracker/0"
}
}