/HoloTuberKit-RealTime

Simple Volumetric Video capture & AR visualizer

MIT LicenseMIT

HoloTuberKit

HoloTuberKit is a simple solution for volumetric video capture and AR visualization. I offer both capture and viewer apps compatible with various platforms:

Capture Apps Compatibility

  1. True Depth Camera(For iOS Devices. iPhoneX or newer / iPad Pro)
    Open AppStore to install the application.

  2. Azure Kinect
    (*)For Windows. Ensure to install Azure Kinect Sensor SDK v1.4.1.

Viewer Apps Compatibility

  1. XREAL(Nreal) Light
  2. Android Phone
    (*)ARCore compatibility is required. Also make sure Developer mode is turned on.
  3. iPhone/iPad (ARKit compatibility is required)
    (*)This will be included in the Sender app. AppStore
  4. Meta Quest
    (*)Make sure Developer mode is turned on for your Meta Quest device.
    See https://developer.oculus.com/documentation/native/android/mobile-device-setup/
    Also, please use SideQuest to install the application.
  5. LookingGlass Portrait / Go
    (*)For Windows. Please install LookingGlass Bridge.

Check out the YouTube demo video for reference.

YouTube Video

Download Page

Visit this link for download.

How To Use

1. Capture Application (Sender Side)

For Kinect User

This application captures RGB and Depth images from Azure Kinect.

  1. Connect Azure Kinect to your PC.
  2. Open the HoloTuber_Server folder.
  3. Run HoloTuber_RtcServer.exe.
  4. Enter a unique Streaming ID in the text field (Take care not to use an ID already in use by another user).
  5. Click the Start button.


  6. By following the above steps, capturing and streaming will be started.


For True Depth Camera User

This application captures RGB and Depth images from the TrueDepth Camera of your iOS device.

  1. Open the HoloSender app.
  2. Enter a unique Streaming ID in the text field (Take care not to use an ID already in use by another user).
  3. Tap the Connect button.

Now, capturing and streaming are initiated.

2. Viewer Applications (Receiver Side)

Here's how to operate the viewer applications:

  1. Install the application on your device.
    • ARCore/Nreal/Quest: Install the compatible .apk.
    • LookingGlass: Unzip LKG_WRTC_HoloTuberKit.zip.
    • iOS: Download the app from AppStore.
  2. Launch the application.
    • Android/iOS/Nreal/Quest: Start HoloTuber(WRTC).
    • LookingGlass: Run HoloTuberKit.exe.
  3. Enter the same Streaming ID that user of sender side entered in the capture app.
  4. Tap the Connect button or hit the Enter Key of the virtual keyboard.

Follow these steps to utilize the viewer applications effectively.

Known Issue

1.Connection Error

In highly secure network environments, it may not be possible to obtain the device's IP address, which can prevent point cloud streaming. In such cases, please use tethering from a smartphone or other means to stream.

2.FireWallSetting for LookingGlass App

When running the Windows version of the Looking Glass app for the first time, a dialog will appear asking whether to allow the app to connect to the network.
If this appears within the Looking Glass display, the text may be very difficult to read, but please CLICK the BUTTON on the LEFT to allow internet connection.
If you accidentally click the button on the right, please remove "holotuberkit.exe" from the application list of Windows firewall.
Firewall Setting

Give Me Your Feedback

I'm glad if you'll give me feedback, or tag me or use hash tag, #HoloTuberKit, when you share the video of your experience on social media or other web-media.

Contact Me
Twitter: @Tks_Yoshinaga (https://twitter.com/Tks_Yoshinaga or https://twitter.com/Taka_Yoshinaga)
LinkedIn: Takashi Yoshinaga (https://www.linkedin.com/in/tks-yoshinaga/?locale=en_US)

Join Our Discord Server

There is the channel of HoloTuber Kit on Discord of AR_Fukuoka.
Feel free to join us!
https://discord.gg/XzrPmgGbfn