aframe-stereo-component: A JavaScript repository from oscarmarinmiro

aframe-stereo-component

A stereo component for A-Frame VR.

This component builds on the ['layer' concept of THREE.js] (mrdoob/three.js#6437) and is really two components in one:

'stereocam' component, with tells an aframe camera which 'eye' to render in case of monoscopic display (without 'Entering VR'). The camera will render all entities without the stereo component, but if it encounters an entity with the 'stereo' component active, it will render only those in the same eye as defined here.
'stereo' component, which tells aframe to include an entity in either the 'right' eye or 'left' eye (you can also specify 'both', but this has the same effect as not using the 'stereo' component. The component also enables stereoscopic video rendering projected on spheres, so if a sphere (see example below) has the 'stereo' component enabled, if will only project half of the video texture (which one depends on the 'eye' property), so the result is stereoscopic video rendering, if you include two spheres. The component expects videos in side-by-side equirectangular projection (see the video example below).

If a video is used in a sphere with the 'stereo' component active, the component will also enable playback in mobile devices, by attaching a 'click' event on the rendering canvas. Thus, in mobile devices you must click on the screen (via cardboard v2.0 button or with your finger) for the video to start playing. This can be disabled by setting the playOnClick variable to false.

**NOTE: for some reason (?) if the video element is put inside scene 'assets' tag, a cross-origin issue is raised **

You can see demos for both examples below [here] (http://oscarmarinmiro.github.io/aframe-stereo-component)

'stereocam' component properties (only for camera)

Property	Description	Default Value
eye	which eye is enabled in monoscopic display ('left' or 'right')	'left

'stereo' component properties (for other entities)

Property	Description	Default Value
eye	in which eye the entity is render VR mode ('left' or 'right')	'left
mode	this property is for spheres holding a video texture. mode can be 'full' or 'half', depending if the original video is full 360 or only spans 180 degrees horizontally (half-dome)	'full'
split	this property indicates whether to split the video texture horizontally (left and right hemispheres), or vertically, (top and bottom hemispheres)	'horizontal'
playOnClick	this property indicates whether the video will automatically be played on clicking on the canvas	true

Usage

Browser Installation. 360 stereoscopic video example

Install and use by directly including the browser files:

<html>
<head>
  <title>My A-Frame Scene</title>
  <script src="https://aframe.io/releases/latest/aframe.min.js"></script>
  <script src="aframe-stereo-component.js.min.js"></script>
</head>
<body>
    <a-scene>


<!--
      stereoscopic panoramic render by
      http://pedrofe.com/rendering-for-oculus-rift-with-arnold/
      http://www.meryproject.com/
 -->
      <!-- side by side equirectangular projected video -->
      <video id="Mary" src="examples/basic_development/textures/MaryOculus.webm" loop></video>


      <!-- we tell here the camera to render (outside VR mode, in monoscopic mode) everything without the 'stereo' component active
      and it it's active, only render those entities in the 'left' eye -->

      <a-camera position="0 0 10" cursor-visible="false" stereocam="eye:left;"></a-camera>

      <!-- native sphere, will render on 'left' eye, and will take only the first half of the video for projection -->

      <a-entity geometry="primitive: sphere;
                      radius: 100;
                      segmentsWidth: 64;
                      segmentsHeight: 64;"
              material="shader: flat; src: #Mary;"
              scale="-1 1 1" stereo="eye:left">
      </a-entity>

      <!-- native sphere, will render on 'right' eye, and will take only the second half of the video for projection -->

      <a-entity geometry="primitive: sphere;
                      radius: 100;
                      segmentsWidth: 64;
                      segmentsHeight: 64;"
              material="shader: flat; src: #Mary;"
              scale="-1 1 1" stereo="eye:right">
      </a-entity>


    </a-scene>

 </body>
 </html>

Browser Installation. Stereoscopic panoramas (images)

if you have an over/under stereo panorama file, you can follow this instructions to split it

Install and use by directly including the browser files:

<html>
  <head>
    <title>My A-Frame Scene</title>
    <script src="https://aframe.io/releases/latest/aframe.min.js"></script>
    <script src="aframe-stereo-component.js.min.js"></script>
  </head>
  <body>

    <a-scene antialias="true">
      <!-- Paths to left and right images -->
      <a-assets>
        <img id="left" src="http://i.imgur.com/YAaxpv6.jpg">
        <img id="right" src="http://i.imgur.com/JUxTnzK.jpg">
      </a-assets>

      <!-- Camera -->
      <a-entity camera look-controls position="0 0 0" stereocam="eye:left;"></a-entity>

      <!-- Sky sphere -->
      <a-sky id="sky1" src="#left" stereo="eye:left"></a-sky>
      <a-sky id="sky2" src="#right" stereo="eye:right"></a-sky>

      <-- or alternatively -->

      <!--<a-sky id="sky1" src="http://i.imgur.com/YAaxpv6.jpg" stereo="eye:left"></a-sky>-->
      <!--<a-sky id="sky2" src="http://i.imgur.com/JUxTnzK.jpg" stereo="eye:right"></a-sky>-->


    </a-scene>

  </body>
</html>

Browser Installation. Two cubes, each one for each eye

Install and use by directly including the browser files:

<html>
<head>
  <title>My A-Frame Scene</title>
  <script src="https://aframe.io/releases/latest/aframe.min.js"></script>
  <script src="aframe-stereo-component.js.min.js"></script>
</head>
<body>
  <a-scene>
      <a-sky color="#FFF"></a-sky>
      <a-light color="#333" position="0 5 0" type="ambient" intensity="0.2"></a-light>
      <a-light type="point" color="#EEE" intensity="1.0" position="3 3 10"></a-light>

      <!-- 'left' eye entities will pass trough the camera in non-VR mode -->

      <a-camera position="0 0 10" cursor-color="black" stereocam="eye:left;"></a-camera>

      <!-- in VR mode, the first box is displayed only in the left eye, the second one in the right eye -->

      <a-entity geometry="primitive: box" material="color: #C03546" stereo="eye:left"></a-entity>
      <a-entity geometry="primitive: box" material="color: #3546C0" position="0 5 0" stereo="eye: right"></a-entity>

  </a-scene>

 </body>
 </html>

Stereoscopic videos that are split vertically - Top and Bottom

Install and use by directly including the browser files:

<html>
<head>
  <title>My A-Frame Scene</title>
  <script src="https://aframe.io/releases/latest/aframe.min.js"></script>
  <script src="aframe-stereo-component.js.min.js"></script>
</head>
<body>
  <a-scene>
  <!-- top and bottom equirectangular projected video -->
  <video id="video" src="path/to/top-bottom/mp4" loop></video>


    <!-- here we tell the camera to render (outside VR mode, in monoscopic mode) everything without the 'stereo' component active
    and if it's active, only render those entities in the 'left' eye -->
    <a-camera position="0 0 10" cursor-visible="false" stereocam="eye:left;"></a-camera>

    <!-- native sphere, will render on 'left' eye, and will take only the first half (top) of the video for projection -->
    <a-entity geometry="primitive: sphere; radius: 100; segmentsWidth: 64; segmentsHeight: 64;"
        material="shader: flat; src: #video;"
        scale="-1 1 1" stereo="eye:left; split: vertical">
    </a-entity>

    <!-- native sphere, will render on 'right' eye, and will take only the second half (bottom) of the video for projection -->
    <a-entity geometry="primitive: sphere; radius: 100; segmentsWidth: 64; segmentsHeight: 64;"
        material="shader: flat; src: #video;"
        scale="-1 1 1" stereo="eye:right; split: vertical">
    </a-entity>
  </a-scene>
 </body>
 </html>

NPM Installation

Install via NPM:

npm install aframe-stereo-component

Then register and use.

var AFRAME = require('aframe');
var stereoComponent = require('aframe-stereo-component').stereo_component;
var stereocamComponent = require('aframe-stereo-component').stereocam_component;

AFRAME.registerComponent('stereo', stereoComponent);
AFRAME.registerComponent('stereocam', stereocamComponent);

Credits

The video used in the examples is from http://pedrofe.com/rendering-for-oculus-rift-with-arnold/, from the project http://www.meryproject.com/

Boilerplate code from https://github.com/ngokevin/aframe-component-boilerplate

Code for adjusting sphere face vertex is from https://github.com/mrdoob/three.js/blob/master/examples/webvr_video.html

Stereo images from Dougstar02

oscarmarinmiro/aframe-stereo-component