Triton Project Software

Overview

After successfully building a Triton you are free to create your own software to run on the headset. On the other hand, I have created a custom desktop app that provides a more complete AR user experience and should fast track your project.

Triton AR Launcher

The Triton AR Launcher is a stand alone desktop app that launches AR content onto the headset. As of now the launcher will only support leap motion for dedicated hand tracking. The launcher is being released in alpha and will initially only have Windows support.

Development

Upon purchase of the Triton AR Launcher you have the option to receive a link to the github repository. From there you'll have full access to the source code in which you can modify the code to fit your project needs. The Triton Project has entirely been built with Javascript with the use of frameworks such as electron.js, three.js, and leap.js.

System requirements

Recommended

OS: Windows 10

Processor: Intel Core i7-4820k @3.70GHz

Memory: 16 GB

Graphics: GeForce GTX 760

Storage: 200MB

Important: If you purchase the launcher and want access to the Github repo please send a screenshot of your receipt along with your Github username to gatlee@leap27.com

Table of Contents

  1. Installation
  2. User Guide
  3. Navigating Triton
  4. Additional setup

Installation

1. Download zip file

After purchase of the Triton AR launcher it will be downloadable as zip file. Download the zip file and extract all files into a location on your computer.

2. Create Desktop Shortcut

Inside the folder TritonARlauncher will be a .exe file with the Triton icon. Right click on the icon to a create shortcut and drag onto the desktop.

Installing Leap Motion

The Triton AR Launcher uses the leap motion Orion SDK for all hand tracking and user input. In order to use the leap motion with the Triton AR launcher the Leap Motion Windows drivers must be installed. The necessary software can be downloaded and installed here

User Guide

A. Adjusting screen position

The official screen resolution for the 2k 6inch display is listed as 2560x1440. Electron uses Chromium multi-process architecture to display multiple windows. In order to move a window onto the Triton display x and y positioning values are used. The x value should correspond the screen's width (2560) and the y value should correspond to the screen's height(1440).

B. Setting up stereo comfort

The Triton takes into account the variability in human interpupillary distances (IPD). If you do not know your IPD you can manually find it by using the IPD finder tutorial. Finding the near correct IPD is an absolute necessity to create the impression of 3d depth. IPD should be input as decimal increments 0.064 = 64mm.

C. Starting and ending a session

Clicking launch will immediately send a window to the Triton display. Clicking end session will kill the Triton window. End session will also close the leap motion hand demo window.

D. Screen controls and debugging

Full screen will enable any sub windows to automatically fill the Triton's display. Disabling it will have the effect of making the window into a small window pane. The window will not be draggable with a cursor but instead relies on inputs from the screen position fields. Electron's architecture is built on top of Chromium thus enabling dev tools will open the standard Google Chrome developer tools. You can use dev tools to debug any issues with your project.

E. Enable leap motion

If you do not plan to use the leap motion in your Triton Project then you can choose to leave it disabled. Enabling the leap motion will automatically run all underlying code necessary code for hand tracking.

E. Leap bone hands customization

The leap motion uses a skeletal visualization called bone hands that overlay three.js graphics onto your finger positions in real time. The bone hands visual is incredibly useful for hand object coordination when performing any interaction in AR. These fields allow you to customize the look of those three.js graphics.

Important notes:

F. Save configuration

Clicking show demo scene will launch an isolated sample scene so you can view the bone hands visualization. If you want the changes to take effect you must first click save hand configuration. This will save your changes to a config file so that every time you launch a scene your bone hands settings will be loaded.

Triton Palm Menu

The Triton palm menu is a dedicated AR menu that attaches to the palm position of the left hand. Apps are to be containerized and placed into cells A-D on the menu. The hand right hand index is used a cursor to click on the menu cells. In a future update I will include support for people who are left hand dominate.

1 demo app, Triton Paint, is included with the Triton menu which can be activated through clicking cell A. To exit Triton Paint make a closed fist with your left hand and you will be returned to the main menu.

Additional Setup and Troubleshooting

Display setup

After plugging in the 2k display it should register in the Windows display settings. Inside display settings under Multiple displays make sure to select "extend these displays". For display resolution use 2560 x 1440. Display orientation should be set to landscape.

Leap Motion Troubleshooting

After installing the leap motion drivers a quick access icon should be added to the windows task bar. If the leap icon is black right click the icon and click resume tracking.

IMPORTANT:

Since the TritonARLauncher is built on top of web technology and utilizes the Leap Motion javascript SDK it is considered a web app. Make sure to check that 'Allow Web Apps' is enabled or else the leap motion will not work with the Triton AR launcher.