Looking Glass Documentation
Buy Looking GlassDiscord
  • Looking Glass User Guide
  • NEW! โœจLooking Glass Goโœจ
  • Displays
    • ๐Ÿ”ฎLooking Glass Go
      • โšกGet Started with Looking Glass Go
      • ๐Ÿ“ฑUsing the Go Mobile App
      • ๐Ÿ”†Liteformsโ„ข
      • ๐Ÿ–ฅ๏ธStandalone and Desktop Modes
      • ๐Ÿ”ŒPower and LED States
      • ๐Ÿช„Default Playlist
      • โญ๏ธWhat's Next?
      • ๐Ÿ‘œAccessories
      • โš™๏ธAdvanced Playlist Creation
      • โš™๏ธManual Firmware Update
      • โ“Common Troubleshooting Issues
    • ๐Ÿ”ฎLooking Glass 16" Light Field Displays
      • ๐Ÿช„Looking Glass 16" Light Field Display (Landscape)
      • ๐Ÿช„Looking Glass 16" Light Field Display (Portrait)
      • โ“Common Troubleshooting Issues
    • ๐Ÿ”ฎLooking Glass 32" Light Field Displays
      • ๐Ÿช„Looking Glass 32" Light Field Display (Landscape)
      • ๐Ÿช„Looking Glass 32" Light Field Display (Portrait)
      • โ“Common Troubleshooting Issues
    • ๐Ÿ”ฎLooking Glass 65" Light Field Display
    • ๐Ÿ”ฎLooking Glass Portrait
      • โšกGet Started with Looking Glass Portrait
      • ๐ŸŽ‡Demo Holograms
      • โ“Common Troubleshooting Issues
  • Software Tools
    • ๐Ÿ“šOverview
    • ๐ŸŒ‰Looking Glass Bridge
      • โœจUsing Looking Glass Bridge
      • ๐ŸชŸDisplay Settings on Windows
      • ๐ŸŽDisplay Settings on macOS
      • ๐ŸงDisplay Settings on Linux
      • ๐Ÿ‘ทTroubleshooting
    • ๐Ÿ“ฝ๏ธLooking Glass Studio
      • ๐Ÿ“šUsing Looking Glass Studio
      • RGB-D Photo / Video
      • Quilt Images / Video
      • iPhone Portrait Photos
      • Android Depth Photos
        • Samsung Portrait Mode
      • Light Field Photosets
      • Exporting Holograms
      • Troubleshooting
    • ๐ŸงŠLooking Glass Blocks
      • โœจConvert any image into a hologram
      • โฌ†๏ธUploading, editing and sharing Quilts
      • ๐ŸฅฝViewing your holograms on different platforms
    • ๐ŸŽฌHologram Video
    • ๐Ÿ”†Liteformsโ„ข
      • ๐ŸชŸGet Started on Windows
      • ๐ŸŽGet Started on MacOS
      • ๐Ÿง™Making Custom Liteforms
      • ๐ŸชConfigure Liteforms for Kiosk Setup
    • ๐Ÿ‘€Looking Glass Model Viewer
    • ๐ŸงชExperiments
      • ๐Ÿ“ฝ๏ธMedia Encoder
      • โฉLooking Glass Media Encoder
  • Key Concepts
    • ๐Ÿ”‘Hologram 101
      • ๐ŸŽ‰Making great holograms
      • ๐ŸŒŽHolograms in the real world
      • ๐Ÿ‘พHolograms, but virtual
    • ๐Ÿ”How does Looking Glass Work?
    • ๐Ÿ“ธVirtual Camera
    • ๐ŸงŠ3D Design Guidelines
      • Lighting
      • Post-Processing
      • Scene Composition
      • Materials & Textures
      • Performance
    • ๐Ÿ’กQuilts
      • ๐ŸŽฌQuilt Video Encoding
    • ๐Ÿ’กLight Fields
      • โšกLinear Light Field Capture
    • ๐Ÿ“ฝ๏ธFilming a Looking Glass
  • Creator Tools
    • ๐ŸŽจOverview
    • ๐Ÿ”ŒUnity
      • โšกUsing Unity with Looking Glass
      • Setting up your Development Environment
      • Example Scenes
      • Prefabs
        • Hologram Camera
        • 3D Cursor
        • Dual Monitor Application
      • Script Reference
        • HologramCamera.cs
        • LKGDisplaySystem.cs
        • QuiltCapture.cs
        • Cursor3D.cs
        • OrbitControls.cs
        • BlockUploader.cs
        • MobileDMAController.cs
        • iOS Sample Scene Scripts
          • ChangeInteractionModality.cs
          • XYSlider.cs
          • XYSpotlight.cs
          • AudioRotateControl.cs
          • ModelController.cs
          • DemoIOSUIController.cs
          • PageHandler.cs
          • PageConnectHandler.cs
          • PageCalibrateHandler.cs
          • PageTestHandler.cs
          • DynamicAlcove.cs
      • Package Integrations
        • Built-in Render Pipeline Post-Processing
      • Developing for iOS
      • Depth of Field and Other Post-Processing Effects
      • Quilt Video Audio and Playback
      • Developing for Ultraleap Hand Tracking on Looking Glass
      • Looking Glass Pro (Legacy)
      • Additional Support
      • Change Log
    • ๐ŸนBlender
    • ๐Ÿ”ŒUnreal Engine
      • ๐Ÿ—’๏ธChange Log and Old Versions
      • ๐Ÿ’ฝInstalling the Unreal Engine plugin
      • ๐ŸŽฅUsing the Unreal Engine Plugin
        • Using the HoloPlay Capture
        • Exporting Quilt Images and Video with Sequencer
      • Accessing HoloPlay Data with Blueprint Scripting
      • Packaging the Project
      • Unreal Engine 4 (Legacy Support)
        • Unreal Engine 4 Quick Start
          • Using the HoloPlay Capture
          • Exporting Quilt Images and Video with Sequencer
    • ๐ŸŒWebXR
      • ๐Ÿ”ถPlayCanvas
      • 3๏ธโƒฃ3๏ธโƒฃ Three.JS
      • โš›๏ธReact-Three-Fiber
      • ๐ŸŒˆSpline
  • Tutorials
    • ๐Ÿ“ฑRunning Looking Glass Displays with iOS Devices
    • โ“‚๏ธCapturing Light Fields in Maya
    • ๐Ÿง‘โ€๐Ÿ”ฌUsing ShaderToy with Looking Glass
    • ๐ŸŽจSculpting with Adobe Medium and Looking Glass
    • ๐Ÿ”Turn Videogames Holographic with Refract
    • ๐Ÿ–๏ธBuilding with Leap Motion
  • Developer Docs
    • โš™๏ธLooking Glass Bridge SDK
      • ๐Ÿช›Web Application Integration
      • ๐Ÿ”ŒIntegrating Native Applications
      • ๐Ÿ““Native Function Reference
    • ๐ŸฆLooking Glass Core Migration Guide
  • Third Party Software
    • ๐Ÿ—ก๏ธ3D Slicer
    • ๐Ÿ”ฌVTK (Visualization Toolkit)
    • ๐Ÿ—บ๏ธParaView
    • ๐Ÿ”ฉCommunity Made Tools & Projects
  • Legacy Software
    • ๐Ÿ“ก3D Model Importer
      • 3D Model Importer App Guide
      • 3D Model Importer App Reference
    • ๐ŸŽญDiorama
      • Change Log
    • ๐ŸŽž๏ธDepth Recorder
    • ๐Ÿ“ธLightfield Photo App
    • ๐ŸLooking Glass Core Overview
    • ๐Ÿฝ๏ธLooking Glass Core SDK
      • C API Overview
        • HoloPlayCore.h
          • State Functions
          • General-Query-Functions
          • Device-Query-Functions
        • libHoloPlayCore.h
        • HoloPlayShaders.h
    • ๐Ÿ”ฐLooking Glass Core JS
      • API
        • HoloPlayCore.Client
        • HoloPlayCore.Message
        • HoloPlay Service Related
        • examples
  • Legacy Hardware
    • ๐Ÿ”ปLooking Glass 8.9"
    • ๐Ÿ”ปLooking Glass 15.6"
    • ๐Ÿ”ปLooking Glass 8K
    • ๐Ÿ”ปLooking Glass 16"
    • ๐Ÿ”ปLooking Glass 32"
    • ๐Ÿ”ปLooking Glass Pro
  • ๐Ÿ’ฌContact Us
  • ๐Ÿ› ๏ธFAQ & Troubleshooting
Powered by GitBook

Follow us

  • Twitter
  • Instagram
  • LinkedIn
On this page
  • Requirements
  • Introduction
  • The Types of interactivity
  • Physics
  • Proximity
  • Technical Setup in Unity
  • 1. Install the Leap Motion Unity Packages
  • 2. Add Leap Motion Hands to your scene
  • 3. Setting up Physics with Springs
  • 4. The Importance of Lighting & Shadows

Was this helpful?

  1. Tutorials

Building with Leap Motion

PreviousTurn Videogames Holographic with RefractNextLooking Glass Bridge SDK

Last updated 1 year ago

Was this helpful?

Requirements

Introduction

In this tutorial we'll go over how to setup your Leap Motion Device in Unity and try out one of the cool demos we've put together! In order to follow this tutorial, the Leap Motion Controller needs to be plugged into your PC, and your Looking Glass display needs to be set to Desktop Mode.

The Types of interactivity

So, before we get too in depth in Unity, we want to touch on different kinds of interactions you can make with leap motion. There are two main methods of adding interaction, one has to deal with physics, and the other with proximity.

Physics

Physics interactions can be super fun, they're very useful for getting engagement out of your users and can be a great first experience with hand tracking! Physics tend to be easier to setup, so if you're new to leap motion & unity this is the place you'll want to start.

Proximity

Proximity Interactions can be useful for things like buttons, UI, turn tables or anything you want to have a bit more precision over than with the physics assets.

Proximity Interactions use the location of fingers, or the leap hands combined with raw values like speed, or velocity to create motion or trigger an event. This makes proximity interactions more complex than physics interactions in terms of setup, but they're much easier to work with for UI you'll be interacting with often.

Technical Setup in Unity

๐Ÿ’ก The Leap Motion SDK is best used with Unity 2019.4 LTS currently. Please ensure you're using that version of Unity before getting started.

1. Install the Leap Motion Unity Packages

Before we get started making cool interactions we'll need to install the Leap Motion & HoloPlay Unity Packages. Make sure to grab the latest unity package from the links in the required software section at the start of this tutorial. Note that Leap's software SDK for unity consists of three unity packages, we'll want to install all of them for this project. You can install the unity packages by going to the add menu in Unity, then selecting import package.

โ€

After you've installed the Unity Packages, you should see the following folders in your asset browser. The HoloPlay & HoloPlay Plugins folders contain everything you need to use your Looking Glass, & the Plugins folder contains all the Leap Motion tools.

2. Add Leap Motion Hands to your scene

The easiest way to add leap motion to your scene is to duplicate the capsule hands example demo from: Plugins\LeapMotion\Core\Examples From there you can either copy the scene into your existing scene or work straight out of the copy by adding a HoloPlay Capture to the leap capsule hands scene.

The reason we're duplicating the scene is so we don't overwrite the original if we want to make a new scene with it later.

๐Ÿ’ก you can add a HoloPlay Capture to your scene really quickly by right clicking in your scene graph and choosing "HoloPlay Capture" from the menu!

With our scene now open we should see a leap motion gizmo in the scene, along with a few leap motion specific items. Let's go over some of the basics of setting up our scene. 1) So the first thing you'll probably notice is that the HoloPlay Capture is rather large compared to the leap hands, I typically set the HoloPlay Capture's Size variable to around 0.75 to make the hands larger, but this can be up to you, any size will work as long as the hands are in the HoloPlay capture volume.

โ€

2) The second thing you'll want to change is the tracking settings on the Leap Hand Controller object. By default, this is set to "screen top" but you'll want to change this to "Desktop Mode A" in the object's Inspector panel.

โ€

3) You'll also want to modify the rotation of the Leap Motion, since we are using it in up facing mode flat on our desktop, you'll want to make sure the rotation is zeroed out for now.

โ€

Now that we've done all that we should be set to get started with previewing our hands! Click the "Play" button and hit CTRL + E to toggle the preview window on the Looking Glass.

3. Setting up Physics with Springs

In this video we'll walk you through how to setup spring physics and how springs work in Unity, along with some general tips on testing values quickly & working with live preview in Unity.

4. The Importance of Lighting & Shadows

How your scene is lit & how shadows are cast are super important to a good experience, check out this short video to learn more how a few properly spaced spot lights can make the world of difference!

๐Ÿ–๏ธ

Unity
Ultraleap Gemini Hand Tracking Software
Cover

Looking Glass Bridge

Looking Glass Bridge

The connection between your computer and your Looking Glass.

๐ŸŒ‰