Looking Glass Documentation
Buy Looking GlassDiscord
  • Looking Glass User Guide
  • NEW! ✨Looking Glass Go✨
  • Displays
    • 🔮Looking Glass Go
      • ⚡Get Started with Looking Glass Go
      • 📱Using the Go Mobile App
      • 🔆Liteforms™
      • 🖥️Standalone and Desktop Modes
      • 🔌Power and LED States
      • 🪄Default Playlist
      • ⏭️What's Next?
      • 👜Accessories
      • ⚙️Advanced Playlist Creation
      • ⚙️Manual Firmware Update
      • ❓Common Troubleshooting Issues
    • 🔮Looking Glass 16" Light Field Displays
      • 🪄Looking Glass 16" Light Field Display (Landscape)
      • 🪄Looking Glass 16" Light Field Display (Portrait)
      • ❓Common Troubleshooting Issues
    • 🔮Looking Glass 27" Light Field Display
      • 🪄Looking Glass 27" Light Field Display (Landscape)
      • 🪄Looking Glass 27" Light Field Display (Portrait)
    • 🔮Looking Glass 32" Light Field Displays
      • 🪄Looking Glass 32" Light Field Display (Landscape)
      • 🪄Looking Glass 32" Light Field Display (Portrait)
      • ❓Common Troubleshooting Issues
    • 🔮Looking Glass 65" Light Field Display
    • 🔮Looking Glass Portrait
      • ⚡Get Started with Looking Glass Portrait
      • 🎇Demo Holograms
      • ❓Common Troubleshooting Issues
    • 📱Running Looking Glass Displays with iOS Devices
  • Software
    • 📚Overview
    • 🌉Looking Glass Bridge
      • ✨Using Looking Glass Bridge
      • 🪟Display Settings on Windows
      • 🍎Display Settings on macOS
      • 🐧Display Settings on Linux
      • 👷Troubleshooting
    • ⚙️Looking Glass Bridge SDK
      • 🪛Web Application Integration
      • 🔌Integrating Native Applications
      • 📓Native Function Reference
      • 🐦Looking Glass Core Migration Guide
    • 🔌Unity
      • 🚀Unity Plugin 4.0-alpha
        • 🔄Migrating from Unity Plugin v3.x to v4.0
      • ⚡Using Unity with Looking Glass
      • Setting up your Development Environment
      • Example Scenes
      • Prefabs
        • Hologram Camera
        • 3D Cursor
        • Dual Monitor Application
      • Script Reference
        • HologramCamera.cs
        • LKGDisplaySystem.cs
        • QuiltCapture.cs
        • Cursor3D.cs
        • OrbitControls.cs
        • BlockUploader.cs
        • MobileDMAController.cs
        • iOS Sample Scene Scripts
          • ChangeInteractionModality.cs
          • XYSlider.cs
          • XYSpotlight.cs
          • AudioRotateControl.cs
          • ModelController.cs
          • DemoIOSUIController.cs
          • PageHandler.cs
          • PageConnectHandler.cs
          • PageCalibrateHandler.cs
          • PageTestHandler.cs
          • DynamicAlcove.cs
      • Package Integrations
        • Built-in Render Pipeline Post-Processing
      • Developing for iOS
      • Depth of Field and Other Post-Processing Effects
      • Quilt Video Audio and Playback
      • Developing for Ultraleap Hand Tracking on Looking Glass
      • Looking Glass Pro (Legacy)
      • Additional Support
      • Change Log
    • 📽️Looking Glass Studio
      • 📚Using Looking Glass Studio
      • 🎬Studio for iOS
      • RGB-D Photo / Video
      • Quilt Images / Video
      • iPhone Portrait Photos
      • Android Depth Photos
        • Samsung Portrait Mode
      • Light Field Photosets
      • Exporting Holograms
      • Troubleshooting
    • 👀Looking Glass Model Viewer
    • 🧊Looking Glass Blocks
      • ⬆️Uploading, editing and sharing Quilts
      • 🥽Viewing your holograms on different platforms
    • 🎨Creator Tools
      • 🍹Blender
      • 🔌Unreal Engine
        • 🗒️Change Log and Old Versions
        • 💽Installing the Unreal Engine plugin
        • 🎥Using the Unreal Engine Plugin
        • 🎬Exporting Quilt Images and Video with Sequencer
        • 📘Using Blueprints
        • Packaging the Project
        • Unreal Engine 4 (Legacy Support)
          • Unreal Engine 4 Quick Start
            • Using the HoloPlay Capture
            • Exporting Quilt Images and Video with Sequencer
      • 🌐WebXR
        • 🔶PlayCanvas
        • 3️⃣3️⃣ Three.JS
        • ⚛️React-Three-Fiber
        • 🌈Spline
    • 🧪Experiments
      • 🔆Liteforms™
        • 🪟Get Started on Windows
        • 🍎Get Started on MacOS
        • 🧙Making Custom Liteforms
        • 🏪Configure Liteforms for Kiosk Setup
      • 📽️Media Encoder
        • ⏩Looking Glass Media Encoder
    • 🧑‍🤝‍🧑Third Party Apps and Tools
      • 🗺️ParaView
      • 🔬VTK (Visualization Toolkit)
      • 🗡️3D Slicer
      • 🔩Community Made Tools & Projects
  • Key Concepts
    • 🔑Hologram 101
      • 🎉Making great holograms
      • 🌎Holograms in the real world
      • 👾Holograms, but virtual
    • 🔍How does Looking Glass Work?
    • 📸Virtual Camera
    • 🧊3D Design Guidelines
      • Lighting
      • Post-Processing
      • Scene Composition
      • Materials & Textures
      • Performance
    • 💡Quilts
      • 🎬Quilt Video Encoding
    • 💡Light Fields
      • ⚡Linear Light Field Capture
    • 📽️Filming a Looking Glass
  • Tutorials
    • ✨Convert Any Image into a Hologram
    • 📺Convert Any Video into a Hologram
    • Ⓜ️Capturing Light Fields in Maya
    • 🧑‍🔬Using ShaderToy with Looking Glass
    • 🎨Sculpting with Adobe Medium and Looking Glass
    • 🔍Turn Videogames Holographic with Refract
    • 🖐️Building with Leap Motion
  • Legacy
    • Legacy Hardware
      • 🔻Looking Glass 8.9"
      • 🔻Looking Glass 15.6"
      • 🔻Looking Glass 8K
      • 🔻Looking Glass 16"
      • 🔻Looking Glass 32"
      • 🔻Looking Glass Pro
    • Legacy Software
      • 📡3D Model Importer
        • 3D Model Importer App Guide
        • 3D Model Importer App Reference
      • 🎭Diorama
        • Change Log
      • 🎞️Depth Recorder
      • 📸Lightfield Photo App
      • 🍍Looking Glass Core Overview
      • 🍽️Looking Glass Core SDK
        • C API Overview
          • HoloPlayCore.h
            • State Functions
            • General-Query-Functions
            • Device-Query-Functions
          • libHoloPlayCore.h
          • HoloPlayShaders.h
      • 🔰Looking Glass Core JS
        • API
          • HoloPlayCore.Client
          • HoloPlayCore.Message
          • HoloPlay Service Related
          • examples
  • 💬Contact Us
  • 🛠️FAQ & Troubleshooting
Powered by GitBook
On this page
  1. Software
  2. 🔌Unity

Quilt Video Audio and Playback

PreviousDepth of Field and Other Post-Processing EffectsNextDeveloping for Ultraleap Hand Tracking on Looking Glass

Last updated 1 year ago

Was this helpful?

Follow us

  • Twitter
  • Instagram
  • LinkedIn
CtrlK
  • Recording Audio
  • Playing Back Quilt Videos

Was this helpful?

In addition to recording video content, it is possible to record audio and to play back quilt recordings in the Unity Editor. Both require some specific setups and workarounds to function.

Recording Audio

To record the audio from your Unity scene, you must use the Unity Recorder, an in-editor only utility.

To enable the Unity Recorder you must first import it from the Package Manager. The package can be found in the main Unity registry. Simply select the Unity Recorder from the Package Manager and select "Install". Note that in Unity 2018, you'll need to include enable preview packages in order to locate the recorder package.

Ensure that your scene has a HoloPlay Capture object in it, and the HoloPlay Recorder component added to the object. You can see an example of this setup in scene "8 - Recording Example Scene" under the examples folder of the HoloPlay plugin.

You'll need to set the recording up to begin when you enter Play mode. To do so, you can add a script to your HoloPlay Capture object that calls HoloplayRecorder.StartRecord() in Start and ensures that HoloplayRecorder.EndRecord() is called when you exit Play mode. You can download an example script for your convenience here.

With the Unity Recorder package installed, go ahead and open the recorder window by pressing Window -> Recorder -> Recorder Window. Once the window is open, click the "Add Recorder" button and create an audio recorder -- this means it will only capture the audio from your scene.

Most configurations of the audio recorder will be compatible, however I recommend that the "Target FPS" is set to match the frame rate on the HoloPlay Recorder component, and that "Exit Play Mode" is toggled on so that the video and audio recordings capture the same number of frames.

Now you're ready to press the "START RECORDING" button and capture your video and audio! Note that they will be separate files, and you'll need to combine them using video editing software of your choice.

Playing Back Quilt Videos

It is possible to view a quilt video from within the Unity Editor using the Video Player component and the override quilt property of Holoplay.cs.

First, import a quilt video asset into your project. Once imported, it's recommended to transcode the video with the following settings to ensure smooth playback - in particular changing the codec to be H264:

Now, add an object with the video player component to your scene. You can do so by selecting GameObject -> Video -> Video Player. Add the quilt video to the "Video Clip" property on the component. Then create a new render texture and ensure that its resolution is set to match the resolution of the quilt video - for a Looking Glass Portrait, this is typically 3360 by 3360. Set this render texture to be the "Target Texture" for the video player component.

Next, add a HoloPlay Capture object to your scene - it can be found in your assets folder in Holoplay -> Prefabs -> Holoplay Capture. Open up the dropdown for "Quilt Settings" on Holoplay.cs, and set the "Override Quilt" texture to be the same render texture as the video player component's target texture.

It's important to ensure that the quilt settings of the quilt video match the quilt settings of Holoplay.cs. In particular, make sure that the views and columns match the imported quilt video rows and columns. You can freely adjust the rows and columns of your HoloPlay Capture by setting the "Quilt Preset" to be "Custom" and changing the values of "View Columns" and "View Rows".

Now simply activate the preview window (Ctrl + E or ⌘ + E) and press play to view your quilt video.