Sense XR User Guide

 

Introduction

 

Welcome to Sense XR User Guide, in this guide you will learn everything you need to start using the software, platform and publish your Holograms and WebAR Projects. You can use the menu on the left to go to a specific session or read it through this page. Any question, suggestions and revisions please contact us at contact@senseofspace.io
 

Sense XR Latest version: 2.0.172

 

What’s a Hologram?

When we say “Hologram” we mean a person captured in a volumetric video studio or using a volumetric video capture solution. Volumetric video is an amazing technology in which a moving person (or even a dog – as you will see below) can be captured in 3D and be reconstructed in what we call a “Hologram” – a 3D representation of the captured person that can be viewed in 3D, Virtual or Augmented Reality.

To find a place to capture your Hologram check our Supported Formats section in our website or contact us, we can help you find the best option for your needs.

 

 

Subscription Levels

 

  • Sense XR BASIC

    Sense XR BASIC is free to download and use. The BASIC version gives you a glimpse of what Sense XR is capable of, you can import several formats for volumetric video and sequential 3D data, edit them just like you would edit a 2D video, add audio and build your scene.

    With the BASIC version, you can Publish your Holograms to the Web with some limitations, you can only have 2 Holograms in your Library and only the first 10 seconds will be published. You’ll also have a limit of 100 Total Views. For no-limit usage upgrade to a PRO license.

 

  • Sense XR PRO

    SXR PRO gives you access to Sense XR including our Web and WebAR Publishing capability, allowing you to seamlessly publish your holograms to the Web and WebAR with a single click.

    SXR PRO will take care of converting, compressing, and uploading the hologram to the web. Once the processing is done, you will get a generated web link and a QR code to access and share your hologram with anyone.

    The holograms will be hosted by Sense of Space and will be available via: https://xr.senseofspace.io/user/hologram

    You’ll also get access to our Web Code Editor to create a full WebAR experience using your published holograms – add images, logos, 3d models, and everything you need to create a full WebAR experience. You will also get access to our supported integrations.

    The license comes with 1000 free views and 1 minute of free published data per month, with excess views and published content being billed monthly or every time you reach $250,00.

     

  • Sense XR ENTERPRISE

    Sense XR ENTERPRISE license gives you full control of your holograms and projects, from branding to hosting.

    With this license, you are able to host your holograms and experiences on your own servers. Full experiences and files will reside on your own server and URL, and there will be no extra costs per view.

    You can also have full control of the player, being able to fully white-label your experience.

    You’ll also get access to our API, being able to convert, compress and publish your holograms through an API call. In that way, you’ll get a web and webAR ready hologram right after processing it, without even having to open Sense XR or do any manual work.

    Contact Us for acquiring or hearing more about our Enterprise option.

 

 

Requirements

 

Using our platform requires a Windows desktop computer connected to the internet for Hologram playing and editing with Sense XR, and also a web browser to access your Admin Dashboard and Hologram Library. To visualize WebAR experiences, there are some requirements for the phones that can run the experiences without issues. Check the requirements below:

 

  • WebAR Requirements

    Android:
    Up-to-date browser: Chrome or Samsung Internet.
    3 GB of RAM
    Rear-facing Camera, Accelerometer, Gyroscope
    CPU with 4+ cores

    iPhone:
    iPhone 7 or newer.
    Up-to-date browser: Safari or Chrome.

 

  • Computer Requirements

    Minimum:
    Windows 10
    64-bit (x64) CPU with 4 logical processors.
    8 GB of RAM.
    50+ GB of hard drive space. (Depending on usage)
    OpenGL 3.3 compatible graphics device.

    Recommended:
    64-bit (x64) CPU with 12 logical processors.
    32 GB of RAM.
    100+ GB of hard drive space. (Depending on usage)
    OpenGL 3.3 compatible graphics device.

 

 

Supported Integrations

 

With our system, you can make full interactive WebAR projects without the need for any external platform. However, in case you already use a platform or engine that you would like to create a project at, you can use one of our integrations.

Once your Hologram is published to the web, you can access and play them using our integrations for:

 

 

Getting Started

 

Quick Start Guide

 

In this Quick Start Guide, you will learn how to quickly start creating your Hologram experiences with Sense XR right away. We will go over all the necessary steps in a basic and straightforward way. For more detailed information, you can check the User Guide below and find the respective section. We hope you have fun creating your WebAR Projects with Holograms and take full advantage of Sense XR!

 

  • Create a Sense of Space Account

     

    To create your Sense of Space Account you need to acquire one of our Subscription Licenses, including the free version. You can just simply click on the license you want and create your account following the information in the website.

     

     

    Don’t forget to validate your account by clicking on the email that will be sent to you after registering.

    The 14-day Free Trial will start as soon as you create your Account. You will not be billed before the trial period is over, and you will be able to cancel your subscription before the 14 days to avoid being charged.

    Of course, we hope you will enjoy Sense XR for the 14 days enough to stay with us for much longer 🙂

 

  • Understanding your Dashboard

     

    Now that you successfully subscribed and activated your Sense of Space Account, you will be able to login into the system to download Sense XR and access your Hologram Library through your Admin Panel. Let’s quickly understand your new User Admin Panel:

     

     

    Dashboard:
    In this section, you can check details of your account, download Sense XR (Windows only), Volumetric Sample Data and all our Plugins and necessary files for running SXR files using our many integrations.

     

    Hologram Library:
    In this section, you can see all the Holograms in your Library, which are the Holograms that you published to the web using Sense XR. They can be shared and viewed with anyone using the generated web link and QR code. You can also access the WebAR Code Editor to edit the player of a Hologram, creating a full WebAR experience.

     

    Subscriptions:
    In this section, you can check your Subscription, change your Plan and access your Invoices.

     

    Account & Billing:
    In this section, you can modify your Profile and Payment Methods

 

 

  • Download and Install Sense XR

     

    To Download Sense XR, you can find the download link in your Dashboard:

     

     

    1. Click on the link and the download will start.

    Make sure to always use the latest version of Sense XR. Once you install the software, you will periodically receive update requests from within the software, so you don’t need to re-download and reinstall it when a new version comes out.

     

    2. After downloading the software, double-click on the executable to start the installation.

     

     

    3. The Windows SmartScreen will pop-up, that’s perfectly normal for new Desktop applications. Click on “More Info” and then “Run Anyway”.

     

         

     

    4.  The Installer will now open and you can choose where to install the software and finish the installation.

     

     

    Now you have Sense XR successfully installed in your computer. To open it, you can simply double-click Sense XR in the Desktop or Start Menu, login with your credentials and start creating.

 

 

 

  • Import your Hologram to the Scene

     

    To import a Hologram in Sense XR you can choose File – Import and select the correct format.

     

     

    In case you don’t have a hologram, you can download samples in the Dashboard.

    The supported formats are:
    OBJ Sequences, Alembic + PNG Sequences, .4DS, .TET, .MP4 and .MVX.
    You can also import audio files in .MP3 and .WAV.

    You can read more details about the supported formats in the session Importing Holograms below this User Guide.

    In case your Hologram is in a format that we don’t support, please contact us and we will check how to implement the format.

     

    Once your Hologram is imported, you can simply click and drag the Asset Icon to the 3D Viewport or to the Timeline Panel space, this will add the Hologram to the Scene. You can import as many Holograms as you want, just keep your computer power in mind, so you don’t import more than your computer can handle.

     

     

    To control the 3D Viewport and check your Hologram:

    Zoom In / Zoom Out: use the mouse scroll-wheel to zoom in and zoom out the 3D scene.

    Camera Pan: to pan the camera use the middle-mouse button.

    Rotate Camera: to rotate the camera use the right-mouse button.

 

 

 

  • Play & Edit your Hologram

     

    Once the Hologram is in the Scene, you will be able to position the Hologram in the Scene and also see the hologram timeline in the Timeline Panel, or the Audio Track in case you imported an audio to the Scene.

     

    1. To move, rotate or scale your Hologram, click on the Hologram in the 3D Scene and use the transformation tools on the right side of the 3D Scene.

     

     

     

    2. You can play the Hologram using the Playback Buttons on the left side of the 3D Viewport. Note that this will only play the Hologram in the 3D Viewport and not in the WebAR Publishing window.

     

     

     

    3. Editing a Hologram sequence with Sense XR is really easy, just move the Timeline Marker to the position that you wish to make a cut and click on the Split Icon (the little scissors) and your sequence will be split in place. You can do the same for Audio Tracks.

     

     

    This way you can edit your Holograms to create the perfect sequence to be published or played in a WebAR Experience.

    You can check on the AR Simulator on the right the correct position of the Hologram in relation to the phone screen.

 

 

 

  • Exporting to OBJ Sequences

     

    With the Sense XR BASIC you are able to export your new sequence to OBJ Sequences. For that simply go to File – Export – OBJ Sequences.

    After exporting, you can use the OBJ sequence in your preferred 3D tools.

    With the BASIC license you can also Publish minimum of 2 Holograms to the web of 10 seconds each and 100 WebAR Views. You can always upgrade to a PRO license to avoid this limitation.

     

    Let’s check how you can Publish your new Hologram to the Web!

     

     

    • Publish your Hologram to the Web

       

      Publishing your Hologram to the Web is very simple with Sense XR. By now, you probably noted the WebAR Publishing window next to the 3D Viewport.

       

       

      In this Window you can check how the Hologram will look in Augmented Reality, you can change the background images and even import your own background. You can also Play your Hologram in the window by using the Playback controls.

      To Publish the Hologram to the web, click on “Publish to WebAR” and follow the instructions on the new window.

      Once you hit Publish, your Hologram will be cloud-converted and ready to play on the web, you will get a web-link and a QR Code to check in WebAR, and the Hologram will be part of your Hologram Library. You can visit your Hologram Library by clicking on the “Visit Your Hologram Library” button.

       

       

      The speed of publishing depends on your Upload Speed, it’s highly recommended that you publish a hologram using a high speed connection.

     

     

     

    • Access, View and Share your Holograms

       

      To access, view and share your published Holograms, you can go to your Dashboard – Hologram Library.

       

       

      In the Hologram Library you will be able to see all the Holograms that you published to the Web, get their web-link and QR code to check them in WebAR.

      You can now can share any of your Holograms just by copying the web-link or sharing the QR Code with anyone!

       

       

      Note: Every time someone checks your Hologram it will be counted as a View. So be careful not to reach your Views limit too fast. Extras views will be charged on a monthly-basis. You can always check the amount of views and control using the Dashboard.

     

     

     

    • Make a WebAR Experience using the Web Editor

       

      Now that you’ve your Hologram running on the Web and WebAR, you can also modify the player and create a full WebAR project.

      For that, simply click on “Open in Web Editor” and you will access the coding platform. Using this platform you can code your whole experience just like you do on your usual web development frameworks.

       

       

      You can find more information about the WebAR Code Editor in the User Guide below.

User Guide

 

 

Import and Play

 

In this section you can find detailed information about Importing and Playing your Holograms in Sense XR.

 

  • Creating a New Scene

     

    When you open Sense XR, a clean new Scene will be already in place to start working with. You can start by importing your Hologram to the Scene.

    To create a new Scene simply use the menu File – New

    You can also Save and Load Scenes. Saving and Loading uses the reference of the original Hologram file, this means that the original files should be in the same location where it was first saved. If you move the original file to another folder, a pop-up will appear warning that it couldn’t find the file. You can move the file back to the original place or locate the file to be able to load.

    Loading a saved Scene will re-load all the assets, so please wait for the assets to be fully loaded in order to avoid issues.

 

 

  • Importing Holograms & Supported Formats

     

    To Import a Hologram simply go to File – Import and choose the correct format.

     

     

    Supported formats:

    .ABC + PNG/JPEG Texture Sequences for volumetric video captures using a Depth-sensor (Kinect Azure) based technology such as: Depthkit, Brekel and others.

    .OBJ + .PNG/.JPEG Texture Sequences for volumetric video captures using a Depth-sensor (Kinect Azure) based technology such as: DepthkitBrekel and others.

    .4DS Files for volumetric video captures using a 4D Views HOLOSYS technology such as: 4DR Studios and others.

    .TET Files for volumetric video captures using a TetaVi technology based studio.

    .MP4 Files for volumetric video captures using a Microsoft Mixed Reality Studios such as: MetastageDimension Studio or Avatar Dimension.

    .MVX Files for volumetric video captures using a Mantis Vision technology based studio.

    .WAV for audios in this format.

    .MP3 for audios in this format.

     

    In case you are using a format that we don’t support, please contact us and we will check for implementing the format support.

    Loading times varies greatly depending on the format, source and especially on the size of the Holograms.

    You can load as many Holograms and audio files as you want to add to your scene, just keep in mind on your computer memory power, loading several holograms can reach the maximum memory your computer can handle.

     

 

 

  • Adding Holograms to the Scene

     

    After the Holograms or Audio files are loaded they will be in the Asset Library, which will list all the assets you can use in the Scene.

     

     

    To add to the Scene simply click and drag the asset inside the 3D Viewport or the Timeline Window, in case the Hologram is a big file, it may take a little while to appear in the Scene.

    After you load the Hologram or the Audio file inside the 3D Viewport, the timeline will appear in the Timeline Window where you can edit your Hologram sequence.

 

 

  • Playback Controls

     

    To Play your Holograms you can use the Playback Controls on the lower left area of the 3D Viewport.

     

    Go to Beginning/Go to End: pressing these buttons will take you to the beginning or the end of the sequence.
    Previous/Next Frame: you can move frame-by-frame by clicking the Previous and Next Frame buttons.
    Play/Pause: you can play your Hologram in the scene using the Play/Pause button.

    Note that these Playback Controls only play the Hologram in the 3D Viewport and not in the WebAR Publishing Window.

    To Play the Hologram in the WebAR Publishing Window use the Playback Controls located in that window.

 

 

  • Controlling the 3D Viewport

     

    The 3D Viewport is where you can check the Hologram in a 3D view.

     

     

    To control the 3D Viewport and check your Hologram:

    Zoom In / Zoom Out: use the mouse scroll-wheel to zoom in and zoom out the 3D scene.

    Camera Pan: to pan the camera use the middle-mouse button.

    Rotate Camera: to rotate the camera use the right-mouse button.

 

 

  • Transform Hologram Position & Scale

     

    To transform the Hologram position and scale, use the Transformation Controls on the lower right corner of the 3D Viewport:

     

    Position Button: When you select a Hologram the Position Gizmo is already activated and you can use the arrows to move the Hologram in the 3D space.
    Rotate Button: You can rotate the Hologram in the space by clicking on the Rotate button and using the Rotation Gizmo.
    Scale Button: You can scale the Hologram in the space by clicking on the Scale button and using the Scale Gizmo.

     

    To rotate and scale with precision, you can Right-click on the buttons, this will show you number boxes where you can change the values by writing the exact desired value.

 

 

Editing your Hologram

 

In this section you can find detailed information on how to Edit your Holograms using Sense XR.

 

  • Selecting Clips

     

    Select a clip by clicking on the desired clip in the Timeline Panel or by clicking on the Hologram in the Scene.

    To select multiple clips at once you can hold the Shift key and select multiple clips.

     

 

 

  • Duplicating Clips

     

    Duplicate a clip by selecting the desired clip and click on the Duplicate button at the toolbar to the right of the Timeline Panel.

     

 

 

  • Deleting Clips

     

    Delete a clip by selecting the desired clip and click on the Delete button at the toolbar to the right of the Timeline Panel. You can delete multiple clips at once by shift-selecting them.

     

 

 

  • Splitting Clips

     

    Split a clip by moving the Timeline Marker to the desired position in the clip, select the desired clip and click on the Split button on the right of the Timeline Panel.

     

 

 

  • Locking Clips

     

    Lock a Clip by clicking the Lock Button on the left of the Timeline Panel. By locking a clip, you won’t be able to move the clip around before unlocking the clip.

     

 

 

  • Hiding Clips

     

    Hide a Clip by clicking the Hide Button on the left of the Timeline Panel. By hiding a clip, you won’t be able to see the Hologram in the Scene.

     



    NOTE: A hidden clip won’t be exported.

 

 

  • Editing Audio

     

    You can edit Audio tracks just like editing a Hologram Clip. You can also click the Volume Icon in order to Mute/Unmute the audio clip.

     

 

 

 

Export Options

 

In this section you can find detailed information on how to export your edited sequences.

 

 

  • Exporting to OBJ Sequences

     

    With the Sense XR BASIC you are able to export your new sequence to OBJ Sequences. For that, simply go to File – Export – OBJ Sequences.

    After exporting, you can use the OBJ sequence in your preferred 3D tools.

    For exporting to the Web and WebAR you will need a PRO license, you can also try our 14-days Trial when registering for a PRO license.

     

     

    WebAR Publishing

     

    In this section you can find detailed information on how to Publish your Hologram to the Web. After you edit your Hologram in the scene, including audio, you can publish the hologram to the web with a single click.

     

     

    • WebAR Publishing Window Interface

       

      The WebAR Publishing window contains the following features:
      1. Window Preview: here you can see a preview of how your Hologram will look in AR. This is the default UI when the Hologram is published.
      2. Change Background Button: you can take a picture of your space and upload to check on the preview – this helps you have a better idea of scale when doing an experience to an specific space.
      3. Playback Controls: With these controls you can playback the hologram in the WebAR Preview Window – it’s separated from the main timeline to save computer power and memory.

     

    • Changing Background Image

       

      To change the background image, click on the Change Background Image button, you will have several options to choose from and a “+” sign. To upload your own picture, just click the plus sign and choose the picture. The center of the picture will be the region displayed in the preview window.

     

     

    • WebAR Preview Playback Controls

       

      To control the Playback of your Hologram in the WebAR Preview window, you can use the playback controls. They work just like the controls on the 3D Viewport.

     

     

    • Publish to WebAR

       

      To Publish to Web when you are happy with your Hologram and wants to see running in WebAR. Just hit the button “Publish to Web” and you are good to go!

      Your Hologram will be sent to our cloud-conversion, where we will prepare your Hologram to be Web and WebAR Ready – and they will be available in our Hologram Library in your online Dashboard.

     

     

     

    Hologram Library

     

    In your Hologram Library you can access all the holograms that you published. You can check their number of views, QR Code and web-link to be able to share with anyone, and also access the WebAR Editor.

     

     

    • Accessing your Hologram Library

       

      You can access your Hologram Library by going to your Dashboard and Hologram Library. Our clicking “Visit your Hologram Library” when you publish a hologram from Sense XR.

     

     

    • Understanding Number of Views

       

      Number of views means the amount of times that your Hologram was viewed. A view is counted every time your Hologram is streamed. We calculated the views per-hologram, therefore, if you have several holograms as part of an experience, each hologram will have their individual views counted and added to your total views. In case you go over your total views limit, we will invoice the extra streaming costs separately from the license subscription.

     

     

    • Sharing your WebAR Holograms

       

      You can share your Holograms using the generated QR code and Web-link. They can be accessed by anyone, anywhere in the world. Every time someone checks your Hologram (or the data is streamed), it will count as a view. You can Park a Hologram, meaning, it will not be accessible by anyone, or you can also Delete a Hologram in your Hologram Library section.

      You can also edit the WebAR Player, in order to add images, logos, add another hologram to the experience or 3D models.

      Check more information on how to use the Sense XR WebAR Editor in the section below.

     

     

     

    Sense XR WebAR Editor

     

    When you publish a Hologram, you will be able to access and edit the WebAR Player. In this way, you can create a full WebAR project around your Hologram using our Sense XR WebAR Editor. In this section, you will learn all you need to create a full experience using your Hologram.

     

    • Launching the WebAR Editor

       

      You can launch the WebAR Editor by clicking on “Open in Web Editor” in your chosen Hologram, you will be able to access the code that is used to play the Hologram in WebAR and edit it completely in order to create your own player and WebAR experience.

     

     

    • WebAR Editor Interface

       

      In the Web Editor you can access the code behind the player and modify to create a full WebAR experience. You can Upload a file, images, 3d models, videos.

      Save your changes and try in Web or WebAR by pressing the Play Button.

     

     

    • Adding an Image

       

      Coming Soon.

     

     

    • Adding a 3D Model

       

      Coming Soon.

     

     

    • Adding another Hologram

       

      Coming Soon.

     

     

    • Updating the WebAR Player

       

      To Save and Update the WebAR Player, click the Save icon and try it by clicking on the Play Button.

      You can scan the QR Code to check in WebAR using your smartphone or clicking on the link to try in the desktop Web Browser.

     

     

     

    Supported Integrations

     

    In this section you can find information and how to run your Holograms using our integrations.

     

    • ThreeJS & A-Frame

       

      Coming Soon.

     

     

    • Unity Engine

       

      Coming Soon.

     

     

    • Unreal Engine

       

      Coming Soon.

     

     

    • PlayCanvas

       

      Coming Soon.

Account Settings

 

In this section you will learn about your Account Settings, how to upgrade your plan, cancel and manage your billing information.

 

  • Upgrade Plan

     

    To upgrade your Plan you can go to your Dashboard, or My-Account, from the main website. Click in the Subscription session and Change your Subscription button to upgrade or downgrade your plan.

 

 

  • Cancel Plan

     

    You can cancel your plan by going in your Subscription session and clicking at Action – Cancel button.

 

 

  • Update Billing Information

     

    You can Update your Billing Information by going to the Account & Billing session in your Admin Panel, don’t forget to Save before closing the page.