As of now, we do not know exactly what shape the Metaverse will take. That does not matter, either. What matters is that someday, a global network of spatially organized, predominantly 3D content will be available to all without restriction, for use in all human endeavors — a new and profoundly transformational medium, enabled by major innovations in hardware, human-computer interface, network infrastructure, creator tools and digital economies.

Tony Parisi

Please read the article The Seven Rules of the Metaverse to learn the basic concepts and language.

Short link: aka.ms/MixedRealityUnityLessons

• Lesson 1: Introduction to Mixed Reality Applications and Development.

• Lesson 2: Introduction to Mixed Reality Developer Tools and 3D Concepts.

• : Working with Hand Interactions and Controllers.

• : Eye and Head Gaze Tracking.

• : Spatial Visualization using Bing Maps.

• : Working with REST APIs.

• : Azure Spatial Anchors and Backend Services.

• : Displaying Spatial Anchors on a map.

• : Working with QR codes.

• : Working with Scene Understanding.

• : Getting Started with AI.

• : Project Discussion and Case Studies.

Short link:

Overview

In this lesson, you will learn about the basic concepts of Mixed Reality and explore the applications of Mixed Reality

• Mixed Reality Curriculum:

• WebXR Lessons:

• Unity Lessons:

Hand interaction is a very natural way to interact with 3D models. Since we interact and modify real objects with our hands, a new user of your application can start interacting with your application without having to learn about your application interface first.

How to start debugging performance issues?

In this lesson, you will learn about the basic concepts of Mixed Reality and explore the applications of Mixed Reality in different industries.

Read through the questions below. If you feel comfortable with the answer, feel free to skip to section or next chapters.

The first revolution in computing happened with the creation of mainframe computers: computers that, at times, occupied a whole room. Mainframes were used by large organizations such as NASA for critical applications that process data.

The second wave of computing is defined by the Personal Computers(PC) becoming widely available.

We believe third wave of computing is going to include many devices to manage data and include IoT sensors and Mixed Reality devices.

We have more data than ever before. To be able to process the data and make informed decisions, we need to have access to the data in the right time and right place. Mixed Reality is able to bring that data into our context, real world.

• Go to Edit > Preferences.

• Change the color scheme under General, if it is available.

• You can change the default editor by selecting

The HoloLens Emulator lets you test holographic applications on your PC without a physical HoloLens. It also includes the HoloLens development toolset.

How to create a new scene?

• On the Project panel, right click and select Create > Scene.

• On your Project panel select Assets > MixedRealityToolkit.Examples > Demos.

• Select from the folders that you want to see an example of, ex: HandTracking, EyeTracking...

• Code Samples:

• What is Debugging?

• What makes a 3D model? What are Polygons, Splines, Vertices, Meshes and Materials?

• How to choose performant 3D models?

Bounding boxes make it easier and more intuitive to manipulate objects with one hand for both near and far interaction by providing handles that can be used for scaling and rotating. A bounding box will show a cube around the hologram to indicate that it can be interacted with. The bounding box also reacts to user input.

You can add a bounding box to an object by adding the BoundingBox.cs script as a component of the object.

To add the Bounding Box (Script) component to an object, first select the object in the Hierarchy window. In the Inspector window, click Add Component and search for Bounding Box.

Select the Bounding Box script to apply the component to the object. The bounding box is only visible in Game mode. Press play to view the bounding box. By default, the HoloLens 1st gen style is used.

To reflect the MRTK bounding box style, you need to change the parameters inside the Handles section of the Bounding Box (Script) component.

Change Handle Color

You can change the color of the handles by assigning a material to the Handle Material property.

In the Handles section, click the circle icon to open the Select Material window.

In the Select Material window, search for BoundingBoxHandleWhite. Once found, select to assign the color to the handle material.

When you press play, the handle colors for the bounding box will be white.

Change Handle Color When Object is Grabbed

You can change the color of the handles when an object is grabbed by assigning a material to the Handle Grabbed Material property.

In the Handles section, click the circle icon to open the Select Material window.

In the Select Material window, search for BoundingBoxHandleBlueGrabbed. Once found, select to assign the color to the handle material.

When you press play, grab one of the handles of the bounding box. The color of the handle will change to blue.

Change Scale Handles

You can change the scale handles in corners by assigning a scale handle prefab in the Scale Handle Prefab and Scale Handle Slate Prefab (for 2D slate) parameters.

First, assign a prefab to the Scale Handle Prefab. In the Handles section, click the circle icon to open the Select GameObject window.

In the Select GameObject window, switch to the Assets tab and search for MRTK_BoundingBox_ScaleHandle. Once found, select to assign the prefab to the scale handle.

Next, assign a prefab to the Scale Handle Slate Prefab. In the Handles section, click the circle icon to open the Select GameObject window.

In the Select GameObject window, switch to the Assets tab and search for MRTK_BoundingBox_ScaleHandle_Slate. Once found, select to assign the prefab to the scale handle.

When you press play, grab one of the handles of the bounding box to see the change in how the scale handle look.

Change Rotation Handles

You can change the rotation handles by assigning a rotation handle prefab in the Rotation Handle Prefab parameter.

In the Handles section, click the circle icon to open the Select GameObject window.

In the Select GameObject window, switch to the Assets tab and search for MRTK_BoundingBox_RotateHandle. Once found, select to assign the prefab to the scale handle.

When you press play, grab one of the handles of the bounding box to see the change in how the scale handle look.

How to add audio feedback?

You can configure an object to play a sound when the user touches an object by adding a trigger touch event to the object.

To be able to trigger touch events, the object must have the following components:

• Collider component, preferably a Box Collider

• Near Interaction Touchable (Script) component

• Hand Interaction Touch (Script) component

To add audio feedback, first add an Audio Source component to the object. The audio source component enables you to play audio back in the scene. In the Hierarchy window, select the object and click Add Component in the Inspector window. Search for Audio Source to add the Audio Source component.

Once the Audio Source component has been added to the object, in the Inspector window, change the Spatial Blend property to 1 to enable spatial audio.

Next, with the object still selected, click Add Component and search for the Near Interaction Touchable (Script). Once found, select the component to add to the object. Near interactions come in the form of touches and grabs - which is an interaction that occurs when the user is within close proximity to an object and uses hand interaction.

After the Near Interaction Touchable (Script) is added to the object, click the Fix Bounds and Fix Center buttons. This will update the Local Center and Bounds properties of the Near Interaction Touchable (Script) to match the BoxCollider.

With the object still selected, click Add Component and search for the Hand Interaction Touch (Script). Once found, select the component to add to the object.

To make audio play when the object is touched, you will need to add an On Touch Started event to the Hand Interaction Touch (Script) component. In the Inspector window, navigate to the Hand Interaction Touch (Script) component and click the small + icon to create a new On Touch Started () event.

Drag the object to receive the event and define AudioSource.PlayOneShot as the action to be triggered. PlayOneShot will play the audio clip.

Next, assign an audio clip to the trigger. You can find audio clips provided by MRTK by navigating to Assets > MixedRealityToolkit.SDK > StandardAssets > Audio. Once you've found a suitable audio clip, assign the audio clip to the Audio Clip field.

You can now test the touch interaction using the in-editor simulation. Press the Play button to enter Game mode. Once in Game mode, hold the spacebar to bring up the hand and use the mouse to touch the object and trigger the sound effect.

Concepts and Discussion

What's the difference between eye and head gaze?

What is 6 Degrees of Freedom?

What are good use cases for eye or head tracking?

What are the security concerns with using eye-tracking?

Concepts and Discussion

What's the difference between eye and head gaze?

What is 6 Degrees of Freedom?

What are good use cases for eye or head tracking?

What are the security concerns with using eye-tracking?

How to get permission to use eye-tracking?

How to setup eye-tracking?

How to simulate eye-tracking in the Unity editor?

How to enable eye calibration?

How to use eye-tracking for selection of an object?

How to use eye-tracking for infinite scroll?

How to visualize eye tracking data?

How to setup head tracking?

What could go wrong?

Further Reading

• Code Samples: https://aka.ms/MixedRealityUnitySamples

With spatial data you can discover growth insights, manage facilities and networks, and provide location information to customers. Without considering spatial components and how they relate to your business, your risks and possibility of poor results will increase.

Spatial analysis allows you to solve complex location-oriented problems and better understand where and what is occurring in your world. It goes beyond mere mapping to let you study the characteristics of places and the relationships between them. Spatial analysis lends new perspectives to your decision-making.

Scenes

In Unity, areas of the game that a player can interact with are generally made up of one or more Scenes. Small games may only use one Scene; large ones could have hundreds.

Every Unity project you create comes with a SampleScene that has a light and a camera.

You can create a new scene by right clicking under the assets tab and selecting Create > Scene. Organizing scenes under a Scenes folder is only for the organization purposes.

You can use scenes to organize navigation inside your application or adding different levels to a game.

GameObjects and components

Every object in the game world exists as a GameObject in Unity. GameObjects are given specific features by giving them appropriate components which provide a wide range of different functionality.

When you create a new GameObject, it comes with a Transform component already attached. This component controls the GameObject’s positional properties in the 3D (or 2D) gamespace. You need to add all other components manually in the Inspector.

Prefabs

Prefabs are a great way to configure and store GameObjects for re-use in your game. They act as templates, storing the components and properties of a specific GameObject and enabling you to create multiple instances of it within a Scene.

All copies of the Prefab template in a Scene are linked. This means that if you change the object values for the health potion Prefab, for example, each copy of that Prefab within the Scene will change to match it. However, you can also make specific instances of the GameObject different to the default Prefab settings.

Debugging is the process of finding and resolving defects or problems within a computer program that prevent correct operation of the software.

Debugging tactics can involve:

• Interactive debugging.

• Control flow analysis.

• .

• .

• Monitoring at the or level.

• .

• .

• Turn on your HoloLens device.

• Tab your wrist(HoloLens 2) or make a bloom gesture(HoloLens 1) to initiate Windows menu.

• Open the Settings > Update & Security.

• Select For Developers tab on the right hand panel.

• Make sure your models capture detail without adding extra polygons.

• Choose adding detail through material instead of polygon.

• Reuse the model instance instead of a new model where ever you can.

Mixed Reality Toolkit(MRTK) supports in-editor input simulation. Simply run your scene by clicking Unity’s play button. Use these keys to simulate input.

• Press W, A, S, D keys to move the camera.

• Hold the right mouse button and move the mouse to look around.

• To bring up the simulated hands, press Space bar(Right hand) or left Shift key(Left hand).

• To keep in the view, press T or Y key.

• To rotate simulated hands, press Q or E(horizontal) / R or F(vertical).

Augmented Reality(AR) is defined as a technology that superimposes a computer-generated image on a user's view of the real world, thus providing a composite view. Augmented Reality experiences are not limited to visual addition to our world. You can create augmented experiences that are only audio addition to your physical world or both audio and visual.

Augmented Reality experiences are also not limited to headsets like HoloLens. Today, millions of mobile devices have depth-sensing capabilities to augment your real world with digital information.

Virtual Reality(VR) is when you are absolutely immersed in a Virtual World by wearing a headset. In Virtual Reality you lose connection to the real world visually. Virtual Reality applications are great for training and for simulations where users would benefit from total immersion to replicate the real life situation. Some examples include training for firefighters, emergency room healthcare providers and flight simulations.

Mixed reality is the merging of real and virtual worlds to produce new environments and visualizations, where physical and digital objects co-exist and interact in real time.

We think of Mixed reality as a spectrum from the physical world to an augmented world to fully immersive virtual world and all the possibilities in between.

A 3D model is a digital representation of a real world object. Representing a 3D object requires you to get to know some parts that makes up the 3D object.

Polygonal modeling is an approach for modeling objects by representing or approximating their surfaces using polygon meshes.

Objects created with polygon meshes must store different types of elements. These include vertices, edges, faces, polygons and surfaces.

Why are polygons important?

The more edges and faces a model has, detail if the model improves. On the other hand, having a high polygon count model will reduce the performance of your app. The calculation that needs to be done to render the model is expensive.

Getting Super Powers

Becoming a super hero is a fairly straight forward process:

$ give me super-powers

Once you're strong enough, save the world:

In this section we will install Windows Mixed Reality developer tools and learn about how to use them.

Gestures are input events based on human hands.

There are two types of devices that raise gesture input events in Mixed Reality Toolkit(MRTK):

• Windows Mixed Reality devices such as HoloLens. This describes pinching motions ("Air Tap") and tap-and-hold gestures.

WindowsMixedRealityDeviceManager wraps the Unity XR.WSA.Input.GestureRecognizer to consume Unity's gesture events from HoloLens devices.

• Touch screen devices.

wraps the that supports physical touch screens.

Both of these input sources use the Gesture Settings profile to translate Unity's Touch and Gesture events respectively into MRTK's . This profile can be found under the Input System Settings profile.

• How to run the MRTK Hand Interaction examples in Unity editor?

• How to organize your objects into a grid view?

• How to add manipulation handler to your object?

• Asset creation tools: https://github.com/Yonet/MixedRealityResources#asset-creation-tools.

• Asset Libraries: https://github.com/Yonet/MixedRealityResources#asset-libraries.

• Debugging C# code in Unity:

• Unity IL2CPP debugging: .

Mixed Reality Toolkit (MRTK) provides a set of components and features to accelerate cross-platform Mixed Reality application development in Unity. MRTK includes:

• UI and interaction building blocks.

• Tools.

• Example Scenes.

You can learn more about the components at: .

The HandInteractionExamples.unity example scene contains various types of interactions and UI controls that highlight articulated hand input.

To try the hand interaction scene, first open the HandInteractionExamples scene under Assets\MixedRealityToolkit.Examples\Demos\HandTracking\Scenes\HandInteractionExamples

This example scene uses TextMesh Pro. If you receive a prompt asking you to import TMP Essentials, select the Import TMP Essentials button. Some of the MRTK examples use TMP Essentials for improved text rendering. After you select Import TMP Essentials, Unity will then import the package.

After Unity completes the import, close the TMP Importer window and reload the scene. You can reload the scene by double-clicking the scene in the Project window.

After the scene is reloaded, press the Play button.

Short link: aka.ms/UnityMixedRealityDeveloperTools

Overview

In this section, we will go through the developer tools and how to get started with debugging our applications.

Second part of the course is focused on creating and using 3D assets in your applications.

To grab and move an object, first ensure that the Manipulation Handler (Script) and Near Interaction Grabbable (Script) components are added to the object. The Manipulation Handler (Script) allows you to manipulate an object while the **Near Interaction Grabble (Script) allows the object to respond to near hand interactions.

To add the scripts to the object, first select the object in the Hierarchy window. In the Inspector window, click Add Component and search for each script. Once found, select the script to add to the object.

With the object selected, in the Inspector window, navigate to the Manipulation Handler (Script) component to modify the component's parameters.

You can move an object using one or two hands. This setting is dependent on the Manipulation Type parameter. The Manipulation Type can be limited to either:

• One Handed Only

• Two Handed Only

• One and Two Handed

Select the preferred Manipulation Type so that the user is restricted to use one of the available manipulation types.

You can now test grabbing and moving the object using the in-editor simulation. Press the Play button to enter Game mode. Once in Game mode, hold the space bar to bring up the hand and use the mouse to grab and move the object.

• Why is spatial data important?

• What are some good spatial visualizations for Mixed Reality?

• In the Unity menu, select File > Build Settings... to open the Build Settings window.

• In the Build Settings window, select Universal Windows Platform and click the Switch Platform button.

1 ) Make sure you have imported Microsoft.MixedReality.Toolkit.Unity.Foundation as a custom asset or through NuGet.

2 ) In the Unity Package Manager (UPM), install the following packages:

If you are using HoloLens Seed project, you do not need to follow this step. Seed project already comes with MRTK. Still, it's good to know how to import the MRTK assets for your future projects.

First, you need to download MRTK by going to their github page: and navigating to releases tab. Scroll down to Assets section and download the tools:

• Examples

Check your knowledge by answering below question before you move into the project. Feel free to skip sections you feel comfortable. Make sure you read through the first download section to make sure you have all the modules necessary.

• Make sure you have added the UnityAR Camera Settings Provider to your scene.

• Switch platform to either Android or iOS in the Unity Build Settings

  When you switch the platform you should see the MRTK Project Configurator Window with settings for your chosen platform. Click Apply to enable platform specific settings.

You can download the latest here:.

Can the HoloLens Emulator run on my device?

Before installing the emulator, make sure your PC meets the following hardware requirements:

How to make your buttons follow your hand?

MRTK uses what are known as Solvers to allow UI elements to follow the user or other game objects in the scene. The Radial View solver is a tag-along component that keeps a particular portion of a GameObject within the user's view.

You can make a button follow your hand by adding the Radial View (Script) component to the object.

What are some of the security issues with Mixed Reality Applications?

Since a Mixed Reality application might have access to the user video stream, developers might be able to save or share private information about the user. Be careful to not to save any sensitive data or image anywhere other than users device. Never send sensitive information to any backend.

You can organize any objects in Unity into a grid by using an Object collection script. In this example, you will learn how to organize 6 3D objects into a 3 x 3 grid.

First, configure your Unity scene for the Mixed Reality Toolkit. Next, in the Hierarchy window, right click in an empty space and select Create Empty. This will create an empty GameObject. Name the object CubeCollection.

In the Inspector window, position CubeCollection so that the collection displays in front of the user (example, X = 0, Y = -0.2, Z = 2).

Overview

Shortlink:

A good visualization allows the users to understand a data better by seeing the data points in the right context. Check out some of the examples below to see what the visualization provides that you would have hard time to understand just by seeing the information data points.

• Small arms and ammunition import and export interactive visualization:

• using .

Maps SDK, a Microsoft Garage project provides a control to visualize a 3D map in Unity. The map control handles streaming and rendering of 3D terrain data with world-wide coverage. Select cities are rendered at a very high level of detail. Data is provided by Bing Maps.

The map control has been optimized for mixed reality applications and devices including the HoloLens, HoloLens 2, Windows Immersive headsets, HTC Vive, and Oculus Rift. Soon the SDK will also be provided as an extension to the

How to add button prefabs to your project?

Mixed Reality Toolkit is equipped with a variety of button prefabs that you could add to your project. A prefab is a pre-configured GameObject stored as a Unity Asset and can be reused throughout your project.

You can find button prefabs available in MRTK by navigating to MixedRealityToolkit.SDK > Features > UX > Interactable > Prefabs.

In this project, you will learn how to change the color of a cube when a button is pressed.

First, select the button of your choice from the Project window and drag into the Hierarchy window.

Change the button's Transform Position so that it's positioned in front of the camera to x = 0, y = 0, and z = 0.5

Next, right click on an empty spot in the Hierarchy window and click 3D Object > Cube.

With the Cube object still selected, in the Inspector window, change the Transform Position so that the cube is located near but not overlapping the button. In addition, resize the cube by changing the Transform Scale.

In the Hierarchy window, select the button. In the Inspector window, navigate to the Interactable (Script) component.

In the Events section, expand the Receivers section.

Click the Add Event button to create a new event receiver of Event Receiver Type InteractableOnPressReceiver.

For the newly created InteractableOnPressReceiver event, change the Interaction Filter to Near and Far.

From the Hierarchy window, click and drag the Cube GameObject into the Event Properties object field for the On Press() event to assign the Cube as a receiver of the On Press () event.

Next, click the action dropdown (currently assigned No Function) and select MeshRenderer > Material material. This action will set the Cube's material property to change when the button is pressed.

Now, assign a color for the Cube to change to when the button is pressed. Click the small circle icon next to the Material field (currently assigned None (Material)) to open the Select Material window.

MRTK provides a variety of materials that can be used in your projects. In the search bar, search for MRTK_Standard and select your color of choice.

Now that the event is configured for when the button is pressed, you now need to configure an event that occurs when the button is released. For the On Release () event, click and drag the Cube GameObject into the Event Properties.

Next, click the action dropdown (currently assigned No Function) and select MeshRenderer > Material material. This action will set the Cube's material property to change when the button is released.

Now, assign a color for the Cube to change to when the button is released. Click the small circle icon next to the Material field (currently assigned None (Material)) to open the Select Material window and search for MRTK_Standard. Select your choice of color.

Now that both the On Press () and On Trigger () events are configured for the button, press Play to enter Game mode and test the button in the in-editor simulator.

To press the button, press the space bar + mouse scroll forward.

To release the button, press the space bar + mouse scroll backward.

HoloLens Seed project is a github repository that is configured for Windows Mixed Reality development. The repo includes Mixed Reality Toolkit and .gitignore files.

You can create a new project from the seed instead of downloading the different assets and setting up your git project. To be able to use the seed project, you can get a github account and setup your development environment or directly download the repository content.

Setup

You can clone and delete this repository's history and start a new git project by running the below script. You need to create your own github repo first. Replace with your own github project url.

Or by running the below github commands:

How to update your project to latest seed?

Whenever there is a new update for or packages, this repo will be updated with the latest version. You can automaticly get the latest packages by adding the seed repo as your upstream and pulling from it.

You can check to see if your remote origin and upstream by copy and pasting to your terminal:

You can remove the upstream anytime by running:

• Windows Mixed Reality Docs: aka.ms/MixedRealityDocs

• Mixed Reality Curriculum Youtube Playlist: aka.ms/MixedRealityCurriculumVideos

• Mixed Reality Resources Repository:

• HoloLens Seed Project Repository:

• Code Samples:

• Mixed Reality Development Tools to install:

• Elliminate Texture Confusion: Bump, Normal and Displacement Maps:

• Normal vs. Displacement Mapping & Why Games Use Normals:

• Live editing WebGL shaders with Firefox Developer Tools:

The Settings app on Android includes a screen called Developer options that lets you configure system behaviors that help you profile and debug your app performance. For example, you can enable debugging over USB, capture a bug report, enable visual feedback for taps, flash window surfaces when they update, use the GPU for 2D graphics rendering, and more.

Enable developer options and USB debugging

On Android 4.1 and lower, the Developer options screen is available by default. On Android 4.2 and higher, you must enable this screen. To enable developer options, tap the Build Number option 7 times. You can find this option in one of the following locations, depending on your Android version:

• Android 9 (API level 28) and higher: Settings > About Phone > Build Number

• Android 8.0.0 (API level 26) and Android 8.1.0 (API level 26): Settings > System > About Phone > Build Number

• Android 7.1 (API level 25) and lower: Settings > About Phone > Build Number

At the top of the Developer options screen, you can toggle the options on and off (figure 1). You probably want to keep this on. When off, most options are disabled except those that don't require communication between the device and your development computer.

Before you can use the debugger and other tools, you need to enable USB debugging, which allows Android Studio and other SDK tools to recognize your device when connected via USB. To enable USB debugging, toggle the USB debugging option in the Developer Options menu. You can find this option in one of the following locations, depending on your Android version:

• Android 9 (API level 28) and higher: Settings > System > Advanced > Developer Options > USB debugging

• Android 8.0.0 (API level 26) and Android 8.1.0 (API level 26): Settings > System > Developer Options > USB debugging

• Android 7.1 (API level 25) and lower: Settings > Developer Options > USB debugging

The rest of this page describes some of the other options available on this screen.

To rotate and scale an object, first ensure that the Manipulation Handler (Script) and Near Interaction Grabbable (Script) components are added to the object. The Manipulation Handler (Script) allows you to manipulate an object while the Near Interaction Grabble (Script) allows the object to respond to near hand interactions.

To add the scripts to the object, first select the object in the Hierarchy window. In the Inspector window, click Add Component and search for each script. Once found, select the script to add to the object.

With the object selected, in the Inspector window, navigate to the Manipulation Handler (Script) component to modify the component's parameters.

You can rotate an object using one or two hands. This setting is dependent on the Manipulation Type parameter. The Manipulation Type can be limited to either:

• One Handed Only

• Two Handed Only

• One and Two Handed

Select Two Handed Only for Manipulation Type so that the user can only manipulate the object with two hands.

To limit the two handed manipulation to rotating and scaling, change Two Handed Manipulation Type to Rotate Scale.

To limit whether the object can be rotated on the x, y or z axis, change Constraint on Rotation to your preferred axis.

You can now test rotating and scaling the object using the in-editor simulation. Press the Play button to enter Game mode. Once in Game mode, press T and Y on the keyboard to toggle both hands. This will permanently display both hands in Game mode. Press the space bar to move the right hand and use left mouse click + Shift to move the left hand. While either controlling the left or right hand, use the mouse to rotate and scale the object.

The Windows Device Portal for HoloLens lets you configure and manage your device remotely over Wi-Fi or USB. The Device Portal is a web server on your HoloLens that you can connect to from a web browser on your PC. The Device Portal includes many tools that will help you manage your HoloLens and debug and optimize your apps.

How to setup device portal?

Medical

Before you get started with developing for Mixed Reality for Unity, make sure to check everything in the below list and follow the instructions for each download.

• Latest Windows 10 Education or Pro

• Unity Hub, latest Unity Editor and Windows modules. Optionally, iOS or Android modules if you plan to develop for mobile devices. You can always add a module later.

• Visual Studio

• Windows 10 SDK

• Enable Hyper-V

• Optional: HoloLens Emulator

Windows 10

Install the most recent version of or so your PC's operating system matches the platform for which you are building mixed reality applications.

You can check your Windows version by typing "about" in the Windows search bar and selecting About your PC as shown in the below image.

You can learn more about upgrading your Windows 10 Home to Pro at .

Unity

Go to: page and download the Unity Hub instead of Unity Editor.

Unity Hub allows you to download multiple Unity Editors and organize your projects in one place. Since Unity upgrades are not backward compatible, you have to open the projects with the same Unity version that it was created with. You can update the projects to the latest Unity version but that requires a lot of debugging usually. Easiest way to get going with a project is to keep the same version. I will show you how to debug to update your projects later in this chapter.

You will need to download Windows development related modules along with your Unity Editor. Make sure Universal Windows Platform Build Support and Windows Build Support is checked while downloading Unity Editor through Unity Hub or add it after by modifying the install.

You can add modules or check if you have them in your editor by clicking on the hamburger button for the Unity Editor version and checking the above module check-boxes.

If you would like to build for an Android or iOS mobile device, make sure the related modules are checked as well.

Visual Studio

You can download Visual Studio by adding Microsoft Visual Studio 2019 module to your Unity Editor as shown in previous step or download it at .

You can always add the necessary workflows to Visual Studio after download:

• Search for the Visual Studio Installer in Windows search bar to open the installer.

• Select modify to see the list of modules and select click modify.

• You can also select the Windows SDK versions from individual components tab in the VS installer.

The Unity Editor has four main sections:

Scene view

This is where you can edit the current Scene by selecting and moving objects in the 3D space for the game. In this kit, the game level is contained in one Scene.

Short link:

Overview

In this section, we will look into the hand interactions as an input in our application.