The Anatomy of MR Technology

Hardware

An MR headset is a complex composite of hardware features that together enable holographic computing. An optical system works in lock-step with advanced sensors, an HPU makes light work of processing a large amount of data per second. All those components and more enable the user to move freely and interact with holograms. The primary hardware components include the following:

The Microsoft Hololens is the forerunner of mixed reality and the world’s first fully untethered holographic computer. The HoloLens features an inertial measuremCent unit (IMU) (which includes an accelerometer, gyroscope, and a magnetometer) four “environment understanding” sensors, an energy-efficient depth camera with a 120°×120° angle of view, a 2.4-megapixel photographic video camera, a four-microphone array, and an ambient light sensor. The HoloLens contains an internal rechargeable battery, with average life rated at 2–3 hours of active use, or 2 weeks of standby time. HoloLens also features IEEE 802.11ac Wi-Fi and Bluetooth 4.1 Low Energy (LE) wireless connectivity. The headset uses Bluetooth LE to pair with the included Clicker, a thumb-sized finger-operating input device that can be used for interface scrolling and selecting.

The interactive 3D model below provides a close-up view of the Hololens hardware.

Software

The software of a mixed reality headset is the mastermind behind the MR experience. Headsets receive, understand, and respond to different stimuli almost instantly and applications allow users to cater mixed reality to their personal reality.

The Microsoft HoloLens uses sensual and natural interface commands—gaze, gesture, and voice—sometimes referred to as “GGV”, inputs. Gaze commands, such as head-tracking, allow the user to bring application focus to whatever the user is perceiving. “Elements”—or any virtual application or button—are selected using an air tap method, similar to clicking an imaginary computer mouse. The Hololens also comes with a number of default apps: