Using the Microsoft Hololens as a Robotic Controller

Date of Award

Spring 5-4-2018

Degree Type

Honors Thesis


Electrical and Computer Engineering

First Advisor

Suresh Muknahallipatna


Using the Microsoft Hololens as a Robotic Controller

Marcus Rieker with Professor Suresh S. Muknahallipatna

Computer Engineering

University of Wyoming

Oral & Poster Presentation

Department of Electrical and Computer Engineering Laramie, WY

The Raspberry Pi 3 is a low cost, credit-card sized computer. Windows 10 IoT Core is an operating system built for such small devices. Windows 10 IoT Core embraces a rich UWP (Universal Windows Platform) app experience. The Microsoft HoloLens is the first self-contained, holographic computer, enabling users to engage and interact with holograms in the world around them.

The goal of this project is to use a Raspberry Pi 3 (running Windows 10 IoT Core) and a Microsoft Hololens to control a small robotic platform. This platform will have two DC motors (powering two separate wheels) controlled by an H-Bridge mounted on the robotic platform. The Raspberry Pi will take commands via WiFi (TCP / IP sockets) from the Microsoft Hololens. A user will control the robotic platform (turning it, moving it forward/backward, etc.) via model manipulation. I.e. the model will appear in the Hololens and will allow the user to interact with it. If the user pushes / turns the model the robotic platform will move accordingly. There will also be a live feed from a camera mounted on the platform that streams to the Hololens. This will assist the user in control and not limit them to being in the same vicinity as the platform. The fundamental concept of this project (communication between a Raspberry Pi and Microsoft Hololens) will have unlimited applications in the years to come, especially as the Hololens becomes more and more affordable to the general public.

This document is currently not available here.