Search

Browse

• Communities
• Authors
• Year
• Titles
• Subjects

My Space

• Login

Holo-box: Multi-Level augmented reality glanceable interfaces for machine shop guidance using eye and hand tracking interactions

Daskalogrigorakis Grigorios

Full record

---

Summary

In this work, we employ Serious Games and Augmented Reality as tools for manufacturing training inside a machine shop. First, we analyze the progress of modern manufacturing processes leading up to the 4th industrial revolution, commonly known as Industry 4.0. We tackle shortcomings in relation to the use of simulations and Serious Games as training tools as well as the use of Augmented Reality in manufacturing. Finally, we analyze Glanceable Augmented Reality and its technical challenges. In the first part of this work, we propose a gamified approach to visualising manufacturing missions for the implementation of a Serious Game focused on G-code programming for milling and turning missions for undergraduate students as a standalone training system without the need of a supervisor. Our gamified manufacturing mission design was also translated for use through AR inside the real world machine shop.Glanceable User Interfaces for Augmented Reality (AR) reveal virtual content "at a glance" to provide rapid information retrieval, often based on gaze interaction. They are ideal when the augmented content covers a small proportion of the view space, but when the size of virtual content grows, the potential to occlude the real-world increases provoking safety concerns. In this work, we present Holo-Box, a novel interaction system for AR combining Glanceable interfaces and world-based 3D interfaces across three Levels-Of-Detail, including progressively more information and visuals. Holo-box uses a combination of eye-gaze and hand interactions, focusing on user safety. A 2D Glanceable interface facilitates rapid information retrieval at a glance, while extended 3D interfaces provide interaction with denser content and 3D objects. Holo-Box couples blink-based and gaze-based interactions to minimize errors arising from the Midas Touch Problem. While applicable across domains, the Holo-Box interface is designed and optimized for performing manufacturing tasks in the real world. We evaluated the Holo-Box interface using an object selection task of a manufacturing process. Participants completed subsequent tasks faster using Holo-Box, employing incrementally smaller LOD interfaces over time. The perceived accuracy of Holo-Box gaze-based inputs was high, even when the device's eye tracker accuracy was coarse.

Available Files

Services