Mixed-Reality-in-the-Loop Simulation based on a Digital Twin as a Service concept for Learning Factories

Abstract

This paper presents the Mixed-Reality-in-the-Loop Simulation (MRiLS) for training in mechanical engineering in combination with virtual and hybrid Learning Factories. MRiLS combines the methods of X-in-the-Loop Simulation (XiLS) used in the mechatronic development process with visualization and interaction methods of Mixed Reality (MR), thus enabling the comprehensive integration of humans and their behavior into the simulation loop. In addition to the egocentric visualization of the virtual content, MRiLS also requires intuitive multimodal human-model interaction and multiuser collaboration.

For a location-independent deployment of the MRiLS, the Digital Twin as a Service (DTaaS) concept is presented. Besides to the flexible coupling of industrial control technology with the MR devices, this approach enables the device-independent provision of Digital Twins as well as the use of different virtuality and interaction modalities in a multiuser environment. The basis for the use of the virtuality and interaction modalities with a shared Digital Twin is an abstraction layer between the device technology and the behavioral and interaction model of the Digital Twin. The viability of the methods presented is demonstrated by a selected Digital Twin of a Smart Factory test environment.

Keywords: Mixed-Reality-in-the-Loop Simulation; Digital Twin as a Service; Training; Mechanical engineering; Intuitive human-model interaction