Augmented Reality for Assembly

1. Introduction

Augmented Reality for Assembly (AR system) is aimed at increasing the value of an operator on the shop floor as well as to lower the difficulty of assembly for new operators. This is done by projecting the work instructions for subsequent assembly steps in front of the operator such that the operator does not have to search for information. By this method,  the operator is relieved of mental strain and can focus on the manipulations needed for assembly. The digital system takes care of the process and the human is used in its strength which is flexibility.

2. System delineation

a. Context

The AR system resides in a factory where assembly of complex assemblies is required. Here it works together with the MPMS, HORSE middleware and other HORSE components. The operator working with the AR system receives visual instructions about how to perform certain assembly steps.

b. Scope

The AR system provides the instructions to the operator for assembly. It does not provide the physical tools required for assembly nor the parts that have to be assembled.

c. Operational overview

A task for the AR system is instantiated from the MPMS and provided via the HORSE middleware to the local task manager and AR system. Upon receiving this information, it is queued in the local task manager that takes care of the synchronisation between actors in the work cell. When the work cell is ready for the new task, the AR system retrieves the required working instructions corresponding to the task from the database. AR guidance for assembly begins and when the operator has finished the task, this information is transmitted again via the HORSE middleware to the MPMS.

3. Requirements and functions

Figure 1 The conceptual framework of HORSE requirements (figure 41 D2.1)

System Functions

Functional requirements

1. System description and demonstration scenario

Another setup of HORSE Framework has been assembled for validation and demonstration in the official HORSE test site in the Thomas Regout International factory in Maastricht, Netherland. An Augmented Reality solution that gives instructions for assembling the tool, superimposed on real tool parts was tested in “P1” area. This includes an advanced planning system (MPMS) to help with planning change overs with minimal reconfiguration of tooling, as well as a mobile platform to fetch tooling blocks.

Figure 2 Schematic overview of the actors and their tasks in this scenario

Figure 3: Overview photo of the on site testing at Thomas Regout International

Figure 4: Work desk with AR for TRI P1

5. Download information

Customer specific implementation is very high, for that reason, an example implementation of the framework is provided that allows the integrator to have a software stack from MPMS to the local component running. The actions of the local component, which was AR for assembly in this case, can be easily defined in Python.

Components

1. Configuration 

horseModuleCore.config

2. MPMS example process

human_robot_simple.bpmn

A simple MPMS example process is included in the package that can interface with the other parts in the package.

3. Python script to start MPMS task

test_order.py

This simple script allows to start an MPMS task remotely without using the GUI of the MPMS itself. It is especially valuable during debugging and integration stages where the whole software stack needs to be tested.