- Introduction
Augmented Reality for Assembly (AR system) is aimed at increasing the value of an operator on the shop floor as well as to lower the difficulty of assembly for new operators. This is done by projecting the work instructions for subsequent assembly steps in front of the operator such that the operator does not have to search for information. By this method, the operator is relieved of mental strain and can focus on the manipulations needed for assembly. The digital system takes care of the process and the human is used in its strength which is flexibility.
- System delineation
a. Context
The AR system resides in a factory where assembly of complex assemblies is required. Here it works together with the MPMS, HORSE middleware and other HORSE components. The operator working with the AR system receives visual instructions about how to perform certain assembly steps.
b. Scope
The AR system provides the instructions to the operator for assembly. It does not provide the physical tools required for assembly nor the parts that have to be assembled.
c. Operational overview
A task for the AR system is instantiated from the MPMS and provided via the HORSE middleware to the local task manager and AR system. Upon receiving this information, it is queued in the local task manager that takes care of the synchronisation between actors in the work cell. When the work cell is ready for the new task, the AR system retrieves the required working instructions corresponding to the task from the database. AR guidance for assembly begins and when the operator has finished the task, this information is transmitted again via the HORSE middleware to the MPMS.
- Requirements and functions
Figure 1 The conceptual framework of HORSE requirements (figure 41 D2.1)
System Functions
Stakeholder expectation |
System Function |
Functional requirement |
The HORSE system should make it possible for humans to work in close proximity to pre-determined automated actors. |
SF-01: Work cell situation awareness |
NRQ-17 |
The HORSE System should be able to perform synchronised activities with human actors. Rotate actors for manufacturing tasks, based on cumulative workload, capabilities and availability of actors and system status |
SF-04: Task allocation between human and automated actors based on workload |
FRQ-10
|
SF-05: Ergonomic work station supporting user friendly interaction |
FRQ-11 |
|
The HORSE System should present them instructions of their tasks |
SF-09: Augmented reality manufacturing tasks |
FRQ-19 |
The HORSE System should provide the operator with necessary information to visually inspect pre-defined critical product parameters. |
SF-10: Augmented reality to assist visual inspection |
FRQ-21 |
The HORSE System should allocate tasks between robots and workers according to their capabilities. |
SF-04: Task allocation based on resource characteristics |
FRQ-33
|
The HORSE system should visually display the current status of the manufacturing system (status of production orders, occupation of actors, process performance), based on information received from other systems and actors. |
SF-14: Monitoring and control of work progress of all actors in the manufacturing process |
FRQ-37 |
Functional requirements
Functional requirement |
Description |
FRQ-10 |
The HORSE System shall be able to monitor for every Robotic Actor: a) its capabilities, including at least a.1) maximum load, and a.2) availability, b) its performance , including at least b.1) task actual completion time, b.2) task estimated completion time, b.3) task successful execution estimation |
FRQ-11 |
The Robotic Actor shall be able to accept commands, (including task orders and configuration) via a portable device. |
FRQ-12 |
The Robotic Actor shall be able to present the state of production task to the Production human actor remotely |
FRQ-19 |
The HORSE System shall be able to present information about the production process to the Production human actor via a portable or wearable device, including at least a) alerts and b) task guidelines. |
FRQ-21 |
The HORSE System shall be able to present to the Operator visual captures of a predefined object. |
FRQ-33 |
The HORSE System shall be able to select and allocate appropriate actors to tasks based on their specific capabilities. |
FRQ-37 |
The HORSE System shall be able to manage operational mode and the task state, for all actors. |
NRQ-03 |
The HORSE System shall be configurable |
NRQ-17 |
The HORSE system shall not harm humans. |
- System description and demonstration scenario
Another setup of HORSE Framework has been assembled for validation and demonstration in the official HORSE test site in the Thomas Regout International factory in Maastricht, Netherland. An Augmented Reality solution that gives instructions for assembling the tool, superimposed on real tool parts was tested in “P1” area. This includes an advanced planning system (MPMS) to help with planning change overs with minimal reconfiguration of tooling, as well as a mobile platform to fetch tooling blocks.
Figure 2 Schematic overview of the actors and their tasks in this scenario
Figure 3: Overview photo of the on site testing at Thomas Regout International
Figure 4: Work desk with AR for TRI P1
- Download information
Customer specific implementation is very high, for that reason, an example implementation of the framework is provided that allows the integrator to have a software stack from MPMS to the local component running. The actions of the local component, which was AR for assembly in this case, can be easily defined in Python.
Components
1. Configuration
horseModuleCore.config
2. MPMS example process
human_robot_simple.bpmn
A simple MPMS example process is included in the package that can interface with the other parts in the package.
.png)
3. Python script to start MPMS task
test_order.py
This simple script allows to start an MPMS task remotely without using the GUI of the MPMS itself. It is especially valuable during debugging and integration stages where the whole software stack needs to be tested.
Python local component
Other examples
The package contains more files that we created during the project to test various functionality.
Download link
http://horse-project.eu/How_to_get_access_to_HORSE_Prototype_System