How can operators in complex industrial processes work faster, safer, and with fewer errors? PhD researcher Tim Schoonbeek investigated how the use of Augmented Reality (AR) and Artificial Intelligence (AI) can improve assembly and production processes. His research shows that innovative technology not only increases the quality of these processes but also redefines the role of humans in the future factory. He collaborated with ASML for his PhD research.
The catalyst for Tim Schoonbeek's doctoral research was a global event that affected everyone. "During the coronavirus pandemic, ASML operators were guided online by experts to resolve machine malfunctions. This gave the company an idea: what if AR glasses and AI could take over that role? No longer would a second person be required to observe; instead, a system would automatically issue warnings, log actions, and display instructions. This saves time, reduces paperwork, and increases safety."
International collaboration and crucial insight
To gain a deeper understanding of the human side of technology, Schoonbeek undertook an internship at the University of Cambridge. There, he teamed up with a psychologist to set up a study in which participants had to assemble a basic drone setup using AR glasses.
Schoonbeek explains the insights that this collaboration generated: "Participants without experience were found to follow the AR instructions accurately. The experts who participated in the study often ignored these instructions."
According to Schoonbeek, this insight is crucial for designing human-machine interactions. "When designing a system, machine, or product, you must account for how humans assemble and use it."
PRACTICAL APPLICATIONS
The PhD researcher reached a few conclusions that have practical applications:
• Automatic logging: Operators do not have to respond immediately to notifications but can finish their work and then act.
• 4-eyes principle: AR glasses allow a second inspector to be replaced by intelligent algorithms that monitor and warn. This enables the second engineer to focus on other tasks.
• Safety and precision: With machines as large as a bus, every mistake is costly. AR helps prevent errors and minimizes downtime
The cover of Tim's dissertation. Image: AI-generated
Gaining knowledge
During his PhD, Schoonbeek seized every opportunity to explore the various elements of his research further. After his research adventure in the UK, he then completed a three-month internship at Microsoft in Seattle. There, the PhD candidate researched HoloLens (a type of AR glasses) and its associated algorithms. "I investigated how such a lens, and the data it collects, can be used as automatic support for the industry during the execution of procedures. I looked specifically at the possibilities for use with machines such as those used by ASML."
Preventing stagnation
Due to the variety of ASML machines, uniform application with AR glasses is not yet possible. Schoonbeek does see opportunities for the company to apply its new knowledge of this digital tool.
"Building an ASML machine requires extreme precision: one wrong screw can lead to days of stagnation, with enormous costs for customers. AR and AI offer a solution that not only prevents errors but also speeds up processes and supports operators."
