Press Release 047/2020

AI Supports Assembly Specialists

Kimoknow, a Startup of KIT, Develops Digital Assembly Assistants Based on Automatic AI-supported Object Recognition
With the help of augmented reality glasses, the digital assistant understands what the wearer sees. In this way, machine and humans can communicate in real time. (Photo: Tanja Meißner, KIT)
With the help of augmented reality glasses, the digital assistant understands what the wearer sees. In this way, machine and humans can communicate in real time. (Photo: Tanja Meißner, KIT)

Artificial intelligence (AI) enables machines to recognize objects. For this purpose, large amounts of high-quality image data are required to manually train the algorithms. Kimoknow, a startup established at Karlsruhe Institute of Technology (KIT), has now developed a technology to automate this training. The first use case: A digital assembly assistant for contact-free cooperation of humans and machines. It is tested in cooperation with Elabo GmbH at the Center for Artificial Intelligence Talents (CAIT).


“Training of AI systems for the recognition of objects still is time-consuming, inflexible, expensive, highly environment-dependent, and associated with a high computation expenditure,” says Lukas Kriete, one of the founders of Kimoknow. For this reason, the startup of KIT uses image data that are generated anyway for all objects in computer-aided development processes (CAD) and pro-duction data management (PDM). These data, among others, in-clude information about the material, geometry, and position of the object. CAD and PDM data are extracted and used for automatic training of the AI.


The trained object recognition system can be used for many pur-poses, among others, in augmented reality (AR) glasses. They cap-ture relevant objects in the field of view of the user in real time and additionally possess the necessary context information on the ob-ject. As the first use case of such AR glasses, Kimoknow devel-oped an assistant to support specialists in the assembly of com-plex devices. The virtual assistant guides users through the com-plete assembly process, visualizes the assembly instructions step by step without an additional display, and shows in which order which part is to be assembled with which tools and assembly mate-rials. It repeats certain steps, if errors occur, and documents the process. The mechanic has both hands free and communicates with the system via eye contact, hand signal, or voice command. “The assembly assistant makes the process more efficient, productive, quicker, and less expensive, while quality is improved,” Kriete says.


The assistant is suited for all industries producing small numbers of highly complex products. The prototype is applied for final assem-bly of highly specialized measurement instruments and presently being tested in cooperation with Elabo GmbH at the Center for Arti-ficial Intelligence Talents (CAIT) of KIT’s Institute for Information Management in Engineering (IMI).


Kimoknow is a startup of IMI and was established on May 13, 2020 as a limited-liability company. Apart from Lukas Kriete, Roman Wie-gand, Aaron Boll, Michael Grethler, and Vesa Klumpp are members of the team of founders.


Center for Artificial Intelligence Talents (CAIT)

The Center for Artificial Intelligence Talents (CAIT) specifically sup-ports talented researchers who combine methods of artificial intelli-gence and engineering.  Apart from the infrastructure, resources, and training formats, it allows to test new developments and ideas under real operation conditions and in cooperation with potential users. This accelerates transfer to practice. The concept focuses on humans and their interaction with artificial intelligence. “It is not new technologies that change the world, but the people using these technologies,” says the Head of CAIT, Professor Jivka Ovtcharova. Researchers and startups are given the opportunity to develop new AI technologies closely to the market. Companies profit from the know-how of these talents and from latest research results. “This is a win-win situation and an optimum model for the collaboration of science and industry,” Ovtcharova points out.


Under the direction of Jivka Ovtcharova, CAIT of IMI was opened in June 2019 to implement the concept of the Lifecycle Engineering Solutions Center (LESC) operated until that time with a focus on AI. Apart from Elabo GmbH, abas Software AG and SolidLine AG are among the partners of CAIT.


More information:
(in German)


Being “The Research University in the Helmholtz Association”, KIT creates and imparts knowledge for the society and the environment. It is the objective to make significant contributions to the global challenges in the fields of energy, mobility, and information. For this, about 10,000 employees cooperate in a broad range of disciplines in natural sciences, engineering sciences, economics, and the humanities and social sciences. KIT prepares its 22,800 students for responsible tasks in society, industry, and science by offering research-based study programs. Innovation efforts at KIT build a bridge between important scientific findings and their application for the benefit of society, economic prosperity, and the preservation of our natural basis of life. KIT is one of the German universities of excellence.

sur, 08.06.2020

Margarete Lehné
Chief Press Officer (acting)
Phone: +49 721 608-41105
Fax: +49 721 608-43658
presse does-not-exist.kit edu

Contact for this press release:

Sandra Wiebe
Press Officer
Phone: +49 721 608-41172
sandra wiebe does-not-exist.kit edu
The photo in the best quality available to us may be requested by
presse does-not-exist.kit edu or phone: +49 721 608-41105.

The press release is available as a PDF file.