How Startup Is Making AI Faster And More Sustainable

TUM

The capabilities of artificial intelligence (AI) are growing rapidly; at the same time, energy consumption and costs are rising. This is where Pruna AI comes in: The startup develops highly efficient and cost-effective AI models. The goal is to keep AI accessible to researchers and businesses, particularly in Europe, and to significantly reduce its environmental footprint.

The three founders of Pruna AI are sitting on a sofa in front of their laptops, engaged in discussion. Astrid Eckert / TUM
The founders of Pruna AI: Bertrand Charpentier, Rayan Nait Mazi, and Stephan Günnemann (from left to right).

In brief

  • AI's energy and resource consumption is steadily increasing
  • Pruna AI's goal is therefore to develop more efficient and cost-effective AI models
  • This is intended to strengthen Europe's position as a hub for research and business

Especially in research, which relies on powerful computational models, the costs and energy consumption of AI have risen sharply in recent years. The Pruna AI team is therefore developing AI models that require significantly fewer resources while maintaining high performance.

In addition to research, typical use cases can be found in e-commerce, for example: A company wants to allow its customers to upload a photo to an app and virtually try on different items of clothing. For this "virtual try-on" to work in everyday life, the AI model must generate realistic images in fractions of a second - such as the same person wearing different T-shirts - while operating cost-effectively enough to allow the feature to be used millions of times.

How Pruna makes AI models more efficient

Technically, the start-up relies on several compression and optimization methods that target different parts of the model. For example, connections and model components that play only a minor role in the result are removed. In addition, intermediate results that have already been calculated can be temporarily stored so they do not have to be recalculated for later, similar requests.

The technical distinction of Pruna AI's methods lies in the fact that they are not used in isolation, but rather combined and applied to models in a standardized manner. The system then automatically evaluates the extent to which speed, memory usage, and quality change compared to the original model. This makes it possible to find the optimal balance between efficiency and accuracy for different applications. In addition, Pruna AI relies on agent-based methods to further improve the quality of the models.

Artificial Intelligence

Artificial intelligence is shaping our working lives, research, and the world around us. Learn how we are contributing to this progress by developing innovative AI methods and applications, ranging from robotics to machine learning.

AI and robotics at TUM

Image of the interior of the Leibniz Supercomputing Centre of the Bavarian Academy of Sciences and Humanities Andreas Heddergott / TUM

Europe must remain technologically competitive

Pruna AI is backed by a four-person founding team: Bertrand Charpentier, Rayan Nait Mazi, John Rachwan, and TUM Professor Stephan Günnemann. The idea for the startup emerged around 2020 while Bertrand Charpentier was working on his doctoral dissertation and John Rachwan was working on his undergraduate research projects; during their research at TUM, they were directly confronted with the challenges of developing efficient and high-performance AI.

We need to develop AI systems that can operate with significantly fewer resources. This is particularly crucial for Europe if we want to remain technologically competitive.

Prof. Stephan Günnemann

"But there was also always the thought that relying on additional energy sources, such as nuclear power plants, to meet AI's growing computational demands couldn't be the right approach. Instead, we need to develop AI systems that can operate with significantly fewer resources. This is particularly crucial for Europe if we want to remain technologically competitive. That's why, in addition to our location in Munich, we also have another one in Paris," says Stephan Günnemann. The diverse and international team has since grown to 16 full-time employees and several student assistants.

The team received funding from the EXIST startup grant, as well as from UnternehmerTUM, the Center for Innovation and Entrepreneurship, and the TUM Venture Labs Software/AI and Robotics/AI.

A view over the shoulder of an employee sitting at a computer screen. In the background, other people can be seen at their computers. Astrid Eckert / TUM
A Look Inside Pruna AI's Offices

Entrepreneurship

Entrepreneurship is part of our DNA. Discover the founding ecosystem of TUM, UnternehmerTUM, and the TUM Venture Labs with a wide range of entrepreneurship offerings - from startup consulting to entrepreneurship education.

Entrepreneurship at TUM

Group work in a class of electrical engineering and information technology students Andreas Heddergott / TUM
Further information and links
/Public Release. This material from the originating organization/author(s) might be of the point-in-time nature, and edited for clarity, style and length. Mirage.News does not take institutional positions or sides, and all views, positions, and conclusions expressed herein are solely those of the author(s).View in full here.