All news

Open source LLMs and retrieval augmented generation: TTZ Günzburg plays a key role in regional development

27.03.2025, Research:

Large Language Models (LLMs) have revolutionised the world of AI. The Technology Transfer Centre (TTZ) Günzburg at Neu-Ulm University of Applied Sciences (HNU) plays a central role in the regional development of this technology. The focus is on open source LLMs in particular, as they not only offer flexible customisation options thanks to their openness, but also enable data protection-compliant use.

Retrieval Augmented Generation (RAG) has proven to be a key technology for effectively adapting open source LLMs to the specific requirements of regional partners. RAG brings decisive advantages that include both technological and economic aspects:

  1. Addressing the key limitations of generative models: RAG reduces hallucinations, improves factual accuracy and keeps models up to date by incorporating external, up-to-date knowledge sources.
  2. Adaptation to specialised and knowledge-intensive domains: By providing access to external data, RAG enables AI to excel in specialised domains without extensive retraining. This is particularly valuable for industries with highly specialised requirements.
  3. Increasing explainability and trust: RAG's retrieval component provides verifiable sources that allow users to trace the origin of answers. This promotes transparency and strengthens trust in the technology.
  4. Cost efficiency: RAG systems do not require constant retraining of LLMs, as the relevant knowledge is retrieved dynamically from external sources. This makes AI systems more adaptable and scalable - at significantly lower costs.
  5. Enabling complex, realistic applications: RAG can merge information from multiple documents, enabling it to process complex queries. This is crucial for real-world, knowledge-intensive tasks that require precise and reliable information processing.

Practice-orientated research for the region

TTZ Günzburg relies on these strengths of RAG to address highly specialised use cases for companies in the region. This includes the development of domain-specific chatbots, the automation of processes and the support of data-driven decision-making - always taking into account data protection and the data sovereignty of companies.

Technological progress for regional strength

Research at TTZ Günzburg shows that open source LLMs, combined with RAG, are not only a globally relevant topic, but also play a key role in regional development. Through the targeted application of this technology, the TTZ is helping to strengthen the competitiveness of the Günzburg region and at the same time create innovative, data protection-compliant solutions for local challenges.

Contact person

Professor Dr. Philipp Brune

 (opens enlarged image)
AI-generated picture.