Retrieval Augmented Generation in Large Language Models: Development of AI Chatbot for Student Support

izvorni znanstveni rad

izvorni znanstveni rad

Retrieval Augmented Generation in Large Language Models: Development of AI Chatbot for Student Support

Vrsta prilog sa skupa (u zborniku)
Tip izvorni znanstveni rad
Godina 2024
Nadređena publikacija Proceedings of the 15th International Conference on e-Learning (eLearning 2024)
Stranice str. 12-23
ISSN 1613-0073
Status objavljeno

Sažetak

Large Language Models (LLMs) are being employed in various domains to support different tasks. There are many challenges when working with LLMs, such as hallucination and domain knowledge gaps. Retrieval Augmented Generation (RAG) has emerged as one of the best paradigms for enabling LLMs to access domain-specific data and as a mechanism for mitigating hallucinations. In this paper, we are employing RAG and investigating how large language models use repositories of pre-existing knowledge
to enhance the quality and relevance of generated responses. The focus of the paper is the development of real-world RAG applications in the educational domain. The research aims to develop an AI-based chatbot for university students that could answer students` frequently asked questions. Such a chatbot solves several challenges faced by the faculty administration and guides the improvement of the student's study experience. In the implementation, a low-code approach of Flowise AI is used. As a result, the prototype is
developed. From the domain point of view, the prototype represents a step toward an AI-powered educational system that has the potential to further enhance the level of individualized educational support. From the technological point of view, such implementation emphasizes the benefits of LLM and RAGintegration and the advantages of generative artificial intelligence.

Ključne riječi

Generative artificial intelligence; large language models; retrieval augmented generation; AI chatbot; student support