Е-Публикации
Технически университет - София

Abstract: This paper presents the possibilities for applying generative AI chatbot models (GenAI), in particular large language models (LLM), in the practice of implementing Business Information Systems (BIS). The study included popular GenAI and students studying similar disciplines. The goal is to assess the quality of the responses of the chatbots and students to a real case study from practice related to the implementation of BIS. As a result of the study, it was found that GenAI can be a good assistant in practice.

References

1. O. Nakov, M. Lazarova, N. Hinov, "Advanced Technologies and Applications in Computer Science and Engineering", Electronics, 2025; 14(4):753. https://doi.org/10.3390/electronics14040753.
2. K. Anguelov, Trends in the development of business information systems of ERP class, AIP Conf. Proc. 2505, 060014 (2022), https://doi.org/10.1063/5.0103049
3. M. Hayes and A. Downie, “What is AI transformation?“. IBM website. 2024. Available at: https://www.ibm.com/think/topics/ai-transformation.
4. R. Ilieva, K. Anguelov and M. Nikolov, "A Cynefin Framework for Agile Decision Making of AI BOTS," 2018 International Conference on High Technology for Sustainable Development (HiTech), Sofia, Bulgaria, 2018, pp. 1-4, doi: 10.1109/HiTech.2018.8566411.
5. I. Pap, S. Oniga, “eHealth Assistant AI Chatbot Using a Large Language Model to Provide Personalized Answers through Secure Decentralized Communication”, Sensors. 2024, 24(18), 6140; https://doi.org/10.3390/s24186140.
6. N. Kshetri, et al. "Generative artificial intelligence in marketing: Applications, opportunities, challenges, and research agenda", International Journal of Information Management, vol. 75, April 2024, 102716.
7. N. Kshetri, N. Ahmad, P. Chauhan, "Generative Artificial Intelligence and E-Commerce" in Computer, vol. 57, no. 02, pp. 125-128, Feb. 2024, doi: 10.1109/MC.2023.3340772.
8. M. Nuruzzaman and O. K. Hussain, "A Survey on Chatbot Implementation in Customer Service Industry through Deep Neural Networks," 2018 IEEE 15th International Conference on e-Business Engineering (ICEBE), Xi'an, China, 2018, pp. 54-61, doi: 10.1109/ICEBE.2018.00019.
9. P. R. Chelliah et al., Generative Artificial Intelligence in Finance: Large Language Models, Interfaces, and Industry Use Cases to Transform Accounting and Finance Processes. Wiley Online Library, 2025.
10. Y. Li, S. Wang, H. Ding, H. Chen, "Large Language Models in Finance: A Survey", ICAIF 2023 - 4th ACM International Conference on AI in Finance, New York City, 2023, pp. 374 – 382.
11. P. Budhwar, et al. “Human resource management in the age of generative artificial intelligence: Perspectives and research directions on ChatGPT”, Human Resource Management Journal, 33(3), 2023, pp. 606–659.
12. R. Samsami, “Optimizing the Utilization of Generative Artificial Intelligence (AI) in the AEC Industry: ChatGPT Prompt Engineering and Design”, CivilEng, 5(4), 2024, pp. 971–1010.
13. W. Liao, X. Lu, Y. Fei, Y. Gu, Y. Huang, “Generative AI design for building structures”, Automation in Construction, vol. 157, 2024, 105187.
14. J. Sun, et al., “Investigating Explainability of Generative AI for Code through Scenario-based Design”, In Proceedings of the 27th International Conference on Intelligent User Interfaces (IUI '22). Association for Computing Machinery, New York, USA, 2022, pp. 212–228.
15. C. Ebert and P. Louridas, "Generative AI for Software Practitioners," in IEEE Software, vol. 40, no. 4, pp. 30-38, July-Aug. 2023, doi: 10.1109/MS.2023.3265877.
16. D. Russo, “Navigating the Complexity of Generative AI Adoption in Software Engineering”, ACM Transactions on Software Engineering and Methodology, vol. 33(5), Article No.: 135, 2024, pp. 1 – 50.
17. A. Fan et al., "Large Language Models for Software Engineering: Survey and Open Problems," 2023 IEEE/ACM International Conference on Software Engineering: Future of Software Engineering (ICSE-FoSE), Melbourne, Australia, 2023, pp. 31-53, doi: 10.1109/ICSE-FoSE59343.2023.00008.
18. L. Belzner, T. Gabor, M. Wirsing, “Large Language Model Assisted Software Engineering: Prospects, Challenges, and a Case Study”, Bridging the Gap Between AI and Reality. AISoLA 2023, Springer, vol. 14380, 2023, pp. 355–374. https://doi.org/10.1007/978-3-031-46002-9_23
19. J. Schnepf, T. Engin, S. Anderer, B. Scheuermann, “Studies on the Use of Large Language Models for the Automation of Business Processes in Enterprise Resource Planning Systems”, In: Rapp, A., Di Caro, L., Meziane, F., Sugumaran, V. (eds) Natural Language Processing and Information Systems. NLDB 2024. Lecture Notes in Computer Science, vol 14762. Springer, Cham.
20. K. Anguelov, "Applications of Artificial Intelligence for Optimization of Business Processes in Enterprise Resource Planning Systems," 2021 12th National Conference with International Participation (ELECTRONICA), Sofia, Bulgaria, 2021, pp. 1-4, doi: 10.1109/ELECTRONICA52725.2021.9513677.
21. A. Beheshti et al., "ProcessGPT: Transforming Business Process Management with Generative Artificial Intelligence," 2023 IEEE International Conference on Web Services (ICWS), Chicago, IL, USA, 2023, pp. 731-739, doi: 10.1109/ICWS60048.2023.00099.
22. A. Beheshti et al., "ProcessGPT: Transforming Business Process Management with Generative Artificial Intelligence," 2023 IEEE International Conference on Web Services (ICWS), Chicago, IL, USA, 2023, pp. 731-739, doi: 10.1109/ICWS60048.2023.00099.
23. V. Nachev and D. Gotseva, "Design of Remote Labs and Experiments about Embedded Systems and Robotics Learning," 2022 10th International Scientific Conference on Computer Science (COMSCI), Sofia, Bulgaria, 2022, pp. 1-4, doi: 10.1109/COMSCI55378.2022.9912587.

Issue