Autors: Ujkani B., Minkovska, D. V., Hinov, N. L.
Title: Course Success Prediction and Early Identification of At-Risk Students Using Explainable Artificial Intelligence
Keywords: course success prediction, education, explainable artificial intelligence, machine learning, online learning, shap

Abstract: Artificial Intelligence (AI) is increasingly used in online education platforms to provide valuable insights into students’ performance and success. However, the complexity of AI models makes it challenging for educators to interpret the specific factors that influence whether a student is going to pass or fail. Utilizing the Open University Learning Analytics Dataset (OULAD), this study employs various machine learning and deep learning techniques for predicting students’ success, along with SHapley Additive exPlanations (SHAP) as an Explainable Artificial Intelligence (XAI) technique, to understand the key factors behind success or failure. Unlike traditional statistical methods that explore variable relationships, this AI-driven approach uses advanced deep learning techniques to identify patterns and insights, allowing for a better understanding of the factors influencing student success. Additionally, this study focuses on identifying students at risk of failure using XAI techniques, specifically SHAP, to interpret model outputs by breaking down how specific factors contribute to a student’s success. This method enables targeted interventions to support their success. Results reveal that student engagement and registration timelines are critical factors affecting performance. The customized models achieve up to 94% accuracy for the designed tasks, outperforming traditional approaches. This study contributes to the use of AI in education and offers practical insights not only for educators but also for administrators and policymakers to enhance the quality and effectiveness of online learning.

References

  1. Tseng S.F. Tsao Y.W. Yu L.C. Chan C.L. Lai K.R. Who will pass? Analyzing learner behaviors in MOOCs Res. Pract. Technol. Enhanc. Learn. 2016 11 8 10.1186/s41039-016-0033-5 30613241
  2. Gardner J. Brooks C. Student success prediction in MOOCs User Model. User-Adapt. Interact. 2018 28 127 203 10.1007/s11257-018-9203-z
  3. Khosravi H. Shum S.B. Chen G. Conati C. Tsai Y.S. Kay J. Knight S. Martinez-Maldonado R. Sadiq S. Gašević D. Explainable artificial intelligence Artif. Intell. Comput. Educ. 2022 3 100074 10.1016/j.caeai.2022.100074
  4. Shabaninejad S. Khosravi H. Abdi S. Indulska M. Sadiq S. Incorporating explainable learning analytics to assist educators with identifying students in need of attention Proceedings of the Ninth ACM Conference on Learning@Scale Roosevelt Island, NY, USA 1–3 June 2022 384 388
  5. De Laet T. Mothilal R.K. Broos T. Pinxten M. Predicting First-year engineering student success: From traditional statistics to machine learning Proceedings of the 46th SEFI Annual Conference 2018 Copenhagen, Denmark 17–21 September 2018 Volume 46 322 329
  6. Tinto V. Dropout from Higher Education: A Theoretical Synthesis of Recent Research Rev. Educ. Res. 1975 45 89 125 10.3102/00346543045001089
  7. Dagar Y.A. Constructivism: A Paradigm for Teaching and Learning Arts Soc. Sci. J. 2016 7 1 4 10.4172/2151-6200.1000200
  8. Hassija V. Chamola V. Mahapatra A. Singal A. Goel D. Huang K. Scardapane S. Spinelli I. Mahmud M. Hussain A. Interpreting black-box models: A review on explainable artificial intelligence Cogn. Comput. 2024 16 45 74 10.1007/s12559-023-10179-8
  9. Atakishiyev S. Salameh M. Yao H. Goebel R. Explainable artificial intelligence for autonomous driving: A comprehensive overview and field guide for future research directions IEEE Access 2024 12 101603 101625 10.1109/ACCESS.2024.3431437
  10. Bekler M. Yilmaz M. Ilgın H.E. Assessing Feature Importance in Eye-Tracking Data within Virtual Reality Using Explainable Artificial Intelligence Techniques Appl. Sci. 2024 14 6042 10.3390/app14146042
  11. Romano D. Novielli P. Diacono D. Cilli R. Pantaleo E. Amoroso N. Tangaro S. Insights from Explainable Artificial Intelligence of Pollution and Socioeconomic Influences for Respiratory Cancer Mortality in Italy J. Pers. Med. 2024 14 430 10.3390/jpm14040430
  12. Yagin F.H. Colak C. Algarni A. Gormez Y. Guldogan E. Ardigò L.P. Hybrid Explainable Artificial Intelligence Models for Targeted Metabolomics Analysis of Diabetic Retinopathy Diagnostics 2024 14 1364 10.3390/diagnostics14131364
  13. Carvalho D.D. Goethel M.F. Silva A.J. Vilas-Boas J.P. Pyne D.B. Fernandes R.J. Swimming Performance Interpreted through Explainable Artificial Intelligence (XAI)—Practical Tests and Training Variables Modelling Appl. Sci. 2024 14 5218 10.3390/app14125218
  14. Hussain S. Khan M.Q. Student-performulator: Predicting students’ academic performance at secondary and Intermediate level using machine learning Ann. Data Sci. 2023 10 637 655 10.1007/s40745-021-00341-0 38624826
  15. Pallathadka H. Wenda A. Ramirez-Asís E. Asís-López M. Flores-Albornoz J. Phasinam K. Classification and prediction of student performance data using various machine learning algorithms Mater. Today Proc. 2023 80 3782 3785 10.1016/j.matpr.2021.07.382
  16. Chen Y. Zhai L. A comparative study on student performance prediction using machine learning Educ. Inf. Technol. 2023 28 12039 12057 10.1007/s10639-023-11672-1
  17. Hooda M. Rana C. Dahiya O. Shet J.P. Singh B.K. Integrating LA and EDM for improving students Success in higher Education using FCN algorithm Math. Probl. Eng. 2022 2022 7690103 10.1155/2022/7690103
  18. Shapley L.S. 17. A Value for n-Person Games Contributions to the Theory of Games (AM-28) Kuhn H.W. Tucker A.W. Princeton University Press Princeton, NJ, USA 1953 Volume II 307 318 10.1515/9781400881970-018
  19. Schunk D.H. Social cognitive theory APA Educational Psychology Handbook, Vol 1: Theories, Constructs, and Critical Issues American Psychological Association Washington, DC, USA 2012 Volume 1 101 123
  20. Adams N.E. Bloom’s Taxonomy of Cognitive Learning Objectives J. Med. Libr. Assoc. JMLA 2015 103 152 153 10.3163/1536-5050.103.3.010 26213509
  21. Kuzilek J. Hlosta M. Zdrahal Z. Open University Learning Analytics dataset Sci. Data 2017 4 170171 10.1038/sdata.2017.171
  22. Butucha K.G. Emerging Trends in Student Engagement in the 21St Century Contemporary World Baraton Interdiscip. Res. J. 2016 6 39 43
  23. Tartavulea C.V. Albu C.N. Albu N. Dieaconescu R.I. Petre S. Online Teaching Practices and the Effectiveness of the Educa-tional Process in the Wake of the COVID-19 Pandemic Amfiteatru Econ. 2020 22 920
  24. Breiman L. Random forests Mach. Learn. 2001 45 5 32 10.1023/A:1010933404324
  25. Friedman J.H. Greedy function approximation: A gradient boosting machine Ann. Stat. 2001 29 1189 1232 10.1214/aos/1013203451
  26. Keller J.M. Gray M.R. Givens J.A. A fuzzy k-nearest neighbor algorithm IEEE Trans. Syst. Man Cybern. 1985 SMC-15 580 585 10.1109/TSMC.1985.6313426
  27. Shanmuganathan S. Artificial Neural Network Modelling: An Introduction Springer International Publishing Berlin/Heidelberg, Germany 2016 1 14
  28. O’Shea K. An introduction to convolutional neural networks arXiv 2015 1511.08458
  29. Hochreiter S. Long Short-term Memory Neural Comput MIT-Press Cambridge, UK 1997
  30. Chen T. Guestrin C. Xgboost: A scalable tree boosting system Proceedings of the 22nd acm sigkdd international conference on knowledge discovery and data mining San Francisco, CA, USA 13–17 August 2016 785 794
  31. Cohen S. The evolution of machine learning: Past, present, and future Artificial Intelligence and Deep Learning in Pathology Elsevier Berlin/Heidelberg, Germany 2021 1 12
  32. Lundberg S. A unified approach to interpreting model predictions arXiv 2017 1705.07874
  33. Lim K.K. Lee C.S. Investigating Learner’s Online Learning Behavioural Changes during the COVID-19 Pandemic Proc. Assoc. Inf. Sci. Technol. 2021 58 777 779 10.1002/pra2.559
  34. Jereb E. Jerebic J. Urh M. Studying Habits in Higher Education Before and After the Outbreak of the COVID-19 Pandemic Athens J. Educ. 2023 10 67 84 10.30958/aje.10-1-4

Issue

Electronics (Switzerland), vol. 13, 2024, , https://doi.org/10.3390/electronics13214157

Copyright MDPI AG

Цитирания (Citation/s):
1. Fabrizio Stasolla, Antonio Zullo, Roberto Maniglio, Anna Passaro, Deep Learning and Reinforcement Learning for Assessing and Enhancing Academic Performance in University Students: A Scoping Review, AI 2025, 6(2), 40; https://doi.org/10.3390/ai6020040 - 2025 - в издания, индексирани в Scopus и/или Web of Science
2. Nazir M., Noraziah A., Rahmah M., Fakherldin M., Khawaji A., Transforming Education with Deep Learning: A Systematic Review on Predicting Student Performance and Critical Challenges, 2025, Fusion: Practice and Applications, issue 2, vol. 18, pp. 79-99, DOI 10.54216/FPA.180207, issn 27700070, eissn 26924048 - 2025 - в издания, индексирани в Scopus
3. Córdova-Esparza, DM, Terven, J, Romero-González, JA, Córdova-Esparza, KE, López-Martínez, RE, García-Ramírez, T, Chaparro-Sánchez, R, Predicting and Preventing School Dropout with Business Intelligence: Insights from a Systematic Review, INFORMATION, vol 16, 2025, eissn: 2078-2489, art_no: ARTN 326, doi: 10.3390/info16040326 - 2025 - в издания, индексирани в Scopus и/или Web of Science
4. Liu B., Li C., Wan Z., Using Explainable AI (XAI) to Identify and Intervene with Students in Need: A Review, 2025, Proceedings of 2024 3rd International Conference on Artificial Intelligence and Education, ICAIE 2024, issue 0, pp. 636-641, DOI 10.1145/3722237.3722348 - 2025 - в издания, индексирани в Scopus
5. Kalita E., El Aouifi H., Kukkar A., Hussain S., Ali T., Gaftandzhieva S., LSTM-SHAP based academic performance prediction for disabled learners in virtual learning environments: a statistical analysis approach, 2025, Social Network Analysis and Mining, issue 1, vol. 15, DOI 10.1007/s13278-025-01484-1, issn 18695450, eissn 18695469 - 2025 - в издания, индексирани в Scopus и/или Web of Science
6. Hatwalne P.A., Zanjat S.N., Barbudhe V.K., Unveiling educational patterns: A comprehensive review of machine learning and deep learning in student study habits analysis, 2025, Aip Conference Proceedings, issue 1, vol. 3327, DOI 10.1063/5.0289448, issn 0094243X, eissn 15517616 - 2025 - в издания, индексирани в Scopus
7. Saurabh P., Jayamala C., Saffina C., Arun R., Nadanasabai R., Harini R., On Early Prediction of Risks in Academic Performance for Students Based on Hybrid Gbdtrbm Model, 2025, 3rd IEEE International Conference on Data Science and Network Security Icdsns 2025, issue 0, DOI 10.1109/ICDSNS65743.2025.11168759 - 2025 - в издания, индексирани в Scopus
8. Gaftandzhieva, S, Doneva, R, PREDICTING STUDENT ACADEMIC PERFORMANCE: MODERN APPROACHES AND TECHNIQUES, PEDAGOGIKA-PEDAGOGY, vol 97, 2025, issn: 0861-3982, eissn: 1314-8540, doi: 10.53656/ped2025-7.07 - 2025 - в издания, индексирани в Web of Science
9. Muresan A., Cardei M., Cardei I., Predicting Student Success with Heterogeneous Graph Deep Learning and Machine Learning Models, 2025, Proceedings of the International Conference on Educational Data Mining, issue 0, pp. 265-275, DOI 10.5281/zenodo.15870191, eissn 29602866 - 2025 - в издания, индексирани в Scopus
10. Gunasekara S., Saarela M., Systematic Literature Review on Explainable Learning Analytics and Educational Data Mining, 2025, IEEE Access, issue 0, DOI 10.1109/ACCESS.2025.3643645, eissn 21693536 - 2025 - в издания, индексирани в Scopus
11. Paul, R, Sarker, S, El Aouifi, H, Hussain, S, Baruah, AK, Gaftandzhieva, S, Analyzing dropout of students and an explainable prediction of academic performance utilizing artificial intelligence techniques, FRONTIERS IN EDUCATION, vol 10, 2025, eissn: 2504-284X, art_no: ARTN 1698505, doi: 10.3389/feduc.2025.1698505 - 2025 - в издания, индексирани в Web of Science
12. Shaik S., Dasari S.S., Singala S., Mangalampalli K., Varalakshmi B., ESN-MAXOUT: An Efficient Framework for Predicting Student’s Academic Performance in Online Learning, 2026, SN Computer Science, issue 1, vol. 7, DOI 10.1007/s42979-025-04618-6, issn 2662995X, eissn 26618907 - 2026 - в издания, индексирани в Scopus
13. Lu Y., Yeom S., Maktoubian J., Rahman M.M., Kim S.-H., Improve Student Risk Prediction with Clustering Techniques: A Systematic Review in Education Data Mining, 2025, Education Sciences, issue 12, vol. 15, DOI 10.3390/educsci15121695, eissn 22277102 - 2025 - в издания, индексирани в Scopus
14. Altukhi Z.M., Pradhan S., Multi-Modal XAI Framework for Trustworthy Higher Education Applications, 2025, Americas Conference on Information Systems Amcis 2025, issue 0, vol. 4, pp. 2323-2327 - 2025 - в издания, индексирани в Scopus

Вид: статия в списание, публикация в издание с импакт фактор, публикация в реферирано издание, индексирана в Scopus и Web of Science