Penerapan Logistic Regression pada Data Tidak Seimbang untuk Sistem Pendukung Keputusan Deteksi Dini Dropout Mahasiswa

ismail setiawan; Apolinario dos Santos; Aisyah Mutia Dawis

doi:10.35960/ikomti.v7i2.2458

Authors

ismail setiawan Universitas 'Aisyiyah Surakarta
Apolinario dos Santos Instituto Profissional de Canossa (IPDC)
Aisyah Mutia Dawis Universitas 'Aisyiyah Surakarta

DOI:

https://doi.org/10.35960/ikomti.v7i2.2458

Keywords:

student dropout, early warning system, machine learning, logistic regression, decision support system

Abstract

Student dropout negatively impacts both university performance and the futures of individual students. Identifying at-risk students during the early stages of their studies is crucial for effective academic intervention. This study aims to develop an Early Warning System (EWS) using machine learning to predict dropout potential based on academic and demographic data from the first three semesters. To address the extreme class imbalance in the dataset, a cost-sensitive learning approach using class weighting was applied. Three classification algorithms were evaluated: Random Forest, XGBoost, and Logistic Regression. Performance evaluation using the Area Under the Precision-Recall Curve (AUC-PR) metric demonstrated that Logistic Regression outperformed the tree-based ensemble models, achieving the highest score of 0.6454. Feature interpretation revealed that low parental income, poor minimum attendance, and early course failure were the primary risk factors for dropping out. Furthermore, the best model was successfully implemented into a web-based Decision Support System (DSS) prototype dashboard. This system provides university management and academic advisors with an interactive tool for conducting proactive, data-driven early interventions.

References

[1] M. Shoaib, N. Sayed, J. Singh, J. Shafi, S. Khan, and F. Ali, “AI student success predictor: Enhancing personalized learning in campus management systems,” Comput. Human Behav., vol. 158, no. April, p. 108301, Sep. 2024, doi: 10.1016/j.chb.2024.108301.

[2] E. A. Saire-Peralta and M. D. C. Córdova-Martínez, “Predicting Academic Performance Path Using Classification Algorithms,” Int. J. Inf. Educ. Technol., vol. 13, no. 12, pp. 1890–1898, 2023, doi: 10.18178/ijiet.2023.13.12.2002.

[3] Kinjal, S. M. Parida, J. Suthar, and S. D. Pande, “Predicting Academic Success: A Comparative Study of Machine Learning and Clustering-Based Subject Recommendation Models,” EAI Endorsed Trans. Internet Things, vol. 10, 2024, doi: 10.4108/eetiot.5378.

[4] H. T. H. Duong, L. T. M. Tran, H. Q. To, and K. Van Nguyen, “Academic performance warning system based on data driven for higher education,” Neural Comput. Appl., vol. 35, no. 8, pp. 5819–5837, 2023, doi: 10.1007/s00521-022-07997-6.

[5] J. G. C. Krüger, A. de S. Britto, and J. P. Barddal, “An explainable machine learning approach for student dropout prediction,” Expert Syst. Appl., vol. 233, no. May, p. 120933, 2023, doi: 10.1016/j.eswa.2023.120933.

[6] X. Wang, Y. Zhao, C. Li, and P. Ren, “ProbSAP: A comprehensive and high-performance system for student academic performance prediction,” Pattern Recognit., vol. 137, p. 109309, 2023, doi: 10.1016/j.patcog.2023.109309.

[7] J. Kuzilek, Z. Zdrahal, and V. Fuglik, “Student success prediction using student exam behaviour,” Futur. Gener. Comput. Syst., vol. 125, pp. 661–671, 2021, doi: 10.1016/j.future.2021.07.009.

[8] A. A. Khan, O. Chaudhari, and R. Chandra, “A review of ensemble learning and data augmentation models for class Imbalanced problems: Combination, implementation and evaluation,” Expert Syst. Appl., vol. 244, no. November 2023, p. 122778, 2024, doi: 10.1016/j.eswa.2023.122778.

[9] M. Correa-Peralta, J. Vinueza-Martínez, and L. Castillo-Heredia, “Evolution, topics and relevant research methodologies in business intelligence and data analysis in the academic management of higher education institutions. A literature review,” Results Eng., vol. 25, no. December 2024, p. 103782, 2025, doi: 10.1016/j.rineng.2024.103782.

[10] J. Martínez and D. Castillo, “ScienceDirect ScienceDirect Prediction of student dropout using Artificial Intelligence Prediction of student dropout using Artificial Intelligence algorithms algorithms,” Procedia Comput. Sci., vol. 251, pp. 764–770, 2024, doi: 10.1016/j.procs.2024.11.182.

[11] M. M. Jamjoom, E. A. Alabdulkareem, M. Hadjouni, F. K. Karim, and M. A. Qarh, “Early prediction for at-risk students in an introductory programming course based on student self-efficacy,” Inform., vol. 45, no. 6, pp. 1–9, 2021, doi: 10.31449/INF.V45I6.3528.

[12] Y. Lin, H. Chen, W. Xia, F. Lin, Z. Wang, and Y. Liu, “A Comprehensive Survey on Deep Learning Techniques in Educational Data Mining,” Sep. 2023, [Online]. Available: http://arxiv.org/abs/2309.04761

[13] L. Bognár and T. Fauszt, “Factors and conditions that affect the goodness of machine learning models for predicting the success of learning,” Comput. Educ. Artif. Intell., vol. 3, p. 100100, 2022, doi: https://doi.org/10.1016/j.caeai.2022.100100.

[14] B. Prenkaj, D. Distante, S. Faralli, and P. Velardi, “Hidden space deep sequential risk prediction on student trajectories,” Futur. Gener. Comput. Syst., vol. 125, pp. 532–543, Dec. 2021, doi: 10.1016/j.future.2021.07.002.

[15] T. K. F. Chiu, Q. Xia, X. Zhou, C. S. Chai, and M. Cheng, “Systematic literature review on opportunities, challenges, and future research recommendations of artificial intelligence in education,” Comput. Educ. Artif. Intell., vol. 4, no. November 2022, p. 100118, 2023, doi: 10.1016/j.caeai.2022.100118.

[16] V. Realinho, J. Machado, L. Baptista, and M. V. Martins, “Predicting Student Dropout and Academic Success,” Data, vol. 7, no. 11, 2022, doi: 10.3390/data7110146.

[17] C. F. de Oliveira, S. R. Sobral, M. J. Ferreira, and F. Moreira, “Interpretable Success Prediction in a Computer Networks Curricular Unit Using Machine Learning,” Procedia Comput. Sci., vol. 239, no. 2023, pp. 598–605, 2024, doi: 10.1016/j.procs.2024.06.212.

[18] V. Christou et al., “Performance and early drop prediction for higher education students using machine learning,” Expert Syst. Appl., vol. 225, p. 120079, 2023, doi: https://doi.org/10.1016/j.eswa.2023.120079.

[19] M. Delogu, R. Lagravinese, D. Paolini, and G. Resce, “Predicting dropout from higher education: Evidence from Italy,” Econ. Model., vol. 130, p. 106583, 2024, doi: 10.1016/j.econmod.2023.106583.

[20] A. A. Mubarak, H. Cao, and I. M. Hezam, “Deep analytic model for student dropout prediction in massive open online courses,” Comput. Electr. Eng., vol. 93, p. 107271, May 2021, doi: 10.1016/j.compeleceng.2021.107271.

[21] J. Niyogisubizo, L. Liao, E. Nziyumva, E. Murwanashyaka, and P. C. Nshimyumukiza, “Predicting student’s dropout in university classes using two-layer ensemble machine learning approach: A novel stacked generalization,” Comput. Educ. Artif. Intell., vol. 3, Jan. 2022, doi: 10.1016/j.caeai.2022.100066.

[22] J. Niyogisubizo, L. Liao, E. Nziyumva, E. Murwanashyaka, and P. C. Nshimyumukiza, “Predicting student’s dropout in university classes using two-layer ensemble machine learning approach: A novel stacked generalization,” Comput. Educ. Artif. Intell., vol. 3, no. November 2021, p. 100066, 2022, doi: 10.1016/j.caeai.2022.100066.

[23] L. Hannaford, X. Cheng, and M. Kunes-Connell, “Predicting nursing baccalaureate program graduates using machine learning models: A quantitative research study,” Nurse Educ. Today, vol. 99, p. 104784, 2021, doi: 10.1016/j.nedt.2021.104784.

[24] M. Vaarma and H. Li, “Predicting student dropouts with machine learning: An empirical study in Finnish higher education,” Technol. Soc., vol. 76, no. December 2023, p. 102474, 2024, doi: 10.1016/j.techsoc.2024.102474.

[25] J. Pecuchova and M. Drlik, “Predicting Students at Risk of Early Dropping Out from Course Using Ensemble Classification Methods,” Procedia Comput. Sci., vol. 225, pp. 3223–3232, 2023, doi: 10.1016/j.procs.2023.10.316.

[26] J. Niyogisubizo, L. Liao, E. Nziyumva, E. Murwanashyaka, and P. C. Nshimyumukiza, “Predicting student’s dropout in university classes using two-layer ensemble machine learning approach: A novel stacked generalization,” Comput. Educ. Artif. Intell., vol. 3, p. 100066, May 2022, doi: 10.1016/j.caeai.2022.100066.

[27] V. Tinto, Leaving college: Rethinking the causes and cures of student attrition. University of Chicago press, 2012.