• Abstract

    Employee turnover is a significant threat to organizations and incurs tremendous costs and operational delays. Accurate prediction of employee churn enables companies to initiate proactive employee retention; however, data skewness, interpretability, and bias hinder accurate prediction. This paper presents a novel artificial intelligence-based approach for employee churn prediction based on big data analysis with the integration of a Versatile Black Widow-driven Logistic Regression (VBW-LR) model for predictive enhancement.  A publicly available Kaggle dataset of employee demographics, performance, and churn history was used. Preprocessing of data involved missing value handling, feature scaling, and reduction of dimensionality using Principal Component Analysis (PCA) to enhance the efficiency of the model. The VBW optimization algorithm, which is motivated by natural selection, was used to optimize the parameters of logistic regression using fine-tuning with the aim of maximizing predictive power. VBW-LR was used with Python to compare it with the best performance measures that yielded a high accuracy rate (92.5%), recall rate (91.2%), precision, and specificity (98.97%). Comparative research validated its more effective prediction capacity in identifying vulnerable workers over ordinary logistic regression. Through the strength of AI power and large-scale data analytics, this approach presents data-backed advice for HR practitioners through the mechanism of early intervention to reduce the risk of attrition and support more effective workforce retention techniques. Outcomes suggest that AI-based practices are most effective in managing a workforce and present a viable, scalable framework to minimize turnover from employees. By using these predictive models, organizations are provided with the ability to make decisions that create long-term stability and operational effectiveness.

  • References

    1. Al Akasheh, M., Hujran, O., Malik, E. F., & Zaki, N. (2024). Enhancing the prediction of employee turnover with knowledge graphs and explainable AI. IEEE Access. https://doi.org/10.1109/ACCESS.2024.3404829
    2. Alsheref, F. K., Fattoh, I. E., & M. Ead, W. (2022). Automated prediction of employee attrition using ensemble model based on machine learning algorithms. Computational Intelligence and Neuroscience, 2022(1), 7728668. https://doi.org/10.1155/2022/7728668
    3. Bachan, L., & Gaber, T. (2021). Predicting customer churn in the internet service provider industry of developing nations: A single, explanatory case study of Trinidad and Tobago. In Advanced machine learning technologies and applications: Proceedings of AMLTA 2021 (pp. 835–844). Springer International Publishing. https://doi.org/10.1007/978-3-030-69717-4_77
    4. Chaudhary, M., Gaur, L., Jhanjhi, N. Z., Masud, M., & Aljahdali, S. (2022). Envisaging employee churn using MCDM and machine learning. Intelligent Automation & Soft Computing, 33(2). https://doi.org/10.32604/iasc.2022.023417
    5. Edwine, N., Wang, W., Song, W., & Ssebuggwawo, D. (2022). Detecting the risk of customer churn in telecom sector: A comparative study. Mathematical Problems in Engineering, 2022(1), 8534739. https://doi.org/10.1155/2022/8534739
    6. Fallucchi, F., Coladangelo, M., Giuliano, R., & William De Luca, E. (2020). Predicting employee attrition using machine learning techniques. Computers, 9(4), 86. https://doi.org/10.3390/computers9040086
    7. Jain, N., Tomar, A., & Jana, P. K. (2021). A novel scheme for employee churn problem using multi-attribute decision making approach and machine learning. Journal of Intelligent Information Systems, 56, 279–302. https://doi.org/10.1007/s10844-020-00614-9
    8. Park, J., Feng, Y., & Jeong, S. P. (2024). Developing an advanced prediction model for new employee turnover intention utilizing machine learning techniques. Scientific Reports, 14(1), 1221. https://doi.org/10.1038/s41598-023-50593-4
    9. Pekel Ozmen, E., & Ozcan, T. (2022). A novel deep learning model based on convolutional neural networks for employee churn prediction. Journal of Forecasting, 41(3), 539–550. https://doi.org/10.1002/for.2827
    10. Saha, L., Tripathy, H. K., Gaber, T., El-Gohary, H., & El-kenawy, E. S. M. (2023). Deep churn prediction method for telecommunication industry. Sustainability, 15(5), 4543. https://doi.org/10.3390/su15054543
    11. Wagh, S. K., Andhale, A. A., Wagh, K. S., Pansare, J. R., Ambadekar, S. P., & Gawande, S. H. (2024). Customer churn prediction in telecom sector using machine learning techniques. Results in Control and Optimization, 14, 100342. https://doi.org/10.1016/j.rico.2023.100342
    12. Wu, S., Yau, W. C., Ong, T. S., & Chong, S. C. (2021). Integrated churn prediction and customer segmentation framework for telco business. IEEE Access, 9, 62118–62136. https://doi.org/10.1109/ACCESS.2021.3073776

Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Copyright (c) 2025 The Authors

How to cite

Garg, P., Verma, Y., Singh, I., Raghu, N., Samal, A., & Sharma, N. (2025). Developing an advanced model for employee churn prediction leveraging AI and big data analytics. Multidisciplinary Science Journal, 7, 2025ss0209. https://doi.org/10.31893/multiscience.2025ss0209
  • Article viewed - 504
  • PDF downloaded - 409