Analisis Pengaruh Chi-Square Feature Selection terhadap Kinerja Random Forest dan XGBoost dalam Prediksi Konversi Pengunjung Website
- Muhamad Rosdiana Universitas Pamulang, Tangerang Selatan, Indonesia
- Teti Desyani Universitas Pamulang, Tangerang Selatan, Indonesia
-
Perani Rosyani
*
Universitas Pamulang, Tangerang Selatan,
Indonesia
(*) Corresponding Author
Abstract
The increasing number of visitors to e-commerce websites is not always accompanied by a corresponding increase in purchase transactions, making it difficult for companies to identify visitors with high conversion potential. In addition, using all available attributes may increase model complexity without necessarily improving predictive performance. This study analyzes the impact of Chi-Square Feature Selection on the performance of Random Forest and Extreme Gradient Boosting (XGBoost) in predicting website visitor conversion. The study uses the Online Shoppers Purchasing Intention dataset consisting of 12,330 instances with 17 predictor attributes and one target attribute. The research process includes exploratory data analysis, preprocessing, Chi-Square-based feature selection, classification model development using Random Forest and XGBoost, and evaluation using Accuracy, Precision, Recall, F1-Score, Matthews Correlation Coefficient (MCC), and Area Under the Curve (AUC-ROC). Four experimental scenarios were evaluated: all features (baseline), Top-15, Top-10, and Top-5 selected features. The results show that the baseline model using all features achieved the best overall performance. The Random Forest baseline model obtained an Accuracy of 90.05%, Precision of 73.94%, F1-Score of 63.13%, and MCC of 0.5835, while the XGBoost baseline model achieved the highest AUC-ROC of 0.9271. Furthermore, PageValues, BounceRates, ExitRates, ProductRelated_Duration, and ProductRelated were identified as the most influential features affecting visitor conversion. The main contribution of this study is providing empirical evidence that Chi-Square Feature Selection is more effective in reducing feature complexity and identifying relevant attributes than improving classification performance on the Online Shoppers Purchasing Intention dataset, offering practical guidance for feature selection strategies in machine learning-based website conversion prediction
Downloads
References
R. Kassemeier, S. Alavi, and J. Habel, “Implementing e-commerce channels in business-to-business selling,” International Journal of Research in Marketing, 2025, doi: 10.1016/j.ijresmar.2025.10.003.
R. G. Mahendra, R. A. Trenady, and P. T. Pungkasanti, “Penerapan Metode Analytical Hierarchy Process dan Additive Ratio Assessment Dalam Menentukan Target Promosi Universitas,” Building of Informatics, Technology and Science (BITS), vol. 6, no. 2, Sep. 2024, doi: 10.47065/bits.v6i2.5469.
P. Jansen, M. Colley, T. Pfeifer, and E. Rukzio, “Visualizing imperfect situation detection and prediction in automated vehicles: Understanding users’ perceptions via user-chosen scenarios,” Transp. Res. Part F Traffic Psychol. Behav., vol. 104, pp. 88–108, Jul. 2024, doi: 10.1016/j.trf.2024.05.015.
K. Mili, I. Bengana, and M. S. Benmoussa, “Integrating intercultural communication into E-commerce theory: The DCEM framework for online shopping behavior,” Dec. 01, 2025, Elsevier B.V. doi: 10.1016/j.chbr.2025.100810.
Abdullah-All-Tanvir, I. Ali Khandokar, A. K. M. Muzahidul Islam, S. Islam, and S. Shatabda, “A gradient boosting classifier for purchase intention prediction of online shoppers,” Heliyon, vol. 9, no. 4, Apr. 2023, doi: 10.1016/j.heliyon.2023.e15163.
C. Karunakaran, V. Niranjan, and A. S. Setlur, “Random Forest and XGBoost-based ensemble models for colorectal cancer exome variant classification and web application deployment for early prediction,” Computational and Structural Biotechnology Reports, vol. 2, p. 100063, Jan. 2025, doi: 10.1016/j.csbr.2025.100063.
I. M. Rajagukguk, R. Hartanto, Julian, and R. Halim, “Comparative Analysis of XGBoost, Random Forest, and Logistic Regression for Classifying Jakarta’s Air Pollution Index (ISPU),” in Procedia Computer Science, Elsevier B.V., 2025, pp. 108–120. doi: 10.1016/j.procs.2025.08.264.
R. K. E. Tau, A. Yahya, M. Mangwala, and N. M. J. Ditshego, “XGBoost–random forest stacking with dual-state Kalman filtering for real-time battery SOC estimation,” Results in Engineering, vol. 27, Sep. 2025, doi: 10.1016/j.rineng.2025.106428.
F. Zare Ebrahimabad, H. Yazdani, A. Hakim, and M. Asarian, “Augmented Reality Versus Web-Based Shopping: How Does AR Improve User Experience and Online Purchase Intention,” Telematics and Informatics Reports, vol. 15, Sep. 2024, doi: 10.1016/j.teler.2024.100152.
M. Fikri, R. Herteno, R. A. Nugroho, S. W. Saputro, and F. Abadi, “Multi-Criteria Decision Making Dalam Seleksi Fitur Ensemble Untuk Prediksi Cacat Perangkat Lunak Multi-Criteria Decision Making In Ensemble Feature Selection,” vol. 12, no. 6, pp. 1385–1394, 2025.
S. T. Hamidou and A. Mehdi, “Enhancing IDS performance through a comparative analysis of Random Forest, XGBoost, and Deep Neural Networks,” Machine Learning with Applications, vol. 22, p. 100738, Dec. 2025, doi: 10.1016/j.mlwa.2025.100738.
S. S. Shafin, “An explainable feature selection framework for web phishing detection with machine learning,” Data Science and Management, vol. 8, no. 2, pp. 127–136, Jun. 2025, doi: 10.1016/j.dsm.2024.08.004.
X. Wei, “Research on Preprocessing Techniques for Software Defect Prediction Dataset Based on Hybrid Category Balance and Synthetic Sampling Algorithm,” Procedia Comput. Sci., vol. 262, pp. 840–848, 2025, doi: 10.1016/j.procs.2025.05.117.
D. P. Sakas, D. P. Reklitis, N. T. Giannakopoulos, and P. Trivellas, “The influence of websites user engagement on the development of digital competitive advantage and digital brand name in logistics startups,” European Research on Management and Business Economics, vol. 29, no. 2, May 2023, doi: 10.1016/j.iedeen.2023.100221.
L. W. Hiselius, E. Adell, U. Berggren, and L. S. Rosqvist, “Consumer involvement in last-mile e-commerce transport and impact on travel Patterns: A case study in Sweden,” Transp. Res. Part A Policy Pract., vol. 211, Sep. 2026, doi: 10.1016/j.tra.2026.105087.
W. A. Srisathan, C. Ketkaew, N. Jantuma, and P. Naruetharadhol, “Trust and website conversion in consumer responses to green product purchasing: A new perspective through the lens of innovative website Design’s technology integration,” Heliyon, vol. 10, no. 1, Jan. 2024, doi: 10.1016/j.heliyon.2023.e23764.
H. Khani Sanij, R. Babagoli, and R. Mohammadi Elyasi, “Enhancing stone matrix asphalt performance with sugarcane bagasse ash: Mechanical properties and machine learning-based predictions using XGBoost and random forest,” Case Studies in Construction Materials, vol. 23, Dec. 2025, doi: 10.1016/j.cscm.2025.e05186.
M. He, T. D. Pham Thi, H. M. Tran, and N. T. Duong, “Consumers’ intentions to use online shopping apps: A comparative analysis,” Acta Psychol. (Amst)., vol. 259, Sep. 2025, doi: 10.1016/j.actpsy.2025.105414.
J. Q. Ruan, Z. S. Chen, Y. Yang, and M. Deveci, “How the metaverse enhances e-commerce supply chain resilience: An actor-network theory perspective,” Advanced Engineering Informatics, vol. 74, Sep. 2026, doi: 10.1016/j.aei.2026.104710.
N. J. Downing, “Missing value imputation in environmental, social, and governance data: an impact on emissions scores,” Financ. Res. Lett., vol. 85, pp. 1–10, Nov. 2025, doi: 10.1016/j.frl.2025.107818.
M. Zhafir and N. Rukhiviyanti, “Analisis Perbandingan Algoritma Machine Learning untuk Prediksi Konversi Penjualan UMKM Shiroapparel pada Platform Social Commerce Di Tik Tok Shop A Comparative Study of Machine Learning Algorithms for Predicting Sales Conversion of Shiroapparel MSMEs on the TikTok Shop Social Commerce Platform.”
A. Shoukat, Z. Liu, Y. Y. A. Abuker, J. Li, and L. Mao, “Dual attention-enhanced data augmentation for diagnosing water management faults in proton exchange membrane fuel cells using imbalanced multi-sine AC data,” Energy and AI, vol. 22, Dec. 2025, doi: 10.1016/j.egyai.2025.100630.
J. R. Pivin-Bachler and E. L. van den Broek, “SIMBA: A robust and generalizable measure of data imbalance,” Patterns, vol. 6, no. 12, Dec. 2025, doi: 10.1016/j.patter.2025.101395.
A. Balazs, S. Tuominen, and A. Kangas, “Enhancing forest inventory Accuracy: Comparing 3D-CNN and k-NN with genetic algorithm Approaches using ALS data across boreal bioregions,” Comput. Electron. Agric., vol. 237, Oct. 2025, doi: 10.1016/j.compag.2025.110576.
N. Ichsan, R. Sopandi, H. Priyandaru, and M. Tabrani, “Pendekatan Level Data Smote Pada Algoritma Bagging C4.5 Untuk Prediksi Cacat Software Smote Data Level Approach of C4.5 Bagging Algorithm for Software Defect Prediction,” Cermin:Jurnal Penelitian, vol. 7, pp. 402–416, 2023.
Bila bermanfaat silahkan share artikel ini
Berikan Komentar Anda terhadap artikel Analisis Pengaruh Chi-Square Feature Selection terhadap Kinerja Random Forest dan XGBoost dalam Prediksi Konversi Pengunjung Website
Pages: 601-614
Copyright (c) 2026 Muhamad Rosdiana, Teti Desyani, Perani Rosyani
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under Creative Commons Attribution 4.0 International License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (Refer to The Effect of Open Access).
