Improving Support Vector Machine Performance with Hyperparameter Tuning Methods Using a Balanced-Moderate Model for Palm Oil Production Prediction

Main Article Content

Iwan Rizal Setiawan
Ahmad Zainul Fanani
Ruri Suko Basuki
Purwanto

Abstract

Prediction is an essential step for anticipating future events, encompassing both accuracy and the rate at which predictions are generated. In palm oil production, which holds strategic economic value in the global economy, particularly for Indonesia, precise forecasting is essential. Machine learning algorithms are indispensable for producing accurate predictions, especially when working with large-scale, long-term datasets. This study proposes a novel Balanced-Moderate hyperparameter tuning strategy for Support Vector Regression (SVR) in forecasting global palm oil production. This strategy represents an innovative approach that integrates gradual parameter adjustment with Bayesian optimization to produce moderate and stable predictions. Unlike previous approaches that prioritize extreme parameter search, the Balanced-Moderate method systematically adjusts the values of C (regularization), gamma, epsilon, and kernel through incremental steps, thereby reducing model complexity while enhancing generalization capability. This method was applied to global palm oil production data spanning 1961–2021, comprising 12,053 records from all producing countries. The baseline SVR model, without hyperparameter tuning, yielded an MSE of 0.5969, RMSE of 0.7726, MAE of 0.2207, and R2 of 0.3759. After applying the Balanced-Moderate strategy combined with Bayesian optimization, performance improved significantly, achieving an MSE of 0.0006, RMSE of 0.0257, MAE of 0.007, and R2 of 0.7937. This result outperformed Grid Search (R2 = 0.556) and Random Search (R2 = 0.512), confirming the superiority of the proposed approach. These findings hold significant relevance for palm oil supply chain planning and plantation policy formulation, given that forecasting accuracy is a crucial factor in ensuring economic sustainability.

Article Details

How to Cite
Iwan Rizal Setiawan, Zainul Fanani, A., Suko Basuki, R., & Purwanto. (2026). Improving Support Vector Machine Performance with Hyperparameter Tuning Methods Using a Balanced-Moderate Model for Palm Oil Production Prediction. JITSI : Jurnal Ilmiah Teknologi Sistem Informasi, 7(3), 248 - 261. https://doi.org/10.62527/jitsi.7.3.633
Section
Articles

References

[1] M. Jeong, S. Kim, E. Yi, and K. Ahn, “Market efficiency and information flow between the crude palm oil and crude oil futures markets,” Energy Strateg. Rev., vol. 45, no. December 2022, p. 101008, 2023, doi: 10.1016/j.esr.2022.101008.
[2] A. J. Astari, J. C. Lovett, and M. Wasesa, “Sustainable pathways in Indonesia’s palm oil industry through historical institutionalism,” World Dev. Sustain., vol. 6, no. 229, p. 100200, 2025, doi: 10.1016/j.wds.2024.100200.
[3] N. Widiastuti, R. S. Silitonga, H. N. C. Dharma, J. Jaafar, A. R. Widyanto, and M. Purwanto, “Decreasing free fatty acid of crude palm oil with polyvinylidene fluoride hollow fiber membranes using a combination of chitosan and glutaraldehyde,” RSC Adv., vol. 12, no. 35, pp. 22662–22670, 2022, doi: 10.1039/d2ra04005k.
[4] L. Ifa, T. Syarif, S. Sartia, J. Juliani, N. Nurdjannah, and H. S. Kusuma, “Techno-economics of coconut coir bioadsorbent utilization on free fatty acid level reduction in crude palm oil,” Heliyon, vol. 8, no. 3, p. e09146, 2022, doi: 10.1016/j.heliyon.2022.e09146.
[5] F. Hariyanti, A. Syahza, Zulkarnain, and Nofrizal, “Economic transformation based on leading commodities through sustainable development of the oil palm industry,” Heliyon, vol. 10, no. 4, p. e25674, 2024, doi: 10.1016/j.heliyon.2024.e25674.
[6] K. Sukiyono et al., “Smallholder palm oil and sustainable development goals (SDGs) achievement: An empirical analysis,” Sustain. Futur., vol. 8, no. March, p. 100233, 2024, doi: 10.1016/j.sftr.2024.100233.
[7] W. Y. Cheah, R. P. Siti-Dina, S. T. K. Leng, A. C. Er, and P. L. Show, “Circular bioeconomy in palm oil industry: Current practices and future perspectives,” Environ. Technol. Innov., vol. 30, 2023, doi: 10.1016/j.eti.2023.103050.
[8] B. Jin and X. Xu, “Price forecasting through neural networks for crude oil, heating oil, and natural gas,” Meas. Energy, vol. 1, no. February, p. 100001, 2024, doi: 10.1016/j.meaene.2024.100001.
[9] S. C. Iweka, O. Akpomedaye, A. O. Emu, and T. F. Adepoju, “Impact of optimization parameters on green sustainable oil from ripe palm kernel seeds for energy utilities: A machine learning approach,” Sci. African, vol. 23, no. September 2023, p. e02097, 2024, doi: 10.1016/j.sciaf.2024.e02097.
[10] V. Vytla, B. Baduru, S. S. Kolukula, N. N. Ragav, and J. P. Kumar, “Forecasting of sea surface temperature using machine learning and its applications,” J. Earth Syst. Sci., vol. 134, no. 1, 2025, doi: 10.1007/s12040-024-02483-0.
[11] S. Albahra et al., “Seminars in Diagnostic Pathology Artificial intelligence and machine learning overview in pathology & laboratory medicine : A general review of data preprocessing and basic supervised concepts,” vol. 40, no. February, pp. 71–87, 2023, doi: 10.1053/j.semdp.2023.02.002.
[12] R. Cinca, “International Journal of Human - Computer Studies ‘“ What are they not telling me ?”’ Learning machine learning : Understanding the challenges for novices,” Int. J. Hum. - Comput. Stud., vol. 196, no. December 2024, p. 103438, 2025, doi: 10.1016/j.ijhcs.2024.103438.
[13] P. Stodola and R. Ščurek, “Using machine learning in combinatorial optimization: Extraction of graph features for travelling salesman problem,” Knowledge-Based Syst., vol. 314, no. June 2024, 2025, doi: 10.1016/j.knosys.2025.113216.
[14] S. Gentili, G. D. Chiappetta, G. Petrillo, P. Brondi, and J. Zhuang, “Forecasting strong subsequent earthquakes in Japan using an improved version of NESTORE machine learning algorithm,” Geosci. Front., vol. 16, no. 3, p. 102016, 2025, doi: 10.1016/j.gsf.2025.102016.
[15] M. P. Behera, A. Sarangi, D. Mishra, and S. K. Sarangi, “A Hybrid Machine Learning algorithm for Heart and Liver Disease Prediction Using Modified Particle Swarm Optimization with Support Vector Machine,” Procedia Comput. Sci., vol. 218, no. 2022, pp. 818–827, 2022, doi: 10.1016/j.procs.2023.01.062.
[16] C. Geiß, P. Aravena Pelizari, O. Tunçbilek, and H. Taubenböck, “Semi-supervised learning with constrained virtual support vector machines for classification of remote sensing image data,” Int. J. Appl. Earth Obs. Geoinf., vol. 125, no. September, 2023, doi: 10.1016/j.jag.2023.103571.
[17] S. Zhou, D. Yan, and Y. He, “Interpretable Capacity Prediction of RC Bridges Based on Genetic Algorithm-enhanced Support Vector Machine Learning,” KSCE J. Civ. Eng., vol. 28, no. 10, pp. 4559–4574, 2024, doi: 10.1007/s12205-024-1975-6.
[18] B. Bargam, A. Boudhar, C. Kinnard, H. Bouamri, K. Nifa, and A. Chehbouni, “Evaluation of the support vector regression (SVR) and the random forest (RF) models accuracy for streamflow prediction under a data-scarce basin in Morocco,” Discov. Appl. Sci., vol. 6, no. 6, 2024, doi: 10.1007/s42452-024-05994-z.
[19] J. Zhang and Q. Han, “Buffer Monitoring of Critical Chain Projects Based on Support Vector Machine Prediction,” KSCE J. Civ. Eng., vol. 27, no. 7, pp. 2745–2755, 2023, doi: 10.1007/s12205-023-0033-0.
[20] R. Li et al., “Differential Evolution-Optimized Multi-Output Support Vector Regression-Based Prediction of Weld Bead Morphology in Wire-Fed Laser-Arc Directed Energy Deposition of 2319 Aluminum Alloy,” Addit. Manuf. Front., vol. 4, no. 2, p. 200203, 2025, doi: 10.1016/j.amf.2025.200203.
[21] M. De Iuliis, E. Miceli, and P. Castaldo, “Information theory-guided machine learning to estimate seismic response of non-linear SDOF structures,” Eng. Struct., vol. 336, no. April 2024, p. 120448, 2025, doi: 10.1016/j.engstruct.2025.120448.
[22] S. Der Lu, H. D. Liu, M. H. Wang, and C. C. Wu, “A novel strategy for multitype fault diagnosis in photovoltaic systems using multiple regression analysis and support vector machines,” Energy Reports, vol. 12, no. April, pp. 2824–2844, 2024, doi: 10.1016/j.egyr.2024.08.074.
[23] A. Turnip, M. Taufik, and D. E. Kusumandari, “Precision blood pressure prediction leveraging Photoplethysmograph signals using Support Vector Regression,” Egypt. Informatics J., vol. 29, no. December 2023, p. 100599, 2025, doi: 10.1016/j.eij.2024.100599.
[24] K. Kalbe and T. Kalamees, “Evaluating moisture safety strategies in CLT buildings – predictions vs actual outcomes,” Case Stud. Constr. Mater., vol. 23, no. March, p. e04958, 2025, doi: 10.1016/j.cscm.2025.e04958.
[25] T. O. Hodson, “Mean Squared Error , Deconstructed Journal of Advances in Modeling Earth Systems,” pp. 1–10, 2021, doi: 10.1029/2021MS002681.
[26] C. W. Goh, J. Chai, A. Rahman, and W. E. Ong, “Crude Palm Oil Price Prediction Using Simulated Annealing-Based Support Vector Regression (Sa-Svr),” Asian Acad. Manag. J. Account. Financ., vol. 20, no. 1, pp. 305–333, 2024, doi: 10.21315/aamjaf2024.20.1.10.
[27] N. Khan et al., “Prediction of Oil Palm Yield Using Machine Learning in the Perspective of Fluctuating Weather and Soil Moisture Conditions: Evaluation of a Generic Workflow,” Plants, vol. 11, no. 13, 2022, doi: 10.3390/plants11131697.
[28] A. Jierula, S. Wang, and T. Oh, “applied sciences Study on Accuracy Metrics for Evaluating the Predictions of Damage Locations in Deep Piles Using Artificial Neural Networks with Acoustic Emission Data,” 2021.
[29] L. A. Thorsrud, “Centre for Applied Macroeconomic Analysis,” 2013.
[30] M. Salama, “Optimization of Regression Models Using Machine Learning: A Comprehensive Study with Scikit-learn,” Int. Uni-Scientific Res. J., vol. 5, no. September, pp. 119–129, 2024, doi: 10.59271/s45500.024.0624.16.
[31] J. Won, H. S. Lee, and J. W. Lee, “A review on multi-fidelity hyperparameter optimization in machine learning,” ICT Express, vol. 11, no. 2, pp. 245–257, 2025, doi: 10.1016/j.icte.2025.02.008.
[32] M. S. Tahosin, M. A. Sheakh, T. Islam, R. J. Lima, and M. Begum, “Optimizing brain tumor classification through feature selection and hyperparameter tuning in machine learning models,” Informatics Med. Unlocked, vol. 43, no. November, p. 101414, 2023, doi: 10.1016/j.imu.2023.101414.
[33] P. Fatima, “Optimizing Algorithm Efficiency through Advanced Data Structures in C++: A Comparative Analysis of Performance, Scalability, and Complexity,” Int. J. Comput. Inf. Manuf., vol. 3, no. 2, pp. 66–72, 2023, [Online]. Available: https://journals.gaftim.com/index.php/ijcim/article/view/256
[34] V. S. T., “A Study on Hyperparameter Tuning in Support Vector Machines and its Impact on Model Accuracy,” Glob. J. Eng. Innov. Interdiscip. Res., vol. 5, no. 1, pp. 1–6, 2025, doi: 10.33425/3066-1226.1063.
[35] L. W. Rizkallah, “Optimizing SVM hyperparameters for satellite imagery classification using metaheuristic and statistical techniques,” Int. J. Data Sci. Anal., 2025, doi: 10.1007/s41060-025-00762-7.
[36] Y. Sherry and N. C. Thompson, “How Fast Do Algorithms Improve? [Point of View],” Proc. IEEE, vol. 109, no. 11, pp. 1768–1777, 2021, doi: 10.1109/JPROC.2021.3107219.
[37] A. M. Eltamaly, Z. A. Almutairi, and M. A. Abdelhamid, “Modern Optimization Algorithm for Improved Performance of Maximum Power Point Tracker of Partially Shaded PV Systems,” Energies, vol. 16, no. 13, 2023, doi: 10.3390/en16135228.
[38] B. Gaye, D. Zhang, and A. Wulamu, “Improvement of Support Vector Machine Algorithm in Big Data Background,” Math. Probl. Eng., vol. 2021, 2021, doi: 10.1155/2021/5594899.
[39] I. S. Al-Mejibli, J. K. Alwan, and D. H. Abd, “The effect of gamma value on support vector machine performance with different kernels,” Int. J. Electr. Comput. Eng., vol. 10, no. 5, pp. 5497–5506, 2020, doi: 10.11591/IJECE.V10I5.PP5497-5506.
[40] Z. Liu and M. J. Zuo, “An Analytical Approach to Fast Parameter Selection of Gaussian RBF Kernel for Support Vector Machine An Analytical Approach to Fast Parameter Selection of Gaussian RBF Kernel for Support Vector Machine *,” no. September, 2016.
[41] A. A. Ewees, A. A. Hemedan, A. E. Hassanien, and A. T. Sahlol, “Optimized support vector machines for unveiling mortality incidence in Tilapia fish,” Ain Shams Eng. J., vol. 12, no. 3, pp. 3081–3090, 2021, doi: 10.1016/j.asej.2021.01.014.
[42] C. Comito and C. Pizzuti, “Artificial intelligence for forecasting and diagnosing COVID-19 pandemic: A focused review,” Artif. Intell. Med., vol. 128, no. March, p. 102286, 2022, doi: 10.1016/j.artmed.2022.102286.
[43] Y. Hahn, T. Langer, R. Meyes, and T. Meisen, “Time Series Dataset Survey for Forecasting with Deep Learning,” Forecasting, vol. 5, no. 1, pp. 315–335, 2023, doi: 10.3390/forecast5010017.
[44] H. J. Park, Y. S. Koo, H. Y. Yang, Y. S. Han, and C. S. Nam, “Study on Data Preprocessing for Machine Learning Based on Semiconductor Manufacturing Processes,” Sensors, vol. 24, no. 17, pp. 1–14, 2024, doi: 10.3390/s24175461.
[45] A. Azlan, Y. Yusof, and M. F. M. Mohsin, “Determining the impact of window length on time series forecasting using deep learning,” Int. J. Adv. Comput. Res., vol. 9, no. 44, pp. 260–267, 2019, doi: 10.19101/ijacr.pid77.
[46] Purwanto, C. Eswaran, and R. Logeswaran, “Improved adaptive neuro-fuzzy inference system for HIV/AIDS time series prediction,” Commun. Comput. Inf. Sci., vol. 253 CCIS, no. PART 3, pp. 1–13, 2011, doi: 10.1007/978-3-642-25462-8_1.
[47] Z. Zhan and S. K. Kim, “Versatile time-window sliding machine learning techniques for stock market forecasting,” Artif. Intell. Rev., vol. 57, no. 8, pp. 1–25, 2024, doi: 10.1007/s10462-024-10851-x.
[48] L. Yang and A. Shami, “On hyperparameter optimization of machine learning algorithms: Theory and practice,” Neurocomputing, vol. 415, pp. 295–316, 2020, doi: 10.1016/j.neucom.2020.07.061.
[49] R. Guido, M. C. Groccia, and D. Conforti, “A hyper-parameter tuning approach for cost-sensitive support vector machine classifiers,” Soft Comput., vol. 27, no. 18, pp. 12863–12881, 2023, doi: 10.1007/s00500-022-06768-8.
[50] Y. J. Chang, Y. L. Lin, and P. F. Pai, “Support Vector Machines with Hyperparameter Optimization Frameworks for Classifying Mobile Phone Prices in Multi-Class,” Electron., vol. 14, no. 11, pp. 1–21, 2025, doi: 10.3390/electronics14112173.
[51] M. Yalsavar, P. Karimaghaee, A. Sheikh-Akbari, M. H. Khooban, J. Dehmeshki, and S. Al-Majeed, “Kernel Parameter Optimization for Support Vector Machine Based on Sliding Mode Control,” IEEE Access, vol. 10, pp. 17003–17017, 2022, doi: 10.1109/ACCESS.2022.3150001.
[52] A. Yaman and A. Cengiz, “The Effects of Kernel Functions and Optimal Hyperparameter Selection on Support Vector Machines,” J. New Theory, vol. 34, no. September, pp. 64–71, 2021, [Online]. Available: https://dergipark.org.tr/en/pub/jnt
[53] S. Alrefaee, … S. A. B.-I. J. of, and undefined 2022, “Hyperparameters optimization of support vector regression using black hole algorithm,” ijnaa.semnan.ac.irSD Alrefaee, SM Al Bakal, ZY AlgamalInternational J. Nonlinear Anal. Appl. 2022•ijnaa.semnan.ac.ir, vol. 13, no. January, pp. 2008–6822, 2022, doi: 10.22075/ijnaa.2022.6107.
[54] N. Ortiz, O. Avilés, and R. Jiménez, “Epsilon Support Vector Regression based Controller,” Int. J. Appl. Eng. Res., vol. 13, no. 19, pp. 14112–14115, 2018, [Online]. Available: http://www.ripublication.com
[55] A. Kocaoğlu, “Efficient Optimization of a Support Vector Regression Model with Natural Logarithm of the Hyperbolic Cosine Loss Function for Broader Noise Distribution,” Appl. Sci., vol. 14, no. 9, 2024, doi: 10.3390/app14093641.
[56] D. C. E. Saputra, A. Ma’arif, and K. Sunat, “Optimizing Predictive Performance: Hyperparameter Tuning in Stacked Multi-Kernel Support Vector Machine Random Forest Models for Diabetes Identification,” J. Robot. Control, vol. 4, no. 6, pp. 896–904, 2023, doi: 10.18196/jrc.v4i6.20898.
[57] J. Suárez Ferreira, M. Slavkovik, and J. Casillas, “General procedure to measure fairness in regression problems,” Int. J. Data Sci. Anal., 2025, doi: 10.1007/s41060-025-00721-2.
[58] M. Ogunsanya, J. Isichei, and S. Desai, “Grid search hyperparameter tuning in additive manufacturing processes,” Manuf. Lett., vol. 35, pp. 1031–1042, 2023, doi: 10.1016/j.mfglet.2023.08.056.
[59] Y. Zhao, W. Zhang, and X. Liu, “Grid search with a weighted error function: Hyper-parameter optimization for financial time series forecasting,” Appl. Soft Comput., vol. 154, no. January, 2024, doi: 10.1016/j.asoc.2024.111362.
[60] C. Arnold, “The role of hyperparameters in machine learning models and how to tune them,” pp. 841–848, 2024, doi: 10.1017/psrm.2023.61.
[61] B. Li, “Random Search Plus: A more effective random search for machine learning hyperparameters optimization,” pp. 1–95, 2020, [Online]. Available: https://trace.tennessee.edu/utk_gradthes/5849
[62] P. Cihan, “Bayesian Hyperparameter Optimization of Machine Learning Models for Predicting Biomass Gasification Gases,” Appl. Sci., vol. 15, no. 3, 2025, doi: 10.3390/app15031018.
[63] R. Marco, S. S. S. Ahmad, and S. Ahmad, “Bayesian Hyperparameter Optimization and Ensemble Learning for Machine Learning Models on Software Effort Estimation,” Int. J. Adv. Comput. Sci. Appl., vol. 13, no. 3, pp. 419–429, 2022, doi: 10.14569/IJACSA.2022.0130351.
[64] J. Wu, X. C. Hao, Z. L. Xiong, and H. Lei, “Hyperparameter Optimization for Machine Learning Models Based on Bayesian Optimization,” J. Electron. Sci. Technol., vol. 17, no. 1, pp. 26–40, 2019, doi: 10.11989/JEST.1674-862X.80904120.