Proceedings of The International Conference on Computer Science, Engineering, Social Sciences, and Multidisciplinary Studies
Vol. 1 (2025)

Critical Evaluation of Machine Learning Models for Glucose Prediction: A Case Study Of Overfitting and Small Data

Arnita Arnita (Medan State University)
Hermawan Syahputra (Medan State University)
Faridawaty Marpaung (Medan State University)
Marlina Setia Sinaga (Medan State University)
Agus Junaidi (Medan State University)
Fanny Ramadhani (Medan State University)



Article Info

Publish Date
31 Dec 2025

Abstract

Glucose level prediction is an important area of research, but the application of machine learning models often faces challenges such as overfitting and limited data. This study aims to evaluate the performance of seven regression models—Linear Regression, Lasso, SVR, Decision Tree, Random Forest, Gradient Boosting, and K-Nearest Neighbors in predicting glucose levels on a small dataset that has undergone preprocessing and dimensionality reduction using Principal Component Analysis (PCA). The evaluation was conducted using the R-squared, Mean Squared Error (MSE), and Root Mean Squared Error (RMSE) metrics. The results showed that most models suffered from severe overfitting, where good performance on the training data was not followed by performance on the test data, as reflected by negative R-squared values. Although Random Forest produced relatively lower errors (MSE = 0.009; RMSE = 0.095), the overall performance remained inadequate due to data limitations. These findings confirm that small sample sizes and overfitting simultaneously hamper the generalizability of models and emphasize the need for more robust approaches in biomedical applications with limited data.

Copyrights © 2025






Journal Info

Abbrev

cessmuds

Publisher

Subject

Religion Computer Science & IT Decision Sciences, Operations Research & Management Education Electrical & Electronics Engineering Engineering

Description

The International Conference on Computer Science, Engineering, Social Science, and Multi-Disciplinary Studies (CESSMUDS) with ISSN No. 3123-2507 (online) is one of the activities organized by Raskha Media Group Publisher. The International Conference on Computer Science, Engineering, Social Science, ...