Claim Missing Document
Check
Articles

Found 38 Documents
Search

Attention Mechanism with Kalman Smoothing Improved Long Short-Term Memory Mechanism for Obesity Weight Forecasting Pranolo, Andri; Utami, Nurul Putrie; Anasyua, Fairuz Khairunnisa
JOIV : International Journal on Informatics Visualization Vol 9, No 6 (2025)
Publisher : Society of Visual Informatics

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.62527/joiv.9.6.4633

Abstract

This study aims to evaluate and compare the performance of several variants of Long Short-Term Memory (LSTM) based models in predicting obesity weight data. The main contribution of this research was to perform an extensive assessment of the effectiveness of LSTM-based models, including the combination of Attention-LSTM with Kalman Smoothing (KS), using two different data normalization methods (Z-score and Min-Max). This research used a publicly available dataset on obesity levels based on eating habits and physical condition, available at the UCI Machine Learning Repository. The models evaluated include the standard LSTM, Attention-LSTM, KS-LSTM, and the proposed KS-Attention-LSTM. The evaluation is conducted using the Root Mean Square Error (RMSE), the Mean Absolute Percentage Error (MAPE), and the coefficient of determination (R²). The results showed that the proposed KS-Attention-LSTM model with Min-Max normalization achieved the lowest MAPE (0.28372) and the highest R² (0.79527) among the models. This suggests that the proposed model offers advantages in terms of prediction accuracy and has a good ability to handle data variations. Therefore, the KS-Attention-LSTM model with Min-Max normalization is strongly recommended for practical implementation, particularly for time-series data prediction in the health sector. This research is beneficial and contributes an effective alternative model that improves prediction accuracy, supports decision-making in the health sector, and enriches forecasting methods. 
Synergistic preprocessing approaches for improved time series analysis Andri Pranolo; Ardi Pujiyanta; Supriyanto Supriyanto
International Journal of Advances in Intelligent Informatics Vol 12, No 1 (2026): February 2026
Publisher : Universitas Ahmad Dahlan

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.26555/ijain.v12i1.2321

Abstract

This paper systematically evaluates the performance of an LSTM baseline model, along with four smoothing augmentation methods (Kalman, Laplace, Moving Average, Savitzky-Golay), under different normalization strategies (Min-Max and Z-Score) for multivariate time-series forecasting. Experiments were conducted on six publicly available datasets (electricity consumption, energy consumption, sensor data, household energy, Indian electricity, and Brazilian temperature), and model performance was comprehensively compared using three metrics: MAPE, RMSE, and R². Results indicate that Laplace smoothing achieved the best performance across five datasets, effectively reducing errors while maintaining high fit quality, demonstrating its advantage in handling highly volatile and noisy time-series data. However, in some instances, Laplace smoothing, along with MA and SG methods, may produce an “over-smoothing” effect, causing forecasts to lose sensitivity to spike fluctuations. The choice of normalization strategy is equally critical: Min-Max is more suitable for data with stable distributions, while Z-Score demonstrates greater advantages for data with large numerical ranges and significant volatility. Notably, in temperature datasets with small sample sizes and high volatility, complex smoothing methods actually degraded performance, making the baseline LSTM + Z-Score the optimal choice. However, the LSTM-Laplace model with Min-Max normalization achieves the best performance among the models. Overall, the study concludes that improving prediction performance relies not only on model architecture but also on optimizing data scale, distribution characteristics, and preprocessing strategies.
Nondestructive Chicken Egg Fertility Detection Using CNN-Transfer Learning Algorithms Shoffan Saifullah; Rafal Drezewski; Anton Yudhana; Andri Pranolo; Wilis Kaswijanti; Andiko Putro Suryotomo; Seno Aji Putra; Alin Khaliduzzaman; Anton Satria Prabuwono; Nathalie Japkowicz
Jurnal Ilmiah Teknik Elektro Komputer dan Informatika Vol. 9 No. 3 (2023): September
Publisher : Universitas Ahmad Dahlan

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.26555/jiteki.v9i3.26722

Abstract

This study explores the application of CNN-Transfer Learning for nondestructive chicken egg fertility detection. Four models, VGG16, ResNet50, InceptionNet, and MobileNet, were trained and evaluated on a dataset using augmented images. The training results demonstrated that all models achieved high accuracy, indicating their ability to accurately learn and classify chicken eggs’ fertility state. However, when evaluated on the testing set, variations in accuracy and performance were observed. VGG16 achieved a high accuracy of 0.9803 on the testing set but had challenges in accurately detecting fertile eggs, as indicated by a NaN sensitivity value. ResNet50 also achieved an accuracy of 0.98 but struggled to identify fertile and non-fertile eggs, as suggested by NaN values for sensitivity and specificity. However, InceptionNet demonstrated excellent performance, with an accuracy of 0.9804, a sensitivity of 1 for detecting fertile eggs, and a specificity of 0.9615 for identifying non-fertile eggs. MobileNet achieved an accuracy of 0.9804 on the testing set; however, it faced challenges in accurately classifying the fertility status of chicken eggs, as indicated by NaN values for both sensitivity and specificity. While the models showed promise during training, variations in accuracy and performance were observed during testing. InceptionNet exhibited the best overall performance, accurately classifying fertile and non-fertile eggs. Further optimization and fine-tuning of the models are necessary to address the limitations in accurately detecting fertile and non-fertile eggs. This study highlights the potential of CNN-Transfer Learning for nondestructive fertility detection and emphasizes the need for further research to enhance the models’ capabilities and ensure accurate classification.
Neural Network Classification of Brainwave Alpha Signalsin Cognitive Activities Azhari, Ahmad; Susanto, Adhi; Pranolo, Andri; Mao, Yingchi
Knowledge Engineering and Data Science
Publisher : citeus

Show Abstract | Download Original | Original Source | Check in Google Scholar

Abstract

The signal produced by human brain waves is one unique feature. Signals carry information and are represented in electrical signals generated from the brain in a typical waveform. Human brain wave activity will always be active even when sleeping. Brain waves will produce different characteristics in different individuals. Physical and behavioral characteristics can be identified from patterns of brain wave activity. This study aims to distinguish signals from each individual based on the characteristics of alpha signals from brain waves produced. Brain wave signals are generated by giving several mental perception tasks measured using an Electroencephalogram (EEG). To get different features, EEG signals are extracted using first-order extraction and are classified using the Neural Network method. The results of this study are typical of the five first-order features used, namely average, standard deviation, skewness, kurtosis, and entropy. The results of pattern recognition training show that 171 successful iterations are carried out with a period of execution of 6 seconds. Performance tests are performed using the Mean Squared Error (MSE) function. The results of the performance tests that were successfully obtained in the pattern test are in the number 0.000994.
Parallel Approach of Adaptive Image Thresholding Algorithm on GPU Prahara, Adhi; Pranolo, Andri; Anwar, Nuril; Mao, Yingchi
Knowledge Engineering and Data Science
Publisher : citeus

Show Abstract | Download Original | Original Source | Check in Google Scholar

Abstract

Image thresholding is used to segment an image into background and foreground using a given threshold. The threshold can be generated using a specific algorithm instead of a pre-defined value obtained from observation or experiment. However, the algorithm involves per pixel operation, histogram calculation, and iterative procedure to search the optimum threshold that is costly for high-resolution images. In this research, parallel implementations on GPU for three adaptive image thresholding methods, namely Otsu, ISODATA, and minimum cross-entropy, were proposed to optimize their computational times to deal with high-resolution images. The approach involves parallel reduction and parallel prefix sum (scan) techniques to optimize the calculation. The proposed approach was tested on various sizes of grayscale images. The result shows that the parallel implementation of three adaptive image thresholding methods on GPU achieves 4-6 speeds up compared to the CPU implementation, reducing the computational time significantly and effectively dealing with high resolution images.
Optimized Three Deep Learning Models Based-PSO Hyperparameters for Beijing PM2.5 Prediction Pranolo, Andri; Mao, Yingchi; Prasetya Wibawa, Aji; Utama, Agung Bella Putra; Dwiyanto, Felix Andika
Knowledge Engineering and Data Science
Publisher : citeus

Show Abstract | Download Original | Original Source | Check in Google Scholar

Abstract

Deep learning is a machine learning approach that produces excellent performance in various applications, including natural language processing, image identification, and forecasting. Deep learning network performance depends on the hyperparameter settings. This research attempts to optimize the deep learning architecture of Long short term memory (LSTM), Convolutional neural network (CNN), and Multilayer perceptron (MLP) for forecasting tasks using Particle swarm optimization (PSO), a swarm intelligence-based metaheuristic optimization methodology: Proposed M-1 (PSO-LSTM), M-2 (PSO-CNN), and M-3 (PSO-MLP). Beijing PM2.5 datasets was analyzed to measure the performance of the proposed models. PM2.5 as a target variable was affected by dew point, pressure, temperature, cumulated wind speed, hours of snow, and hours of rain. The deep learning network inputs consist of three different scenarios: daily, weekly, and monthly. The results show that the proposed M-1 with three hidden layers produces the best results of RMSE and MAPE compared to the proposed M-2, M-3, and all the baselines. A recommendation for air pollution management could be generated by using these optimized models.
Time Series Forecasting with LSTM: an extensive content analysis Pranolo, Andri; Zhou, Xiaofeng; Mao, Yingchi
Knowledge Engineering and Data Science
Publisher : citeus

Show Abstract | Download Original | Original Source | Check in Google Scholar

Abstract

This paper presents a comprehensive bibliometric and content review of the trend, architecture, and application of long short-term memory (LSTM) models for time series forecasting. The study aims to provide insights into the overall statistics and distribution of papers focused on LSTM for forecasting. Additionally, the research questions address the most highly cited papers based on LSTM approaches in forecasting, the most productive journals in this field, and identifying trends, gaps, summary tasks and their performance, datasets availability, and future research directions for LSTM in forecasting. This paper is a comprehensive review of LSTM for forecasting from 2017 to 2023 and identifies emerging trends, potential research gaps, and future directions for LSTM in forecasting. These findings contribute to a deeper understanding of the current state of LSTM-based forecasting research and provide valuable insights for researchers and practitioners in the field. This bibliometric and content review sheds light on the landscape of LSTM for time series forecasting, highlighting the most cited papers and productive journals and outlining potential areas for future exploration and development of LSTM models in forecasting.
Exploring LSTM-based Attention Mechanisms with PSO and Grid Search under Different Normalization Techniques for Energy demands Time Series Forecasting Pranolo, Andri; Zhou, Xiaofeng; Mao, Yingchi; Pratolo, Bambang Widi; Wibawa, Aji Prasetya; Utama, Agung Bella Putra; Ba, Abdoul Fatakhou; Muhammad, Abdullahi Uwaisu
Knowledge Engineering and Data Science
Publisher : citeus

Show Abstract | Download Original | Original Source | Check in Google Scholar

Abstract

Advanced analytical approaches are required to accurately forecast the energy sector's rising complexity and volume of time series data. This research aims to forecast the energy demand utilising sophisticated Long Short-Term Memory (LSTM) configurations with Attention mechanisms (Att), Grid search, and Particle Swarm Optimization (PSO). In addition, the study also examines the influence of Min-Max and Z-Score normalization approaches in the preprocessing stage on the accuracy performances of the baselines and the proposed models. PSO and Grid Search techniques are used to select the best hyperparameters for LSTM models, while the attention mechanism selects the important input for the LSTM. The research compares the performance of baselines (LSTM, Grid-search-LSTM, and PSO-LSTM) and proposes models (Att-LSTM, Att-Grid-search-LSTM, and Att-PSO-LSTM) based on MAPE, RMSE, and R2 metrics into two scenarios normalization: Min-Max, and Z- Score. The results show that all models with Min-Max normalization have better MAPE, RMSE, and R2 than those with Z-Score. The best model performance is shown in Att-PSO-LSTM MAPE 3.1135, RMSE 0.0551, and R2 0.9233, followed by Att-Grid-search-LSTM, Att-LSTM, PSO-LSTM, Grid-search-LSTM, and LSTM. These findings emphasize the effectiveness of attention mechanisms in improving model predictions and the influence of normalization methods on model performance. This study's novel approach provides valuable insights into time series forecasting in energy demands.
Co-Authors ., Suparman AA Sudharmawan, AA Abdalla, Modawy Adam Ali Achmad Fanany Onnilita Gaffar Adhi Prahara Adhi Prahara Adhi Prahara, Adhi Adhi Susanto Adhi Susanto Afief Akmal Afiqa, Nurul Agung Bella Putra Utama Agus Cahyono Agus Dianto Agus Salim Ahmad Azhari Aji Prasetya Wibawa Akbari, Ade Kurnia Ganesh Albas, Juan Alin Khaliduzzaman Anasyua, Fairuz Khairunnisa Andiko Putro Suryotomo Anton Satria Prabuwono Anton Yudhana Ardi Pujiyanta Azhari, Ahmad Azlan, Faris Farhan Ba, Abdoul Fatakhou Bambang Widi Pratolo Camargo, Jair Dani Fadillah Daniel Happy Putra Drezewski, Rafał Dwiyanto, Felix Andika Elhindi, Mohamed Fachrul Kurniawan Fadhilla, Akhmad Fanny Felix Andika Dwiyanto Firdaus, Nalendra Firdaus, Nalendra Putra Ghazali, Ahmad Badaruddin Hanafi Hanafi Hariyanti, Nunik Heni Pujiastuti Heri Pramono Hoz, César De La Husnul Khotimah Ismail, Amelia Ritahani Khadir, Mohammed Tarek Leonel Hernandez Leonel Hernandez, Leonel Mao, Yingchi Mirghani, Abdelhameed Mokhtar, Nur Azizah Mohammad Muhammad, Abdullahi Uwaisu Nanang Fitriana Kurniawan Nathalie Japkowicz Nisa, Syed Qamrun Noormaizan, Khairul Akmal Nor Amalina Abdul Rahim Nuril Anwar Nuril Anwar, Nuril Nuryana, Zalik Omar, Abdalwahab Omer, Abduelrahman Adam Onie Yudho Sundoro Paramarta, Andien Khansa’a Iffat Prayitno Prayitno Putra, Agung Bella Utama Rafal Drezewski Rafał Dreżewski Roman Voliansky Saifullah, Shoffan Sarina Sulaiman Sarina Sulaiman Seno Aji Putra Setyaputri, Faradini Usha Snani, Aissa Sri Winiarti Suharto Suharto Sularso Sularso, Sularso Suparman Supriadi Supriadi Supriyanto Taqwa Hariguna Tedy Setyadi Tri Andi, Tri Triono, Alfiansyah Putra Pertama Uriu, Wako Utama, Agung Bella Putra Utami, Nurul Putrie Wadiyo Wadiyo Wilis Kaswijanti Yingchi Mao Yingchi Mao Yingchi Mao Yingchi Mao Zhou, Xiaofeng