Lontar Komputer: Jurnal Ilmiah Teknologi Informasi
Vol. 15 No. 02 (2024): Vol. 15, No. 2 August 2024

BERT Uncased and LSTM Multiclass Classification Model for Traffic Violation Text Classification

Komang Ayu Triana Indah (Unknown)
I Ketut Gede Darma Putra (Unknown)
Made Sudarma (Unknown)
Rukmi Sari Hartati (Unknown)
Minho Jo (Unknown)



Article Info

Publish Date
12 Oct 2025

Abstract

The increasing amount of internet content makes it difficult for users to find information using the search function. This problem is overcome by classifying news based on its context to avoid material that has many interpretations. This research combines the Uncased model BiDirectional Encoder Representations from Transformer (BERT) with other models to create a text classification model. Long Short-Term Memory (LSTM) architecture trains a model to categorize news articles about traffic violations. Data was collected through the crawling method from the online media application API through unmodified and modified datasets. The BERT Uncased-LSTM model with the best hyperparameter combination scenario of batch size 16, learning rate 2e-5, and average pooling obtained Precision, Recall, and F1 values of 97.25%, 96.90%, and 98.10%, respectively. The research results show that the test value on the unmodified dataset is higher than on the modified dataset because the selection of words that have high information value in the modified dataset makes it difficult for the model to understand the context in text classification.

Copyrights © 2024






Journal Info

Abbrev

lontar

Publisher

Subject

Computer Science & IT Control & Systems Engineering Decision Sciences, Operations Research & Management Electrical & Electronics Engineering Engineering

Description

Lontar Komputer: Jurnal Ilmiah Teknologi Informasi focuses on the theory, practice, and methodology of all aspects of technology in the field of computer science and engineering. It provides an international publication platform to boost the scientific and academic publication of research in the ...