JURNAL SISTEM INFORMASI BISNIS
Vol 14, No 4 (2024): Volume 14 Nomor 4 Tahun 2024

A Novel Fusion of Machine Learning Methods for Enhancing Named Entity Recognition in Indonesian Language Text

Widyawan, Widyawan (Unknown)
Utomo, Bayu Prasetiyo (Unknown)
Rizala, Muhammad Nur (Unknown)



Article Info

Publish Date
09 Oct 2024

Abstract

One of the important implementations in machine learning is Named Entity Recognition (NER), which is used to process text and extract entities such as people, organizations, laws, religions, and locations. NER for the Indonesian language still faces significant challenges due to the lack of high-quality labelled datasets, which limits the development of more advanced models. To address this issue, we utilized several pre-trained BERT models (bert-base-uncased, indobenchmark/indobert-base-p1, indolem/indobert-base-uncased) and datasets (NERGRIT-IndoNLU, NERGRIT-Corpus, NERUGM, and NERUI). This study proposes a novel fusion approach by integrating deep learning architectures such as CNN, Bi-LSTM, Bi-GRU, and CRF to detect 19 entities. This approach enhances BERT’s sequence modelling and feature extraction capabilities, while CRF improves entity prediction by enforcing global word-sequence constraints. Experimental results demonstrate that the fusion approach outperforms previous methods. On the bert-base-uncased dataset, accuracy reached 94.75%, while indobenchmark/indobert-base-p1 achieved 95.75%, and indolem/indobert-base-uncased achieved 95.85%. This study emphasizes the effectiveness of combining deep learning architectures with pre-trained transformers to improve NER performance in the Indonesian language. The proposed methodology offers significant advancements in entity extraction for languages with limited datasets, such as Indonesian.

Copyrights © 2024






Journal Info

Abbrev

jsinbis

Publisher

Subject

Computer Science & IT Economics, Econometrics & Finance

Description

JSINBIS merupakan jurnal ilmiah dalam bidang Sistem Informasi bisnis fokus pada Business Intelligence. Sistem informasi bisnis didefinisikan sebagai suatu sistem yang mengintegrasikan teknologi informasi, orang dan bisnis. SINBIS membawa fungsi bisnis bersama informasi untuk membangun saluran ...