Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi)
Vol 7 No 6 (2023): December 2023

Pengenalan Tulisan Tangan Aksara Bali Menggunakan Faster R-CNN

Alif Adwitiya Pratama (Telkom University)
Mahmud Dwi Sulistiyo (Telkom University)
Aditya Firman Ihsan (Telkom University)



Article Info

Publish Date
26 Nov 2023

Abstract

In Balinese culture, the ability to read Balinese script is one of the challenges young generations face. Advances in machine learning have proposed handwriting detection systems using both traditional and deep learning models. However, the traditional approach is usually impractical and is prone to inaccurate identification results. Convolutional neural network (CNN)-based models integrate feature extraction and classification into an end-to-end pipeline to increase performance. This research proposes that recognizing characters through an object detection approach makes an end-to-end process of localizing and classifying several characters simultaneously using the Faster R-CNN. Four CNN models, including ResNet-50, ResNet-101, ResNet-152, and Inception ResNet V2, were tested to detect 28 Balinese characters in a single form that covers 18 consonants and 10 digits using Intersection over Union (IoU) thresholds: 0.5 and 0.75. ResNet-50 and Inception ResNet V2 achieve 0.991 mAP at IoU of 0.5, while Inception ResNet V2 excels at IoU of 0.75. Further analysis showed that the class ‘nol’ had the lowest Recall due to many undetected ground truths. Meanwhile, class ‘ba’ had the lowest Precision due to its similarity to classes “ga” and “nga”. This research contributes to the experiment with Faster R-CNN in detecting handwritten Balinese scripts.

Copyrights © 2023






Journal Info

Abbrev

RESTI

Publisher

Subject

Computer Science & IT Engineering

Description

Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi) dimaksudkan sebagai media kajian ilmiah hasil penelitian, pemikiran dan kajian analisis-kritis mengenai penelitian Rekayasa Sistem, Teknik Informatika/Teknologi Informasi, Manajemen Informatika dan Sistem Informasi. Sebagai bagian dari semangat ...