Article Per Year (5 Year)
p-Index From 2021 - 2026
0.23
P-Index
This Author published in this journals
All Journal Indonesian Journal of Artificial Intelligence and Data Mining
Chairunnisa, Charina Mutiara
Unknown Affiliation
Computer Science & IT

Published : 1 Documents Claim Missing Document
Claim Missing Document
Check
Articles

Found 1 Documents
Search

 1 
Robustness Testing of TrOCR for Multi-Condition Food Ingredient Labels Detected By YOLO Chairunnisa, Charina Mutiara; Husni, Nyayu Latifah; Kusumanto, RD.
Indonesian Journal of Artificial Intelligence and Data Mining Vol 8, No 2 (2025): July 2025
Publisher : Universitas Islam Negeri Sultan Syarif Kasim Riau

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.24014/ijaidm.v8i3.37301

Abstract

This study aimed to develop an automatic text extraction system for ingredient labels by integrating YOLOv8 for object detection and a Transformer-based Optical Character Recognition (OCR) for text recognition. YOLOv8 was trained to detect and crop the label area in the image, while TrOCR was used to extract text from the cropped bounding box. The evaluation involved 16 sample image inputs under various conditions, including background color (Monochrome and RGB), languages (Bahasa Indonesia and English), and text formatting (single-line and multi-line). The results indicated that TrOCR performed well in single-line format, but struggled with multi-line format and longer text, even omitting words. Character and word error rates reached up to 100% for this complex layout. 
Co-Authors Nyayu Latifah Husni, Nyayu Latifah RD Kusumanto