Indonesian Journal of Artificial Intelligence and Data Mining
Vol 8, No 2 (2025): July 2025

Robustness Testing of TrOCR for Multi-Condition Food Ingredient Labels Detected By YOLO

Chairunnisa, Charina Mutiara (Unknown)
Husni, Nyayu Latifah (Unknown)
Kusumanto, RD. (Unknown)



Article Info

Publish Date
14 Dec 2025

Abstract

This study aimed to develop an automatic text extraction system for ingredient labels by integrating YOLOv8 for object detection and a Transformer-based Optical Character Recognition (OCR) for text recognition. YOLOv8 was trained to detect and crop the label area in the image, while TrOCR was used to extract text from the cropped bounding box. The evaluation involved 16 sample image inputs under various conditions, including background color (Monochrome and RGB), languages (Bahasa Indonesia and English), and text formatting (single-line and multi-line). The results indicated that TrOCR performed well in single-line format, but struggled with multi-line format and longer text, even omitting words. Character and word error rates reached up to 100% for this complex layout. 

Copyrights © 2025






Journal Info

Abbrev

IJAIDM

Publisher

Subject

Computer Science & IT

Description

Indonesian Journal of Artificial Intelligence and Data Mining (IJAIDM) is an electronic periodical publication published by Puzzle Research Data Technology (Predatech) Faculty of Science and Technology UIN Sultan Syarif Kasim Riau, Indonesia. IJAIDM provides online media to publish scientific ...