Jurnal Penelitian Teknologi Informasi dan Sains
Vol. 4 No. 2 (2026): Juni: JURNAL PENELITIAN TEKNOLOGI INFORMASI DAN SAINS (JPTIS)

Integrasi Yolov11 dengan Large Language Model untuk Deteksi Makanan dan Estimasi Nilai Gizi pada Program Makan Bergizi Gratis

Firdausi Nuzula (Unknown)
Reno Syaelendra (Unknown)
Zakaria Mujur Prasetyo (Unknown)
Muhammad Fajar Nugroho (Unknown)
Giraldo Stevanus (Unknown)



Article Info

Publish Date
30 Jun 2026

Abstract

Evaluating food portions and types in the Free Nutritious Meal (MBG) program is generally still performed manually, which is time-consuming and potentially subjective. This study aims to develop an automated deep learning-based system to efficiently detect food types and estimate their nutritional value. The method used is a quantitative experiment integrating the YOLOv11m architecture for real-time object detection and the Google Gemini 2.5 Flash Large Language Model (LLM) for contextual nutritional estimation reasoning. The model training utilized a dataset of 2,630 food tray images categorized into five classes (fruit, side dish, staple food, vegetable, milk) that had undergone an augmentation process. The results showed that the YOLOv11m model achieved excellent performance with a mean Average Precision (mAP@0.5) of 0.9727 and the highest F1-score of 0.9522 at a confidence threshold of 0.1. Furthermore, validation of the LLM integration demonstrated a high prediction agreement rate of 85%. In conclusion, the combination of the YOLOv11m algorithm and LLM reasoning is capable of detecting and validating nutritional classification quickly and precisely, showing strong potential as an objective nutritional evaluation monitoring solution for large-scale MBG program implementation.

Copyrights © 2026






Journal Info

Abbrev

JPTIS

Publisher

Subject

Computer Science & IT

Description

Ruang lingkup meliputi bidang Informatika, Teknik Mesin, Teknik Elektro,Teknik Sipil, Teknik Industri, Ilmu Komputer dan ...