JOURNAL OF INFORMATION SYSTEM RESEARCH (JOSH)
Vol 8 No 1 (2026): October 2026

Klasifikasi Hierarkis dengan Kalibrasi Probabilitas untuk Penyakit Daun Singkong Menggunakan Fusi Fitur dan Random Forest

Regi Fernando Najoan (Universitas Klabat, Minahasa Utara)
Enrico Samuel Djimesha (Universitas Klabat, Minahasa Utara)
Argha Orion Silitonga (Universitas Klabat, Minahasa Utara)
Wilsen Grivin Mokodaser (Universitas Klabat, Minahasa Utara)
George William Tangka (Universitas Klabat, Minahasa Utara)



Article Info

Publish Date
18 Oct 2026

Abstract

Field-image classification of cassava leaf disease requires trustworthy probabilities and a mechanism for withholding uncertain decisions, rather than label accuracy alone. This study evaluates HSV, GLCM, and MobileNetV3-Small embedding fusion in a two-stage hierarchical Random Forest with probability calibration and selective prediction. A total of 7,508 CCMT images were evaluated using outer stratified 5-fold cross-validation. Model comparisons report mean ± standard deviation across five outer folds. End-to-end MobileNetV3-Small achieved 93.90±0.73% accuracy, 94.64±0.59% balanced accuracy, and 94.23±0.73% Macro F1, exceeding the Hierarchical Hybrid Random Forest at 88.28±1.12%, 89.66±0.76%, and 88.79±1.07%, respectively. The 1.03-percentage-point Macro F1 difference between the hierarchical and Flat Hybrid models was not significant at the 5% level (two-sided Wilcoxon, p=0.125). A separate calibration and selective-prediction experiment divided each outer-train fold into 70% model-fit, 15% calibrator-fit, and 15% threshold-selection partitions, all disjoint from the outer-test fold. Simplex-temperature yielded the lowest ECE (0.54%), whereas sigmoid performed better on log loss and Brier score. Thresholds selected on the held-out threshold-selection partition yielded 75.87% outer-test coverage, 95.40% accepted accuracy, and 95.58% accepted Macro F1. Selective accuracy applies only to accepted samples, not all data or guaranteed future performance; the contribution is evaluation of the coverage–risk trade-off, not improved intrinsic accuracy.

Copyrights © 2026






Journal Info

Abbrev

josh

Publisher

Subject

Computer Science & IT Decision Sciences, Operations Research & Management

Description

Artikel yang dimuat melalui proses Blind Review oleh Jurnal JOSH, dengan mempertimbangkan antara lain: terpenuhinya persyaratan baku publikasi jurnal, metodologi riset yang digunakan, dan signifikansi kontribusi hasil riset terhadap pengembangan keilmuan bidang teknologi dan informasi. Fokus Journal ...