Jurnal Teknik Informatika (JUTIF)
Vol. 7 No. 5 (2026): JUTIF Volume 7, Number 5, October 2026

Enhancing Accuracy and Interpretability of Facial Skin Tone Classification Using Hybrid Feature Fusion and LightGBM

Azed Yayah Durrotun Nihayah (Faculty of Study Academic, Universitas Sains dan Teknologi Komputer, Indonesia)
Joseflim Marchel (Faculty of Study Academic, Universitas Sains dan Teknologi Komputer, Indonesia)
Joseph Teguh Santoso (Faculty of Study Academic, Universitas Sains dan Teknologi Komputer, Indonesia)
Wiwid Wahyudi (Faculty of Study Academic, Universitas Sains dan Teknologi Komputer, Indonesia)
Noorul Hassan (Dept. of Artificial Intelligence and Data Science, Arunai Engineering College, India)



Article Info

Publish Date
10 Oct 2026

Abstract

Facial skin tone classification plays an important role in cosmetic recommendations and digital beauty applications. Existing approaches frequently rely on single-domain feature extraction combined with conventional classifiers, which may limit representational coverage and analytical transparency. This study proposes a hybrid feature-fusion framework that integrates HSV color descriptors, GLCM statistical texture features, and LBP micro-texture patterns into a unified feature representation, which is then classified using a Light Gradient Boosting Machine (LightGBM). Experiments were conducted on 899 facial images from the Kaggle Skin Tone dataset, categorized into White, Olive, and Dark Brown classes. A stratified 70:30 hold-out scheme was applied to evaluate model performance. The results indicate that combining heterogeneous visual descriptors improves classification accuracy compared to individual feature domains. Under the selected experimental configuration, the LightGBM classifier achieved an accuracy of 89.67%, with consistent precision and recall values across classes. In addition to overall performance metrics, balanced accuracy and confusion matrix analysis were employed to examine class-level prediction behavior. SHAP-based interpretability analysis was further utilized to identify feature contribution patterns, showing that chromatic descriptors played a prominent role while texture features contributed to boundary refinement. These findings suggest that hybrid feature integration combined with boosting-based modeling provides a structured and interpretable approach for moderate-scale skin tone classification tasks.

Copyrights © 2026






Journal Info

Abbrev

jurnal

Publisher

Subject

Computer Science & IT

Description

Jurnal Teknik Informatika (JUTIF) is an Indonesian national journal, publishes high-quality research papers in the broad field of Informatics, Information Systems and Computer Science, which encompasses software engineering, information system development, computer systems, computer network, ...