Mochamad Rizal Fauzan
National Taipei University of Technology

Published : 3 Documents Claim Missing Document
Claim Missing Document
Check
Articles

Found 3 Documents
Search

Hyperparameter Sensitivity of Vanilla Knowledge Distillation for Compact CNNs on CIFAR-100 Mochamad Rizal Fauzan; Raden Muhammad Rafi Rachman; Shifa Rangga Saputra; Daffa Irsyad Nugraha
Journal of Computer Networks, Architecture and High Performance Computing Vol. 8 No. 2 (2026): Research Paper April 2026
Publisher : Information Technology and Science (ITScience)

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.47709/cnahpc.v8i2.8239

Abstract

Knowledge distillation has become an effective strategy for improving compact convolutional neural networks, yet the performance of vanilla knowledge distillation in lightweight image classification is still often reported using default hyperparameter settings without systematic justification. This study addresses the limited empirical understanding of how two core vanilla knowledge distillation hyperparameters, temperature scaling (T) and loss balancing (?), affect compact convolutional neural networks under a unified experimental setting. Using CIFAR-100 as the benchmark dataset, a ResNet-50 teacher was employed to distill knowledge into two lightweight student models, MobileNetV2 and ShuffleNetV2 ×1.0. Performance was evaluated using top-1 accuracy, top-5 accuracy, parameter count, and inference latency. The teacher achieved 81.24% top-1 accuracy and 96.05% top-5 accuracy. Under the default distillation setting, MobileNetV2 improved from 79.18% to 80.83% top-1 accuracy and from 95.77% to 96.40% top-5 accuracy, while reducing latency from 3.98 ms to 3.44 ms. ShuffleNetV2 ×1.0 improved from 77.00% to 78.36% top-1 accuracy and from 94.81% to 95.45% top-5 accuracy, with only a marginal latency increase from 4.23 ms to 4.29 ms. To examine hyperparameter sensitivity, an ablation study was conducted on MobileNetV2 with T = 2, 4, and 6, and ? = 0.3, 0.5, and 0.7. The best configuration was obtained at T = 4 and ? = 0.3, yielding 80.88% top-1 accuracy and 96.51% top-5 accuracy. These results show that vanilla knowledge distillation consistently improves compact convolutional neural networks, but its effectiveness depends strongly on careful hyperparameter selection rather than inherited default settings.
Rethinking Efficiency: A Comparative Study of Lightweight CNN Architectures for Image Classification Mochamad Rizal Fauzan; Naufal Nadhif Rabbani Iskandar; Rafi Zahran Fauzi
Journal of Intelligent Systems Technology and Informatics Vol 2 No 1 (2026): JISTICS, March 2026
Publisher : Aliansi Peneliti Informatika

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.64878/jistics.v2i1.167

Abstract

Lightweight convolutional neural networks (CNNs) are increasingly required for image classification in resource-constrained environments; however, their comparative behavior under unified training conditions remains insufficiently explored, particularly when accuracy, parameter efficiency, inference latency, and augmentation sensitivity are evaluated simultaneously. This study presents a systematic benchmark of five lightweight CNN architectures, namely MobileNetV2, EfficientNet-B0, ShuffleNetV2, SqueezeNet, and ResNet18, on the CIFAR-100 dataset using a consistent experimental pipeline. All models were trained for 40 epochs with an input resolution of 128 × 128, AdamW optimization, cosine annealing, mixed-precision training, and identical preprocessing settings. Two augmentation strategies, namely basic and advanced augmentation, were evaluated to examine their influence on model generalization. The results show that EfficientNet-B0 achieved the best classification performance with 82.75% Top-1 accuracy and 96.46% Top-5 accuracy, while SqueezeNet achieved the fastest inference latency of 1.52 ms and the smallest parameter size, indicating its suitability for highly constrained deployment scenarios. Across all evaluated models, the average Top-1 and Top-5 accuracies reached 76.6% and 94.16%, respectively. In addition, the effect of advanced augmentation was found to be architecture-dependent rather than uniformly beneficial. On average, it resulted in a Top-1 accuracy change of −0.66 percentage points, with only ResNet18 showing a modest improvement. The main contribution of this study is to provide a unified, practically oriented benchmark that highlights how architectural design, rather than parameter count alone, determines the balance between accuracy and computational efficiency. These findings provide clearer guidance for selecting lightweight CNN models for real-world image classification tasks under varying deployment constraints.
SILOSENSE: AN IOT-BASED CORN GRAIN SILO LEVEL MONITORING SYSTEM USING HC-SR04 Annisa Nur Azmi; Farhan Garindesta; Muhamad Iqbal Firdaus; Mochamad Rizal Fauzan
Jurnal Informatika dan Teknik Elektro Terapan Vol. 14 No. 3 (2026)
Publisher : Universitas Lampung

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.23960/jitet.v14i3.9878

Abstract

The availability of corn grain in production silos is important for maintaining the continuity of corn flour production. However, manual level inspection is discontinuous, requires operator involvement, and is prone to reading errors. This study presents SiloSense, an Internet of Things (IoT)-based corn grain silo level monitoring prototype using an HC-SR04 ultrasonic sensor, ESP8266 WeMos D1 Mini, SSD1306 OLED display, Firebase Realtime Database, and Progressive Web App. Ultrasonic distance data are converted into estimates of fill percentage, volume, and mass through seven-sample trimmed median filtering, adaptive exponential smoothing with a dynamic alpha range of 0.35–0.85, and two-point linear calibration. The prototype was tested under five main fill conditions, namely 0%, 13%, 45%, 87%, and 100%, along with an additional sweep from 5% to 100%. The results showed consistent readings between the OLED display and the web application, with a median interface response time of 1600.5 ms. The system also classifies silo conditions into SAFE, MODERATE, NEARLY EMPTY, and EMPTY. These findings indicate that SiloSense is feasible as a low-cost, non-contact monitoring approach for small-scale corn grain silo level estimation, with further validation required before industrial deployment.