Pandula Pallewatta
Nanjing University of Information Science and Technology

Published : 2 Documents Claim Missing Document
Claim Missing Document
Check
Articles

Found 2 Documents
Search

A Study of Loss Weight Balance in Lightweight Self-Distilled Crowd Counting Muhammad Raza; Atta Ur Rahman; Pandula Pallewatta; Inayat Ur Rahman; Sahib Bahadar
Scientific Journal of Engineering Research Vol. 2 No. 3 (2026): September
Publisher : PT. Teknologi Futuristik Indonesia

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.64539/sjer.v2i3.2026.493

Abstract

Lightweight crowd counting is important for real-time surveillance and resource-constrained deployment, where both computational efficiency and effective supervision are required. Although teacher-free self-distillation can improve lightweight density-regression models by guiding intermediate representations without an external teacher, the influence of composite loss weights in such frameworks has not been sufficiently analyzed. This paper presents a focused coefficient-wise loss-weight analysis within the Lightweight Self-Knowledge Distillation framework for single-image crowd counting. Instead of proposing a new architecture, the study investigates how the coefficients α, β, γ, and λ₂ affect optimization behavior and counting accuracy under a fixed experimental setup on ShanghaiTech Part B. Specifically, α controls intermediate feature alignment, β controls consistency supervision, γ controls direct density-regression supervision, and λ₂ controls the structural similarity term in the regression loss. The results show that moderate values of α and β improve performance by providing useful internal regularization, while excessive auxiliary weighting can slightly degrade accuracy. The analysis also indicates that γ should remain dominant because direct density-map regression is the primary learning signal. The best observed configuration is α = 6.0, β = 2.0, γ = 13.0, and λ₂ = 0.2, achieving 8.94 MAE and 11.51 RMSE on ShanghaiTech Part B. These findings highlight the importance of balanced supervision design within the evaluated LSKD framework on ShanghaiTech Part B.
LSKD: Lightweight Self-Knowledge Distillation Framework for Fast and Robust Crowd Counting Muhammad Raza; Miaogen Ling; Atta Ur Rahman; Pandula Pallewatta; Aboubakar Abdinur Hersi; Shehan Maxwell Beruwalage; Deshan Sachintha Kannangara
Scientific Journal of Engineering Research Vol. 2 No. 2 (2026): June
Publisher : PT. Teknologi Futuristik Indonesia

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.64539/sjer.v2i2.2026.436

Abstract

Crowd counting plays an important role in the surveillance of the safety of the people, traffic, and intelligent surveillance systems. However, the exact density estimations remain hard to achieve in highly congested scenes due to the tough occlusion, large-scale variance, and complicated background. Although the recent deep-learning methods have high performance, several of them do not need computationally efficient underlying backbone networks, and rather, they employ an external teacher-student distillation architecture, which can limit their use in resource-constrained applications. To avoid this problem, we introduce LSKD, a lightweight self-knowledge distillation network that is density map regression-specific. Unlike other conventional teacher-dependent processes, LSKD can also independently carry out internal multi-level feature alignment within a single small network that is not in need of an external teacher model. The structure integrates a Feature Matching Block (FMB) and a Context Fusion (CoFuse) block to enhance the hierarchical match of features and global awareness of context. The large experiments demonstrate that LSKD obtain competitive performance using the number of parameters as 2.65 million and GFLOPs as 10.23. Particularly, it has 63.17 MAE on ShanghaiTech Part A, 8.94 on ShanghaiTech Part B, 143.7 on UCF-QNRF, and 223.88 on UCF-CC-50, which is a good ratio between the accuracy and the efficiency of the calculations. Such results indicate that LSKD has an implementable and efficient solution to the real-time counting of crowds at the edge devices.