Claim Missing Document
Check
Articles

Found 1 Documents
Search

Leakage-Free Evaluation of Capsule Network Heads for Brain Tumor MRI Classification Maulana Kanigara; Guruh Fajar Shidik
Equivalent: Jurnal Ilmiah Sosial Teknik Vol. 8 No. 5 (2026): Equivalent: Jurnal Ilmiah Sosial Teknik
Publisher : Politeknik Siber Cerdika Internasional

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.59261/jequi.v8i5.478

Abstract

Background: Deep learning studies using the widely used Brain Tumor MRI Dataset routinely report accuracies above 95%. However, the dataset combines overlapping public collections, and capsule networks are often promoted for such data without controlled comparisons. Objective: This study quantified duplicate-induced data leakage in the dataset and investigated whether capsule heads improve classification under leakage-free evaluation. Methods: Exact and near-duplicate slices were identified using file hashing and correlation analysis of head-cropped thumbnails, with the correlation threshold calibrated against label-conflict rates. Ten models using three backbones were trained under a unified protocol with five random seeds on a consumer-grade GPU. Capsule, dense, and pooling heads were compared. The models were also evaluated using the original, potentially leaky split, and their rotation robustness and inference costs were assessed. Results: Near-duplicates linked 1,707 of 5,712 training images (29.9%) to images in the test set, and data leakage inflated test accuracy by 3.22–6.33 percentage points through both memorization and the larger effective training set. With a lightweight backbone trained from scratch, the capsule head improved macro-F1 by 7.16 percentage points over the dense head while using 91.3% fewer parameters, and by 6.63 percentage points over the pooling head. These improvements were consistent across all five random seeds. However, the capsule head provided no improvement with ImageNet-pretrained backbones and did not consistently reduce the loss in accuracy under rotation. Conclusion: Capsule heads appear to offer the greatest benefit when features are learned from limited data. Leakage-free evaluation across multiple random seeds is essential for credible brain tumor MRI benchmarks. These conclusions apply to the tested public dataset and experimental protocol and do not constitute clinical validation.