Article Per Year (5 Year)
p-Index From 2021 - 2026
0.23
P-Index
This Author published in this journals
All Journal EXPLORER
Jonathan Simorangkir
Program Studi Sistem Informasi, Fakultas Informatika dan Teknik Elektro, Institut Teknologi Del, Laguboti
Computer Science & IT

Published : 1 Documents Claim Missing Document
Claim Missing Document
Check
Articles

Found 1 Documents
Search

 1 
The Multimodal Medical Clustering of Chest X-Ray Images and Clinical Reports Using Deep Visual and Semantic Text Features Humasak Simanjuntak; Lenni Hutapea; Jonathan Simorangkir; Yolanda Saragih; Jaden Panggabean
Explorer Vol 6 No 2 (2026): July 2026
Publisher : Forum Kerjasama Pendidikan Tinggi

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.47065/explorer.v6i2.2915

Abstract

The limited availability of labelled medical data is a real obstacle in building a supervised learning-based Radiology analysis system. This study offers an alternative approach, unlabeled multimodal clustering, that simultaneously combines clinical information sources: chest X-ray images and physician clinical reports. Visual features are extracted from 1,000 images using a pretrained ResNet152, and text features are constructed using a Dual TF-IDF Vectorizer that processed the findings and conclusions columns separately with explicit weightings (0.4 and 0.6), then enriched with 10 related topics from the Latent Dirichlet Allocation (LDA) model. These two modalities are combined through a weighted late fusion strategy after being normalized by L2, with a visual weight of 0.5 and a text weight of 0.5, respectively. Before clustering, dimensionality reduction is performed using UMAP with 50 components and a cosine metric. Determining the optimal K value using the Elbow and Silhouette Score methods in the range of K=2 to K=15 showed K=8 as the best choice with a Silhouette Score value of 0.7524. The clustering results reveal eight clinical groups reflecting diverse diagnostic patterns, ranging from normal to abnormal findings, such as cardiomegaly and pneumonia, that require clinical attention. This approach has the potential to serve as the basis for a medical data exploration system that relies on no label annotations.
Co-Authors Humasak Simanjuntak Jaden Panggabean Lenni Hutapea Yolanda Saragih