Simtek : Jurnal Sistem Informasi dan Teknik Komputer
Vol. 11 No. 2 (2026): Oktober 2026

KLASIFIKASI GENRE MUSIK BERBASIS AUDIO DAN LIRIK MENGGUNAKAN CNN DAN MULTILINGUAL BERT

Dhany Ramadhan (Program Studi Ilmu Komputer, Fakultas MIPA, Universitas Halu Oleo, Kendari, Indonesia)
lham Julian Efendi (Program Studi Ilmu Komputer, Fakultas MIPA, Universitas Halu Oleo, Kendari, Indonesia)
Andi Tenriawaru (Program Studi Ilmu Komputer, Fakultas MIPA, Universitas Halu Oleo, Kendari, Indonesia)



Article Info

Publish Date
04 Nov 2026

Abstract

The rapid growth of music content in the digital era has highlighted the need for automated music genre classification systems to replace conventional methods that are less efficient. This study develops a multimodal music genre classification architecture that combines audio signal feature extraction and semantic information from song lyrics in Indonesian and English, focusing on four music genres: Country, Hip-Hop, Pop, and Rock. The proposed deep learning approach integrates a Convolutional Neural Network (CNN) to extract Mel-Spectrogram representations from audio signals and Multilingual BERT to capture contextual relationships within song lyrics. The audio dataset was obtained from the GTZAN Genre Collection, which comprises ten music genres (Blues, Classical, Country, Disco, Hip-Hop, Jazz, Metal, Pop, Reggae, and Rock), while the lyrics dataset was collected from Genius Song Lyrics and Indonesian song lyrics repositories. Features extracted from both modalities were integrated using a feature-level fusion technique. Experimental results demonstrate that the audio-only model achieved an accuracy of 90.4%, while the lyrics-only model obtained an accuracy of 61.7%. The multimodal approach achieved the highest classification performance, with an accuracy of 93.8%. The trained model was subsequently deployed as a web-based application using the Flask framework.

Copyrights © 2026






Journal Info

Abbrev

simtek

Publisher

Subject

Computer Science & IT Electrical & Electronics Engineering Engineering

Description

Jurnal Sistem Informasi dan Teknik Komputer diterbitkan dua edisi jurnal dalam satu tahun, yaitu pada bulan April dan Oktober. Jurnal Sistem Informasi dan Teknik Komputer mencakup bidang-bidang ilmu teknologi informasi antara lain teknik komputer, ilmu komputer, sistem informasi, komputerisasi ...