Article Per Year (5 Year)
p-Index From 2021 - 2026
1.704
P-Index
This Author published in this journals
All Journal Jurnal Edukasi dan Penelitian Informatika (JEPIN) Gelar : Jurnal Seni Budaya Buletin Ilmiah Sarjana Teknik Elektro G-Tech : Jurnal Teknologi Terapan TRANSFORMASI : JURNAL PENGABDIAN PADA MASYARAKAT JUSIFOR : Jurnal Sistem Informasi dan Informatika JANUR
Ratnasari, Novia
Unknown Affiliation
Arts Humanities Computer Science & IT Decision Sciences, Operations Research & Management Economics, Econometrics & Finance Education Electrical & Electronics Engineering Energy Engineering Environmental Science Library & Information Science Social Sciences

Published : 11 Documents Claim Missing Document
Claim Missing Document
Check
Articles

Found 11 Documents
Search

 1   2 
Language as the Semantic Bridge in Audio, Music, and Multimodal Artificial Intelligence: A Systematic Review (2021-2025) Ratnasari, Novia; Wibawa, Aji Prasetya
Buletin Ilmiah Sarjana Teknik Elektro Vol. 8 No. 2 (2026): April
Publisher : Universitas Ahmad Dahlan

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.12928/biste.v8i2.15564

Abstract

This study presents a systematic review of research in Audio, Music, and Multimodal Artificial Intelligence published between 2021 and 2025, investigating how language operates as a semantic mediation layer between acoustic signals and high-level meaning. The research addresses the fragmentation of existing surveys by introducing a Domain; Modality; Technique; Task (D-M-T-T) taxonomy that systematically differentiates domain focus, modality configuration, modeling techniques, and task objectives. The research contribution is a structured analytical framework that offers a more granular perspective than architecture-centered surveys of Multimodal Large Language Models. Following the PRISMA 2020 protocol, 2,197 Scopus-indexed publications were screened, yielding 369 eligible studies. Language is defined as a representational layer encompassing natural language and structured symbolic encodings that connect acoustic embeddings to semantic interpretation and generative reasoning. Multimodal systems aligning audio and vision without explicit textual grounding are included and analyzed as non-linguistic alignment architectures within the taxonomy. The findings reveal a shift from recognition-based models toward unified multimodal systems in which language conditions alignment, reasoning, and generative synthesis. For instance, text-conditioned music generation demonstrates how linguistic prompts guide compositional structure and emotional expression. These developments reflect an epistemic transition from signal recognition paradigms to language-mediated generative intelligence. Emerging gaps include limited explainability in generative audio systems and insufficient low-resource cross-modal semantic grounding.
Co-Authors Aji Prasetya Wibawa Darmawan, Kiki Fatma, Merry Nur Fitroni, Derry Rahmat Husnah, Jamilatul Ifada, Tia Irnadianis Rahmawati, Zurriat Nyndia Rohman, Mojibur Septarina, Amalia Agung Setiawan, Afriandi Setyaji, Wahyu Candra Syaad Patmanthara Tarecha, Rachmad Imam Tjiptady, Bella Cornelia Wahyudi, Farid Widanigrum, Anisa Hudi widaningrum, anisa hudi Wijaya, Mia Yuli Putri Zamzami, Muhammad Rizal Akbar