Article Per Year (5 Year)
p-Index From 2021 - 2026
4.829
P-Index
This Author published in this journals
All Journal MEDIA ELEKTRIKA WARTA Jurnal Pengabdian UntukMu NegeRI Al Ishlah Jurnal Pendidikan CIRCUIT: Jurnal Ilmiah Pendidikan Teknik Elektro Kinetik: Game Technology, Information System, Computer Network, Computing, Electronics, and Control DoubleClick : Journal of Computer and Information Technology JURNAL SIMTIKA (Sistem Informasi dan Informatika) Jurnal Riset Informatika Jurnal Sistem Informasi Kaputama (JSIK) JATI (Jurnal Mahasiswa Teknik Informatika) Journal of Education Informatic Technology and Science Journal of Applied Data Sciences Jurnal FASILKOM (teknologi inFormASi dan ILmu KOMputer) Jurnal Computer Science and Information Technology (CoSciTech) Jurnal SAINTIKOM (Jurnal Sains Manajemen Informatika dan Komputer) Jurnal Abdimas Bina Bangsa BIOS : Jurnal Teknologi Informasi dan Rekayasa Komputer Jurnal Ilmu Pendidikan (SOKO GURU) Prosiding Seminar Nasional Sisfotek (Sistem Informasi dan Teknologi Informasi) Jurnal Pengabdian Masyarakat Sains dan Teknologi Journal of Software Engineering and Information System (SEIS) Jurnal Pengabdian Kepada Masyarakat Ekonomi, Pendidikan, dan Sosial Humaniora Journal of Information Systems Management and Digital Business Sintaksis: Publikasi Para Ahli Bahasa dan Sastra Inggris Katalis Pendidikan: Jurnal Ilmu Pendidikan dan Matematika Soko Guru: Jurnal Ilmu Pendidikan
Finanta Okmayura
Unknown Affiliation
Religion Agriculture, Biological Sciences & Forestry Humanities Computer Science & IT Control & Systems Engineering Decision Sciences, Operations Research & Management Economics, Econometrics & Finance Education Electrical & Electronics Engineering Energy Engineering Languange, Linguistic, Communication & Media Law, Crime, Criminology & Criminal Justice Mathematics Social Sciences Other

Published : 44 Documents Claim Missing Document
Claim Missing Document
Check
Articles

Found 1 Documents
Search
Journal : Journal of Applied Data Sciences

 1 
Improving Evaluation Metrics for Text Summarization: A Comparative Study and Proposal of a Novel Metric Junadhi, Junadhi; Agustin, Agustin; Efrizoni, Lusiana; Okmayura, Finanta; Habibie, Dedi Rahman; Muslim, Muslim
Journal of Applied Data Sciences Vol 6, No 2: MAY 2025
Publisher : Bright Publisher

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.47738/jads.v6i2.547

Abstract

This research evaluates and compares the effectiveness of various evaluation metrics in text summarization, focusing on the development of a new metric that holistically measures summary quality. Commonly used metrics, including ROUGE, BLEU, METEOR, and BERTScore, were tested on three datasets: CNN/DailyMail, XSum, and PubMed. The analysis revealed that while ROUGE achieved an average score of 0.65, it struggled to capture semantic nuances, particularly for abstractive summarization models. In contrast, BERTScore, which incorporates semantic representation, performed better with an average score of 0.75. To address these limitations, we developed the Proposed Metric, which combines semantic similarity, n-gram overlap, and sentence fluency. The Proposed Metric achieved an average score of 0.78 across datasets, surpassing conventional metrics by providing more accurate assessments of summary quality. This research contributes a novel approach to text summarization evaluation by integrating semantic and structural aspects into a single metric. The findings highlight the Proposed Metric's ability to capture contextual coherence and semantic alignment, making it suitable for real-world applications such as news summarization and medical research. These results emphasize the importance of developing holistic metrics for better evaluation of text summarization models.
Co-Authors Adlian Jefiza Adlian Jefiza Agus, Weni Oktavia Agustin Agustin Ahmad Khaidir Ahmad Khaidir Aidha Tita Irani Al Azhar, Safri Alfala, Resi Fazri Anfilla Tahany Angguni, Melati Anjani, Suci Putri Ansyah, Dandi Arfa Fadilah Arman, Doni Bestari Aulia Ananda Boy Zidan Nadjal Chairunnisa, Azzahra Cily Tria Marisa Dawita, Yanda Rahmadani Dayani, Fitri Nur Deprizon Dewi Fatimahwati Diny Syahputri Dira Yanti dwi winarti winarti Effendi, Noverta Efrizoni, Lusiana Eliya Mei Sisri Elvianti, Suci Ernia Juliastuti Faila, Arfa Fatayat Faturrahman, Ariya Febby Wilyani Fitri Hasanah Fitri, Tiara Greghard Shawenner Gunawan Ali Gustiara, Delya Haana Udtari Anjani Habibie, Dedi Rahman Harahap, Lelis Nawiyah Hayami, Regiolina Herdani, Inka friska Herlandy, Pratama Benny Husnah, Mirdatul Impian Sefria Nanda Indayana, Nurul Sakhila Jayus Jayus Jefiza, Adlian Junadhi, Junadhi Khairiyah Alifya Azizah Khairul Anshari Khairunnisah Khairunnisah Khalik, Ananda Difni Khusnul Hanafi Lukas, Ivander marisa, cily Melati Angguni Melly Novalia Melly Novalia Melly Novalia Melly Novalia Melly Novalia, Melly Molizarni Molizarni Mufty, Nouval Ditya Muhammad Amirulhaq Muhammad Farhan Muhammad Ryan Pratama Yudha Muhammad Zidhan Muhammad Zidhan Muslim Muslim Nanda Sopira Nelysa, Mise Novchi, Raja Widya Nur Fadilah Achmad Nurul Azani Oktariandi, Ital Pangestu, Rudi Rahayu Setianingsih rahmad Kurniawan Rahmat Hidayat Rahmat Hidayat Raihan Khairunisa Raimando, Dego Akbar Raja , Widya Novchi Raja Arlizon Raja Widya Novchi Ramadhani, Witri Risanto, Joko Risnal Diansyah, Risnal Rizky Aditya RIZKY ARDIANSYAH Robby Satria Robby Satria Robby Roma Tika Adi Putra Salsabila, Adilah Santia, Erma Saputra, Haris Tri Saputra, Tio Meylandi Saputro, Reihan Hersi Sherly Fillia Siti Niah, Siti Solihulibad, Akma Sridevi yuliani Suandevin, Hichmaed Tachta Hinggo Sulis Martiana Suryadila, Lusi Sy, Yandiko Saputra Teguh Sujana Vitriani Vitriani Vitriani Vitriani Vitriani Vitriani Vitriani Vitriani, Vitriani Wiranti Yolanda, Amalia Zaiful Bahri Zidhan, Muhammad