Article Per Year (5 Year)
p-Index From 2021 - 2026
5.571
P-Index
This Author published in this journals
All Journal EDU CIVIC Jurnal Kajian Ekonomi Promotif: Jurnal Kesehatan Masyarakat Efektor Medical Technology and Public Health Journal Gema Wiralodra Jurnal Ilmiah Permas: Jurnal Ilmiah STIKES Kendal JURNAL PENELITIAN PERAWAT PROFESIONAL Jurnal Tekinkom (Teknik Informasi dan Komputer) Jurnal Peduli Masyarakat Indonesian Journal of Global Health research Jurnal Pengabdian kepada Masyarakat Nusantara Innovation in Research of Informatics (INNOVATICS) Halu Oleo Legal Research Journal of Applied Data Sciences Jurnal Kesehatan Tambusai LOSARI: Jurnal Pengabdian Kepada Masyarakat MAHESA : Malahayati Health Student Journal Journal of English Language and Education Jurnal Penelitian Inovatif Jurnal Bhakti Civitas Akademika Jurnal Keperawatan Klinis dan Komunitas (Clinical and Community Nursing Journal) Journal of Community Engagement Research for Sustainability GENIUS JOURNAL (General Nursing Science Journal) Indonesian Journal of Cancer International Journal Of Economics Social And Technology Pharmaceutical Sciences and Research (PSR) Journal Of Safety and Health DEVICE : JOURNAL OF INFORMATION SYSTEM, COMPUTER SCIENCE AND INFORMATION TECHNOLOGY Citra Delima Scientific journal of Citra Internasional Institute Prosiding Seminar Nasional Inovasi Teknologi Terapan Jurnal PGSD Indonesia PENG: Jurnal Ekonomi dan Manajemen ZIJEn: Zabags International Journal of Engagement Widya Katambung Jurnal Filsafat Agama Hindu Prosiding Konferensi Nasional Ilmu Kesehatan STIKES Adi Husada
Agustin Agustin
Bagian Farmasetika Fakultas Farmasi Universitas Airlangga Surabaya
Religion Agriculture, Biological Sciences & Forestry Humanities Automotive Engineering Biochemistry, Genetics & Molecular Biology Computer Science & IT Control & Systems Engineering Decision Sciences, Operations Research & Management Dentistry Earth & Planetary Sciences Economics, Econometrics & Finance Education Electrical & Electronics Engineering Energy Engineering Environmental Science Health Professions Immunology & microbiology Languange, Linguistic, Communication & Media Law, Crime, Criminology & Criminal Justice Library & Information Science Mathematics Mechanical Engineering Medicine & Pharmacology Nursing Public Health Social Sciences Transportation Veterinary Other

Published : 50 Documents Claim Missing Document
Claim Missing Document
Check
Articles

Found 1 Documents
Search
Journal : Journal of Applied Data Sciences

 1 
Improving Evaluation Metrics for Text Summarization: A Comparative Study and Proposal of a Novel Metric Junadhi, Junadhi; Agustin, Agustin; Efrizoni, Lusiana; Okmayura, Finanta; Habibie, Dedi Rahman; Muslim, Muslim
Journal of Applied Data Sciences Vol 6, No 2: MAY 2025
Publisher : Bright Publisher

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.47738/jads.v6i2.547

Abstract

This research evaluates and compares the effectiveness of various evaluation metrics in text summarization, focusing on the development of a new metric that holistically measures summary quality. Commonly used metrics, including ROUGE, BLEU, METEOR, and BERTScore, were tested on three datasets: CNN/DailyMail, XSum, and PubMed. The analysis revealed that while ROUGE achieved an average score of 0.65, it struggled to capture semantic nuances, particularly for abstractive summarization models. In contrast, BERTScore, which incorporates semantic representation, performed better with an average score of 0.75. To address these limitations, we developed the Proposed Metric, which combines semantic similarity, n-gram overlap, and sentence fluency. The Proposed Metric achieved an average score of 0.78 across datasets, surpassing conventional metrics by providing more accurate assessments of summary quality. This research contributes a novel approach to text summarization evaluation by integrating semantic and structural aspects into a single metric. The findings highlight the Proposed Metric's ability to capture contextual coherence and semantic alignment, making it suitable for real-world applications such as news summarization and medical research. These results emphasize the importance of developing holistic metrics for better evaluation of text summarization models.
Co-Authors Abdul Wahab Agustian, Fadhlan Hatta Agustin, Ina Agustini, Elina Ainur Rofiq Alfares, Juli Dayan Alhidayah Andesa, Khusaeri Andesla, Askari Andini, Andini ANGGERIYANA, SEPTA Anggraini, Fadhila Anggraini, Rima Berti Annurahman, Arif ARDIANSYAH ARDIANSYAH Atalia, Atalia Bella, Bella Cecep Eli Kosasih Chusjairi, Juni Alfiah Dahnilsyah, Dahnilsyah Darmawan, Flora Honey Dewi Supu, Sri Diana Ulfah Diva, Nisrina Nazhifah Dudini, Amalia Khasanah Ima Efrizoni, Lusiana Elsi Dwi Hapsari Erlinda, Susi Fakhriyah, Anya Bunga Fauta, Ari FERLY OKTRIYEDI Finanta Okmayura Fitri Nurhayati Fitriana Fitriana Fransiskus Zoromi, Fransiskus Furnamasari, Dyan Gaurifa, Debi F Putra Ghazali, Muh Al Habibie, Dedi Rahman Hairil Akbar Hamza, St. Rahmawati Hamzah, St.Rahmawati Hasdi Aimon Herwin Herwin, Herwin Husen, Ratna Andini Hutami, Nurfitria Anisa Ilham Ary Wahyudie Inarotul A’yun Irawan, Muhammad Henrie Irfandi Irfandi, Irfandi Isjoni, Muhammad Yogi Ryantama Iskandar, Dina Nur Ismanizan, Ryan Jafar, Kamaruddin JANUARSI, RATNA Jesi Alexander Alim Joleha, Joleha Junadhi Junadhi Junadhi, Junadhi Kudadiri, Parlindungan Kusmiati, Lisa Lastari, Vina Fuji Lestari, Indri Puji Mahmud Alpusari Manan, Afni Abdul Maryana Maryana, Maryana Matius Paundanan, Matius Mokodompit, Hariansyah Muhammad Rivai Mujahidah, Gita Murtiani, Farida Muslim Muslim Muzayyana, Muzayyana Nanda Indira Nelson Alexander Neni Hermita Ningsih, Septiara Noorma Rosita Norma Norma Nova Mardiana, Nova Novita, Karina Nurlaili Nurlaili Nurvinanda, Rezka Nuzulullail, Agung Subakti Persitiowati, Yuly Perumal, Thinagaran Pratiwi, Gessy Ade Prawira, Ade Bagus Puspitasari, Halfie Zaqiyah Gusti Putra, Jean Riko Kurniawan Putra, Septian Aditya Putri Asilestari, Putri Putri, Wanda Dwi Rahmaddeni Rahmaddeni Rahmiati Rahmiati Retno Sari Rianti, Wida Rianti Riliyantri, Sri Riyati, Riyati Rizky Meilando Rudiantoro, Danar Rukmini Rukmini Sarifudin, Asri Wati Sarma, Nyoman Sazali, Didik Selwis Raistanti, Sihqina Ramadhani Sinapoy, Muh. Sabaruddin Sitti Nurul Hikma Saleh Sri Hartini Sri Ulfa Sentosa Sriwahyuningsih, Ade Sudirman Sudirman Sunarti Suprapto, Sentot Imam syahirah, nazhifah Syahrir, Syamsul Syarah, Amalia Tetti Solehati Triyani Arita Fitri Tsauroh, Salsabila Fiqrotu Tussa’diah, Halimah Tutiek Purwanti Viegas, Bonifacio de Jesus Wiratama, Novialita Angga Yenny Puspitasari Yuly Peristiowati Yuwan, Ifan Alif Zahroh, Windy Septiana Zetra Hainul Putra Zuhroh, Siti