Article Per Year (5 Year)
p-Index From 2021 - 2026
7.265
P-Index
This Author published in this journals
All Journal IAES International Journal of Artificial Intelligence (IJ-AI) IJCCS (Indonesian Journal of Computing and Cybernetics Systems) Kompak : Jurnal Ilmiah Komputerisasi Akuntansi E-Bisnis : Jurnal Ilmiah Ekonomi dan Bisnis CommIT (Communication & Information Technology) Al-Iqtishad : Jurnal Ilmu Ekonomi Syariah (Journal of Islamic Economics) LINK ANDHARUPA Akuisisi : Jurnal Akuntansi Pendas : Jurnah Ilmiah Pendidikan Dasar JMM (Jurnal Masyarakat Mandiri) Jurnal Rekam Medis dan Informasi Kesehatan Jurnal Manajemen Informasi Kesehatan Indonesia (JMIKI) Kajian Bisnis STIE Widya Wiwaha Go Infotech: Jurnal Ilmiah STMIK AUB Jurnal Ekonomi Dan Bisnis Abdimasku : Jurnal Pengabdian Masyarakat JURNAL PENDIDIKAN, SAINS DAN TEKNOLOGI Infokes : Jurnal Ilmiah Rekam Medis dan Informasi Kesehatan MANAJEMEN ProBisnis : Jurnal Manajemen Educenter: Jurnal Ilmiah Pendidikan INFORMATIKA Dinamika PENA ABDIMAS : Jurnal Pengabdian Masyarakat JURNAL AKUNTANSI DAN BISNIS Journal of Artificial Intelligence and Digital Business Community: Jurnal Pengabdian Pada Masyarakat Jurnal Rekayasa elektrika Journal of Technology Informatics and Engineering Jurnal Informatika Polinema (JIP) Empowering Humanity Journal of Economics, Business, Accounting and Management Jurnal Riset Teknik Komputer EDUCENTER JURNAL PENDIDIKAN Scientific Journal of Informatics Jurnal Informatika dan Kesehatan Bumi: Jurnal Hasil Kegiatan Sosialisasi Pengabdian Kepada Masyarakat International Journal of Mechanical, Electrical and Civil Engineering Cakrawangsa Bisnis Go Infotech: Jurnal Ilmiah STMIK AUB
Nur Rokhman
Dept. Of Computer Science And Electronics, Gadjah Mada University
Religion Arts Humanities Computer Science & IT Control & Systems Engineering Decision Sciences, Operations Research & Management Economics, Econometrics & Finance Education Electrical & Electronics Engineering Energy Engineering Health Professions Industrial & Manufacturing Engineering Languange, Linguistic, Communication & Media Law, Crime, Criminology & Criminal Justice Library & Information Science Mathematics Mechanical Engineering Medicine & Pharmacology Nursing Public Health Social Sciences Veterinary Other

Published : 59 Documents Claim Missing Document
Claim Missing Document
Check
Articles

Found 1 Documents
Search
Journal : Scientific Journal of Informatics

 1 
Combining Multiple Text Representations for Improved Automatic Evaluation of Indonesian Essay Answers Wibowo, Moh Edi; Rokhman, Nur; Sihabudin, Agus
Scientific Journal of Informatics Vol. 11 No. 3: August 2024
Publisher : Universitas Negeri Semarang

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.15294/sji.v11i3.9440

Abstract

multiple-choices, regarding students’ learning achievement. When the number of students in a class is huge, however, examinations using essay questions become hard to conduct and take a long evaluation time. Automatic essay evaluation has, therefore, become a potential approach in this situation. Various methods have been proposed, however, optimal solutions for such evaluation in the Indonesian language are less known. Furthermore, with the rapid development of machine learning approaches, in particular deep learning approaches, the investigation of such optimal solutions becomes more necessary. Method: To address the aforementioned issue, this study proposed the investigation of text representation approaches for optimal automatic evaluation of Indonesian essay answers. The investigation compared pre-trained word embedding methods such as Word2vec, GloVe, FastText, and RoBERTa, as well as compared text encoding methods such as long short-term memories (LSTMs) and transformers. LSTMs are able to capture temporal semantics by employing state variables, while transformers are able to capture long-term dependency between parts of their input sequences. Additionally, we investigated classification-based and similarity-based training to build text encoders. We expected that these training approaches allowed encoders to extract different views of information. We compared classification results produced by different text encoders and combinations of text encoders. Result: We evaluated various text representation approaches using the UKARA dataset. Our experiments showed that the FastText word embedding method outperformed the Word2vec, GloVe, and RoBERTa methods. The FastText method achieved an F1-score of 75.43% on validation sets, while the Word2vec, GloVe, and RoBERTa methods achieved F1-scores of 69.56%, 74.53%, and 72.87%, respectively. In addition, the experiments showed that combinations of text encoders outperformed individual encoders. The combination of the LSTM encoder, the transformer encoder, and the TF-IDF encoder obtained an F1-score of 77.22% in the best case, which is better than the best F1-scores of the individual LSTM encoders (75.35%), the best combination of transformer encoders (71.49%), and the individual TF-IDF encoder (76.69%). We observed that LSTM encoders produced better performance when they were built using classification-based training. Meanwhile, the transformer encoders obtained better performance when built using similarity-based training. Novelty: The novelty proposed in this research is the optimal combination of text encoders specifically constructed for the evaluation of essay answers in the Indonesian language. Our experiments showed that the combination of three encoders - namely the LSTM encoder built using classification-based training, the transformer encoder built using classification-based and similarity-based training, and the TF-IDF encoder - obtained the best classification performance.
Co-Authors Abdul Khafid, Abdul Agus Priyadi Agus Priyadi Agus Setiawan Agus Sihabuddin Agustiningrum, Vetriana Ahmad Riyadi Akbar, Muhamat Maulana Akrom, Ahmad Alamsyah, Reka Ali Imron Andleeb, Naima Andreas Heri Kurniawan Angga Eko Pramono Anifudin Azis Anshori, Arif Iman Arga adriansah Arif Sutrisno Bambang Widjanarko Susilo Bayu Aryanto Belo, Teresa Freitas Cahaya Jatmoko Cahyaning, Enggar Kartika Chasandra Puspitasari Choerun Asnawi Choirunnisa, Ayu Rizka Citra Nova Amalia Delinda Dalis Yuliani Dewi, Fadila Ayu Kumala Dewi, Siska Dian Herawati Dini Kharisatul Khabibah Dwi Nugroho Dyah Ari Susanti Edi Sugiarto Edwin Zusrony Eka Sudarusman, Eka Eni Endaryati ENI ENDARYATI Etylusfina, Etylusfina Fangela Myas Sari Fikri Budiman Fitro Nur Hakim Ghulam, Hafiz Grace, Flora Grhasta Dian Perestroika Hakim, Mujibul Hapsari, Luthfia Nurma Heri Hernawan Heru Lestiawan Heryawan, Lukman Indonesia, Dini Kharisatul Khabibah Iqnatius Dimas Nugroho Irda Yunianto Iswantoro, Ibnu Yanuar Jamaludin, Haris Jatmiko, Cahaya Junta Zeniarja Juwita Maharanti Kirana, Kusuma Candra kumalasari subroto, vivi Kurniawan, Andreas Heri Kusuma Chandra Kirana, Kusuma Chandra Kusumajaya, Robby Andika Kusumo, Haryo Laksana, Deddy Award Widya Maharani Maharani, Maharani Maulan, Puteri Anindya Miftah, Mohamad Miftakhur Rohmah, Miftakhur Millatina, Syifa Muinah Fadhilah, Muinah Muljono Muljono Murdayana, Murdayana Murdianingsih, Dian Nining Fitriani Nur Chakiki Ramadiansyah Nur Romdhonah, Fitri Nurgiyantoro, Edi Permata, Aurel Priastyca Praretno Wibowo Prasetio, Diki Bima Purnasari, Eni Puspitasari, Arnetta Aulia Puspitasari, Chasandra Qayyum, Abdul Raden Arief Nugroho Raden Roro Sisilia Sulistiyaningsih rahman, Maftur Rahmawati, Alfiani Diah Rasilah, Rasilah Riski Yunanto Rizka Ariyanti Saidah, Nur Saifudin Zuhri Salsabila, Ika Putri Sari, Fangela Myas Setiawardani, Wawan Sindhu Rakasiwi Siska Dewi Siswanto, Edy Sri Wahyuning Sukemi Kamto Sudibyo Sumaryanto Sumaryanto, Sumaryanto Syamsul Hadi Syarifah Salma Titik Rianawati Valentina Widya Suryaningtyas, Valentina Widya Vintya Meiliana Putri Nugraheni Vivi Kumalasari Vivi Kumalasari, Vivi Wahyono Wenti Ayu Sunarjo Wibowo, Moh Edi Wildan, Muh Khaerul Wiryanta, Wiryanta Wiwid Wahyudi