Article Per Year (5 Year)
p-Index From 2021 - 2026
2.17
P-Index
This Author published in this journals
All Journal Jurnal Master Pariwisata (JUMPA) Jurnal Teknologi Informasi dan Ilmu Komputer ELINVO (Electronics, Informatics, and Vocational Education) Syntax Literate: Jurnal Ilmiah Indonesia Sebatik The IJICS (International Journal of Informatics and Computer Science) Indonesian Journal of Electrical Engineering and Computer Science Journal of Computer Networks, Architecture and High Performance Computing J-Icon : Jurnal Komputer dan Informatika
Sinaga, Arnaldo Marulitua
Institut Teknologi Del, Sumatera Utara, Indonesia
Humanities Computer Science & IT Control & Systems Engineering Decision Sciences, Operations Research & Management Economics, Econometrics & Finance Education Electrical & Electronics Engineering Engineering Environmental Science Industrial & Manufacturing Engineering Law, Crime, Criminology & Criminal Justice Social Sciences Other

Published : 12 Documents Claim Missing Document
Claim Missing Document
Check
Articles

Found 12 Documents
Search

 1   2 
Penerapan Proses User Experience Design dalam Rancang Ulang User Interface Aplikasi Marketplace Rumah Kreatif Toba Sianturi, Riyanthi Angrainy; Siagian, Yuni Yustina; Harianja, Rusdeni; Sinurat, Indah Chris Sarah; Nababan, Cynthia Deborah; Sinaga, Arnaldo Marulitua
Jurnal Teknologi Informasi dan Ilmu Komputer Vol 13 No 2: April 2026
Publisher : Fakultas Ilmu Komputer, Universitas Brawijaya

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.25126/jtiik.132

Abstract

Perkembangan teknologi digital telah mendorong perubahan signifikan dalam pola perdagangan, dari sistem konvensional menuju perdagangan elektronik (e-commerce). Platform e-commerce menjadi sarana strategis bagi UMKM untuk memasarkan produk secara daring. Rumah Kreatif Toba merupakan platform berbasis web dan mobile yang dikembangkan untuk mendukung digitalisasi Usaha Mikro, Kecil dan Menengah (UMKM) di Kabupaten Toba. Hasil evaluasi awal menunjukkan bahwa aplikasi ini belum sepenuhnya optimal pada aspek kemudahan penggunaan dan pengalaman pengguna (user experience), terlihat dari navigasi yang sulit ditemukan, keterbatasan notifikasi, serta alur proses bisnis yang panjang dan kurang terintegrasi. Kendala ini menghambat efektivitas penggunaan aplikasi dan memerlukan perbaikan menyeluruh pada rancangan User Interface. Penelitian ini bertujuan merancang ulang User Interface aplikasi dengan menggunakan pendekatan User Experience Design yang mencakup lima tahapan: user research, analysis, design, production, dan evaluate. Dari keseluruhan proses, tahap user research dan design menjadi bagian paling krusial. Tahap user research mampu mengidentifikasi kebutuhan dan permasalahan secara menyeluruh dari perspektif pengguna maupun ahli. Tahap design menghasilkan rancangan information architecture, user flow, task flow, dan style guide sebagai acuan utama perancangan ulang User Interface. Evaluasi setelah perancangan ulang User Interface menunjukkan bahwa kualitas user experience yang sebelumnya berada pada skor 48,3 (Poor) menjadi 88,6 (Excellent) dengan success rate pengujian mencapai 100%. Prototipe interaktif yang dihasilkan diharapkan dapat menjadi acuan dalam pengembangan sistem lebih lanjut untuk mendukung transformasi digital UMKM secara optimal dan berkelanjutan.   Abstract The growth of digital technology has led to significant changes in commercial practices, shifting from conventional systems to electronic commerce (e-commerce). E-commerce platforms have become a strategic tool for MSMEs to market their products online. Toba Creative Marketplace is a web and mobile-based platform developed to support the digitalization of Micro, Small, and Medium Enterprises (MSMEs) in Toba Regency. Initial evaluation results show that this application is not fully optimized in terms of ease of use and good user experience, as evidenced by difficult navigation, limited notifications, and a long and insufficiently integrated flow of business processes. These obstacles prevent the effective utilization of the application and require comprehensive improvements to the User Interface design. This study aims to redesign the User Interface of the application using a User Experience Design Process approach that includes five stages: user research, analysis, design, production, and evaluation. Of the entire process, the user research and design are the most important stages. The user research stage identifies the needs and problems comprehensively from the perspective of both users and experts. The design stage produces information architecture, user flow, task flow, and style guide designs as the main references for redesigning the User Interface. An evaluation following the User Interface redesign showed that the user experience score improved from 48.3 (Poor) to 88.5 (Excellent), with a 100% test success rate. The interactive prototype developed is expected to serve as a reference for further system development to support the digital transformation of MSMEs optimally and sustainably.
Evaluating LLM-Based Institutional Information Chatbot Responses Using a Preliminary Human-Scored Analytic Rubric and Automatic Metrics Rosni Lumbantoruan; Arnaldo Marulitua Sinaga; Markus Pardianto Hutagalung; Priskila Christine Natalia Parapat; Mutiara Teccalonica Simanjuntak
Elinvo (Electronics, Informatics, and Vocational Education) Vol. 11 No. 1 (2026): May 2026
Publisher : Department of Electronic and Informatic Engineering Education, Faculty of Engineering, UNY

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.21831/elinvo.v11i1.91571

Abstract

Large language models (LLMs) are increasingly used for answering institutional information enquiries in higher education, yet the quality of responses is not straightforward to evaluate, as factual accuracy alone does not account for interactive qualities such as clarity, conversational flow, error handling and personalisation. This pilot study developed, preliminary examined a human-scored analytic rubric for assessing ChatGPT responses in a higher-education institutional-information setting and explored the alignment of selected rubric scores with reference-based automatic metrics. We designed a literature-informed rubric comprising 15 criteria across five conceptual domains. Of these, 14 criteria were operationalised through 42 rubric questions, and system usability was rated separately using the System Usability Scale. Seventy-five qualified students from one higher-education institution rated the chatbot responses using a four-point scale. Preliminary evidence at the item level was provided by item-total correlations and Cronbach’s alpha, while Pearson and Spearman correlations were used to investigate the alignment between human scores and reference-based metrics namely ROUGE-1, ROUGE-2, ROUGE-L and SacreBLEU for four content-oriented criteria. The results showed positive but partial agreement between human ratings and referenced-based metrics, with stronger agreement for clarity and up-to-date response than for accuracy and relevance. These findings suggest that reference-based metrics can complement, but not replace, human evaluation for insitutional information chatbot assessment. The study was confined to one institution and did not incorporate inter-rater reliability, expert validation or factor analysis. Thus, the rubric should be seen as a preliminary evaluation instrument rather than a fully validated scale.
Co-Authors Andre Sitorus Arlinta Barus Felix Oswaldo Siburian Harianja, Rusdeni Hotni Simatupang Hutapea, Mikhael Hutasoit, Dian Ira Putri Julio Panjaitan Kevin J F Pardamaian S Markus Pardianto Hutagalung Mutiara Teccalonica Simanjuntak Nababan, Cynthia Deborah Nainggolan, Wordyka Yehezkiel Priskila Christine Natalia Parapat Riyanthi Angrainy Sianturi Rosni Lumbantoruan Ruth Rilis Tambunan Sandy Sihotang Siagian, Yuni Yustina Sinaga, Ardiles Sinurat, Indah Chris Sarah Sipahutar, Rini Juliana Verawaty Situmorang Verawaty Situmorang Verawaty Situmorang Yohannes Nababan Yohanssen Pratama Yohanssen Pratama Yohanssen Pratama Yohanssen Pratama