Claim Missing Document
Check
Articles

Pemanfaatan Deep Convolutional Auto-encoder untuk Mitigasi Serangan Adversarial Attack pada Citra Digital Putu Widiarsa Kurniawan S; Yosi Kristian; Joan Santoso
J-INTECH ( Journal of Information and Technology) Vol 11 No 1 (2023): J-Intech : Journal of Information and Technology
Publisher : LPPM STIKI MALANG

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.32664/j-intech.v11i1.845

Abstract

Adversarial attacks on digital images pose a serious threat to the utilization of machine learning technology in various real-life applications. The Fast Gradient Sign Method (FGSM) technique has proven to be effective in conducting attacks on machine learning models, including digital images found in the ImageNet dataset. This research aims to address this issue by utilizing the Deep Convolutional Auto-encoder (AE) technique as a method for mitigating adversarial attacks on digital images.The results of the study demonstrate that FGSM attacks can be performed on the majority of digital images, although there are certain images that are more resilient to such attacks. Furthermore, the AE mitigation technique proves to be effective in reducing the impact of adversarial attacks on most digital images. The accuracy of the attack and mitigation models is measured at 14.58% and 91.67%, respectively.
Evaluating User Experience of a Virtual Reality-Based Adaptive Learning Application on Chemical Compound Structures for High School Students Esther Irawati Setiawan; Mohammad Farid Machfudin; Daniel Gamaliel Saputra; Joan Santoso; Gunawan Gunawan; Samuel Budi Wardhana Kusuma
International Journal of Engineering, Science and Information Technology Vol 5, No 4 (2025)
Publisher : Malikussaleh University, Aceh, Indonesia

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.52088/ijesty.v5i4.1445

Abstract

Recognizing the significant spatial visualization challenges that high school students face in understanding abstract chemical compound structures—a limitation often inherent in conventional teaching methods based on 2D diagrams—this research presents the comprehensive development and user experience (UX) evaluation of an innovative adaptive learning application in Virtual Reality (VR). The application, developed using the Unity 3D engine and configured via XR Plugin Management to ensure broad hardware compatibility, places students in an interactive virtual laboratory. Within it, students can directly manipulate meticulously designed 3D atomic models to build molecules, observe the formation of covalent and ionic bonds, and interact with dynamic chemical processes. Its key innovation is the integration of an intelligent adaptive learning algorithm, which utilizes a Firebase cloud database to analyze user performance metrics—such as accuracy, completion time, and recurring areas of difficulty. Based on this data, the system dynamically personalizes learning pathways by recommending remedial content or more challenging topics. Furthermore, assessment materials such as quizzes were efficiently generated using large language models (LLMs) to ensure relevance and quality. An in-depth UX evaluation was conducted with high school students using a mixed-methods approach, combining standardized questionnaires to quantitatively measure metrics like usability, engagement, and satisfaction, with qualitative feedback sessions for contextual insights. The results indicate a highly positive user experience; participants reported that the ability to directly manipulate molecules in 3D space significantly enhanced their conceptual understanding, bridging the gap between theory and visualization. The adaptive system was highly valued for its ability to adjust to individual learning paces, which was shown to boost confidence and reduce frustration. This research provides strong evidence that VR-based adaptive learning platforms are powerful pedagogical tools, capable of transforming chemistry education by making complex scientific concepts more accessible, engaging, and comprehensible.
Large Language Models for JSON-Based Function Call Planning from Indonesian Natural Language: A Restaurant Search Chatbot Case Study Mohammad Mauludin; Joan Santoso; Hartarto Junaedi
SMATIKA JURNAL : STIKI Informatika Jurnal Vol 16 No 01 (2026): SMATIKA Jurnal : STIKI Informatika Jurnal
Publisher : LPPM Universitas Bhinneka Nusantara

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.32664/smatika.v16i01.2216

Abstract

Large Language Models are increasingly adopted as planning components that translate natural language into structured representations for tool invocation, enabling executable interaction with backend systems through JSON based function calling. However, empirical studies focusing on Indonesian natural language remain limited. This paper presents a restaurant search chatbot case study that investigates JSON based function call planning from Indonesian user queries, with emphasis on the upstream planning task rather than conversational response generation. A synthetic dataset of 33,470 Indonesian restaurant search queries paired with ground truth JSON plans was constructed based on a predefined tool set and database schema. Supervised fine tuning with parameter efficient adaptation was applied to a pretrained language model. The fine tuned Mistral 7B model was evaluated using multiple metrics measuring JSON structural validity, tool sequence correctness, and parameter accuracy at different granularities. The results show strong performance, achieving a JSON structure validity rate of 0.97, tool sequence exact match accuracy of 0.92, column level accuracy of 0.97, and value level accuracy of 0.94. More stringent evaluation at the session level reveals remaining challenges in composing all parameters correctly within a single planning instance. Overall, the findings demonstrate that with carefully designed datasets and strict supervision, Large Language Models can reliably perform structured JSON based function call planning from Indonesian natural language, providing a practical foundation for extending this approach to other structured application domains where execution correctness is critical.
Digit Classification of Majapahit Relic Inscriptionusing GLCM-SVM Septianto, Tri; Setyati, Endang; Santoso, Joan
Knowledge Engineering and Data Science
Publisher : citeus

Show Abstract | Download Original | Original Source | Check in Google Scholar

Abstract

A higher level of image processing usually contains some kind of classification or recognition. Digit classification is an important subfield in handwritten recognition.Handwritten digits are characterized by large variations so template matching, in general, is inefficient and low in accuracy. In this paper, we propose the classification of the digit of the year of a relic inscription in the Kingdom of Majapahit using Support Vector Machine (SVM). This method is able to cope with very large feature dimensions and without reducing existing features extraction. While the method used for feature extraction using the Gray-Level Co-Occurrence Matrix (GLCM), special for texture analysis. This experiment is divided into 10 classification class, namely: class 1, 2, 3, 4, 5, 6, 7, 8, 9, and class 0. Each class is tested with 10 data so that the whole data testing are 100 data number year. The use of GLCM and SVM methods have obtained an average of classification results about 77 %.
Indonesian Sentence Boundary Detection using Deep Learning Approaches Santoso, Joan; Setiawan, Esther Irawati; Purwanto, Christian Nathaniel; Kurniawan, Fachrul
Knowledge Engineering and Data Science
Publisher : citeus

Show Abstract | Download Original | Original Source | Check in Google Scholar

Abstract

Detecting the sentence boundary is one of the crucial pre-processing steps in natural language processing. It can define the boundary of a sentence since the border between a sentence, and another sentence might be ambiguous. Because there are multiple separators and dynamic sentence patterns, using a full stop at the end of a sentence is sometimes inappropriate. This research uses a deep learning approach to split each sentence from an Indonesian news document. Hence, there is no need to define any handcrafted features or rules. In Part of Speech Tagging and Named Entity Recognition, we use sequence labeling to determine sentence boundaries. Two labels will be used, namely O as a non-boundary token and E as the last token marker in the sentence. To do this, we used the Bi-LSTM approach, which has been widely used in sequence labeling. We have proved that our approach works for Indonesian text using pre-trained embedding in Indonesian, as in previous studies. This study achieved an F1-Score value of 98.49 percent. When compared to previous studies, the achieved performance represents a significant increase in outcomes.
Indonesian Language Term Extraction using Multi-Task Neural Network Santoso, Joan; Setiawan, Esther Irawati; Ferdinandus, Fransiskus Xaverius; Gunawan, Gunawan; Collantes, Leonel Hernandez
Knowledge Engineering and Data Science
Publisher : citeus

Show Abstract | Download Original | Original Source | Check in Google Scholar

Abstract

The rapidly expanding size of data makes it difficult to extricate information and store it as computerized knowledge. Relation extraction and term extraction play a crucial role in resolving this issue. Automatically finding a concealed relationship between terms that appear in the text can help people build computer-based knowledge more quickly. Term extraction is required as one of the components because identifying terms that play a significant role in the text is the essential step before determining their relationship. We propose an end-to-end system capable of extracting terms from text to address this Indonesian language issue. Our method combines two multilayer perceptron neural networks to perform Part-of-Speech (PoS) labeling and Noun Phrase Chunking. Our models were trained as a joint model to solve this problem. Our proposed method, with an f-score of 86.80%, can be considered a state-of-the-art algorithm for performing term extraction in the Indonesian Language using noun phrase chunking.
Timbre Style Transfer for Musical Instruments Acoustic Guitar and Piano using the Generator-Discriminator Model Nagari, Widean; Santoso, Joan; Setiawan, Esther Irawati
Knowledge Engineering and Data Science
Publisher : citeus

Show Abstract | Download Original | Original Source | Check in Google Scholar

Abstract

Music style transfer is a technique for creating new music by combining the input song's content and the target song's style to have a sound that humans can enjoy. This research is related to timbre style transfer, a branch of music style transfer that focuses on using the generator-discriminator model. This exciting method has been used in various studies in the music style transfer domain to train a machine learning model to change the sound of instruments in a song with the sound of instruments from other songs. This work focuses on finding the best layer configuration in the generator- discriminator model for the timbre style transfer task. The dataset used for this research is the MAESTRO dataset. The metrics used in the testing phase are Contrastive Loss, Mean Squared Error, and Perceptual Evaluation of Speech Quality. Based on the results of the trials, it was concluded that the best model in this research was the model trained using column vectors from the mel-spectrogram. Some hyperparameters suitable in the training process are a learning rate 0.0005, batch size greater than or equal to 64, and dropout with a value of 0.1. The results of the ablation study show that the best layer configuration consists of 2 Bi-LSTM layers, 1 Attention layer, and 2 Dense layers.
Cross Platform Waste Reuse, Reduce And Recycle Management Application With Prototyping Methodology Esther Irawati Setiawan; Patrick Hartono; Tong Nam Tuan Vu; Kevin Jonathan Halim; F. X. Ferdinandus; Joan Santoso
Applied Information System and Management (AISM) Vol. 7 No. 1 (2024): Applied Information System and Management (AISM)
Publisher : Depart. of Information Systems, FST, UIN Syarif Hidayatullah Jakarta

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.15408/aism.v7i1.37230

Abstract

The use of plastic bags by the public as containers for shopping goods is very high. People often throw away plastic waste carelessly, causing pollution everywhere. The biggest problem with the lack of recycling action lies in the lack of public awareness of the importance of implementing 3R (Reduce, Reuse, Recycle). People are less motivated to do 3R, one of which is because there are no rewards after doing 3R. This research develops an application provides rewards to the community for using Eco-Green Bags as an alternative to plastic bags. This research application has a system that makes it easier for people to carry out 3R. This proposed framework application uses the React Native framework for creating mobile apps and Next.JS for creating admin websites and APIs. With the React Native framework, application performance will be faster and smoother for users. The Next.JS framework allows developers to have a very clear project structure, because Next.JS uses file-based routing. With this research, it is hoped that people can be even more motivated to carry out 3R. The community can participate easily in implementing 3R without any coercion but through the community's own initiative. In this way, the application can be a real supporter of society in implementing 3R and avoiding the use of plastic bags which are also contributors to environmental pollution.
Co-Authors Aditya Dwi Aryanto Adriel Ferdianto Afandi, Acxel Derian Agung Dewa Bagus Soetiono Ahdan, Syabith Umar Ahmad Syaifuddin Ali Djamhuri Ananta Tio Putra Andik Jatmiko Anita Guterres Budi Irawan Cahyadi, Billy Kelvianto Chandra, Francisca H. Christian Nathaniel Purwanto Collantes, Leonel Hernandez Daniel Gamaliel Saputra Devi Dwi Purwanto Dewi, Nindian Puspa Dipa, Sasra Edwin Pramana Eka Rahayu Setyaningsih Eko Mulyanto Yuniarno Elizabeth Shirley, Stephanie Endang Setyati Esther Irawati S. Esther Irawati Setiawan Eunike Kardinata F. X. Ferdinandus F.X. Ferdinandus Fachrul Kurniawan Fachrul Kurniawan Febriantoro, Erfan Ferdinandus, Fransiskus Xaverius Francisca Chandra Fujisawa, Kimiya Gunawan Gunawan Gunawan Gunawan Gunawan Gunawan Hans Juwiantho Hans Keven Budi Prakoso Harianto, Reddy Alexandro Hartarto Junaedi Hendrawan Armanto Heppi Siswanto Herman Budianto Imron, Syaiful Indra Maryati Irawati Setiawan, Esther Jatmiko, Andik Kevin Jonathan Halim Kristian Indradiarta Gunawan Kristina, Natalia Kurniawan S, Putu Widiarsa Langgeng, Yudo Sembodo Hastoro Leonel Hernandez Lim, Ernest Luhfita Tirta Lukman Zaman Mauridhi Hery Purnomo Mochamad Hariadi Mohammad Farid Machfudin Mohammad Mauludin Muhammad Amfahtori Wijarnoko Mustaqin, Farhan Faisal Zainul Nagari, Widean Nindian Puspa Dewi Ong, Hansel Santoso Patrick Hartono Purwanto, Christian Nathaniel Putra, Bayu Anggara Putu Widiarsa Kurniawan S Rossy P. C. Rully Widiastutik Samuel Budi Wardhana Kusuma Saputra, Daniel Gamaliel Setiawan, Esther Setya Ardhi Soetiono, Agung Dewa Bagus Stefanie Hilda Kusumahadi Surya Sumpeno Sutanto, Patrick Sutanto, Ricky Syaiful Huda Syaiful Imron Tjendika, Patrick Tjwanda Putera Gunawan Tong Nam Tuan Vu Tri Septianto Tuesday saka gustaf Ubaidi Ubaidi Ubaidi, Ubaidi Vania, Stella Wardoyo, Nikko Riestian Putra Yosi Kristian