Article Per Year (5 Year)
p-Index From 2021 - 2026
4.777
P-Index
This Author published in this journals
All Journal Sainteks Transmisi: Jurnal Ilmiah Teknik Elektro JURNAL SISTEM INFORMASI BISNIS Jurnal Pseudocode Sistemasi: Jurnal Sistem Informasi Jurnal Pengabdian UntukMu NegeRI SISFOTENIKA Network Engineering Research Operation [NERO] INOVTEK Polbeng - Seri Informatika Conference SENATIK STT Adisutjipto Yogyakarta Jurnal Teknologi Informasi MURA CYBERNETICS Jurnal Nasional Pendidikan Teknik Informatika (JANAPATI) Building of Informatics, Technology and Science International Journal of Informatics and Computation JATI (Jurnal Mahasiswa Teknik Informatika) Dharma Raflesia : Jurnal Ilmiah Pengembangan dan Penerapan IPTEKS Jurnal Riset Sistem Informasi dan Teknologi Informasi (JURSISTEKNI) Aiti: Jurnal Teknologi Informasi Information System Journal (INFOS) Melek IT: Information Technology Journal Ilmu Komputer untuk Masyarakat Jurnal Informatika Teknologi dan Sains (Jinteks) PELS (Procedia of Engineering and Life Science) Digital Transformation Technology (Digitech) International Journal of Health Science and Technology Jurnal Teknologi Informasi Mura NERO (Networking Engineering Research Operation)
Tikaridha Hardiani
Universitas Aisyiyah Yogyakarta
Religion Aerospace Engineering Agriculture, Biological Sciences & Forestry Humanities Computer Science & IT Control & Systems Engineering Decision Sciences, Operations Research & Management Economics, Econometrics & Finance Education Electrical & Electronics Engineering Engineering Health Professions Industrial & Manufacturing Engineering Law, Crime, Criminology & Criminal Justice Library & Information Science Mechanical Engineering Medicine & Pharmacology Nursing Public Health Social Sciences Other

Published : 41 Documents Claim Missing Document
Claim Missing Document
Check
Articles

Found 41 Documents
Search

 1   2   3   4   5 
SAST Implementation for Evaluating LLM-Generated Code Quality using Prompt Engineering Muhammad Luthfi Abdillah; Tikaridha Hardiani
Sistemasi: Jurnal Sistem Informasi Vol 15, No 5 (2026): Sistemasi: Jurnal Sistem Informasi
Publisher : Program Studi Sistem Informasi Fakultas Teknik dan Ilmu Komputer

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.32520/stmsi.v15i5.6395

Abstract

The use of Large Language Models (LLMs) for generating programming code has become increasingly widespread; however, the quality of the generated output heavily depends on the instructions or prompts provided. This study aims to evaluate the influence of prompt engineering techniques on the quality of non-functional code generated by LLMs. The research employed a quantitative experimental approach involving five Python game development tasks using four prompt variations: zero-shot, few-shot, chain-of-thought, and role-based prompting. A total of 200 code snippets were analyzed using Static Application Security Testing (SAST) with the DeepSource tool to detect issues across seven categories: secrets, bug risk, anti-pattern, security, performance, style, and documentation. The results indicate that few-shot prompting produced the lowest total number of issues overall (1,328 out of 6,932 issues), demonstrating particular advantages in the anti-pattern and performance categories. However, this technique also recorded a higher number of critical issues (3 issues) compared to zero-shot and role-based prompting (1 issue each), indicating a trade-off between the overall volume of issues and the severity of certain issues. Role-based prompting generated the highest number of issues (2,516 issues), particularly in the style and documentation categories. This study recommends few-shot prompting as a foundational approach for AI-assisted software development and highlights the importance of integrating SAST into CI/CD pipelines to ensure code security and quality.
Co-Authors Adam, Nurul Tazkiyah Agil Setyo Prasandi Amalia Nur Afifah Choiruddin, Choiruddin Edowardo, Muhamad Irfan Eka Noviani, Nor Firdonsyah, Arizona Gunawan Ediyasanto, Rahmat Indah, Mahrunisa Izdiana, Alvi Zumaela Lutfandita Landistyas Maskhuri, Alip Mita Permatasari, Mita Muhammad Ircham Maulana Muhammad Luthfi Abdillah Nurrohman, Muhammad Yusuf Nurul Latifah Priyatno, Fadhil Alif Putri Silmina, Esi Putri, Regina Noviyanti Rudy Hartanto Sadr Lufti Mufreni Salsyabila Vidia Nur Afni Selo Sulistyo, Selo Silmina, Esi Putri Silmina, Esi Putri Sodik Habibulloh, Akmal Sri Lestari Linawati Wahyu Fajri Wijayanto, Danur Zahra Arwananing Tyas