Article Per Year (5 Year)
p-Index From 2021 - 2026
3.981
P-Index
This Author published in this journals
All Journal Jurnal SPEKTRUM PIKSEL : Penelitian Ilmu Komputer Sistem Embedded and Logic Jurnal Ilmiah Kursor JOIV : International Journal on Informatics Visualization Matrix : Jurnal Manajemen Teknologi dan Informatika Jurnal Teknoinfo Jurnal Teknik Industri Terintegrasi (JUTIN) VISA: Journal of Vision and Ideas Ulil Albab Majalah Ilmiah Teknologi Elektro
Widyadi Setiawan
Universitas Udayana
Religion Humanities Civil Engineering, Building, Construction & Architecture Computer Science & IT Control & Systems Engineering Decision Sciences, Operations Research & Management Economics, Econometrics & Finance Education Electrical & Electronics Engineering Energy Engineering Environmental Science Industrial & Manufacturing Engineering Languange, Linguistic, Communication & Media Mechanical Engineering Public Health Social Sciences

Published : 41 Documents Claim Missing Document
Claim Missing Document
Check
Articles

Found 41 Documents
Search

 1   2   3   4   5 
Pemanfaatan Local Large Language Model dalam Software Effort Estimation Menggunakan Metode LOOCV Diyan Sueka Buana Putra; Dewa Made Wiharta; Widyadi Setiawan; Ida Bagus Gede Manuaba
Majalah Ilmiah Teknologi Elektro Vol 25 No 1 (2026): (Januari - Juni) Majalah Ilmiah Teknologi Elektro
Publisher : Study Program of Magister Electrical Engineering

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.24843/MITE.2026.v25.01.p13

Abstract

 Software Effort Estimation (SEE) in the early stages of a project is generally confronted with minimal technical specifications and high ambiguity in requirement documents. Large Language Models (LLMs) offer the potential to automate information extraction from unstructured natural language text. This exploratory study evaluates the standalone performance of a local LLM (Phi-3 Mini architecture) in predicting man-days effort using a within-company historical dataset from a local digital agency. The experiment was conducted using the Leave-One-Out Cross-Validation (LOOCV) method to ensure objective evaluation within a limited data population. Model optimization utilized Chain-of-Thought (CoT) prompt engineering combined with a methodological strategy of few-shot selection based on boundary distribution (Min, Median, Max) to serve as cognitive anchors. Qualitative analysis proves that the LLM possesses high semantic intelligence in evaluating relative project complexity. However, quantitative evaluation using MMRE, PRED(25), and Coefficient of Determination (R-squared) indicates fundamental limitations in standalone mathematical regression. The model achieved an MMRE of 0.6963 and a PRED(25) of 0.25, performing below the Mean Baseline (MMRE 0.44) with a negative R-squared of -2.038. These results confirm that while LLMs are proficient in understanding context, they struggle with precise numerical interpolation. Consequently, this study recommends a hybrid estimation framework for future research, positioning the LLM purely as a qualitative feature extractor for conventional Machine Learning algorithms to produce robust and precise estimation accuracy.
Co-Authors A.A Ngurah Amrita Alfian Hadianto Antonius Ibi Weking Ardiansiah Ardiansiah Axel Adamma Diwanda Azra Ariel Azmir Bagus D. Cahyono Desi Ramayanti Dewa Gede Satria Bayu Putra Dewa Made Wiharta Dewa Ngakan Made Barel Diyan Sueka Buana Putra Dove Gandaria, Aaron Gerry Ian Duman Care Khrisne Dyana Arjana, I Gd. E. Duta Nugraha, I Putu Gede Sastra Utara Gede Sukadarmika Hilmy Jawas I Dewa Gde Bayu Wiranatha I Dewa Gede Aditya Pemayun I Dewa Gede Angga Prastika I G. A. K. Diafari Djuni Hartawan I Gede Dyana Arjana I Gede Dyana Arjana, I Gede I Gede Wiyoga Putra I Gusti Agung Adhi Waskita I Gusti Agung Komang Diafari Djuni Hartawan I Gusti Made Andi Dipayana I Ketut Ariek Astana Adi I Made Arsa Suyadnya I Made Martina Edi Putra I Made Oka Widyantara I N Satya Kumara I Nyoman Budiastra I Nyoman Setiawan I Putu E. Duta Nugraha I Putu Gde Raditya Wikadhyana I Putu Gede Krsna Yudha Dharma I Putu Hardy Sarjana I Putu Weda Suryawan I Wayan Darma Satika Ida Ayu Putu Intania Paramitha1 Ida Bagus A. Swamardika Ida Bagus Gede Manuaba Issabelle M. Merry Jaime Luis da Costa Kevin Philip Khrisne , Duman Care Komang Oka Saputra Komang Rio Adi Prasetya Limbong, Patrick Andreas Linawati Linawati M. Merry, Issabelle Made R. D. Prabawa Maharta Pemayun, A.A Gd. Maria Gusti Agung Ayu Permata Michael Angelo Vincensio Simon Muhamad Sony Pratama Ngurah Indra ER Ni Kadek Diah Parwati Ni Made Ary Esta Dewi Wirastuti Ni Putu Dina Rahmawati Ni Wayan Ernawati Novadianto Yudha Irawan Nyoman Putra Sastra Oktafiana Susanti, Baiq Dwinda Padwita Darma, I Made Angga Pande Ketut Sudiarta, Pande Ketut Patrick Andreas Limbong Pawana, I Wayan Adi Juliawan Permata Sari, Indah Ayu Philip, Kevin R. D. Prabawa, Made Ramadhan, Ahmad Ersam Nur Rendi Gustina Riawanto Tambun Robbani Punggawa Arcapada Rukmi Sari Hartati Satriya Utama Sri Andriani Asri Sri Andriati Asri Sri Andriati Asri Sri Andriati Asri Sri Andriati Asri Sri Andriati Asri, Sri Andriati Sri Dianing Asri Sungkono, Gilberth Tjok Gede Indra Partha Vina Yuliani, Ni Putu Willy Sucipto Willy Susanto