Article Per Year (5 Year)
p-Index From 2021 - 2026
0.408
P-Index
This Author published in this journals
All Journal Jurnal Sains Sistem Informasi Technologia Journal
Annisa Fathia Aziza
Universitas Islam Kalimantan Muhammad Arsyad Al Banjari
Computer Science & IT

Published : 2 Documents Claim Missing Document
Claim Missing Document
Check
Articles

Found 2 Documents
Search

 1 
Klasifikasi Sentimen Ulasan Produk Tokopedia Menggunakan SVM dan Random Forest dengan Strategi Eliminasi Label Ambigu Berbasis Binary Classification Aziza, Annisa Fathia; Noor, Hayati
Jurnal Sains Sistem Informasi Vol 4, No 2 (2026): JSSI (Mei)
Publisher : Universitas Islam Kalimantan Muhammad Arsyad Al Banjari

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.31602/jssi.v4i2.23714

Abstract

@font-face {font-family:"Cambria Math"; panose-1:2 4 5 3 5 4 6 3 2 4; mso-font-charset:0; mso-generic-font-family:roman; mso-font-pitch:variable; mso-font-signature:-536870145 1107305727 0 0 415 0;}p.MsoNormal, li.MsoNormal, div.MsoNormal {mso-style-unhide:no; mso-style-qformat:yes; mso-style-parent:""; margin:0cm; mso-pagination:widow-orphan; font-size:11.0pt; font-family:"Times New Roman",serif; mso-fareast-font-family:"Times New Roman";}.MsoChpDefault {mso-style-type:export-only; mso-default-props:yes; font-size:11.0pt; mso-ansi-font-size:11.0pt; mso-bidi-font-size:11.0pt; mso-font-kerning:0pt; mso-ligatures:none;}div.WordSection1 {page:WordSection1;} Analisis sentimen ulasan produk e-commerce merupakan teknik penting untuk memahami opini konsumen secara otomatis. Penelitian ini membandingkan performa algoritma Support Vector Machine (SVM) dengan kernel Linear dan Random Forest (RF) dalam mengklasifikasikan sentimen ulasan produk Tokopedia ke dalam dua kelas: Positif dan Negatif. Dataset yang digunakan adalah Tokopedia Product Reviews dari Kaggle (farhan999) yang terdiri dari 40.607 ulasan. Penelitian ini mengusulkan strategi labeling berbasis binary classification dengan membuang ulasan rating 3 bintang yang secara linguistik ambigu, sehingga tersisa 976 dokumen valid dari subsample seimbang 500 per kelas. Representasi teks menggunakan TF-IDF dengan 300 fitur (unigram dan bigram, min_df=1). Optimasi hyperparameter dilakukan dengan GridSearchCV 5-Fold dan validasi akhir menggunakan 10-Fold Stratified Cross-Validation. Hasil menunjukkan SVM dengan parameter C=0,1 menghasilkan akurasi 86,73%, precision 86,75%, recall 86,73%, dan F1-score 86,73%, mengungguli Random Forest yang memperoleh akurasi 80,10%. Penelitian ini membuktikan bahwa eliminasi label ambigu (rating 3 bintang) meningkatkan akurasi secara signifikan sebesar 28,57 poin persentase dibandingkan pendekatan 3 kelas sebelumnya.
Evaluation of Deep Learning for Source Code Vulnerability Detection Based on Vulnerability Detection Score Muhammad Amin; Muhammad Rais Wathani; Annisa Fathia Aziza
Technologia Journal Vol. 3 No. 3 (2026): Technologia Journal-August
Publisher : Pt. Anagata Sembagi Education

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.62872/xcnyy434

Abstract

Source code vulnerabilities pose a serious threat to software development, with reported Common Vulnerabilities and Exposures exceeding 25,000 entries per year, making manual inspection unscalable. This study aims to evaluate and compare four deep learning architectures for automated source code vulnerability detection: Convolutional Neural Network, Bidirectional Long Short-Term Memory, CodeBERT, and GraphCodeBERT, and to measure CodeBERT's ability to classify eight types of Common Weakness Enumeration. The research method uses a quantitative experimental approach with 43,164 C and C++ functions derived from the combined BigVul and CVEfixes datasets. The data were processed through comment cleaning, MD5 hash-based deduplication to prevent data leakage, and class balancing with a one-to-three ratio. The datasets were then divided into training, validation, and test datasets. In addition to conventional metrics such as accuracy, precision, recall, F1-score, and AUC-ROC, this study applies a Vulnerability Detection Score, which measures the proportion of missed vulnerabilities at a false positive rate below zero point five percent. The results showed that CodeBERT achieved the best performance with an F1-score of 0.702, an AUC-ROC of 0.896, and a Vulnerability Detection Score of 0.857, outperforming the baseline model, which only achieved an F1-score of around 0.64. However, all models recorded high Vulnerability Detection Scores in the range of 0.857 to 0.906, meaning that approximately 86 percent of vulnerabilities were still missed under realistic operating conditions. The eight-class Common Weakness Enumeration classification only achieved a macro-F1 of 0.28. This study concluded that conventional metrics tend to overestimate the model's readiness for real-world deployment.
Co-Authors Hayati Noor Muhammad Amin Muhammad Rais Wathani