Article Per Year (5 Year)
p-Index From 2021 - 2026
5.423
P-Index
This Author published in this journals
All Journal JPMS (Jurnal Pendidikan Matematika dan Sains) INOTEKS : Jurnal Inovasi Ilmu Pengetahuan, Teknologi, dan Seni Pythagoras: Jurnal Matematika dan Pendidikan Matematika Journal on Mathematics Education (JME) Journal on Mathematics Education (JME) Jurnal Riset Pendidikan Matematika AKSIOMA: Jurnal Program Studi Pendidikan Matematika Eduma : Mathematics Education Learning and Teaching Jurnal Mercumatika : Jurnal Penelitian Matematika dan Pendidikan Matematika PEDAGOGIA Jurnal Pengabdian Masyarakat MIPA dan Pendidikan MIPA Journal of Honai Math JTAM (Jurnal Teori dan Aplikasi Matematika) International Journal on Emerging Mathematics Education Beta: Jurnal Tadris Matematika Jurnal Math Educator Nusantara: Wahana Publikasi Karya Tulis Ilmiah di Bidang Pendidikan Matematika JISIP: Jurnal Ilmu Sosial dan Pendidikan Mandalika Mathematics and Educations Journal Journal for Lesson and Learning Studies PROFICIO: Jurnal Pengabdian Masyarakat Kognitif: Jurnal Riset HOTS Pendidikan Matematika Edumatika Jurnal DiMas (Jurnal Pengabdian Kepada Masyarakat) Indonesian Journal Of Educational Research and Review Journal of Mathematics Instruction, Social Research and Opinion Indonesian Journal of Mathematics Education Jurnal Pedagogi Matematika Kreano, Jurnal Matematika Kreatif Inovatif Scientific Journal of Informatics Advance Sustainable Science, Engineering and Technology (ASSET) Jurnal Arsitektur ARCADE Journal on Mathematics Education Jurnal Didaktik Matematika
Wahyu Setyaningrum
Universitas Negeri Yogyakarta
Agriculture, Biological Sciences & Forestry Arts Humanities Chemistry Civil Engineering, Building, Construction & Architecture Computer Science & IT Control & Systems Engineering Decision Sciences, Operations Research & Management Education Electrical & Electronics Engineering Engineering Health Professions Industrial & Manufacturing Engineering Languange, Linguistic, Communication & Media Law, Crime, Criminology & Criminal Justice Library & Information Science Mathematics Medicine & Pharmacology Public Health Social Sciences Other

Published : 59 Documents Claim Missing Document
Claim Missing Document
Check
Articles

Found 1 Documents
Search
Journal : Scientific Journal of Informatics

 1 
Improving Sentiment Analysis with a Context-Aware RoBERTa–BiLSTM and Word2Vec Branch Hardyanto, Wahyu; Aryani, Nila Prasetya; Andestian, Defin; Sugiyanto; Setyaningrum, Wahyu; Mardiansyah, M Fadil; Islam, Muhamad Anbiya Nur; Purwinarko, Aji
Scientific Journal of Informatics Vol. 12 No. 4: November 2025
Publisher : Universitas Negeri Semarang

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.15294/sji.v12i4.35918

Abstract

Purpose: We improve the accuracy of Twitter sentiment analysis with a hybrid model combining Word to Vector (Word2Vec) and the Robustly Optimized BERT Pretraining Approach (RoBERTa). The idea is that Word2Vec is strong for slang/novel vocabulary (distributional semantics), while RoBERTa excels in contextual meaning; combining the two mitigates each other's weaknesses. Methods/Study design/approach: The Sentiment140 dataset contains 1.6 million balanced tweets. The split is stratified; Word2Vec is trained solely on the training data. RoBERTa is pretrained (frozen in the first stage, then fine-tuned with some layers in the second stage). The Word2Vec and RoBERTa vectors are concatenated and processed using Bidirectional Long Short-Term Memory (BiLSTM) with sigmoid activation. Training utilizes TensorFlow and the Adam optimizer, incorporating dropout and early stopping. The decision threshold is optimized during the validation process. The process supports caching and training resumes. Result/Findings: The hybrid model achieved an accuracy of 88.09%, an F1-score of 88.09 %, and an Area Under the Curve (AUC) ≈ 95.19% on the Receiver Operating Characteristic (ROC). No overfitting was observed, and the hybrid model outperformed both single baselines. The confusion matrix and ROC curve corroborate the findings. Novelty/Originality/Value: The novelty lies in the fusion of distributional and contextual representations with resource-efficient fine-tuning. Limitations: Computational requirements and hyperparameter tuning are not yet extensive. Further directions: systematic hyperparameter search and cross-validation across other large sentiment datasets to assess generalization.
Co-Authors Abdullah, Abdul Halim Abdullah, Abdul Halim Abu Yazid Raisal Adi Susanto Aji Purwinarko, Aji Al Gafari, Muhamad Rizky Ali Mahmudi Ali, Mohamad Bilal Ali, Mohamad Bilal Aminuyati Andestian, Defin Aoyama, Kazuhiro Arif Sapta Mandala Ariyadi Wijaya Aryani, Nila Prasetya Atmini Dhoruri Azizah, Nur Lailatul Caturiyati Caturiyati Dita Aldila Krisma Dyah Ayu Puspita Ardani Edward E. Pandelaki, Edward E. Eka Purwanto , Ungsari Rizki Eka Purwanto, Ungsari Rizki Erlyanna Nur Risqi Fabian, Khristin Fadilla Camellia Fanggidae, Janrino Junus Rivaldi Fitriana Yuli Saptaningtyas Franyoto, Yuvianti Dwi Gunawan Gunawan Guntur, Muhamad Ikhsan Sahal Habibie, Akmal Hibban Habibullah, Habibullah Hakim, Nur Akmalul Hakim, Titi Adriani Handayawati, Ponco Heri Retnawati Hery Murtianto, Yanuar Hidayati, Diah Nur Himmawati Puji Lestari I Bagiana Ika Puspitaningrum Ilham Rizkianto Inggri Ramadhani Widigda Irdatul Fitri Islam, Muhamad Anbiya Nur Jailani Jailani Kana Hidayati Kazuhiro Aoyama Koes Sundoro , Aries Koes Sundoro, Aries Kusmita , Lia Loviga Denny Pratama Loviga Denny Pratama Loviga Denny Pratama Lubis, Shelly Lusyana, Evvy Maharani, Ika Dewi Fitria Mahmudah, Faisa Nirbita Mami Hastuti Mardiansyah, M Fadil Maria Ulfah Marsigit Marsigit Marsigit Mayang Purbaningrum Meilina, Dika Dwi Melda Datu Kalu Mohamad Bilal Ali Muhammad Faisal Muhammad Fauzan Mutmainah Mutmainah Myelnawan Myelnawan Nanny Setiawati Hadirahardja, Maria Caecilia Nasution, Sela Lufita Salim Nauqi Aprilia Putri Noordin, Muhamad Kahir bin Nur Hadi Waryanto Nur Insani Nurhikmah Widi Asriani Pangestu, Saka Aji Pastoriko, Fransiskus Magnis Pratama, Loviga Denny Pratama, Loviga Denny Pulungan, Delyanti Azzumarito Purwoko, Agus Ramadhan, Sahrul Rastuti, Musafir Ratri Murdy Andari Raudya Thauzahra Rhomiy Handican Rohmah, Riska Nur RR Rianto, Vivi Sahrul Ramadhan Salsabila, Nilza Humaira Saragih, Novilda Angela Septianisha, Nurul Indah Sintia Wulandari Siti Munisih Sri Suryaningtyas Sugiman Sugiman Sugiman Sugiman Sugiman SUGIYANTO Suprapti, Atik - Syukrul Hamdi Tuharto, Tuharto Utami, Nopi Tri Wahyu Hardyanto Yanuarita, Heylen Amildha Ying, Chiang Yi Yosafat Ardian Kristiarta