Claim Missing Document
Check
Articles

Found 1 Documents
Search
Journal : Kinetik: Game Technology, Information System, Computer Network, Computing, Electronics, and Control

Evaluation of Stratified K-Fold Cross Validation for Predicting Bug Severity in Game Review Classification Mayangsari, Mustika Kurnia; Syarif, Iwan; Barakbah, Aliridho
Kinetik: Game Technology, Information System, Computer Network, Computing, Electronics, and Control Vol. 8, No. 3, August 2023
Publisher : Universitas Muhammadiyah Malang

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.22219/kinetik.v8i3.1740

Abstract

Steam review data provides a lot of information for the game development team, either positive or negative reviews. It is essential as negative and positive reviews provide crucial information, and 7% of positive reviews contains bug reports. These bug reports were captured after the game was released, and many reports of common problems still exist. If players found an issue in the game, they could report it directly through the review feature provided by the online game platform. However, it took a long time for the development team to manually analyze and classify the reviews. This study proposed a new approach to automatically classify the reviews on Steam based on the bug severity level. Therefore, to solve this problem, we recommend a solution based on the research background indicated above. For this experiment, we analyzed reviews on two popular game titles namely, FIFA 23 and Apex Legends. We implemented three different classifiers, namely KNN, Decision Tree, and Naïve Bayes, which would be used to train a dataset to classify the bug severity level. Due to the imbalanced dataset, we performed cross-validation to reduce bias in the dataset.  Performance in this model would be evaluated using accuracy rate, precision, recall, and F1 score. As a result, the experiment showed that game reviews of different game titles achieved different accuracy scores. The game review classification for FIFA 23 performed better than the game review classification for Apex Legends. The mean accuracy score of FIFA 23 was 72% with Decision Tree and Apex Legend was 64% with KNN.
Co-Authors A.A. Ketut Agung Cahyawan W Abd. Rasyid Syamsuri Achmad Basuki Achmad Basuki Achmad Basuki Achmad Basuki Achmad Basuki Aditya Afgan Hermawan Adnan Rachmat Anom Besari Afifah, Izza Nur Afrida Helen Afrida Helen Afrida Helen, Afrida Agata, Dias Agus Kurniasari, Arvita Ahsan, Ahmad Syauqi Al Islami, M Tafaquh Fiddin Alde, Muhammad Riski Alfi Fadliana Amali, Darari Nur Amalia Wirdatul Hidayah Amalo, Elizabeth Anggraeni Amang Sudarsono, Amang Andhik Ampuh Yunanto Andy Yuniawan ANITA DAMAYANTI Anom Besari, Adnan Rachmat Arna Fariza Arvita Agus Kurniasari Arvita Agus Kurniasari Aziz, Adam Shidqul Bayu Dwiyan Satria Bima Sena Bayu Dewantara Budi Santosa Dadet Pramadihanto Dadet Pramadihanto Darari Nur Amali Desi Amirullah, Desi Desy Intan Permatasari, Desy Intan Devira Nanda Kuswhara Devira Nanda Kuswhara, Devira Nanda Dewanto, Raden Sanggar Dias Agata Edelani, Renovita Edi Satriyanto Edi Wahyu Widodo Entin Martiana Kusumaningtyas Fahrudin, Tresna Maulana Fauzi Nafi'Ubadah, Kriza Febrianto, Ardiansyah Indra Ferry Astika S Ferry Astika Saputra Galih Hendra Wibowo Haikal Yuniarta Krisgianto, Ricko Hamida, Silfiana Nur Hermawan, Aditya Afgan Hidayah, Amalia Wirdatul Hidayah, Nadila Wirdatul Hisyam, Masfu Huda, Achmad Thorikul I Made Akira Ivandio Agusta Idris Winarno Idris Winarno Ilham Iskandariansyah Indah Yulia Prafitaning Tiyas Indah Yulia Prafitaning Tiyas, Indah Yulia Prafitaning Indra Adji Sulistijono Insani, Fawzan Irene Erlyn Wina Rachmawan Irene Erlyn Wina Rachmawan Irene Erlyn Wina Rachmawan, Irene Erlyn Wina Irsal Shabirin Isbat Uzzin Nadhori, Isbat Uzzin Iwan Syarif iwan Syarif Kindarya, Fabyan Kohei Arai Kohei Arai Kohei Arai Kurniasari, Arvita Agus Kusuma, Dedy Hidayat Kusuma, Selvia Ferdiana Louis Nashih Uluwan Arif M Udin Harun Al Rasyid, M Udin Harun Mahardhika, Yesta Medya Marlisa Sigita Marlisa Sigita, Marlisa Masfu Hisyam Maulana, Wahyu Ikbal Mayangsari, Mustika Kurnia Mirza Ghulam Rifqi Mirza Ghulam Rifqi Mohammad Nur Shodiq Mohammad Nur Shodiq Mohammad Nur Shodiq Mohammad Nur Shodiq, Mohammad Nur Mu'arifin, Mu'arifin Muarifin . Muarifin ., Muarifin Muarifin Muarifin Muh Subhan Muhammad Alfian Muhammad Rois Muhammad Wahyu Nugroho Sakti Nadila Wirdatul Hidayah Nana Ramadijanti, Nana Ni'Ma, Najma Akmalina Nur Rosyid Mubatada'i Nur Rosyid Mubtadai Nur Rosyid Mubtadai, Nur Rosyid Oktavia Citra Resmi Rachmawati Piko Permata Ilham Prasetyo Primajaya, Grezio Arifiyan Puspasari Susanti Putra, Berlian Juliartha Martin Rachmawati, Oktavia Citra Resmi Rasyada, Ihda Ratri Cahyaning Winedhar Renovita Edelani Renovita Edelani Ridho, Bistiana Syafina Riyanto Sigit Riyanto Sigit, Riyanto Rizka Rahayu Sasmita Rudi Kurniawan S, Ferry Astika Sa'adah, Umi Saputra, Muhammad Krisnanda Vilovan Sesulihatien, Wahjoe Tjatur Setiawardhana Setiawardhana Setiawardhana, Setiawardhana Subhan, Muh Sumarsono, Irwan Suryani, Indah Yudi Susanti, Puspasari Susetyoko, Ronny Syd. Ali Zein Farmadi Syd. Ali Zein Farmadi, Syd. Ali Zein Tahta Alfina Taufan Radias Miko Tessy Badriyah Tessy Badriyah, Tessy Tita Karlita Tita Karlita Tresna Maulana Fahrudin Tresna Maulana Fahrudin Tri Hadiah Muliawati, Tri Hadiah Tri Harsono Tri Harsono ULURRASYADI, FAIZ Umam, Khotibul Wahjoe Tjatur Sesulihatien Wahjoe Tjatur Sesulihatien Wibowo, Galih Hendra Widodo, Edi Wahyu Wina Rachmawan, Irene Erlyn Yuliana Setiowati Yuliana Setiowati, Yuliana Zainal Arief