Claim Missing Document
Check
Articles

Found 1 Documents
Search
Journal : Jurnal ULTIMATICS

Comparing Karate Framework with Others for Automated Regression Testing: A Case Study of PT Fliptech Lentera Inspirasi Pertiwi Dayanti, Afina Putri; Tony, Tony
ULTIMATICS Vol 16 No 1 (2024): Ultimatics : Jurnal Teknik Informatika
Publisher : Faculty of Engineering and Informatics, Universitas Multimedia Nusantara

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.31937/ti.v16i1.3397

Abstract

In the rapidly evolving digital era, applications, and software systems increasingly rely on Application Programming Interfaces (APIs) to enable interaction, integration, and functionality extension. However, manual testing of APIs is often inefficient and challenging to reuse when changes occur. To address this, automation testing has become a more effective choice, where test scripts can verify and execute tests repeatedly, easily adapting to API changes. Essentially, automation testing plays a vital role in software maintenance, particularly in regression testing, which tests modified or upgraded software versions to ensure that their core functions remain unchanged and unaffected. One approach to automation testing is employing the Software Testing Life Cycle (STLC), which follows a systematic series of stages conducted by the testing team to ensure software product quality. This paper utilizes PT Fliptech Lentera Inspirasi Pertiwi's public API to conduct testing on 25 scenarios from two modules. The objective is to utilize the Karate Framework to conduct these automated regression tests, resulting in an impressively short testing duration, averaging only 42.645 seconds, or approximately 1.706 seconds per scenario. A comparison with the Behave framework, using the same scenarios but with differences in steps, reveals that Behave achieves a duration of 18.762 seconds, or 0.750 seconds per scenario, making it 127.295% faster than Karate. However, in terms of the number of steps, Behave covers only 188, while Karate includes 543. This means that Behave requires 0.100 seconds per step, while Karate necessitates 0.079 seconds per occurrence. Karate provides more detailed results by 188.830% per step or 26.582% in terms of step duration. The primary goal is to enhance testing efficiency, expedite issue identification and resolution, provide a clearer testing process, and potentially improve overall software quality.
Co-Authors Adrian Hartanto, Adrian Agus Budi Dharmawan Agustining, Agustining Agustino, Wongso Alnas, Mujib Medio Andreas Andreas Anthony Gunawan, Anthony Ardhytia Nugraha, Ardhytia Bastari Bastari, Bastari Bernard Dean Sofli Bezaliel Rumengan, Bezaliel Budiyanto Lomewa Lo Cahyaningtyas, Dian Anggraini Chairisni Lubis Cynthia Marcelina, Cynthia Daniel Daniel Darius Andana Haris Dayanti, Afina Putri Dayanti, Sry Dedi Trisnawarman Desi Arisandi Devi, Tengku Keizerina Diana Tanu Wijaya, Diana Tanu Dyah Erny Herwindiati Emmy Supariyani Erikson T Ery Dewayani Filipus Hanung Nugroho, Filipus Hanung Frans Lienardi, Frans Garry Wiratama, Garry H.D Ahmad, Sutarmin Harialdi Dharmawan Syahputra HASIM PURBA Hendri Yukianto, Hendri Hiryanto, M.Sc., Lely Idha Aprilyana Sembiring Irvan Lewenusa Jap Tji Beng Jelly Leviza Joko Joko Karto Iskandar Ketaren, Marianne Magda Keyza Novianti Lely Hiryanto Leo Fantony, Leo Lina Lina Lu Sudirman Luissandro Hermawan MAHMUL SIREGAR Marito, Bintang Meilita Chintya Michael Andrian Michael Antoni, Michael Miranti, Indah Nasution, Dinny Oktariza Nawawi, Vivi Damayanti Phankova, Claudia Henlly Rosnidar Sembiring Sagala, Liwarny Salawati, Salawati Setiawati, Winni Siregar, Sausan Raihanah Stephen Christian, Stephen Steven Halim, Steven Sufisan Sufisan Sunarmi Sunarmi Suprayitno Suprayitno Taufik, Yusuf Teodoran, Vincent Tonny Jaya Putra, Tonny Jaya Utary Maharany Barus Vialli, Vina Viny Christanti M Wahyu Tri Putra, Wahyu Tri Wasino Wasino Yapriady Yapriady, Yapriady Yoshua Christianto, Yoshua Zyad Rusdi