Claim Missing Document
Check
Articles

AI and Multimodality-Based Authentic-Innovative Assessment for Evaluating English Speaking Skills Subroto, Ibnu; Rosalinah, Yanti; Nuraeni, Cicih
Wanastra: Jurnal Bahasa dan Sastra Vol. 18 No. 1 (2026): March
Publisher : LPPM Universitas Bina Sarana Informatika

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.31294/wanastra.v18i1.11392

Abstract

This study aimed to develop and validate an AI-Enhanced Multimodal Authentic Assessment model for evaluating EFL students' speaking skills, addressing the limitations of conventional, subjective methods. Employing a mixed-methods approach with a qualitative-dominant design, the research involved 35 university students from a Communication and Language study program. Data were collected through authentic video-based speaking tasks, AI-assisted linguistic analysis (using Google Speech-to-Text and a ChatGPT-based evaluator), detailed multimodal rubric assessments, and student perception questionnaires. Data analysis was conducted through three procedures: multimodal performance analysis using a validated rubric, comparative analysis of AI-generated linguistic metrics, and thematic analysis of questionnaire responses. Quantitative data from AI metrics and Likert-scale questionnaire items were analyzed using descriptive statistics, while qualitative data were analyzed thematically. The findings revealed that multimodal assessment effectively captured verbal, prosodic, visual, and gestural aspects of performance. Concurrently, AI excelled at objectively analyzing micro-linguistic features such as pronunciation, speech rate, and vocabulary. The integration of human and AI evaluation created a comprehensive hybrid model that provided richer, more informative feedback. Furthermore, students expressed positive perceptions regarding the clarity and usefulness of the AI-generated feedback. The study concludes that this integrated assessment model is highly relevant for 21st-century pedagogy and enhances the accuracy and quality of oral performance evaluation. The implications suggest that educators can adopt this framework to create more objective, efficient, and holistic speaking assessments, ultimately fostering better learning outcomes.
Co-Authors Adiningsih, Sekar Safitri Dhita Afni, Jhesti Tiara Afriyandi, Herry Aimar, Juan Pablo Alga, Alifah Junis Alhaq, Muhammad Wafdan ALOYSIUS RANGGA ADITYA NALENDRA, ALOYSIUS RANGGA Alya, Wulansari Regina Shafa Ambanilah, Eldalati Ananda, Aulia Sagita Andika Hendra Mustaqim, Andika Hendra Anshorullah, Muhammad Faiq Anti, Upi Aprilia, Intan Ika Apriliana, Priscila Arif - Hidayat, Arif - Arif Hidayat Ary Iswanto Wibowo Athaillah, Siti Adhwa Azhari, Jihan Begum, Syahkira Cicih Nuraeni Damayanti, Yulianingtyas Dwi Darmawan, Muhammad Rahman Dimas Galih Prayogo Dio Fathan Dwi Puji Hastuti Eldalani Ambanilah Fadhila, Radhiazka Ariq Faswanadina, Feras Fauzi, Fera Fitri Fazari, Tengku Nizar Feras Faswanadina Giacinta Azzahra Haifa, Yasmin Hakim, Aulia Hidayat, Muhammad Raihan Ibnu Subroto Ibnu Subroto Ibnu Subroto Ibnu Subroto Idelia Salsabillah Ikhsandi, Muhammad Rafi Inggit Dessy Susanti Intan Ika Aprilia Jonathan Susilo Effendi Khairunisa, Naila Putri Lea Zahra Santoso Ma'wa, Kesya Asyura Mathilda, Bonaventura Maulavi, Astraditya Ikhsan Maulidya, Syafina Maulina, Rizda Mohammad Arief Muhammad Rafi Ikhsandi Muhammad Rahman Darmawan Muqtafin, Muhammad Zaki Nabila, Bella Naila Putri Khairunisa Namira Salsabila Novelia, Rara Nurhaliza, Ananda Nursasliza, Naufara Nurul Khilda Putri, Bernadeta Kartika Buana Prima R.R. Okky Luthfiana Rahmawati, Anisya Dewi Ramadhan, Refan Gusti Ravi, Muhammad Retno Rahayuningsih Rina Lestari Rina Lestari Rizal, Andriansyah Sahel, Mayadha Salsabila, Namira Salva Syeira Wijaya Sari, Alexys Kartika Sari, Margareta Anita Soraya, Najwa Sri Arfani Subroto, Ibnu Sudarmo, Indah Rahmawati Surahman, Fauzi Akbar Surya, Annisa Keyshawardhana Susana Hamu Eti Sutju, Mihkael Sulaeman Syawal, Ifra Putra Syifa Aulia Tergun, Prabu Barry Alamsyah Tiara Apriella Tias Mawarni Upi Anti Waspodo, Marcellinus Bhanu K winda pratiwi Yasmin, Zahra Zachary, Ferraz Aditya Zaidan, Muhammad Ariq Zein, Ratu Azizah Arzellya