Claim Missing Document
Check
Articles

Found 30 Documents
Search

A Systematic Review of the Use of Technology in Educational Assessment Practices: Lesson Learned and Direction for Future Studies Retnawati, Heri; Kardanova, Elena; Sumaryanto, Sumaryanto; Prasojo, Lantip Diat; Jailani, Jailani; Arliani, Elly; Hidayati, Kana; Susanti, Mathilda; Lestari, Himmawati Puji; Apino, Ezi; Rafi, Ibnu; Rosyada, Munaya Nikma; Tuanaya, Rugaya; Dewanti, Septinda Rima; Sotlikova, Rimajon; Kassymova, Gulzhaina Kuralbayevna
International Journal of Robotics and Control Systems Vol 4, No 4 (2024)
Publisher : Association for Scientific Computing Electronics and Engineering (ASCEE)

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.31763/ijrcs.v4i4.1572

Abstract

Previous studies have demonstrated that technology helps achieve learning outcomes. However, many studies focus on just one aspect of technology’s role in educational assessment practices, leaving a gap in studies that examine how various aspects affect the use of technology in assessments. Hence, through a systematic work, we analyzed the extent and manner in which technology is integrated into educational assessments and how education level, domain of learning, and region may affect the use of technology. We reviewed empirical studies from two major databases (i.e., Scopus and ERIC) and a national journal whose focus and scope are on educational measurement and assessment, following PRISMA guidelines for systematic reviews. The findings of the present study are directed towards emphasizing the roles of technology in educational assessment practices and how these roles are adapted to varying educational contexts such as the level of education, the three domains of learning (i.e., cognitive, psychomotor, and affective), and the setting in which the assessment was conducted. These findings not only highlight the current roles of technology in educational assessment but also provide a roadmap for future research aimed at optimizing the integration of technology across diverse educational contexts.
Assessment Quality in Mathematics Learning: An Analysis of Critical Thinking Instruments for Derivative Topics Amini, Nurul; Arliani, Elly
Jurnal Ilmiah Profesi Pendidikan Vol. 10 No. 1 (2025): Februari
Publisher : Fakultas Keguruan dan Ilmu Pendidikan, Universitas Mataram

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.29303/jipp.v10i1.3087

Abstract

The assessment of students' critical thinking abilities is crucial for the learning process; however, numerous educators have been unable to select high-quality evaluation tools. A question that is effective must satisfy the following criteria: adequate validity, reliability, difficulty level, differentiating power, and effectiveness of the checker. A quantitative approach was employed in this study, which employed descriptive methods in one of the high schools in Yogyakarta. 15 summative test items on derivative material were administered to 30 students as the research subjects. The question is declared valid, as the content validity results using V-Aiken's indicate a value of 0.8889. This value is classified as high. The reliability test yielded a value of 0.924 for choice questions and 0.777 for description questions, suggesting that the questions were reliable. The analysis of the items revealed that item number 6 required deletion due to its low differential power, while item number 7 required revision. Questions 10 and 12 should be addressed in accordance with the level of difficulty. The exemptions are ineffective, necessitating revision of the answer options in question numbers 9 and 10. This research underscores the significance of enhancing evaluation instruments to facilitate the attainment of student learning indicators.
LITERASI MATEMATIKA MATERI SISTEM PERSAMAAN DAN PERTIDAKSAMAAN LINIER: PENGEMBANGAN BUTIR SOAL Nur Lailatul Azizah; Elly Arliani; Mayang Purbaningrum; Sahrul Ramadhan
AKSIOMA: Jurnal Program Studi Pendidikan Matematika Vol 13, No 2 (2024)
Publisher : UNIVERSITAS MUHAMMADIYAH METRO

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.24127/ajpm.v13i2.8547

Abstract

Kebanyakan guru terkendala dalam mengindentifikasi indikator kemampuan matematika saat penyusunan soal. Sehingga soal tidak dapat mengukur kemampuan siswa dengan tepat. Penelitian ini bertujuan untuk mengembangkan tes literasi matematika pada materi sistem persamaan dan pertidaksamaan linier. Terdapat empat kriteria soal yang dikembangkan, yakni valid, tingkat kesukaran, keefektifan pengecoh, dan daya pembeda yang baik. Jenis penelitian ini adalah penelitian dan pengembangan (R&D) menggunakan desain ADDIE. Teknik pengambilan sampel berupa Cluster Random Sampling dengan memilih 3 kelompok kelas secara acak. Data empiris hasil uji coba dianalisis menggunakan Classical Test Theory(CTT). Terdapat 12 butir tes pilihan ganda dan 3 butir uraian yang dikembangkan dan diujikan kepada 90 siswa kelas 10 SMK. . Hasil dari validitas adalah 0,93 dan reliabilitas 0,86. Menunjukkan bahwa soal tes literasi matematika valid dan reliabel. Sebanyak 12 butir soal pada kategori baik dan 3 butir soal pada kategori cukup baik. Terdapat 14 butir soal memiliki hasil estimasi daya pembeda yang baik, 14 butir soal dengan hasil estimasi kesukaran sedang dan 10 butir soal dengan hasil estimasi distraktor yang berfungsi dengan baik. Sehingga perlu dilakukan revisi pada 2 soal yang memiliki hasil estimasi distraktor yang tidak berfungsi dengan baik. Most teachers have problems identifying indicators of mathematical ability when preparing questions so, it’s cannot measure students' abilities accurately. This research aims to develop  mathematical literacy test that focuses on systems of linear equations and inequalities. There are four question criteria developed, those are validity, level of difficulty, effectiveness of distractors, and good discriminating power. This type of research is research and development (R&D) using the ADDIE design. The sampling technique is Cluster Random Sampling by selecting 3 class groups randomly. Empirical data from trial results were analyzed using Classical Test Theory (CTT). There were 12 multiple choice test items and 3 essay items which were developed and tested on 90 students of grade 10 Vocational High School. The results of validity are 0.93 and reliability 0.86. Shows the mathematics literacy test questions are valid and reliable. A total of 12 questions were in the good category and 3 questions were in the quite good category. There were 14 questions with good discriminant estimation results, 14 questions with moderate difficulty estimation results, and 10 questions with distractor estimation results which functioned well. So it is necessary to revise the 2 questions with the distractor estimation results not functioning properly.
Pengembangan Modul Matematika Berbasis Cerpen untuk Meningkatkan Kemampuan Literasi Matematika dan Motivasi Belajar Siswa SMK Zaki, Ahmad; Arliani, Elly
Ideguru: Jurnal Karya Ilmiah Guru Vol 10 No 2 (2025): Edisi Mei 2025
Publisher : Dinas Pendidikan, Pemuda dan Olahraga Daerah Istimewa Yogyakarta

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.51169/ideguru.v10i2.1971

Abstract

Penelitian ini dilatarbelakangi oleh kurangnya ketersediaan modul matematika yang berkualitas bagi guru dan siswa dalam proses pembelajaran. Tujuan penelitian ini adalah mendeskripsikan karakteristik dan menghasilkan modul matematika berbasis cerita pendek serta menilai kualitasnya dari aspek kevalidan, kepraktisan, dan keefektifan dalam meningkatkan literasi matematika dan motivasi belajar siswa SMK. Metode yang digunakan adalah penelitian pengembangan model 4D (Define, Design, Develop, Disseminate). Instrumen yang digunakan meliputi pedoman wawancara, lembar validasi, angket kepraktisan, tes literasi matematika, dan angket motivasi belajar. Validitas instrumen diuji melalui expert judgment dan reliabilitasnya masing-masing 0,607 (literasi matematika) dan 0,854 (motivasi belajar). Subjek penelitian adalah siswa kelas X DPB 2 SMK Negeri 1 Sewon. Hasil penelitian berupa modul cetak yang memuat elemen cerita pendek sebagai pengantar materi persamaan kuadrat. Modul memperoleh skor validitas materi 3,13 (layak) dan media 3,62 (sangat layak). Kepraktisan diperoleh dari guru (3,61) dan siswa (3,34), keduanya berkategori sangat baik. Keefektifan dibuktikan dengan rata-rata nilai literasi matematika 80,14 dan skor motivasi belajar 3,28. Hasil uji one sample t-test menunjukkan t hitung 2,63 > t tabel 1,65 dan p-value 0,013 < 0,05. Dengan demikian, modul yang dikembangkan valid, praktis, dan efektif untuk digunakan dalam pembelajaran matematika khususnya di SMK.
ICT-Based Mathematics Learning Assessment: A Systematic Review of Effectiveness, Challenges, and Pedagogical Impacts Hidayatullah, Syarif; Arliani, Elly; Hidayati, Kana
Prisma Sains : Jurnal Pengkajian Ilmu dan Pembelajaran Matematika dan IPA IKIP Mataram Vol. 13 No. 4: October 2025
Publisher : Universitas Pendidikan Mandalika

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.33394/j-ps.v13i4.16987

Abstract

The importance of integrating Information and Communication Technology (ICT) into mathematics learning lies in its potential to enhance students’ critical thinking, problem-solving, and logical reasoning skills. Conventional assessments often face limitations in providing personalized and dynamic feedback. This study aims to examine the effectiveness, challenges, and pedagogical impacts of ICT-based mathematics assessment through a systematic review of literature published between 2020 and 2025. The research method employed is a Systematic Literature Review (SLR) following the PRISMA guidelines. Data were collected from the Scopus, WoS, ERIC, and Google Scholar databases using relevant keywords. The selection process involved identification, screening, eligibility assessment, and inclusion, resulting in n=15 articles for comprehensive analysis. The findings indicate that ICT-based assessment is effective in measuring cognitive domains, particularly conceptual understanding (33.3%), problem solving (26.7%), and learning outcomes (26.7%), while other aspects remain limited mathematical reasoning and self-assessment (13.3%). Furthermore, challenges in implementing ICT-based mathematics assessment include the design and development of instruments, technical and infrastructural limitations, teachers’ readiness and competencies, as well as student characteristics and the context of online learning. ICT-based assessment in mathematics also provides five main pedagogical impacts: enhancing student engagement and motivation, offering feedback and self-reflection, fostering cognitive and problem-solving skills, improving learning efficiency, and promoting pedagogical innovation.
Accuracy of Self-Assessment and Peer Assessment in Learning : A Systematic Literature Review Sinaga, Yohana Dwi Kristiani; Arliani, Elly; Ngala, Januarius Clief; Agustina, Ni Luh Ika Tri
Jurnal Paedagogy Vol. 11 No. 2 (2024): April
Publisher : Universitas Pendidikan Mandalika

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.33394/jp.v11i2.9417

Abstract

This study aims to explore the influence of self-assessment and peer assessment in learning, the factors affecting the accuracy of self-assessment and peer assessment, and efforts to enhance the accuracy of self-assessment and peer assessment. This research was a qualitative approach with a systematic literature review method. The data collected are from national and international scholarly journals related to self-assessment and peer assessment in learning, which were then analyzed using content analysis. According to the study's findings, using peer and self-evaluation to evaluate students' learning had a very beneficial effect. Thus, it should be put into practice. Additionally, a number of factors, such as self-confidence, emotional intelligence, self-perception of abilities, prior experience, feedback quality, assessment instrument clarity, assessor agreement, and trust in peer assessment, affect how accurately learners assess themselves and each other. Clear assessment criteria and procedures, which provide students direction for both their own and their peers' evaluations, can increase the accuracy of peer and self assessments. Good feedback is essential to improving both assessment techniques' accuracy. In addition, sufficient instruction for pupils is required to guarantee that evaluations are more precise, impartial, and beneficial.
Analysis of practice math problems on statistics material for 8th grade students Riski, Muhammad; Arliani, Elly; Fitriana, Silfi Nisa
UNION : Jurnal Ilmiah Pendidikan Matematika Vol 12 No 3 (2024)
Publisher : Universitas Sarjanawiyata Tamansiswa

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.30738/union.v12i3.17911

Abstract

To improve the quality of learning, learning evaluation has an important role. One of the learning evaluations that is often carried out is daily assessments to see the achievement of particular material. The aim of this research is to describe the quality of mathematics questions in statistics material for junior high school students. The method used in this research is quantitative descriptive research assisted by the AnBuSo program and R studio software. The data collection technique used documentation techniques, with data sources in the form of mathematics questions on statistics material. Question items analysis is applied to prove validity, estimate reliability, level of difficulty, discrimination, as well as analyzing the factors that cause the question items to be difficult and have poor discrimination. The respondents in this research were 200 students taken from three junior high schools in DIY. Meanwhile, qualitative data analysis is used to explain the difficulty index and discrimination of the test items. The results of this research show that the Aiken value is valid, and the reliability estimates are quite good. The results of analysis based on the CTT and IRT approaches obtained a good mean index of difficulty and discrimination. These findings imply that the validated and reliable question items can be used as a reference for developing higher-quality assessments to improve student learning outcomes.
Do Habits of Mind and Cognitive Style Affect Critical Thinking Ability of High School Students? Sinaga, Yohana Dwi Kristiani; Arliani, Elly
Jurnal Kependidikan : Jurnal Hasil Penelitian dan Kajian Kepustakaan di Bidang Pendidikan, Pengajaran, dan Pembelajaran Vol. 10 No. 3 (2024): September
Publisher : LPPM Universitas Pendidikan Mandalika

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.33394/jk.v10i3.12730

Abstract

This research aims to analyze the influence of habits of mind and cognitive style (field dependent and field independent) on the critical thinking ability of high school students. This research employs a mixed-method approach with an explanatory sequential design and a QUAN → qual model. The population consists of all 11th-grade high school students in Sintang Regency, West Kalimantan Province, with a sample of 385 students and 19 students serving as interview informants. The instruments used include a critical thinking ability test, habits of mind questionnaire, GEFT, and interview guidelines. The analysis techniques employed are descriptive analysis, inferential analysis, and qualitative analysis based on Miles & Huberman. The results show that habits of mind and cognitive style simultaneously have a significant influence on critical thinking ability. Furthermore, based on the coefficient of determination, it is found that habits of mind and cognitive style together have the power to explain critical thinking ability. The implication is that teachers need to adjust learning strategies based on students' cognitive styles and develop habits of mind to improve their critical thinking skills.
Designing Closed-Ended Questions into Open-Ended Questions to Support Student’s Creative Thinking Skills and Mathematical Communication Skills Septiani, Syilvia; Retnawati, Heri; Arliani, Elly
JTAM (Jurnal Teori dan Aplikasi Matematika) Vol 6, No 3 (2022): July
Publisher : Universitas Muhammadiyah Mataram

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.31764/jtam.v6i3.8517

Abstract

The ability of creative thinking and mathematical communication is important in learning mathematics. However, in fact mathematics learning in schools today has not shown an optimal effort to help students develop creative thinking skills and mathematical communication skills. The purpose of this study is to examine the use of open-ended questions in mathematics learning and in the evaluation of mathematics learning to support the ability of creative thinking and mathematical communication skills of students, this will be implemented in the perspective of literature review. The type of research used is a systematic and structured literature review, where researchers synthesize relevant study results from international and national literature through Google Scholar, Eric, DOAJ, Scopus and ScienceDirect. Based on the analysis results obtained that mathematical learning using open-ended questions is effectively used to support the ability of creative thinking and mathematical communication skills of students; the provision of open-ended questions can be familiarized with providing learning methods leading to an open-ended approach; the test in the form of open-ended questions can be used as a tool to measure the ability of creative thinking and mathematical communication skills of students; the use of open-ended question can be applied to all levels of education; and the need for high creativity from teachers to prepare learning by applying open-ended questions.
CTL-Deep learning: Its influence on critical thinking skills and self-confidence in linear equation system material Anggraini, Amelia; Arliani, Elly
Jurnal Math Educator Nusantara: Wahana Publikasi Karya Tulis Ilmiah di Bidang Pendidikan Matematika Vol 11 No 1 (2025): Jurnal Math Educator Nusantara
Publisher : Program Studi Pendidikan Matematika, Universitas Nusantara PGRI Kediri

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.29407/jmen.v11i1.25185

Abstract

Many senior high school students have difficulty in understanding Linear Equation Systems (LES). The Contextual Teaching and Learning-Deep Learning (CTL-DL) approach is one of the current solutions. This study aims to describe the effect of the CTL-DL approach on students' critical thinking skills and self-confidence in the material of Linear Equation Systems. This quasi-experimental study with a pretest-posttest control group design used a population of class X students of SMA Negeri 2 Yogyakarta in the 2024/2025 academic year. Sampling was carried out by purposive sampling. Data were collected using observation sheets, critical thinking ability tests, and self-confidence questionnaires, then analyzed using the Multivariate Hotelling's T² statistical test and the independent t-test at a significance level of 0.05. The results of the study showed: 1) there was an influence of the CTL-DL approach on students' critical thinking skills and self-confidence, 2) the CTL-DL approach was significantly superior to the expository approach in improving critical thinking skills, and 3) the CTL-DL approach was significantly superior to the expository approach in improving students' self-confidence