cover
Contact Name
-
Contact Email
-
Phone
-
Journal Mail Official
-
Editorial Address
-
Location
Kab. sleman,
Daerah istimewa yogyakarta
INDONESIA
REiD (Research and Evaluation in Education)
ISSN : -     EISSN : 24606995     DOI : -
Core Subject : Education,
Arjuna Subject : -
Articles 176 Documents
Estimating the ability of pre-service and in-service Teacher Profession Education (TPE) participants using Item Response Theory Lian Gafar Otaya; Badrun Kartowagiran; Heri Retnawati; Siti Salina Mustakim
REID (Research and Evaluation in Education) Vol 6, No 2 (2020)
Publisher : Program Pascasarjana Universitas Negeri Yogyakarta & HEPI

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.21831/reid.v6i2.36043

Abstract

This research generally aimed to describe the characteristic of the ability of Pre-service and In-service TPE participants using the Item Response Theory, IRT. The research subject comprised 516 participants divided into 239 participants of the Pre-service TPE program and 277 participants of the In-service TPE program using the purposive sampling technique. Data were collected through the technique of observation and documentation. In estimating the item parameter and ability parameter, the IRT model polytomous was implemented, which was furthermore described. This finding shows that the assessor could directly recognize the position of the ability of students in the TPE program based on the item characteristic and the ability between the highest and the lowest grade in the ability scale, so this finding did not only support the implementation of TPE program in Indonesia, but also its applicability was expected to revise the assessment of teachers’ performance, the supervision of teachers, field teaching practice, and the assessment in the other teaching fields, so it could be used as an evaluation in revising the assessment model.
Developing an instrument to measure student's perception of the medical education curriculum from the perspective of Communities of Practice theory Yoga Pamungkas Susani; Gandes Retno Rahayu; Yayi Suryo Prabandari; Rossi Sanusi; Harsono Mardiwiyoto
REID (Research and Evaluation in Education) Vol 6, No 2 (2020)
Publisher : Program Pascasarjana Universitas Negeri Yogyakarta & HEPI

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.21831/reid.v6i2.31500

Abstract

The concept of participation as a learning process is essential to foster professional identity development. Faculties are expected to provide a curriculum that supports students' participation in the profession's context. Curriculum evaluation is needed to assess the extent to which curriculum implementation supports participation. In this regard, this study aims to develop instruments that measure students' perceptions of the medical education curriculum. The blueprint for the instrument's development was based on the concept of participation in communities of practice theory. Qualitative research, which involved 17 pre-clinical and clinical medical students as participants, was conducted to explore medical students' perception about formal learning activities that encourage participation. The results were used to generate the items. A series of review processes, item reduction, revisions, and analysis generated 20 items in four factors, namely: engagement support, imagination support, convergence, and feedback. This shows that the instrument is multidimensional. The instrument also has good discriminant validity and composite reliability.
Evaluating the implementation of the character education strengthening program of vocational high schools in Yogyakarta City Edhy Susatya; Budi Santosa; Andriyani Andriyani; Dwi Ariyani
REID (Research and Evaluation in Education) Vol 7, No 1 (2021)
Publisher : Program Pascasarjana Universitas Negeri Yogyakarta & HEPI

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.21831/reid.v7i1.38029

Abstract

The research aims to evaluate the character education strengthening program (CESP) implementation in vocational high schools (VHS) throughout Yogyakarta City. The evaluation is done in the functions of (1) planning, (2) implementation, and (3) evaluation. In this descriptive qualitative research, the researchers collected information related to the implementation of CESP. The subjects are school principals, vice principals, and teachers determined using the snowball sampling technique in four vocational high schools in Yogyakarta City. The evaluation uses the discrepancy model, which looks for the gap between planning and implementation. Data were collected through observation, interviews, and documentation, validated using the source and collection triangulation, and analyzed using a descriptive technique carried out during and after completing data collection within a certain period. The findings show that: (1) the CESP planning consists of elements of initial assessment, CESP socialization, vision and mission, policy design, and CESP design, with an average score of 2.74, meaning that it is good; (2) the CESP implementation consists of the elements including CESP development in learning, school culture development, community participation, and implementation of the CESP main values, with an average score of 2.98, meaning that it is in a good category; and (3) the CESP evaluation has an average score of 2.50, meaning that it is in a good category. The results of this study are recommended as consideration for mapping the CESP implementation, determining education policies related to character education, developing CESP models, reference for character research, and as materials for discussions regarding character education.
Evaluation of education and training programs in Solo Technopark Central Java in Indonesia Sudiyatno Sudiyatno; Iswahyuni Wulandari
REID (Research and Evaluation in Education) Vol 6, No 2 (2020)
Publisher : Program Pascasarjana Universitas Negeri Yogyakarta & HEPI

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.21831/reid.v6i2.36794

Abstract

This study aims to evaluate the implementation of a training program for youth in Solo Technopark, Central Java, Indonesia, and get important feedback and recommendations to increase its effectiveness. The evaluation method used is based on four levels of the Kirkpatrick model to assess: (1) participants' reaction to the training program (to the contents, facilitators, and facilities); (2) training participants' learning (knowledge and basic skills); (3) change of participant behaviors; and (4) succeed of the training participants based on competence skills and rate of graduate employability and employer’s satisfaction. Research respondents were 47 training participants from four optional courses at the reaction and learning level. There were 59 alumni, three training instructors, and one employer as the respondents at the behavior and results level. Data were collected using questionnaires, interviews, documentation, and an observation checklist. The data were analyzed using the quantitative descriptive analysis method. The study shows that: (1) at the reaction level, most training participants are satisfied with the training program, instructors, and facilities; (2) at the learning level, most participants have a good category in knowledge and basic skills; (3) at the behavior level, participants can implement the attitudes and major skills at a good level; (4) at the results level, alumni have high skills at workplaces; they have been employed in various industries, and the alumni's employability rate is less than 50%. To increase the low rate of employability in the labor market, Solo Technopark needs to improve alumni networking and collaboration with industries and employers.
Factor analysis: Competency framework for measuring student achievements of architectural engineering education in Indonesia Rihab Wit Daryono; V. Lilik Hariyanto; Husaini Usman; Sutarto Sutarto
REID (Research and Evaluation in Education) Vol 6, No 2 (2020)
Publisher : Program Pascasarjana Universitas Negeri Yogyakarta & HEPI

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.21831/reid.v6i2.32743

Abstract

This study aims to prove the validity test and estimate the instrument's reliability to measure student achievement in the department of architectural engineering education in Indonesia. The cluster random sampling technique was used to determine the number of students consisting of 103 vocational education students. This study uses a survey method to examine and analyze the structure of students' competency achievements factors. The collected empirical data were analyzed using descriptive and inferential statistics using Exploratory Factor Analysis (EFA). EFA test is intended to reveal factors that can be formed from instruments that have been established for measurement of achievements of vocational student competencies. The analysis results using EFA showed that the instrument had good construct validity. The result of this research shows that the instrument test for measuring the achievement of student competencies has good reliability and consists of 30 competency items covering ten competency aspects, namely general competencies, technical drawing, statically structures, basic building construction, land measurement engineering, software application and building interior design, road and bridge construction, estimated construction costs, building construction and utility, creative and entrepreneurship product competencies.
From an international English language assessment framework to a teacher-based assessment: A study of primary English teachers’ agentive perspectives and projections Santi Farmasari
REID (Research and Evaluation in Education) Vol 7, No 1 (2021)
Publisher : Program Pascasarjana Universitas Negeri Yogyakarta & HEPI

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.21831/reid.v7i1.38850

Abstract

This study explores four primary English teachers' agentive perspectives about assessment in their schools. Given the challenges brought by the abolition of International Standard School (ISS), the changed status of the school, and the exclusion of English from the 2013 National Education Curriculum (NEC), a teacher-based assessment was the only solution to the unavailability of assessment guidelines and the unsuitability of assessment materials and methods. Employing teacher agency theory, this study examines the agentive sides of the teachers' perspectives as they would represent the teachers' strategic solutions toward the school's emerging problems. The teacher-based assessment was expected to accommodate the school's context, the students, and the subject taught. This instrumental case study's data was collected through semi-structured interviews and focus group discussion, which was then analyzed through six phases of thematic analysis and by employing nVivo12 software. The study indicates that the challenges brought by the changed educational policies reinforced collaborative work amongst the teachers. The teachers' perspectives also represent their agentive projections toward English language assessment which was heavily shaped by the teachers' previous assessment experiences during ISS and their ultimate teaching objectives. The findings are expected to provide insightful knowledge about how English teachers responded to shifted educational policies and projected to accommodate the school's specific contexts of assessment. The findings are also expected to explain how people's perspectives can be examined from an agency perspective.
Evaluation of learning process: Knowledge of ICT integration among pre-service English language teachers Dyah Setyowati Ciptaningrum; Nur Hidayanto Pancoro Setyo Putro; Nila Kurnia Sari; Nurqadriyanti Hasanuddin
REID (Research and Evaluation in Education) Vol 7, No 1 (2021)
Publisher : Program Pascasarjana Universitas Negeri Yogyakarta & HEPI

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.21831/reid.v7i1.30521

Abstract

This research aims at investigating the knowledge of ICT integration among the students of the English Language Education Study Program at a particular university in Yogyakarta. By employing the quantitative method, this ex-post facto research involved 70 English Department students who had taken microteaching as respondents in a survey to gather the data using a questionnaire. The questionnaire was taken from the model developed by one of the researchers based on the TPACK framework. There are five domains in the questionnaire. Four domains measure TPACK perceptions: Technological Knowledge (TK), Technological Content Knowledge (TCK), Technological Pedagogical Knowledge (TPK), and Technological Pedagogical Content Knowledge (TPACK). One domain measures the pre-service teachers’ perceptions of their ICT-related learning experiences. Demographic questions are included to identify the characteristics of the respondents in order to understand gender differences or relationships between teachers who have access to technologies at home and those who do not. The closed-ended questions applied a five-point Likert-type scale ranging from 1=strongly disagree to 5=strongly agree. Correspondingly, it contains one open-ended question in the TPACK domain. Descriptive analysis and MANOVA were conducted for the quantitative data analysis. The result of this study showed that the pre-service students possess a high self-confidence in the application of TK (Technological Knowledge), TPK (Technological Pedagogical Knowledge), and TCK (Technological Content Knowledge). However, their TPACK appears to need further development. The results from MANOVA showed that the pre-service teachers’ related learning experiences significantly differed by the students’ gender, with male students reporting more experiences than female students.
Multiple intelligences instrument development: Identification system of multiple intelligences tutor Mery Berlian; Iqbal Miftakhul Mujtahid; Rian Vebrianto; Musa Thahir
REID (Research and Evaluation in Education) Vol 6, No 2 (2020)
Publisher : Program Pascasarjana Universitas Negeri Yogyakarta & HEPI

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.21831/reid.v6i2.35120

Abstract

Research instruments are an important factor in a study in which the truth of researched results lies that determines the conclusion. Instruments are used to collect data and measure a research variable's object. This study aimed to retest a valid, consistent, and reliable instrument related to multiple intelligences previously developed by McClellan Conti. In this study, Multiple intelligences adapted from American psychologist, Howard Gardner, consisted of nine constructs, namely: (1) physical/kinesthetic, (2) existential/spiritual, (3) interpersonal, (4) intrapersonal, (5) logical thinking, (6) musical/rhythmic, (7) naturalistic, (8) verbal, and (9) visual. Designed as a survey study, it involved 140 respondents from primary education tutors of Universitas Terbuka at Pekanbaru selected using simple random sampling techniques. The data was analyzed using SPSS version 23.00 for Windows. The results showed that all questionnaire items were valid and reliable with a high average Cronbach Alpha reliability value (0.763 0.6), and every statement item has a high value (0.786 – 0.887) with a total construct value of 0.859.  This study provides an alternative assessment related to multiple intelligence. Knowing each tutor's multiple intelligences will make the tutor focus more on the superiority of his intelligence. This will have good consequences for the development of the student learning process.
Hierarchical linear modeling for determining the effect of ICT literacy on mathematics achievement Suci Paramitha Liestari; Muhardis Muhardis
REID (Research and Evaluation in Education) Vol 7, No 1 (2021)
Publisher : Program Pascasarjana Universitas Negeri Yogyakarta & HEPI

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.21831/reid.v7i1.39181

Abstract

This study aims to identify the effect of ICT literacy on mathematics achievement in grade 8 by using the Indonesian Student Competency Assessment's (Asesmen Kompetensi Siswa Indonesia or AKSI) 2019 questionnaire data. A multistage probability sample of 13,079 students was analyzed using a two-level hierarchical linear model (HLM) which student achievement scores are the first level laid in schools as the second level. The results of the analysis revealed that SES, the number of smartphones and computers that students have at home, the availability of ICT at home and school, the use of ICT for education, and perspective on the benefits of ICT in daily life have a positive influence on mathematics literacy achievement, while the easiness of access to the use of digital devices in schools has negative influence at the student level. At the school level, the high mathematics literacy achievement of students is influenced by the location of the school and the number of certified teachers. School accreditation and completeness of learning facilities in schools are not factors upon better students toward their mathematics literacy achievement. However, the interaction between the easiness of access to the use of digital devices in schools and the completeness of learning facilities in schools have an influence in increasing students' mathematics literacy achievement. Based on the diversity component, it is known that the diversity of students' mathematical literacy achievement explained by the student level and school-level variables are 33.24 and 0.18, respectively.
The characteristics of chemistry test items on nationally-standardized school examination in Yogyakarta City Ummul Karimah; Heri Retnawati; Deni Hadiana; Pujiastuti Pujiastuti; Eri Yusron
REID (Research and Evaluation in Education) Vol 7, No 1 (2021)
Publisher : Program Pascasarjana Universitas Negeri Yogyakarta & HEPI

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.21831/reid.v7i1.31297

Abstract

This study aimed to describe the characteristics of chemistry test items in Nationally Standardized School Examination or Ujian Sekolah Berstandar Nasional (USBN), consisted of discrimination index, difficulty index, and question reliability. The data were collected by using documentation of the answers of 194 students. The type of research was descriptive exploratory with quantitative and qualitative approaches. Quantitative data analysis was performed by using the classical test theory approach and item response theory with 1 logistical parameter. Meanwhile, qualitative data analysis was conducted to describe the items categorized as difficult and bad categories. The results show that, according to classical test theory, the USBN Chemistry item test has an average level of difficulty of 0.57, which is categorized as moderate. Regarding the discrimination index, the average of different test power obtained is equal to 0.146 and belongs to the good category. Based on the item response theory, the average difficulty index of -0.00086 is categorized as moderate. The results of the estimated reliability of the questions amounted to 0.48 is included in the moderate category. The results of the qualitative analysis show that the items which belong to the difficult category are the items on salt hydrolysis material, acid-base titration, the concept of periodicity, manufacture, and use of chemical compounds according to classical test theory. Meanwhile, according to the theory of response, items that belong to the difficult category were found in acid-base titration material, the colligative solution phenomenon, and the concept of periodicity of the main metal elements.

Page 10 of 18 | Total Record : 176