Jurnal Pengukuran Psikologi dan Pendidikan Indonesia (JP3I)
Jurnal Pengukuran Psikologi dan Pendidikan Indonesia (JP3I) adalah jurnal ilmiah yang diterbitkan oleh Fakultas Psikologi, Universitas Islam Negeri Syarif Hidayatullah Jakarta. Jurnal ini bertujuan untuk memfasilitasi interaksi, diskusi, dan gagasan di antara para ilmuwan psikologi Indonesia. Jurnal ini difokuskan pada Psikologi Pengukuran.
Articles
260 Documents
The Impact of Z-Score Transformation Scaling on the Validity, Reliability, and Measurement Error of Instrument SATS-36
Sumin Sumin
JP3I (Jurnal Pengukuran Psikologi dan Pendidikan Indonesia) Vol 11, No 2 (2022): JP3I
Publisher : Fakultas Psikologi UIN Syarif Hidayatullah Jakarta
Show Abstract
|
Download Original
|
Original Source
|
Check in Google Scholar
|
DOI: 10.15408/jp3i.v11i2.26591
The Likert scale is a psychometric scale commonly used for response measurement. This measurement scale includes techniques for designing and administering surveys as well as coding and analyzing data. However, Likert scaling has various limitations that can affect the resulting data. This study aims to reprove the number of dimensions of the SATS-36 instrument, prove the validity, and estimate the reliability of the statistical attitude instrument (SATS-36) on students at religious universities in Indonesia using Z-Score Transformation Scaling. The latent constructs of cognitive competence, value, difficulty, effect, and effort were constructed using a Likert scale according to the pattern of statements on each item. This study uses confirmatory research with a quantitative approach. For students at religious universities in Indonesia, 243 respondents were selected using a stratified one-stage cluster random sampling technique. Proof of validity and estimation of reliability was done using confirmatory factor analysis. The results of this study show that the rescaling method can improve the validity of the factors but cannot increase Cronbach's coefficient of internal consistency and cannot reduce the standard error of measurement for each item. This research implies that it is not enough to rescale or transform the data to improve the validity and reliability of a measuring instrument. However, it is necessary to calibrate the statement sentence or item question so that the item measures its construct. Further research also needs to test the effectiveness of rescaling in addition to the Z-Score in improving the validity and reliability of measuring instruments.
Principal Component Analysis and Exploratory Factor Analysis of the Mechanical Waves Conceptual Survey
Purwoko Haryadi Santoso;
Edi Istiyono;
Haryanto Haryanto
JP3I (Jurnal Pengukuran Psikologi dan Pendidikan Indonesia) Vol 11, No 2 (2022): JP3I
Publisher : Fakultas Psikologi UIN Syarif Hidayatullah Jakarta
Show Abstract
|
Download Original
|
Original Source
|
Check in Google Scholar
|
DOI: 10.15408/jp3i.v11i2.27488
Mechanical waves conceptual survey (MWCS) is a measurement tool established by the physics education research (PER) community to evaluate conceptual physics understanding of mechanical waves. A validation study is still needed to figure out the factor structure of MWCS using two data reduction techniques, namely exploratory factor analysis (EFA) and principal component analysis (PCA). The MWCS dataset in this paper was gathered from physics students (n = 419) from nineteen Ugandan secondary schools. The findings of this research suggested the single factor of the MWCS construct that has emerged from the dataset explored in this study. Several issues involved in the calculation of inter-item correlation within the dataset are suspected as the leading cause of the missing component solution or stable loading in the data. Moreover, there might be other issues that leave open space for future exploration. The findings reported in this paper could be the subject of further discussion in evaluating the validity of the MWCS as a research-based assessment (RBA) to measure students' conceptual understanding of wave mechanics within PER studies.
Psychometric Properties of the Indonesian Version of Youth Quality of Life-Weight Instrument (YQOL-W)
Grace Helena Firmansyah Putri;
Fredrick Dermawan Purba
JP3I (Jurnal Pengukuran Psikologi dan Pendidikan Indonesia) Vol 11, No 2 (2022): JP3I
Publisher : Fakultas Psikologi UIN Syarif Hidayatullah Jakarta
Show Abstract
|
Download Original
|
Original Source
|
Check in Google Scholar
|
DOI: 10.15408/jp3i.v11i2.27219
Quality of life refers to a broad concept that describes life satisfaction in terms of culture, value, and life experiences which are used to explain someone’s life aspect in general or specifically in relation to a particular condition, such as being overweight or obese. Obesity causes many health problems and affects the overall quality of life. As the obesity rate continues to be a growing public health problem in Indonesian adolescents, examining the perceptions regarding their weight is fundamental for planning a proper intervention. However, there has been little reported of available weight-specific instruments that measure the QoL in Indonesia. Youth Quality of Life-Weight (YQOL-W) is a multicultural measurement of QoL-weight that was specifically recommended by previous researchers to measure the QoL of adolescents with obesity and overweight conditions. This study was conducted to evaluate the psychometric properties of the adapted YQOL-W instrument for Indonesian adolescents. Twenty-one items were administered to 880 adolescents between 11 and 18 years of age, of whom 54.55% were female and 71.14% were junior high school students. Data were collected with a convenience sampling technique. Confirmatory factor analysis showed that a three-factor model had an acceptable model fit, including a Self factor (4 items), Social factor (12 items), and Environment factor (5 items) with p < .05. The YQOL-W instrument had good internal consistency reliability with Cronbach’s alpha ranging from .87 to .95 and acceptable test-retest reliability with the intraclass correlation coefficients (ICC) all greater than .70. The one-factor and three-factor scores were negatively correlated with BMI and positively correlated with PedsQL (all at p < .01 level). In conclusion, the Indonesian version of the YQOL-W shows good reliability and validity for assessing the weight-specific QoL of adolescents in Indonesia.
Rasch Analysis of The Indonesian Version of Individual Work Performance Questionnaire (IWPQ)
Weepy Grace Dwiliesanti;
Ananta Yudiarso
JP3I (Jurnal Pengukuran Psikologi dan Pendidikan Indonesia) Vol 11, No 2 (2022): JP3I
Publisher : Fakultas Psikologi UIN Syarif Hidayatullah Jakarta
Show Abstract
|
Download Original
|
Original Source
|
Check in Google Scholar
|
DOI: 10.15408/jp3i.v11i2.24157
The Individual Work Performance Questionnaire was developed by Koopmans et al. (2013). This questionnaire was based on the construct of individual work performance which consists of task performance, contextual performance, and counterproductive work behavior. Widyastuti & Hidayat (2018) adapted the IWPQ into Bahasa Indonesia. The mentioned research used the classical test theory (CTT) approach to validate the instrument. Therefore, the findings were only applicable to the study’s sample, as validity and reliability could not be legitimately generalized to other study settings. In comparison, the development of the original IWPQ used Rasch analysis to examine its measurement properties. Rasch analysis is a modern psychometric approach based on item response theory (IRT), which has several advantages over the CTT. This study aimed to validate the psychometric properties of the Indonesian Version of IWPQ using the Rasch model. The psychometric properties discussed in this study include instrument reliability, person and item reliability, unidimensionality, rating scale functioning, and bias detection (Differential Item Functioning). The 213 participants in this research survey were Indonesian citizens aged 18-46 years old (mean = 30.64, SD = 8.55) and were actively working for at least three months at their current job. The result showed that the assumption of the unidimensionality of each sub-scale of IWPQ was fulfilled. The 5-Likert rating scales of this instrument had adequate functionality. The person reliability for all sub-scales ranged from .58 - .80. Meanwhile, the item reliability ranged from .90 - .97. The separations were considered high with a value ranging from 3.04 – 5.77. All items in this instrument functioned well to measure individual work performance except for one item in sub-scale Contextual Performance. This specific item should be revised to achieve a more accurate measurement of the construct. There was one item that was considered biased toward gender in sub-scale Contextual Performance. Also, there was one item that was considered biased toward tenure in sub-scale Counterproductive Work Behavior. These findings had implications for using the Indonesian Version of IWPQ to assess employees’ individual work performance and recommendations for future research.
The Short Version of IPIP-BFM Scale Properties Based on Bugis-Makassar Cultural Background: Do the Items Match with Javanese Culture?
Syahrul Alim;
Titin Florentina Purwasetiawatik;
A. Nur Aulia Saudi;
Susi Susanti
JP3I (Jurnal Pengukuran Psikologi dan Pendidikan Indonesia) Vol 11, No 2 (2022): JP3I
Publisher : Fakultas Psikologi UIN Syarif Hidayatullah Jakarta
Show Abstract
|
Download Original
|
Original Source
|
Check in Google Scholar
|
DOI: 10.15408/jp3i.v11i2.23404
Cultural difference is one of the elements that form individuals. It corresponds with attitudes and beliefs that influence human cognition and behavior. As a response, it is essential to study cultural differences to develop an appropriate measurement tool. This study aims to (1) evaluate the psychometric properties of the IPIP-BFM short version scale based on the Bugis-Makassar cultural setting and also (2) compare with Javanese cultural background results. A total of 430 students participated (78% women and 22% men). We observed that the Item-total correlation ranged from 0.51 to 0.74, with reliability coefficient: intellectual (0.85); consciousness (0.85); extraversion (0.85); agreeableness (0.79); and neuroticism (0.89). The Kaiser Meyer-Olkin was 0.87, and the Bartlett Test of Sphericity was 5191,3 (p < 0.01). All the items had a factor loading >0.60; variance explained 63,1 (63%) and clear factorial structures. The short version scale had good psychometric properties. Meanwhile, the items comparison of the two measurement tools from both cultural backgrounds reveals that two-item were the same in factors: intellectual, extraversion, and emotional, while four items were in consciousness. However, on the agreeableness factor, all items were the same. It shows that cultural variations indeed affect an individual's perception of an item.
Construct Validity and Reliability Testing of Perceived Job Stress as an Academic Leader (PJSAL) Instrument
Immanuel Yosua;
Hana Panggabean
JP3I (Jurnal Pengukuran Psikologi dan Pendidikan Indonesia) Vol 12, No 1 (2023): JP3I
Publisher : Fakultas Psikologi UIN Syarif Hidayatullah Jakarta
Show Abstract
|
Download Original
|
Original Source
|
Check in Google Scholar
|
DOI: 10.15408/jp3i.v12i1.19504
This study aims to develop the Perceived Job Stress as an Academic Leader (PJSAL) instrument based on a modification of the Dean's Stress Inventory (DSI) instrument (Wild, et al., 2003). DSI is selected because it can accurately identify the potential sources of stress for a dean, which is also applicable in the context of academic leadership in general. This study involved 214 lecturers who responded to the PJSAL instrument via Google Form. Its construct validity was then assessed using Exploratory Factor Analysis (EFA), while its reliability was assessed based on Cronbach's Alpha values. The findings show that the PJSAL instrument has strong construct validity and good reliability (α = .965 for the entire instrument; α = .797- .918 for each subscale). The results of the EFA also reveal the existence of 10 factors in the PJSAL instrument, which are extracted from the 38 items composing it. The instrument is found not to be much different from DSI, except for the emergence of a new factor called role ambiguity.
Multidimensional Rasch Analysis of Gender Differences in Tes Intelegensi Kolektif Indonesia–Tinggi (TIKI-T)
Whisnu Yudiana;
Airin Triwahyuni;
Hery Susanto
JP3I (Jurnal Pengukuran Psikologi dan Pendidikan Indonesia) Vol 12, No 1 (2023): JP3I
Publisher : Fakultas Psikologi UIN Syarif Hidayatullah Jakarta
Show Abstract
|
Download Original
|
Original Source
|
Check in Google Scholar
|
DOI: 10.15408/jp3i.v12i1.20417
The empirical evidence on gender differences in the g-factor or general intelligence and various cognitive abilities remains contradictory. Some studies have found that there are no gender differences in general intelligence, while others have found differences between genders in verbal, spatial, and numerical abilities as measured by standardized cognitive tests. This study aims to examine the presence of differential item functioning (DIF) on standardized tests that measure verbal, numerical, and spatial/nonverbal abilities, as well as gender differences in item level. The multidimensional Rasch model was used to identify DIF based on four cognitive domains in the Tes Intelegensi Kolektif IndonesiaTinggi (TIKI-T) test. A total of 1,443 undergraduate students were tested. The results of the study showed that while there were several unbiased items, some items were clearly biased against males or females. The DIF was higher in the numerical and verbal subtests for female-male differences, while the DIF on male tests corresponded to spatial/nonverbal subtest performance. The theoretical and practical implications of the results are discussed.
The Development of Cyberbullying in Social Media Scale
Shabrina Audinia;
Dewi Maulina;
Riangga Novrianto;
Bianca Alia Sudewaji;
Izzatullail Arpin Lotusiana
JP3I (Jurnal Pengukuran Psikologi dan Pendidikan Indonesia) Vol 12, No 1 (2023): JP3I
Publisher : Fakultas Psikologi UIN Syarif Hidayatullah Jakarta
Show Abstract
|
Download Original
|
Original Source
|
Check in Google Scholar
|
DOI: 10.15408/jp3i.v12i1.24142
Despite the fact that cyberbullying is common on social media, only a few instruments have beendeveloped to assess cyberbullying tendencies in the social media context. The purpose of this study is to develop a Cyberbullying in Social Media Scale (CSMS) for cyberbullying perpetration. Participants are active social media users in Indonesia (n = 958) between the ages of 18 and 40. The Cronbach alpha reliability testing showed that CSMS had a high internal consistency (α =.852). Confirmatory factor analysis revealed that CSMS fit the one-factor model (χ² (54) = 154.891, p < 0.001, RMSEA = 0.044 [90% CI 0.036, 0.052], CFI = 0.906, TLI = 0.885, SRMR = 0.049). Convergent-discriminant validity testing method using the Big Five Inventory also showed that CSMS is valid in measuring cyberbullying perpetration in the social media context. The Cyberbullying in Social Media Scale (CSMS) is a developed unidimensional measurement tool that evaluates cyberbullying tendencies on social media. The CSMS has demonstrated reliability and validity, making it a valuable new instrument for screening and assessing levels of cyberbullying tendencies among young adults in Indonesia. As such, the scale has practical applications for guiding interventions and investigating cyberbullying behavior.
Construct Validity of Posttraumatic Growth Inventory in the Context of the COVID-19 Pandemic
Ardiana Meilinawati
JP3I (Jurnal Pengukuran Psikologi dan Pendidikan Indonesia) Vol 12, No 1 (2023): JP3I
Publisher : Fakultas Psikologi UIN Syarif Hidayatullah Jakarta
Show Abstract
|
Download Original
|
Original Source
|
Check in Google Scholar
|
DOI: 10.15408/jp3i.v12i1.24365
Research that examines the construct validity of Posttraumatic Growth Inventory in the context of the COVID-19 pandemic has never been conducted. This study aimed to test the construct validity of Posttraumatic Growth Inventory (PTGI) on the five dimensions to see the consistency of the PTGI dimensionality structure. Data collection was carried out on 135 COVID-19 survivors, aged 18–40 in Indonesia. Analysis was carried out by confirmatory factor analysis (CFA) and measurement invariance (MI). The results of the analysis proved that PTGI is a measuring instrument that tends to be multidimensional and reliable to be used in Indonesia. All model fit indices met the parameters based on the values of SRMR (<.06), RMSEA (<.10), CFI (>.85), and TLI (>.85). Factor loadings ranged from 0.616 to 0.839 except for item 6 and item 9, which were below 0.6. These low loading factors in item 6 and item 9 were caused by the choice of translated words which tend to be less precise with the dimension being measured. Recommendations related to changes in translated words were explained further in the article as a follow-up to the adjustment of the item statement. Other factors such as personality characteristics, level of self-esteem, and social stigma were also found to be associated with the results of the analysis. MI testing showed that the PTGI model was not influenced by gender in the study sample group.
Metacognitive Skills Assessment in Research-Proposal Writing (MSARPW) in the Indonesian University Context: Scale Development and Validation Using Multidimensional Item Response Models
Bahrul Hayat;
Wardani Rahayu;
Muhammad Dwirifqi Kharisma Putra;
Iva Sarifah;
Tina Deviana;
Valendra Granitha Shandika Puri;
Khairunesa Isa
JP3I (Jurnal Pengukuran Psikologi dan Pendidikan Indonesia) Vol 12, No 1 (2023): JP3I
Publisher : Fakultas Psikologi UIN Syarif Hidayatullah Jakarta
Show Abstract
|
Download Original
|
Original Source
|
Check in Google Scholar
|
DOI: 10.15408/jp3i.v12i1.31679
This study aimed to develop the Metacognitive Skills Assessment in a Research Proposal Writing Context (MSARPW), a multidimensional measure, based on student perspectives, for assessing metacognitive skills in thesis writing, and assess the instrument’s psychometric properties using item factor analysis (IFA) and multidimensional item response models. The 40-item MSARPW was administered to 602 Indonesian university students (Mage = 25.254 SDage = 6.854). The IFA showed that the two-dimensional factor structure of MSARPW was satisfactory; however, only 24 of the 40 items were found to fit the model. Multidimensional graded response models (MGRM) were applied to the subsequent 24-item MSARPW, which showed that one item (Item 4) did not satisfy the criteria. The estimated reliabilities of each subscale showed that the 23-item MSARPW has good internal consistency (0.891 and 0.902). To conclude, the 23-item MSARPW appears to be a valid and reliable tool for assessing metacognitive skills in the context of research-proposal writing among Indonesian university students.