IDENTIFIKASI DIFFERENTIAL ITEM FUNCTIONING PADA TES PENGERTIAN MEKANIK (C4) DENGAN PENDEKATAN RASCH MODEL
Keywords:
Mechanical Reasoning Test, Rasch ModelAbstract
Mechanical Reasoning Test (C4) was used in an assessment to measure the mechanical reasoning aptitude. Mechanical Reasoning Test has a quality of high-stakes exam, it has a major life consequence for the subject. Mechanical Reasoning Test needs to be re-tested to check whether its items’ usage are still justified or if it needs to be changed. Also, besides having good items qualities, it is also important to make sure that Mechanical Reasoning Test (C4) are not biased for one gender. An item indicated to be DIF will be beneficiary for one group of subjects, while biased against another. The purpose of this research was to test the quality of items and to identify the Differential Item Functioning (DIF) of Mechanical Reasoning Test using Rasch Model. Rasch Model was chosen because it has advantages in data analysis compared to classical model. Data analysis was done using the software Winstep 3.73. The amount of data gathered were 528 divided into M = 184 and F = 344. Respondents’ age range was 16 to 20 years old. The analysis showed that Mechanical Reasoning Test was a difficult test, because the difficulty level was much higher than subjects’ capability. The reliability score was .73, as such it can be considered reliable. All the questions in Mechanical Reasoning Test were fit and can show subjects’ true capability. There were 24 items indicated to be DIF and biased for one group of subjects.
References
Azwar, S. (1994). Differential Item Functioning analysis, an issue on UMPTN item banking with IRT procedures. Buletin Psikologi, 1, 14–20.
Azwar, S. (2016). Dasar-Dasar Psikometrika. Yogyakarta: Pustaka Pelajar.
Bennett, G. K., Seashore, H., & Wesman, A. (1952). Differential Aptitude Test Manual (Second Edition). New York: The Psychological Corporation.
Dagenais, F. (1992). Bennett Mechanical Comprehension Test: Normative data for a sample of Saudi Arabian technical trainees. Perceptual and Motor Skills, 74(1), 107–113.
Engelhard, G. (2008). Historical Perspectives on Invariant Measurement: Guttman, Rasch, and Mokken. Measurement: Interdisciplinary Research and Perspectives, 6(3), 155–189.https://doi.org/10.1080/15366360802197792
Goh, H. E., Marais, I., & Ireland, M. J.(2017). A Rasch Model Analysis of the Mindful Attention Awareness Scale. Assessment, 24(3), 387–398. https://doi.org/10.1177/1073191115607043
Hambleton, R. K. (2006). Good Practices for Identifying Differential ItemFunctioning: Medical Care,44(Suppl 3), S182–S188.https://doi.org/10.1097/01.mlr.0000245443.86671.c4
Hambleton, R. K., Swaminathan, H., & Rogers, H. J. (1991). Fundamentals of Item Response Theory. Newbury Park: Sage.Nijenhuis, J. T., Evers, A., & Mur, J. P. (2000). Validity of the Differential Aptitude Test for the Assessment of Immigrant Children. Educational Psychology, 20(1), 99–115.
Ojha, J. M. (1965). Revision of Differential Aptitude Test for Higher Secondary Schools. The Maharaja Sayajirao University of Baroda, Vadodara.
Prahastuti, N. F. (2018). Analisis Kualitas Tes Pengertian Mekanik (C4) berdasarkan Teori Tes Klasik.Universitas Gadjah Mada, Yogyakarta.
Strobl, C., Kopf, J., & Zeileis, A. (2015). Rasch Trees: A New Method for Detecting Differential Item Functioning in the Rasch Model. Psychometrika, 80(2), 289–316. https://doi.org/10.1007/s11336-013-9388-3
Sudaryono. (2012). Sensitivitas metode pendeteksian differential item functioning (DIF). Jurnal Evaluasi Pendidikan, 3(1), 82–94.
Wright, B. D., & Stone, M. H. (1979). Best Test Design. Kimbark Ave: Mesa Press.
