Factors affecting the reliability of senior high schools’ english teacher-made test in Kebumen
Abstract
This study come up with the problem during the informal interview with the senior high school teachers. The researchers found that the teachers never check out whether the test they made reliable or not. They just find that the students’ score are high when the test done online and the score was low when the test done offline. This study aims to analyze the reliability and the factors affecting the reliability of senior high schools’ English teacher-made test in Kebumen regency. This research belongs to qualitative research, and it used descriptive case study. The instruments used by the researchers to get the data were documentation, close-ended questionnaires, and open-ended interviews. From the research, the reliability of the teacher-made tests are 0.839 (MAN 1 Kebumen), 0.747 (MAN 2 Kebumen), and 0.649 (MAN 3 Kebumen), so the test are reliable. Viewed from the questionnaires’ results, the factors affecting the reliability of the test are student-related reliability, rater reliability, test administration reliability, and test reliability. From the interviews’ results, the factors influencing the tests’ reliability are the mastery of learning material, the preparation of learning before getting the test, students' physical condition, the clarity of instructions of the test, clarity of questions in the test, the atmosphere and time allocation for doing the test.
References
Adom, D., Mensah, J. A., & Dake, D. A. (2020). Test, measurement, and evaluation: Understanding and use of the concepts in education. International Journal of Evaluation and Research in Education, 9(1), 109–119. https://doi.org/10.11591/ijere.v9i1.20457
Apsari, Y., & Haryudin, A. (2017). THE ANALYSIS OF ENGLISH LECTURERS’ CLASSROOM-BASED READING ASSESSMENTS TO IMPROVE STUDENTS’ READING COMPREHENSION. ELTIN Journal, 5(1), 35–44.
Arifin, M. A. (2018). Validity, Reliability and Practicality Of The First Certification in English (FCE) and The Business Language Testing Service (Bulats). Journal of Language Teaching and Learning, Linguistics and Literature, 6(2), 80–95.
Ary, D., Jacobs, L. C., Sorensen, C., & Razavieh, A. (2010). Introduction to Research in Education (8th ed.). Wadsworth Cengage Learning.
Azmi, U. (2020). Developing web-based reading tests for the students of English language education. Journal of Applied Linguistics, Translation, and Literature, 1(2), 92–104.
Brown, H. D. (2004). Language Assessment: Principles and Classroom Practices. Longman.
Creswell, J. W. (2012). Educational Research: Planning, Conducting, and Evaluating Quantitative and Qualitative Research (Fourth). Pearson Education.
Furwana, D. (2019). Validity and Reliability of Teacher-Made English Summative Test at Second Grade of Vocational High School 2 Palopo. LANGUAGE CIRCLE: Journal Lof Language and Literature, 13(2). http://journal.unnes.ac.id
Heigham, J., & Croker, R. A. (2009). Qualitative Research in Applied Linguistics: A Practical Introduction (First). PALGRAVE MACMILLAN.
James, C. (2013). Errors in Language Learning and Use: Exploring Error Analysis. Routledge.
Jayanti, D., Husna, N., & Hidayat, D. N. (2019). The Validity and Reliability Analysis of English National Final Examination for Junior High School. Voices of English Language Education Society, 3(2), 127–135.
Kinyua, K., & Okunya, L. O. (n.d.). Validity and reliability of teacher-made tests: Case study of year 11 physics in Nyahururu District of Kenya. 11.
Lebagi, D., Sumardi, S., & Sudjoko, S. (2017). THE QUALITY OF TEACHER-MADE TEST IN EFL CLASSROOM AT THE ELEMENTARY SCHOOL AND ITS WASHBACK IN THE LEARNING. Journal of English Education, 2(2), 97–104. https://doi.org/10.31327/jee.v2i2.289
Öz, H., & Özturan, T. (2018). Computer-based and paper-based testing: Does the test administration mode influence the reliability and validity of achievement tests? Journal of Language and Linguistic Studies, 14(1), 67–85.
Qu, W., & Zhang, C. (2013). The Analysis of Summative Assessment and Formative Assessment and Their Roles in College English Assessment System. Journal of Language Teaching and Research, 4(2), 335–339. https://doi.org/10.4304/jltr.4.2.335-339
Rosaroso, R. C. (2015). Using Reliability Measures in Test Validation. European Scientific Journal, 11(18), 369–377.
Setiabudi, A., Mulyadi, & Puspita, H. (2019). An Analysis of Validity and Reliability of A Teacher-Made Test (Case Study at XI Grade of SMA N 6 Bengkulu). Journal of English Education and Teaching, 3(4), 522–532.
Setiawaty, R., Sulistyorini, T. B., Margono, & Rahmawati, L. E. (2017). Validity Test and Reliability of Indonesian Language Multiple Choice in Final Term Examination. The 1st International Seminar on Language, Literature and Education, 2018, 43–50. https://doi.org/10.18502/kss.v3i9.2609
Sugianto, A. (2017). VALIDITY AND RELIABILITY OF ENGLISH SUMMATIVE TEST FOR SENIOR HIGH SCHOOL. Indonesian EFL Journal: Journal of ELT, Linguistics, and Literature, 3(2), 22–38.
Sultana, R. (2015). Reliability of the Currently Administered Language Tests in Bangladesh: A Case Study. Journal of Literature, Languages and Linguistics, 17, 76–85.
SÜRÜCÜ, L., & MASLAKÇI, A. (2020). Validity and Reliability in Quantitative Research. BUSINESS & MANAGEMENT STUDIES: AN INTERNATIONAL JOURNAL, 8(3), 2694–2726. http://dx.doi.org/10.15295/bmij.v8i3.1540
Taherdoost, H. (2016). Validity and Reliability of the Research Instrument; How to Test the Validation of a Questionnaire/Survey in a Research. SSRN Electronic Journal. https://doi.org/10.2139/ssrn.3205040
Tosuncuoglu, I. (2018). Importance of Assessment in ELT. Journal of Education and Training Studies, 6(9), 163–167. https://doi.org/10.11114/jets.v6i9.3443
Ulfah, A. A., Kartono, & Susilaningsih, E. (2020). Validity of Content and Reliability of Inter-Rater Instruments Assessing Ability of Problem Solving. Journal of Educational Research and Evaluation, 9(1), 1–7.
Wenno, I. H., Tuhurima, D., & Manoppo, Y. (2021). How to Create a Good Test. Jurnal Pendidikan Profesi Guru Indonesia, 1(1), 11–20.
Zimmerman, D. W., & Zumbo, B. D. (2015). Resolving the Issue of How Reliability is Related to Statistical Power: Adhering to Mathematical Definitions. Journal of Modern Applied Statistical Methods, 14(2), 9–26. https://doi.org/10.22237/jmasm/1446350640
