Application of Intra-Class Correlation to Multi-Rater Agreement on Students’ Grading
Article Sidebar
Page Numbers:
281-297
Digital Object Identifier:
10.58578/ijhess.v4i2.9109
Viewed: 74 times
Downloaded: 55 times
LYAS Publisher cordially invites qualified professionals to serve as Editors or Reviewers. Your expertise will make an important contribution to maintaining and strengthening the academic quality of our publications. Interested applicants are kindly requested to complete the application form at the following link: Editors & Reviewers
Please feel free to contact us if you need any further information about the submission process or if you have any additional questions.
Authors:
Adetunji . A. A1*, Alo N. G.2, Anibijuwon A. A.3 
Copyright :
Authors retain copyright and grant the journal right of first publication.
Main Article Content
Abstract
Fair and credible student assessment depends on consistent grading practices, particularly when multiple raters evaluate academic performance using a shared rubric. This study aimed to examine the consistency of students’ grading by applying the intraclass correlation approach to multi-rater assessments of academic performance. The reliability of ratings was evaluated using the Intraclass Correlation Coefficient (ICC) for continuous rating scores. Data were obtained from records of students’ assessments of project and seminar presentations. The findings revealed varying levels of agreement among raters, indicating that grading practices were generally inconsistent, although some degree of agreement was observed across different assessed variables. These results highlight the importance of applying inter-rater reliability statistics in educational assessment to identify inconsistencies in scoring practices. The study concludes that improving grading fairness and objectivity requires regular rater calibration and the consistent use of standardized rubrics. This study contributes to assessment practice by emphasizing the value of reliability analysis in strengthening the quality and credibility of academic evaluation.
Citation Metrics:
Downloads
Article Details
Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
References
Adebayo, A., & Ediale, T. (2024). Oral defence reliability among polytechnic faculty using ICC. Journal of Applied Education Studies, 11(1), 60–71.
Adebayo, F., & Eze, M. (2023). Impact of assessor training on essay scoring reliability. Journal of Educational Assessment in Nigeria, 7(3), 44–55.
Adebowale, T., & Ogunyemi, A. (2021). Assessing reliability in clinical evaluations: An ICC approach. Journal of Educational Measurement in Africa, 9(2), 112–124.
Adeola, B., & Ajayi, T. (2025). Improving grading reliability through rubric alignment and rater training. Journal of African Educational Research, 12(2), 33–48.
Ajibola, S., & Fatimah, K. (2021). Long-term effects of rater workshops in tertiary institutions. Nigerian Journal of Teacher Education, 9(1), 78–89.
Akinwunmi, D., & Dada, O. (2021). Standardizing practical exam assessments in universities. Educational Journal of Practical Pedagogy, 5(1), 91–102.
Banjo, R., & Etim, U. (2022). Comparing ICC and Kappa for undergraduate thesis evaluation. African Journal of Educational Statistics, 10(2), 71–83.
Bello, K., & Uche, O. (2023). Technology-enhanced grading: Improving rater consistency. Lagos Journal of Education and Technology, 6(1), 25–37.
Boateng, K., & Amponsah, J. (2020). The effect of digital rubrics on grading efficiency in Ghanaian polytechnics. West African Journal of Education, 4(2), 90–101.
Chukwuemeka, C., & Odili, A. (2022). Scoring alignment in business studies assessments. Journal of Social Science Pedagogy, 8(4), 55–69.
Ede, O., & Oduwole, T. (2022). Calibration sessions and their effects on ICC scores in Nigerian polytechnics. Journal of Polytechnic Education, 13(1), 47–61.
Fatoba, O., & Ajayi, J. (2020). Bias and variability in continuous assessment. Journal of Education and Social Research, 9(2), 103–115.
Ibe, R., & Onuoha, S. (2020). Disagreement in practical science grading: A Kappa analysis. Science Education Review, 10(1), 36–48.
Jones, D., Kimani, L., & Omondi, P. (2023). Rater background effects on scoring in Kenya's teacher colleges. East African Education Journal, 11(2), 62–74.
Kwarteng, K. (2023). A statistical primer on ICC and Kappa for educational research. Ghanaian Journal of Quantitative Methods, 5(1), 14–30.
Molefe, T., & Van Rensburg, L. (2021). Assessing final-year project grading reliability using ICC in South Africa. South African Journal of Higher Education, 35(2), 130–145.
Musa, Y., & Ibrahim, S. (2024). Fairness in oral presentation scoring using Cohen’s Kappa. Nigerian Journal of Communication and Assessment, 8(1), 51–64.
Nwankwo, C., & Ahmed, H. (2020). Best practices in inter-rater reliability for tertiary institutions. Nigerian Journal of Educational Statistics, 6(2), 70–89.
Okeke, A., & Olumide, R. (2021). Rater training outcomes in essay vs. practical assessments. Journal of Education and Training Research, 9(3), 100–115.
Okoro, I., & Eze, U. (2022). Departmental differences in scoring practices in Nigerian colleges. Journal of Comparative Educational Assessment, 7(2), 33–47.
Oladimeji, K., & Yusuf, A. (2023). Grading laboratory reports: A Nigerian polytechnic case study using ICC. West African Journal of Technical Education, 5(3), 76–88.
Oladipo, M., & Ayeni, R. (2020). Cognitive load and reliability in report grading. Journal of Educational Psychology and Measurement, 4(1), 29–40.
Omole, A., & Adebiyi, M. (2023). Disciplinary differences in polytechnic grading. Nigerian Education and Evaluation Journal, 10(1), 58–73.
Oseni, O., & Lawal, T. (2024). Electronic scoring sheets and inter-rater agreement in large classes. Ilorin Journal of Digital Learning, 6(2), 41–56.
Wang, J., & Chan, P. (2020). Peer presentation evaluation: Comparing ICC and Kappa. Asian Journal of Educational Research, 11(4), 101–117.
Wang, X., Harris, B., & Moore, D. (2022). Essay grading agreement among UK educators. Journal of Educational Evaluation, 9(3), 55–68.
Yusuf, I. (2023). Common pitfalls in using Kappa and ICC in educational statistics. Journal of Nigerian Quantitative Research, 7(2), 77–89.