Publication Type:

Conference Paper

Source:

2019 IEEE Tenth International Conference on Technology for Education (T4E) (2019)

URL:

https://ieeexplore.ieee.org/abstract/document/8983727

Keywords:

answer sheets, bilingual assessment, Computer aided instruction, consistent results, correlation coefficient, Dogs, dyslexia, error types, handicapped aids, Indian schools, inter-rater agreement, inter-rater reliability, internal consistency, internal test consistency, intraclass agreement, Malayalam-English dyslexia screening, paediatrics, paper-based tests, rater agreement, reading disability, Reliability, reproducible results, screening test, second-grade students, standardized dyslexia screening test, Task analysis, undiagnosed dyslexics, Visualization, Vocabulary, Writing

Abstract:

A standardized dyslexia screening test can help in identifying the vast number of undiagnosed dyslexics in Indian schools; needless to say, such a test should produce consistent and reproducible results. This study investigated reliability and consistency among raters of a Malayalam-English dyslexia screening in India. Paper-based tests were administered to groups of students, and four raters evaluated the answer sheets of 208 second-grade students (ages 6-7). Inter-rater agreement, intraclass agreement, and internal consistency were calculated. Our findings include good agreement among raters' appraisals for most error types and tasks. Internal consistency for a few tasks was low, possibly because these tasks evaluated more than one skill. A few error types need to be redefined and a few tasks need to be more skill-specific to enable unambiguous and fruitful interpretation by different raters in the future.

Cite this Research Publication

M. Haridas, Dr. Nirmala Vasudevan, Sasikumar, L., Gutjahr, G., Raghu Raman, and Prof. Prema Nedungadi, “Inter-Rater Reliability of a Dyslexia Screening Test”, in 2019 IEEE Tenth International Conference on Technology for Education (T4E), 2019.