Validity and reliability of student perceptions of teaching quality in primary education

Emmelien A. van der Scheer, Hannah J.E. Bijlsma, Cees A.W. Glas

Research output: Contribution to journalArticleAcademicpeer-review

18 Downloads (Pure)

Abstract

A Bayesian IRT-model approach was used to investigate the validity and reliability of student perceptions of teaching quality. Furthermore, the student perceptions were compared with ratings of teaching quality by external observers. Grade 4 students (n = 675) filled out a questionnaire that was used to measure their opinions about the lessons of their teachers. Three lessons of 39 teachers were recorded and rated by 4 raters. The analyses showed that student perception and lesson observation scales fit best in an 11-dimensional model, which was an indication of construct validity and discriminant validity. Student perception scales were reliable, although not all items contributed to the scales to the same extent. Student ratings and lesson observations scores generally correlated moderately (ranging from r = .18 to r = .50). Higher correlations were found for scales with a similar content; however, no clear pattern was apparent. Suggestions for future research are presented.

Original languageEnglish
Pages (from-to)30-50
Number of pages21
JournalSchool effectiveness and school improvement
Volume30
Issue number1
Early online date19 Nov 2018
DOIs
Publication statusPublished - 2 Jan 2019

Fingerprint

primary education
Teaching
student
rating
teacher
construct validity
indication
school grade
questionnaire

Keywords

  • UT-Hybrid-D
  • Student perceptions
  • teaching quality
  • classroom observations

Cite this

@article{9a636b91205f4a7497fca0e7cce013ed,
title = "Validity and reliability of student perceptions of teaching quality in primary education",
abstract = "A Bayesian IRT-model approach was used to investigate the validity and reliability of student perceptions of teaching quality. Furthermore, the student perceptions were compared with ratings of teaching quality by external observers. Grade 4 students (n = 675) filled out a questionnaire that was used to measure their opinions about the lessons of their teachers. Three lessons of 39 teachers were recorded and rated by 4 raters. The analyses showed that student perception and lesson observation scales fit best in an 11-dimensional model, which was an indication of construct validity and discriminant validity. Student perception scales were reliable, although not all items contributed to the scales to the same extent. Student ratings and lesson observations scores generally correlated moderately (ranging from r = .18 to r = .50). Higher correlations were found for scales with a similar content; however, no clear pattern was apparent. Suggestions for future research are presented.",
keywords = "UT-Hybrid-D, Student perceptions, teaching quality, classroom observations",
author = "{van der Scheer}, {Emmelien A.} and Bijlsma, {Hannah J.E.} and Glas, {Cees A.W.}",
note = "Taylor & Francis deal",
year = "2019",
month = "1",
day = "2",
doi = "10.1080/09243453.2018.1539015",
language = "English",
volume = "30",
pages = "30--50",
journal = "School effectiveness and school improvement",
issn = "0924-3453",
publisher = "Taylor & Francis",
number = "1",

}

Validity and reliability of student perceptions of teaching quality in primary education. / van der Scheer, Emmelien A.; Bijlsma, Hannah J.E.; Glas, Cees A.W.

In: School effectiveness and school improvement, Vol. 30, No. 1, 02.01.2019, p. 30-50.

Research output: Contribution to journalArticleAcademicpeer-review

TY - JOUR

T1 - Validity and reliability of student perceptions of teaching quality in primary education

AU - van der Scheer, Emmelien A.

AU - Bijlsma, Hannah J.E.

AU - Glas, Cees A.W.

N1 - Taylor & Francis deal

PY - 2019/1/2

Y1 - 2019/1/2

N2 - A Bayesian IRT-model approach was used to investigate the validity and reliability of student perceptions of teaching quality. Furthermore, the student perceptions were compared with ratings of teaching quality by external observers. Grade 4 students (n = 675) filled out a questionnaire that was used to measure their opinions about the lessons of their teachers. Three lessons of 39 teachers were recorded and rated by 4 raters. The analyses showed that student perception and lesson observation scales fit best in an 11-dimensional model, which was an indication of construct validity and discriminant validity. Student perception scales were reliable, although not all items contributed to the scales to the same extent. Student ratings and lesson observations scores generally correlated moderately (ranging from r = .18 to r = .50). Higher correlations were found for scales with a similar content; however, no clear pattern was apparent. Suggestions for future research are presented.

AB - A Bayesian IRT-model approach was used to investigate the validity and reliability of student perceptions of teaching quality. Furthermore, the student perceptions were compared with ratings of teaching quality by external observers. Grade 4 students (n = 675) filled out a questionnaire that was used to measure their opinions about the lessons of their teachers. Three lessons of 39 teachers were recorded and rated by 4 raters. The analyses showed that student perception and lesson observation scales fit best in an 11-dimensional model, which was an indication of construct validity and discriminant validity. Student perception scales were reliable, although not all items contributed to the scales to the same extent. Student ratings and lesson observations scores generally correlated moderately (ranging from r = .18 to r = .50). Higher correlations were found for scales with a similar content; however, no clear pattern was apparent. Suggestions for future research are presented.

KW - UT-Hybrid-D

KW - Student perceptions

KW - teaching quality

KW - classroom observations

UR - http://www.scopus.com/inward/record.url?scp=85057308287&partnerID=8YFLogxK

U2 - 10.1080/09243453.2018.1539015

DO - 10.1080/09243453.2018.1539015

M3 - Article

VL - 30

SP - 30

EP - 50

JO - School effectiveness and school improvement

JF - School effectiveness and school improvement

SN - 0924-3453

IS - 1

ER -