Assessing Quality of Teaching from Different Perspectives: Measurement Invariance across Teachers and Classes

Research output: Journal contributionsJournal articlesResearchpeer-review

Standard

Assessing Quality of Teaching from Different Perspectives: Measurement Invariance across Teachers and Classes. / Krammer, Georg; Pflanzl, Barbara; Lenske, Gerlinde et al.
In: Educational Assessment, Vol. 26, No. 2, 04.2021, p. 88-103.

Research output: Journal contributionsJournal articlesResearchpeer-review

Harvard

APA

Vancouver

Krammer G, Pflanzl B, Lenske G, Mayr J. Assessing Quality of Teaching from Different Perspectives: Measurement Invariance across Teachers and Classes. Educational Assessment. 2021 Apr;26(2):88-103. Epub 2020 Dec 18. doi: 10.1080/10627197.2020.1858785

Bibtex

@article{2d51d05cd0704f089e5d732b2a05ac06,
title = "Assessing Quality of Teaching from Different Perspectives: Measurement Invariance across Teachers and Classes",
abstract = "Comparing teachers{\textquoteright} self-assessment to classes{\textquoteright} assessment of quality of teaching can offer insights for educational research and be a valuable resource for teachers{\textquoteright} continuous professional development. However, the quality of teaching needs to be measured in the same way across perspectives for this comparison to be meaningful. We used data from 622 teachers self-assessing aspects of quality of teaching and of their classes (12229 students) assessing the same aspects. Perspectives were compared with measurement invariance analyses. Teachers and classes agreed on the average level of instructional clarity, and disagreed over teacher-student relationship and performance monitoring, suggesting that mean differences across perspectives may not be as consistent as the literature claims. Results showed a nonuniform measurement bias for only one item of instructional clarity, while measurement of the other aspects was directly comparable. We conclude the viability of comparing teachers{\textquoteright} and classes{\textquoteright} perspectives of aspects of quality of teaching.",
keywords = "Educational science",
author = "Georg Krammer and Barbara Pflanzl and Gerlinde Lenske and Johannes Mayr",
year = "2021",
month = apr,
doi = "10.1080/10627197.2020.1858785",
language = "English",
volume = "26",
pages = "88--103",
journal = "Educational Assessment",
issn = "1062-7197",
publisher = "Routledge Taylor & Francis Group",
number = "2",

}

RIS

TY - JOUR

T1 - Assessing Quality of Teaching from Different Perspectives

T2 - Measurement Invariance across Teachers and Classes

AU - Krammer, Georg

AU - Pflanzl, Barbara

AU - Lenske, Gerlinde

AU - Mayr, Johannes

PY - 2021/4

Y1 - 2021/4

N2 - Comparing teachers’ self-assessment to classes’ assessment of quality of teaching can offer insights for educational research and be a valuable resource for teachers’ continuous professional development. However, the quality of teaching needs to be measured in the same way across perspectives for this comparison to be meaningful. We used data from 622 teachers self-assessing aspects of quality of teaching and of their classes (12229 students) assessing the same aspects. Perspectives were compared with measurement invariance analyses. Teachers and classes agreed on the average level of instructional clarity, and disagreed over teacher-student relationship and performance monitoring, suggesting that mean differences across perspectives may not be as consistent as the literature claims. Results showed a nonuniform measurement bias for only one item of instructional clarity, while measurement of the other aspects was directly comparable. We conclude the viability of comparing teachers’ and classes’ perspectives of aspects of quality of teaching.

AB - Comparing teachers’ self-assessment to classes’ assessment of quality of teaching can offer insights for educational research and be a valuable resource for teachers’ continuous professional development. However, the quality of teaching needs to be measured in the same way across perspectives for this comparison to be meaningful. We used data from 622 teachers self-assessing aspects of quality of teaching and of their classes (12229 students) assessing the same aspects. Perspectives were compared with measurement invariance analyses. Teachers and classes agreed on the average level of instructional clarity, and disagreed over teacher-student relationship and performance monitoring, suggesting that mean differences across perspectives may not be as consistent as the literature claims. Results showed a nonuniform measurement bias for only one item of instructional clarity, while measurement of the other aspects was directly comparable. We conclude the viability of comparing teachers’ and classes’ perspectives of aspects of quality of teaching.

KW - Educational science

UR - http://www.scopus.com/inward/record.url?scp=85097922463&partnerID=8YFLogxK

U2 - 10.1080/10627197.2020.1858785

DO - 10.1080/10627197.2020.1858785

M3 - Journal articles

AN - SCOPUS:85097922463

VL - 26

SP - 88

EP - 103

JO - Educational Assessment

JF - Educational Assessment

SN - 1062-7197

IS - 2

ER -

Recently viewed

Publications

  1. Programmierung einer DELTA-Roboterzelle nach PackML Standard
  2. An experience-based learning framework
  3. Performance incentives in activity-based management
  4. Rethinking the Spatiality of Spatial Planning
  5. Identification of Parameters and States in PMSMs
  6. PID Controller Application in a Gimbal Construction for Camera Stabilization and Tracking
  7. Eulerian and Lagrangian perspectives on turbulent superstructures in Rayleigh-Bénard convection
  8. Do Linguistic Features Influence Item Difficulty in Physics Assessments?
  9. The erosion of relational values resulting from landscape simplification
  10. Resolving conflicts between people and over time in the transformation toward sustainability
  11. Temporal and thermodynamic irreversibility in production theory
  12. Making the most out of timeseries symptom data
  13. Lyapunov stability analysis to set up a saturating PI controller with anti-windup for a mass flow system
  14. Media-Assisted Foreign Language Learning - Concepts and Functions
  15. Effect of grain size and structure, solid solution elements, precipitates and twinning on nanohardness of Mg-Re alloys
  16. An Exploration of humans‘ ability to recognize emotions displayed by robots
  17. Using Digitalization As An Enabler For Changeability In Production Systems In A Learning Factory Environment
  18. Training in Components of Problem-Solving Competence
  19. Dialogic interactions in higher vocational learning environments in mainland China
  20. Anwendungsprogrammierung mit Embedded-SQL
  21. Metamodelizing the Territory
  22. Diversity Management and Corporate Change: Implications for Co-Determination
  23. Is implicit Theory of Mind real but hard to detect?
  24. Deciding between the Covariance Analytical Approach and the Change-Score Approach in Two Wave Panel Data
  25. Policy implementation through multi-level governance
  26. Effectiveness of self-generation during learning is dependent on individual differences in need for cognition
  27. Accuracy Improvement of Vision System for Mobile Robot Navigation by Finding the Energetic Center of Laser Signal
  28. Activity–rest schedules in physically demanding work and the variation of responses with age
  29. Determinants of entrepreneurial intent: A meta-analytic test and integration of competing models
  30. Internal reference price response across store formats
  31. Sustainable Consumption - Mapping the Terrain
  32. Chip extrusion with integrated equal channel angular pressing
  33. Exploring the dark and unexpected sides of digitalization
  34. Endemic predators, invasive prey and native diversity