?

Evaluate Teaching Performance by Residuals of Student Achievement

  • Wanpeng Lei ,
  • Hongmei Ma ,
  • Huaming Huang
Expand
  • 1. Faculty of Education, Central China Normal University/Hubei Institute for Basic Education Research Wuhan, 430079
    2. Faculty of Education, Shaoguan University Shaoguan, 512005

Online published: 2021-07-02

Abstract

Error-component analysists argue that after netting out the effects of student background, teacher credentials and school characteristics, the residuals of test scores generated by subtracting predicted values from the class-level mean can be regarded as teachers’ effect on pupils’ achievement. The paper tests this idea by using self-collected teacher-student matched data from Hubei and Guangdong province. Residual analyses show that, (1) Marginal effects of teaching performance of teachers instructing Chinese Language Art, Math and English are among 0.3?0.5 standard deviations, among which the magnitude of Math teachers’ effect is the largest. (2) There are huge individual differences among teachers in terms of teaching performance. If a teacher of average quality were replaced by the most effective one, the whole class would witness a net gain of 0.3?1.0 standard deviations. On the contrary, if he or she were replaced by the worst colleague, mean performance of the class he or she taught would go down by 0.5?0.7 standard deviations. Policy implications of this article are obvious with regard to evaluating teachers’ performance.

Cite this article

Wanpeng Lei , Hongmei Ma , Huaming Huang . Evaluate Teaching Performance by Residuals of Student Achievement[J]. Journal of East China Normal University(Educational Sciences), 2021 , 39(7) : 84 -91 . DOI: 10.16382/j.cnki.1000-5560.2021.07.008

References

null 常芳, 党伊玮, 史耀疆, 刘承芳 “优绩优酬”: 关于西北农村教师绩效工资的实验研究 华东师范大学学报(教育科学版) 2018 36 4 131 141 常芳, 党伊玮, 史耀疆, 刘承芳. (2018). “优绩优酬”: 关于西北农村教师绩效工资的实验研究. 华东师范大学学报(教育科学版),36(4),131—141.
null 梁文艳, 杜育红 基于学生学业成绩的教师质量评价: 来自中国西部农村小学的证据 北京大学教育评论 2011 9 3 105 120 梁文艳, 杜育红. (2011). 基于学生学业成绩的教师质量评价: 来自中国西部农村小学的证据. 北京大学教育评论,9(3),105—120.
null 雷万鹏, 马红梅 学生成绩对教师工资的影响 北京大学教育评论 2019 17 4 160 172 雷万鹏, 马红梅. (2019). 学生成绩对教师工资的影响. 北京大学教育评论,17(4),160—172.
null 薛海平, 王蓉 义务教育教师绩效奖金、教师激励与学生成绩 教育研究 2016 37 5 21 33 薛海平, 王蓉. (2016). 义务教育教师绩效奖金、教师激励与学生成绩. 教育研究,37(5),21—33.
null Borman, G. D. and Kimball, S. M Teacher Quality and Educational Equality: Do Teachers with Higher Standards-Based Evaluation Ratings Close Student Achievement Gaps? Elementary School Journal 2005 106 1 3 20 Borman, G. D. and Kimball, S. M. (2005). Teacher Quality and Educational Equality: Do Teachers with Higher Standards-Based Evaluation Ratings Close Student Achievement Gaps?. Elementary School Journal, 106(1), 3—20.
null Chang, F., Wang, H., Qu, Y., Zheng, Q., Loyalka, P., Sylvia, S., Shi, Y., Dill, S.-E. and Rozelle, S The Impact of Pay-for-Percentile Incentive on Low-Achieving Students in Rural China Economics of Education Review 2020 75 3 1 10 Chang, F., Wang, H., Qu, Y., Zheng, Q., Loyalka, P., Sylvia, S., Shi, Y., Dill, S.-E. and Rozelle, S. (2020). The Impact of Pay-for-Percentile Incentive on Low-Achieving Students in Rural China. Economics of Education Review, 75(3), 1—10.
null Chetty, R., Friedman, J. N. and Rockoff, J. E Measuring the Impacts of Teachers Ii: Teacher Value-Added and Student Outcomes in Adulthood American Economic Review 2014 104 9 2633 2679 Chetty, R., Friedman, J. N. and Rockoff, J. E. (2014). Measuring the Impacts of Teachers Ii: Teacher Value-Added and Student Outcomes in Adulthood. American Economic Review, 104(9), 2633—2679.
null Cowan, J. and Goldhaber, D. D Do Bonuses Affect Teacher Staffing and Student Achievement in High Poverty Schools? Evidence from an Incentive for National Board Certified Teachers in Washington State Economics of Education Review 2018 65 4 138 152 Cowan, J. and Goldhaber, D. D. (2018). Do Bonuses Affect Teacher Staffing and Student Achievement in High Poverty Schools? Evidence from an Incentive for National Board Certified Teachers in Washington State. Economics of Education Review, 65(4), 138—152.
null Duflo, E., Dupas, P. and Kremer, M Peer Effects, Teacher Incentives, and the Impact of Tracking: Evidence from a Randomized Evaluation in Kenya American Economic Review 2011 101 5 1739 1774 Duflo, E., Dupas, P. and Kremer, M. (2011). Peer Effects, Teacher Incentives, and the Impact of Tracking: Evidence from a Randomized Evaluation in Kenya. American Economic Review, 101(5), 1739—1774.
null Duflo, E., Dupas, P. and Kremer, M School Governance, Teacher Incentives, and Pupil-Teacher Ratios: Experimental Evidence from Kenyan Primary Schools Journal of Public Economics 2015 123 3 92 110 Duflo, E., Dupas, P. and Kremer, M. (2015). School Governance, Teacher Incentives, and Pupil-Teacher Ratios: Experimental Evidence from Kenyan Primary Schools. Journal of Public Economics, 123(3), 92—110.
null Goldhaber, D. D., Brewer, D. J. and Anderson, D A Three-Way Error Components Analysis of Educational Productivity Education Economics 1999 7 3 199 208 Goldhaber, D. D., Brewer, D. J. and Anderson, D. (1999). A Three-Way Error Components Analysis of Educational Productivity. Education Economics, 7(3), 199—208.
null Goldstein, H Using League Table Rankings in Public Policy Formation: Statistical Issues Annual Review of Statistics and Its Application 2014 1 1 385 399 Goldstein, H. (2014). Using League Table Rankings in Public Policy Formation: Statistical Issues. Annual Review of Statistics and Its Application, 1(1), 385—399.
null Goldstein, H. and Spiegelhalter, D. J League Tables and Their Limitations: Statistical Issues in Comparisons of Institutional Performance Journal of the Royal Statistical Society: Series A (Statistics in Society) 1996 159 3 385 409 Goldstein, H. and Spiegelhalter, D. J. (1996). League Tables and Their Limitations: Statistical Issues in Comparisons of Institutional Performance. Journal of the Royal Statistical Society: Series A (Statistics in Society), 159(3), 385—409.
null Hanushek, E. A The Economic Value of Higher Teacher Quality Economics of Education Review 2011 30 3 466 479 Hanushek, E. A. (2011). The Economic Value of Higher Teacher Quality. Economics of Education Review, 30(3), 466—479.
null Hanushek, E. A., Piopiunik, M. and Wiederhold, S The Value of Smarter Teachers: International Evidence on Teacher Cognitive Skills and Student Performance Journal of Human Resources 2019 54 4 857 899 Hanushek, E. A., Piopiunik, M. and Wiederhold, S. (2019). The Value of Smarter Teachers: International Evidence on Teacher Cognitive Skills and Student Performance. Journal of Human Resources, 54(4), 857—899.
null Hanushek, E. A. and Rivkin, S. G. (2006). Teacher Quality. In E. A. Hanushek and F. Welch (Eds.), Handbook of the Economics of Education (Vol. 2, pp. 1051-1075). Amsterdam, North-Holland: Elsevier.
null Hanushek, E. A. and Rivkin, S. G The Distribution of Teacher Quality and Implications for Policy Annual Review of Economics 2012 4 1 131 157 Hanushek, E. A. and Rivkin, S. G. (2012). The Distribution of Teacher Quality and Implications for Policy. Annual Review of Economics, 4(1), 131—157.
null Leckie, G. and Goldstein, H A Multilevel Modelling Approach to Measuring Changing Patterns of Ethnic Composition and Segregation among London Secondary Schools, 2001-2010 Journal of the Royal Statistical Society. Series A (Statistics in Society) 2015 178 2 405 424 Leckie, G. and Goldstein, H. (2015). A Multilevel Modelling Approach to Measuring Changing Patterns of Ethnic Composition and Segregation among London Secondary Schools, 2001-2010. Journal of the Royal Statistical Society. Series A (Statistics in Society), 178(2), 405—424.
null Loyalka, P., Sylvia, S., Liu, C., Chu, J. and Shi, Y Pay by Design: Teacher Performance Pay Design and the Distribution of Student Achievement Journal of Labor Economics 2019 37 3 621 662 Loyalka, P., Sylvia, S., Liu, C., Chu, J. and Shi, Y. (2019). Pay by Design: Teacher Performance Pay Design and the Distribution of Student Achievement. Journal of Labor Economics, 37(3), 621—662.
null Milanowski, A The Relationship between Teacher Performance Evaluation Scores and Student Achievement: Evidence from Cincinnati Peabody Journal of Education 2004 79 4 33 53 Milanowski, A. (2004). The Relationship between Teacher Performance Evaluation Scores and Student Achievement: Evidence from Cincinnati. Peabody Journal of Education, 79(4), 33—53.
null Mu?oz, M. A., Prather, J. R. and Stronge, J. H Exploring Teacher Effectiveness Using Hierarchical Linear Models: Student-and Classroom-Level Predictors and Cross-Year Stability in Elementary School Reading Planning and Changing 2011 42 3-4 241 273 Mu?oz, M. A., Prather, J. R. and Stronge, J. H. (2011). Exploring Teacher Effectiveness Using Hierarchical Linear Models: Student-and Classroom-Level Predictors and Cross-Year Stability in Elementary School Reading. Planning and Changing, 42(3-4), 241—273.
null Nagler, M., Piopiunik, M. and West, M. R Weak Markets, Strong Teachers: Recession at Career Start and Teacher Effectiveness Journal of Labor Economics 2020 38 2 453 500 Nagler, M., Piopiunik, M. and West, M. R. (2020). Weak Markets, Strong Teachers: Recession at Career Start and Teacher Effectiveness. Journal of Labor Economics, 38(2), 453—500.
null Pham, L. D., Nguyen, T. D. and Springer, M. G Teacher Merit Pay: A Meta-Analysis American Educational Research Journal 2020 57 6 1 40 Pham, L. D., Nguyen, T. D. and Springer, M. G. (2020). Teacher Merit Pay: A Meta-Analysis. American Educational Research Journal, 57(6), 1—40.
null Rothstein, J. M Teacher Quality in Educational Production: Tracking, Decay, and Student Achievement Quarterly Journal of Economics 2010 125 1 175 214 Rothstein, J. M. (2010). Teacher Quality in Educational Production: Tracking, Decay, and Student Achievement. Quarterly Journal of Economics, 125(1), 175—214.
null Shifrer, D., Turley, R. L. and Heard, H Do Teacher Financial Awards Improve Teacher Retention and Student Achievement in an Urban Disadvantaged School District? American Educational Research Journal 2017 54 6 1117 1153 Shifrer, D., Turley, R. L. and Heard, H. (2017). Do Teacher Financial Awards Improve Teacher Retention and Student Achievement in an Urban Disadvantaged School District?. American Educational Research Journal, 54(6), 1117—1153.
null Stronge, J. H., Ward, T. J., Tucker, P. D. and Hindman, J. L What Is the Relationship between Teacher Quality and Student Achievement? An Exploratory Study Journal of Personnel Evaluation in Education 2007 20 3-4 165 184 Stronge, J. H., Ward, T. J., Tucker, P. D. and Hindman, J. L. (2007). What Is the Relationship between Teacher Quality and Student Achievement? An Exploratory Study. Journal of Personnel Evaluation in Education, 20(3-4), 165—184.
null Subedi, B. R., Reese, N. and Powell, R Measuring Teacher Effectiveness through Hierarchical Linear Models: Exploring Predictors of Student Achievement and Truancy Journal of Education and Training Studies 2015 3 2 34 43 Subedi, B. R., Reese, N. and Powell, R. (2015). Measuring Teacher Effectiveness through Hierarchical Linear Models: Exploring Predictors of Student Achievement and Truancy. Journal of Education and Training Studies, 3(2), 34—43.
Outlines

/