Exploring the Chinese Pathway of Value-Added Assessment: Critical Analysis of the U.S. Practice

doi:10.16382/j.cnki.1000-5560.2023.02.006

Abstract

Abstract:

Comparative study and critical analysis approach were applied to analyze the essential features, technical issues, applicable limits, integration trends and preparative conditions of teacher value-added assessment, as well as to detect its pathway in terms of value proposition, technical breakthrough, application focus, developmental framework and practical transformation. Teacher value-added assessment measures teachers’ contribution to students’ learning based on their achievement growth, with the usage of value-added modelling. The approach quantifies the causal effect of teachers’ teaching upon student learning growth, and therefore provides quantitative evidence to diagnose levels of teachers’ effectiveness. Such features imply evidence-based orientation and technical specialties of value-added assessment, however, considering the limitations, over estimation of its value and over generalization in application should be avoided. Debates and unsolved technical challenges still exist around the issues of value-added modelling in terms of reliability, validity and statistical bias, Chinese efforts should be made to challenge the cutting-edge technological innovation and overcome the unsolved difficulties. Drawn from the evaluation reform history and empirical evidence of the U.S., it is proven that teacher value-added assessment should avoid risk of serving high-stakes decisions and highlight its diagnostic function. Integration of value-added assessment with diverse measurements becomes international trend in common, local efforts should be made to construct an integrated assessment system based on value pluralism and negotiation between multiple stakeholders. To promote practical implication of value-added assessment, preparative conditions should be met in development of national system of standardized assessment of student achievement and growth, development of national databases, organization of a professional team of expertise, as well as establishment of reporting and reflection mechanism for value-added assessment results and impacts, in order to add the maximized value to the new evaluation system.

Key words: value-added assessment, teacher value-added assessment, teacher effect, critical analysis

Yumei Han, Wenfan Yan, Dan Jiang. Exploring the Chinese Pathway of Value-Added Assessment: Critical Analysis of the U.S. Practice[J]. Journal of East China Normal University(Educational Sciences), 2023, 41(2): 63-80.

Figures/Tables 1

References 0

	边玉芳, 林志红. (2007). 增值评价: 一种绿色升学率理念下的学校评价模式. 北京师范大学学报(社会科学版), (06), 11- 18.
	边玉芳, 孙丽萍. (2015). 教师增值性评价的进展及在我国应用的建议. 教师教育研究, (01), 88- 95+112. doi: 10.13445/j.cnki.t.e.r.2015.01.001
	陈玉琨. (2007). 教育评价学. 北京: 人民教育出版社.
	古巴, 林肯. (2008). 第四代评估(秦霖, 蒋艳玲等译). 北京: 中国人民大学出版社.
	郭元祥, 王秋妮. (2021). 增值评价研究的知识图谱与前景展望. 教育测量与评价, (07), 3- 10.
	马晓强, 彭文蓉, 萨丽·托马斯. (2006). 学校效能的增值评价——对河北省保定市普通高中学校的实证研究. 教育研究, (10), 77- 84.
	邵越洋, 刘坚. (2020). 增值评价: 关注学校为每一位学生的成长助力——以北京市某区教育实证研究数据为例. 中国考试, (09), 40- 45.
	王斌华. (2005). 教师评价: 增值评价法. 教育理论与实践, (12), 20- 23.
	辛涛, 张文静, 李雪燕. (2009). 增值性评价的回顾与前瞻. 中国教育学刊, (04), 40- 43.
	杨小微. (2020). 在教育公平意义上理解和运用增值评价. 教育测量与评价, (08), 8- 10+18.
	杨欣. (2022). 教育评价改革的算法追问. 华东师范大学学报(教育科学版), (01), 19- 29.
	张兴. (1998). 引进增值观念推进素质教育. 教育导刊, (02-03), 14+81.
	郑智勇, 宋乃庆. (2021). 新时代基础教育增值评价的三重逻辑. 教育发展研究, (10), 1- 7+17. doi: 10.3969/j.issn.1008-3855.2021.10.003
	赵勇. (2021). 教育评价的几大问题及发展方向. 华东师范大学学报(教育科学版), (04), 1- 14. doi: 10.16382/j.cnki.1000-5560.2021.04.001
	朱德全, 宋乃庆. (2013). 教育统计与测评技术. 重庆: 西南师范大学出版社.
	AERA (American Educational Research Association). (2015). AERA issues statement on the use of value-added models in evaluation of educators and education preparation programs. Retrieved from https://www.aera.net/Newsroom/News-Releases-and-Statements/AERA-Issues-Statement-on-the-Use-of-Value-Added-Models-in-Evaluation-of-Educators-and-Educator-Preparation-Programs.
	ASA(American Statistical Association). (2014). ASA statement on using value-added models for educational assessment. Retrieved from http://www.amstar.org/policy/pdfs/ASA_VAM_Statement.pdf.
	Amrein-Beardsley, A. (2008). Methodological concerns about the education value-added assessment system. Educational Researcher, 37 (2), 65- 75. doi: 10.3102/0013189X08316420
	Amrein-Beardsley, A. & Holloway, J. (2019). Value-added models for teacher evaluation and accountability: Commonsense assumptions. Educational Policy, 33 (3), 516- 542. doi: 10.1177/0895904817719519
	Amrein-Beardsley, A., Pivovarova, M. & Geiger, T. (2016). Value-added models: What the experts say. Phi Delta Kappan, 98 (2), 35- 40. doi: 10.1177/0031721716671904
	Ballou, D. & Springer, M. G. (2015). Using student test scores to measure teacher performance: Some problems in the design and implementation of evaluation systems. Educational Researcher, 44 (2), 77- 86. doi: 10.3102/0013189X15574904
	Bill & Melinda Gates Foundation. (2010). Learning about teaching: Initial findings from the measures of effective teaching project. MET Project policy brief. Retrieved from http://k12education.gatesfoundation.org/download/?Num=2683&filename=Preliminary_Finding-Policy_Brief.pdf.
	Bill & Melinda Gates Foundation. (2012). Gathering feedback for teaching: Combing high-quality observations with student surveys and achievement gains. MET project research paper. Retrieved from https://files.eric.ed.gov/fulltext/ED540960.pdf.
	Blazar, D., Litke, E. & Barmore, J. (2016). What does it mean to be ranked a “High” or “Low” value-added teacher? Observing differences in instructional quality across districts. American Educational Research Journal, 53 (2), 324- 359. doi: 10.3102/0002831216630407
	Braun, H. I. (2005). Using student progress to evaluate teachers: A primer on value-added models. Educational Testing Service (ETS) Policy Information Center report. Retrieved from https://www.ets.org/Media/Research/pdf/PICVAM.pdf.
	Braun, H. (2015). The value in value-added depends on ecology. Educational Researcher, 44 (2), 127- 131. doi: 10.3102/0013189X15576341
	Briggs, D. & Domingue, B. (2011). Due diligence and the evaluation of teachers: A review of the value-added analysis underlying the effectiveness rankings of Los Angeles Unified School District teachers by the Los Angeles Times. Boulder, CO: National Education Policy Center. Retrieved from https://files.eric.ed.gov/fulltext/ED516008.pdf.
	Chetty, R., Friedman, J. & Rockoff, R. (2014). Measuring the impacts of teachers II: Teacher value-added and student outcomes in adulthood. American Economic Review, 104 (9), 2633- 2679. doi: 10.1257/aer.104.9.2633
	Collins, C & Amrein-Beardsley, A. (2014). Putting growth and value-added models on the map: A national overview. Teacher College Record, 116 (1), 1- 32.
	Darling-Hammond, L. (2000). Teacher quality and student achievement: A review of state policy evidence. Education Policy Analysis Archives, 8 (1), 1- 44.
	Darling-Hammond, L. (2015). Can value added add value to teacher evaluation? Educational Researcher, 44(2), 132—137.
	Darling-Hammond, L., Amrein-Beardsley, A., Haertel, E, Rothstein, J. (2012). Evaluating teacher evaluation. Phi Delta Kappan, 93 (6), 8- 15. doi: 10.1177/003172171209300603
	Deardorff, A. (2016). Deardorffs’ glossary of international economics. Retrieved from http://www-personal.umich.edu/~alandear/glossary/v.html#ValueAdded.
	Dee, T. & Wyckoff, J. (2015). Incentive, selection, and teacher performance: Evidence from IMPACT. Journal of Policy Analysis and Management, 34 (2), 267- 297. doi: 10.1002/pam.21818
	Dragoset L., et. al. (2015). Usage of policies and practices promoted by Race to the Top. Washington, D. C.: U. S. Department of Education, Institute of Education Sciences, National Center for Educational Evaluation and Regional Assistance. Retrieved from https://files.eric.ed.gov/fulltext/ED559916.pdf.
	Education Week. (2015, October 6). Teacher evaluation heads to the courts. Education Week. Retrieved from https://www.edweek.org/policy-politics/teacher-evaluation-heads-to-the-courts.
	Everson, K. C. (2017). Value-added modeling and educational accountability: Are we answering the real questions? Review of Educational Research, 87(1), 35—70.
	Florida Department of Education. (2022). Performance evaluation. Retrieved from https://www.fldoe.org/teaching/performance-evaluation/.
	Glazerman, S. , Loeb, S. , Goldhaber, D. , Staiger, D. , Raudenbush, S. & Whitehurst, G. (2010). Evaluating teachers: The important role of value-added. The Brookings Brown Center Task Group on Teacher Quality. Retrieved from https://www.brookings.edu/wp-content/uploads/2016/06/1117_evaluating_teachers.pdf.
	Goe, L., Bell, C. & Little, O. (2008). Approaches to evaluating teacher effectiveness: A research synthesis. National Comprehensive Center for Teacher Quality, ETS. Retrieved from https://gtlcenter.org/sites/default/files/docs/EvaluatingTeachEffectiveness.pdf.
	Goldhaber, D. (2015). Exploring the potential of value-added performance measures to affect the quality of the teacher workforce. Educational Researcher, 44 (2), 87- 95. doi: 10.3102/0013189X15574905
	Good, T. L. (2014). What do we know about how teachers influence student performance on standardized tests: And why do we know so little about other student outcomes. Teachers College Record, 116 (1), 1- 41.
	Haertel, E. (2013). Reliability and validity of inferences about teachers based on student test scores. Princeton, NJ: Educational Testing Service.
	Hanushek, E. (1971). Teacher characteristics and gains in student achievement: Estimation using micro data. The American Economic Review, 61 (2), 280- 288.
	Harris, E. A. (2016, May 10). Court vacates Long Island teacher’s evaluation tied to test scores. New York Times. Retrieved from https://www.nytimes.com/2016/05/11/nyregion/court-vacates-long-island-teachers-evaluation-tied-to-student-test-scores.html?_r=1.
	Harris, D. & Herrington, C. D. (2015). Editors’ introduction: The use of teacher value-added measures in schools: New evidence, unanswered questions, and future prospects. Educational Researcher, 44 (2), 71- 76. doi: 10.3102/0013189X15576142
	Johnson, S. M. (2015). Will VAMS reinforce the walls of the egg-crate school? Educational Researcher, 44(2), 117−126.
	Koedel, C., Mihaly, K., & Rockoff, J. E. (2015). Value-added modeling: A review. Economics of Education Review, (47), 180- 195.
	Kupermintz, H. (2003). Teacher effects and teacher effectiveness: A validity investigation of the Tennessee Value Added Assessment System. Educational Evaluation and Policy Analysis, 25 (3), 287- 298. doi: 10.3102/01623737025003287
	McCaffrey, D. F. , Lockwood, J. R. & Hamilton, L. S. (2003). Evaluating value-added models for teacher accountability. Santa Monica, CA: RAND Corporation.
	Millman, J. (1997). Grading teachers, grading schools: Is student achievement a valid evaluation measure? Corwin Press, Inc.
	National Conference of State Legislatures. (2010). Education bill tracking database. Retrieved from https://www.ncsl.org/research/education/education-bill-tracking-and-databases.aspx
	NRC (National Research Council). (2010). Getting value out of value-added: Report of a workshop. Washington, D. C.: The National Academies Press.
	NRC (National Research Council). (2011). Incentives and test-based accountability in education. Washington, D. C.: The National Academies Press.
	Opper, I. M. (2019). Value-added modeling 101: Using student test scores to help measure teaching effectiveness. RAND Corporation. Retrieved from file: ///C: /Users/Admin/Downloads/RAND_RR4312z1%20(1). pdf.
	Sanders, W. L. & Horn, S. P. (1994). The Tennessee Value-Added Assessment System (TVAAS): Mixed-model methodology in educational assessment. Journal of Personnel Evaluation in Education, 8 (3), 299- 311. doi: 10.1007/BF00973726
	Sanders, W. L. & Horn, S. P. (1998). Research findings from the Tennessee Value-Added Assessment System (TVAAS) Database: Implications for educational evaluation and research. Journal of Personnel Evaluation in Education, 12 (3), 247- 256. doi: 10.1023/A:1008067210518
	Sass, T. R. (2008). The stability of value-added measures of teacher quality and implications for teacher compensation policy. Washington DC: National Center for Analysis of Longitudinal Data in Education Research (CALDER). Retrieved from https://files.eric.ed.gov/fulltext/ED508273.pdf.
	Schweig, J. (2019). Measuring teaching effectiveness: Understanding common, uncommon, and combined methods. RAND Corporation. Retrieved from https://www.rand.org/content/dam/rand/pubs/research_reports/RR4300/RR4312z4/RAND_RR4312z4.pdf.
	SDP (Strategic Data Project). (2012). Value-added measures: How and why the Strategic Data Project uses them to study teacher effectiveness. Retrieved from https://hwpi.harvard.edu/files/sdp/files/sdp-va-memo_0.pdf.
	Tennessee Department of Education. (2022). TEAM: Tennessee Educator Acceleration Model. Retrieved from https://team-tn.org/.
	Tucker, P. D. & Stronge, J. H. (2005). Linking teacher evaluation and student learning. Alexandria, VA: Association for Supervision and Curriculum Development.
	USDOE (U. S. Department of Education). (2002). No Child Left Behind. Retrieved from https://www2.ed.gov/nclb/landing.jhtml.
	USDOE (U. S. Department of Education). (2009). Race to the Top program executive summary. Washington, D. C. Retrieved from https://www2.ed.gov/programs/racetothetop/executive-summary.pdf.
	USDOE (U. S. Department of Education). (2016). Every Student Success Act. Retrieved from https://www.ed.gov/essa?src=rn.
	USNCEE (U. S. National Commission on Excellence in Education). (1983). A nation at risk: The imperative for educational reform. U. S. Department of Education Archived Information. Retrieved from https://www2.ed.gov/pubs/NatAtRisk/recomm.html.