The Technical Report on the 2nd Round OECD Survey of Social and Emotional Skills of Chinese Adolescence

doi:10.16382/j.cnki.1000-5560.2024.05.003

Abstract

Abstract:

Based on data from the 2023 Survey on Social and Emotional Skills (SSES) in Jinan, China, this technical report analyzes the psychometric characteristics of the second round of assessment tools under Chinese culture. The report presents a brief introduction of the development and implementation process of the student questionnaire, the subscales of the social and emotional skills, the main components of the questionnaire, the main content of the data set, and the analysis of data quality. The results showed that the students in Jinan had a positive attitude towards the Survey, with high participation rate and valid response rate. However, the frequency distributions of younger cohort showed a tall right tail. The coefficients ω’s and α’s represented that most of the subscales had good reliability. Confirmatory factor analysis revealed the validity (fitness) of each subscale of social and emotional skills were satisfactory. Multi-group confirmatory factor analysis showed that the cross-gender measure invariance of these subscales was better than that of cross-cohorts, so the data of these subscales should be used with caution when examining the age-differences among adolescence.

Key words: adolescence, social and emotional skills, reliability, confirmatory factor analysis, measurement invariance

Zhifang Shao, Yipeng Tang, Jing Zhang. The Technical Report on the 2^nd Round OECD Survey of Social and Emotional Skills of Chinese Adolescence[J]. Journal of East China Normal University(Educational Sciences), 2024, 42(5): 58-71.

Figures/Tables 14

分量表	等值水平	χ²(df)	CFI	TLI	RMSEA	SRMR
果敢	形态等值弱等值强等值	752.41(35) 740.69(34) 1286.62(40)	0.94 0.94 0.90	0.93 0.93 0.89	0.07 0.07 0.09	0.05 0.04 0.06
合作	形态等值弱等值强等值*	1262.04(63) 1254.75(62) 2193.46(70)	0.93 0.93 0.88	0.92 0.92 0.88	0.07 0.07 0.09	0.05 0.05 0.07
创造性	形态等值弱等值强等值	456.95(48) 453.40(47) 732.97(54)	0.98 0.99 0.97	0.98 0.99 0.97	0.05 0.05 0.06	0.03 0.03 0.04
好奇心	形态等值弱等值强等值	605.49(48) 599.62(47) 1185.06(54)	0.95 0.95 0.90	0.95 0.94 0.90	0.06 0.06 0.07	0.04 0.04 0.05
情绪控制	形态等值弱等值强等值	849.17(35) 847.94(34) 1347.60(40)	0.96 0.96 0.93	0.95 0.95 0.93	0.08 0.08 0.09	0.04 0.04 0.05
共情	形态等值* 弱等值* 强等值*	1313.19(48) 1304.72(47) 1805.72(54)	0.88 0.88 0.83	0.86 0.85 0.82	0.08 0.08 0.09	0.06 0.06 0.06
活力	形态等值弱等值强等值*	725.93(35) 725.25(34) 1269.04(40)	0.93 0.93 0.87	0.91 0.91 0.86	0.07 0.07 0.09	0.05 0.05 0.06
成就动机	形态等值弱等值强等值*	1294.47(63) 1280.22(62) 1744.41(70)	0.93 0.93 0.90	0.92 0.92 0.90	0.07 0.07 0.08	0.07 0.06 0.07
乐观	形态等值弱等值强等值*	148.48(24) 147.32(23) 1013.34(28)	0.99 0.99 0.92	0.99 0.99 0.91	0.04 0.04 0.10	0.03 0.03 0.07
毅力	形态等值弱等值强等值	714.64(48) 709.64(47) 1180.01(54)	0.96 0.96 0.94	0.96 0.96 0.94	0.06 0.06 0.07	0.05 0.04 0.06
责任感	形态等值弱等值强等值	484.04(35) 473.61(34) 874.52(40)	0.96 0.97 0.93	0.96 0.96 0.93	0.06 0.06 0.07	0.04 0.04 0.05
自控力	形态等值弱等值强等值	687.39(35) 684.72(34) 984.90(40)	0.95 0.95 0.93	0.94 0.94 0.92	0.07 0.07 0.08	0.05 0.04 0.05
乐群	形态等值弱等值强等值*	1802.96(63) 1772.27(62) 2409.23(70)	0.91 0.91 0.88	0.90 0.90 0.88	0.09 0.08 0.09	0.07 0.06 0.07
抗压力	形态值弱等值强等值	231.97(24) 230.31(23) 242.96(28)	0.98 0.98 0.98	0.97 0.97 0.98	0.05 0.05 0.04	0.05 0.04 0.04
包容度	形态等值弱等值强等值	1075.00(63) 1064.47(62) 2321.77(70)	0.91 0.91 0.81	0.90 0.90 0.80	0.06 0.07 0.09	0.05 0.05 0.07
信任	形态等值弱等值强等值	356.85(48) 356.46(47) 781.16(54)	0.98 0.98 0.96	0.98 0.98 0.96	0.04 0.04 0.06	0.03 0.03 0.04

分量表	等值水平	χ²(df)	CFI	TLI	RMSEA	SRMR
果敢	形态等值弱等值强等值	710.88(35) 705.50(34) 766.68(40)	0.95 0.95 0.95	0.94 0.94 0.95	0.07 0.07 0.07	0.04 0.04 0.04
合作	形态等值弱等值强等值	1129.25(63) 1124.89(62) 1274.23(70)	0.95 0.95 0.94	0.94 0.94 0.94	0.07 0.07 0.07	0.05 0.04 0.04
创造性	形态等值弱等值强等值	511.74(48) 499.80(47) 808.79(54)	0.98 0.98 0.97	0.98 0.98 0.96	0.05 0.05 0.06	0.04 0.03 0.04
好奇心	形态等值弱等值强等值	618.16(48) 614.16(47) 1043.85(54)	0.95 0.95 0.92	0.95 0.95 0.92	0.06 0.06 0.07	0.04 0.04 0.04
情绪控制	形态等值弱等值强等值	942.10(35) 931.45(34) 966.56(40)	0.96 0.96 0.95	0.95 0.95 0.95	0.08 0.08 0.08	0.05 0.04 0.04
共情	形态等值* 弱等值* 强等值*	1206.35(48) 1185.41(47) 1291.17(54)	0.88 0.89 0.88	0.87 0.86 0.87	0.08 0.08 0.08	0.06 0.05 0.05
活力	形态等值弱等值强等值	608.56(35) 608.56(34) 661.09(40)	0.95 0.95 0.94	0.94 0.93 0.94	0.07 0.07 0.06	0.04 0.04 0.03
成就动机	形态等值弱等值强等值	833.11(63) 825.83(62) 1066.08(70)	0.96 0.96 0.95	0.96 0.96 0.95	0.06 0.06 0.06	0.04 0.04 0.04
乐观	形态等值弱等值强等值	179.41(24) 176.58(23) 227.41(28)	0.99 0.99 0.98	0.99 0.99 0.98	0.04 0.04 0.04	0.03 0.03 0.03
毅力	形态等值弱等值强等值	619.43(48) 619.21(47) 720.35(54)	0.97 0.97 0.97	0.97 0.97 0.97	0.06 0.06 0.06	0.03 0.03 0.03
责任感	形态等值弱等值强等值	429.12(35) 428.20(34) 476.05(40)	0.97 0.97 0.97	0.97 0.96 0.97	0.05 0.06 0.05	0.03 0.03 0.03
自控力	形态等值弱等值强等值	670.32(35) 668.19(34) 755.10(40)	0.95 0.95 0.95	0.95 0.94 0.95	0.07 0.07 0.07	0.04 0.04 0.04
乐群	形态等值弱等值强等值	1565.05(63) 1564.64(62) 1612.20(70)	0.93 0.93 0.92	0.92 0.91 0.92	0.08 0.08 0.08	0.05 0.05 0.04
抗压力	形态等值弱等值强等值	144.72(24) 111.12(23) 144.58(28)	0.99 0.99 0.99	0.99 0.99 0.99	0.04 0.03 0.03	0.05 0.02 0.02
包容度	形态等值弱等值强等值	886.19(63) 881.68(62) 943.58(70)	0.93 0.93 0.92	0.92 0.91 0.92	0.06 0.06 0.06	0.04 0.04 0.04
信任	形态等值弱等值强等值	308.25(48) 308.09(47) 477.16(54)	0.99 0.99 0.98	0.99 0.99 0.98	0.04 0.04 0.05	0.02 0.02 0.03

References 0

	高丙成. 中国大陆学生一般自我效能感研究的元分析中国特殊教育 2014 04 90 96 高丙成. (2014). 中国大陆学生一般自我效能感研究的元分析. 中国特殊教育,(04),90—96.
	邵志芳, 刘志, 杨舒豫 & 黄忠敬. 开放能力: 中国青少年社会与情感能力测评分报告之四华东师范大学学报(教育科学版) 2021 09 77 92 邵志芳, 刘志, 杨舒豫 & 黄忠敬. (2021). 开放能力: 中国青少年社会与情感能力测评分报告之四. 华东师范大学学报(教育科学版),(09),77—92. doi: 10.16382/j.cnki.1000-5560.2021.09.005
	张静, 唐一鹏, 郭家俊, 邵志芳. 中国青少年社会与情感能力测评之技术报告华东师范大学学报(教育科学版) 2021 39 9 109 128 张静, 唐一鹏, 郭家俊, 邵志芳. (2021). 中国青少年社会与情感能力测评之技术报告. 华东师范大学学报(教育科学版), 39(9), 109—128. doi: 10.16382/j.cnki.1000-5560.2021.09.007
	张敏, 雷开春, 张巧明. 中学生学习效能感的特点研究心理科学 2005 05 1148 1151+1095 张敏, 雷开春, 张巧明. (2005). 中学生学习效能感的特点研究. 心理科学,(05),1148—1151+1095. doi: 10.16719/j.cnki.1671-6981.2005.05.030
	Beauducel, A., & Wittmann, W. W. Simulation study on fit indexes in CFA based on data with slightly distorted simple structure Structural Equation Modeling 2005 12 41 75 Beauducel, A., & Wittmann, W. W. (2005). Simulation study on fit indexes in CFA based on data with slightly distorted simple structure. Structural Equation Modeling, 12, 41—75.
	Costa, P. T., & McCrae, R. R. Four ways five factors are basic Personality and Individual Differences 1992 13 6 653 665 Costa, P. T., & McCrae, R. R. (1992). Four ways five factors are basic. Personality and Individual Differences, 13(6), 653—665.
	Cronbach, L. Coefficient alpha and the internal structure of tests Psychometrika 1951 16 297 334 Cronbach, L. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16, 297—334.
	de Haan, A., De Pauw, S., van den Akk, A. Dekovic, M., & Prinzie, P. Long-Term Developmental Changes in Children’s Lower-Order Big Five Personality Facets Journal of Personality 2017 85 5 616 631 de Haan, A., De Pauw, S., van den Akk, A. Dekovic, M., & Prinzie, P. (2017). Long-Term Developmental Changes in Children’s Lower-Order Big Five Personality Facets. Journal of Personality, 85(5), 616—631.
	French, B. F., & Finch, W. H. Confirmatory factor analytic procedures for the determination of measurement invariance Structural Equation Modeling A Multidisciplinary Journal 2006 13 378 402 French, B. F., & Finch, W. H. (2006). Confirmatory factor analytic procedures for the determination of measurement invariance. Structural Equation Modeling A Multidisciplinary Journal, 13, 378—402.
	Heene, M., Hilbert, S., Draxler, C., Ziegler, M., & Buehner, M. Masking misfit in confirmatory factor analysis by increasing unique variances: A cautionary note on the usefulness of cut-off values of fit indices Psychological Methods 2011 16 319 336 Heene, M., Hilbert, S., Draxler, C., Ziegler, M., & Buehner, M. (2011). Masking misfit in confirmatory factor analysis by increasing unique variances: A cautionary note on the usefulness of cut-off values of fit indices. Psychological Methods, 16, 319—336.
	Hu, L. T., & Bentler, P. M. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives Structural Equation Modeling: A Multidisciplinary Journal 1999 6 1 55 Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6, 1—55.
	Kankaraš, M., Feron, E., & Renbarger, R. (2019), Assessing students’ social and emotional skills through triangulation of assessment methods. OECD Education Working Papers, No. 208, OECD Publishing, Paris, https://doi.org/10.1787/717ad7f2-en.
	Kankaraš, M., & Suarez-Alvarez, J. (2019). Assessment framework of the OECD Study on Social and Emotional Skills. OECD Education Working Papers, No. 207, OECD Publishing, Paris, https://doi.org/10.1787/5007adef-en.
	McDonald, R. (2013). Test Theory. New York: Psychology Press.
	OECD (2019). Curiosity and Creativity. Unpublished.
	OECD (2021a). OECD Survey on Social and Emotional Skills Technical Report. https://www.oecd.org/education/ceri/social-emotional-skills-study/sses-technical-report.pdf.
	OECD (2021b). Beyond Academic Learning: First Results from the Survey of Social and Emotional Skills, OECD Publishing, Paris, https://doi.org/10.1787/92a11084-en.
	Primi, R., Hauck-Filho, N., Valentini & Santos, D. (2020). Classical Perspectives of Controlling Acquiescence with Balanced Scales, In: Wiberg, M., Molenaar, D., González, J., Böckenholt, U., Kim, JS. (eds) Quantitative Psychology. IMPS 2019. Springer Proceedings in Mathematics & Statistics, vol 322. Springer, Cham. https://doi.org/10.1007/978-3-030-43469-4_25.
	Soto, C., John, O. P., Gosling, S. D., & Potter, J. Age differences in personality traits from 10 to 65: Big Five domains and facets in a large cross-sectional sample Journal of Personality and Social Psychology 2011 100 2 330 348 Soto, C., John, O. P., Gosling, S. D., & Potter, J. (2011). Age differences in personality traits from 10 to 65: Big Five domains and facets in a large cross-sectional sample. Journal of Personality and Social Psychology, 100(2), 330—348.

主维度	子能力	含义
任务能力（尽责性）	毅力（PER）	在任务和活动中坚持不懈直到完成。
	责任感（RES）	能够遵守承诺，守时且可靠。
	自控力（SEL）	能够避免分心和一时冲动，并将注意力集中在当前任务上，以实现个人目标。
	成就动机（MOT）	为自己设定高标准并努力达到这些标准。
情绪能力（情绪稳定性）	抗压力（STR）	有效调节焦虑和冷静解决问题的能力（放松，能很好地处理压力）。
	乐观（OPT）	总体上对自己和生活抱有积极乐观的期望。
	情绪控制（EMO）	面对挫折时能有效调节不同程度的怒气。
协作能力（宜人性）	共情（EMP）	理解和关心他人及其幸福健康，这将促使对亲近关系的重视和投入。
	合作（COO）	与他人和谐相处，重视与他人的关系。
	信任（TRU）	认为他人通常都有良好的意图，并且原谅那些做错事的人。
开放能力（开放性）	包容度（TOL）	对不同的观点持开放态度、重视多样性和/或欣赏外国人和文化。
	创造性（CRE）	通过探索、从失败中学习、洞察力和远见中产生新的做事或思考方式。
	好奇心（CUR）	对想法感兴趣，热爱学习、理解和思考性探索；一种探究的思维模式。
交往能力（外向性）	乐群（SOC）	能够接近他人，包括朋友和陌生人，和/或建立和维持社交联系。
	果敢（ASS）	能够自信地表达观点、需求和感受并施加社会影响。
	活力（ENE）	精力充沛、兴奋和自主地对待日常生活。

生活环境指标		生活结果指标
变量名	含义	变量名	含义
SES ST_BELONG ST_BULLY ST_BULLYPERP ST_DISRUP ST_GENBIAS ST_GENVIO ST_GROWTHMI ST_HOMGEN ST_RELSATIF ST_RELTEACH ST_SESGEN	社会经济地位学校归属感受霸凌霸凌者不良行为性别偏见性别暴力成长型思维家庭性别角色关系满意度师生关系社会情感的性别期望	ST_ANXTEST ST_BODYIMAGE ST_LIFESAT ST_STUCLASS ST_WELLBEING ST_HEALTHBEH	学业焦虑身体意象指数生活满意度同学关系心理幸福感健康行为

学校编号	学校类型		学校编号	学校类型		学校编号	学校类型
001—010 011—012 013 014—019 020—025 026—028 029—50	初中普高职高初中普高职高初中		051—063 064—066 067—069 070，071 072 073—075	普高职高初中普高初中普高		901—902 903 904 905—907 908，909	初中普高初中职高初中

生活环境指标	α系数	生活结果指标	α系数
学校归属感	0.81	学业焦虑	0.93
霸凌者	0.86	身体意象指数	0.67
受霸凌	0.88	生活满意度	0.89
性别偏见	0.43	同学关系	0.84
性别暴力	0.85	心理幸福感	0.92
成长型思维	0.82	不良行为	0.45
家庭性别角色	0.81	健康行为	0.49
师生关系	0.87
社会情感的性别期望	0.88

[1]	Zhenguo Yuan, Zhongjing Huang, Hong Wang, Xiangyu Wang, Jing Zhang. First Report on the Development of Chinese Adolescents’ Social and Emotional Skills: Based on the Second Round of SSES Data [J]. Journal of East China Normal University(Educational Sciences), 2024, 42(5): 1-32.
[2]	Zhongjing Huang, Yipeng Tang, Juan Wang. Student Social and Emotional Competence: International Comparison and Chinese Performance [J]. Journal of East China Normal University(Educational Sciences), 2024, 42(5): 33-57.
[3]	Zhongjing Huang, Kaiyue Shang, Jing Zhang. Does Growth Mindset Affect Students’ Social and Emotional Skills Development: Empirical Analyses Based on OECD Social and Emotional Skills Study [J]. Journal of East China Normal University(Educational Sciences), 2023, 41(4): 22-32.
[4]	Yipeng Tang, Zhongjing Huang. Empirical Research on the Cultivation Performance of Social and Emotional Skills: An International Comparative Analysis Based on SSES 2021 [J]. Journal of East China Normal University(Educational Sciences), 2023, 41(4): 33-45.
[5]	Jing Zhang, Zeliang Jin, Zhongjing Huang. Can Social and Emotional Skills Effectively Reduce Students’ Bullying: Empirical Analyses Based on OECD Social and Emotional Skills Study [J]. Journal of East China Normal University(Educational Sciences), 2023, 41(4): 46-55.
[6]	Lei Zheng, Yu Sun. Where there is a Will, there is a Way: Heterogeneous Effects of Students’ Willpower on Cognitive Abilities [J]. Journal of East China Normal University(Educational Sciences), 2022, 40(8): 83-95.
[7]	Zhenguo Yuan, Zhongjing Huang, Jingjuan Li, Jing Zhang. Report on Chinese Adolescence’s Development of Social and Emotional Skills [J]. Journal of East China Normal University(Educational Sciences), 2021, 39(9): 1-32.
[8]	Jing Zhang, Yipeng Tang, Jiajun Guo, Zhifang Shao. The Technical Report on OECD Study on Social and Emotional Skills of Chinese Adolescence [J]. Journal of East China Normal University(Educational Sciences), 2021, 39(9): 109-126.
[9]	Xingyuan Gao, Hongyan Chen, Jie Wu, Zhongjing Huang. Task Performance: Report on the Study on Social and Emotional Skills of Chinese Adolescence (I) [J]. Journal of East China Normal University(Educational Sciences), 2021, 39(9): 33-46.
[10]	Zhi Liu, Ruirui Zhu, Haili Cui, Zhongjing Huang. Emotional Regulation: Report on the Study on Social and Emotional Skills of Chinese Adolescence (II) [J]. Journal of East China Normal University(Educational Sciences), 2021, 39(9): 47-61.
[11]	Yipeng Tang, Jie Zheng, Xiaoxue Sun, Zhongjing Huang. Collaboration: Report on the Study on Social and Emotional Skills of Chinese Adolescence (III) [J]. Journal of East China Normal University(Educational Sciences), 2021, 39(9): 62-76.
[12]	Zhifang Shao, Zhi Liu, Shuyu Yang, Zhongjing Huang. Open-mindedness: Report on the Study on Social and Emotional Skills of Chinese Adolescence (IV) [J]. Journal of East China Normal University(Educational Sciences), 2021, 39(9): 77-92.
[13]	Zhongjing Huang, Qian Wang, Huanchun Chen, Xingyuan Gao. Engaging with Others: The Report on the Study on Social and Emotional Skills of Chinese Adolescents (V) [J]. Journal of East China Normal University(Educational Sciences), 2021, 39(9): 93-108.
[14]	Yong Zhao. Fundamental Issues in Educational Assessment [J]. Journal of East China Normal University(Educational Sciences), 2021, 39(4): 1-14.