教育评价

举贤不避亲:内部人特征降低了学术论文的质量和影响力吗?——以中国大陆教育学术期刊发表的923901篇论文为例

  • 李一杉 ,
  • 刘金松
展开
  • 1. 华东师范大学教育学部教育学系/国家教育宏观政策研究院,上海 200062
    2. 上海师范大学国际与比较教育研究院,上海 200234

网络出版日期: 2021-09-27

基金资助

2020年教育部人文社科基金青年基金项目“我国普通高中学生综合素质评价改革研究”(20YJC880054)

Relatives are not Avoided When Talents are Demanded: Does Insider Characteristics Reduce the Quality and Influence of Academic Papers? Examples from Mainland China

  • Yishan Li ,
  • Jinsong Liu
Expand
  • 1. Department of Education & National Institutes of Educational Policy Research in Faculty of Education, East China Normal University, Shanghai 200062, China
    2. College of Eudcation, Shanghai Normal University, Shanghai 200234, China

Online published: 2021-09-27

摘要

伴随着学术发表竞争程度加剧,关于学术期刊在论文发表中偏爱内部人稿件的讨论逐渐增加,但是尚无实证研究探讨内部人稿件对教育研究学术论文的质量和影响力发挥了怎样的作用。利用2001年至2019年中国大陆教育类学术研究期刊发表的923901篇论文的数据和80位访谈对象提供的文本证据,基于“成本-收益”机制框架、理性决策视角和交易成本概念三者结合的理论逻辑推导分析,就内部人特征对学术论文质量和影响力的效应提出了一项假说与四项研究假设并通过定量分析与质性分析结合的混合研究模式进行验证。研究发现:(1)内部人稿件在大部分“时段*目录*下载/引用”板块中的影响力和质量均优于外部人稿件。(2)随时间由远及近,内部人效应在不同板块有不同的变动趋势,在CSSCI来源由负转正,在CSSCI扩展与北大核心由正转负,在普通期刊呈现区间波动。(3)内部人特征对质量产生的总效用中包含了一部分影响力的中介/间接效应,该中介/间接效应随板块不同而变动,并且存在遮掩效应,应重视影响力的中介/间接效应对价值发现的作用。(4)位于中低档区间的内部人特征较位于中高档区间的内部人特征呈现更多的负效应,中高档区间的内部人特征则较中低档区间的内部人特征呈现更多的正效应。(5)外部人特征中的伪内部人特征相对内部人特征在质量和影响力维度的效应呈现下降趋势,但优于真外部人特征,并不能简单以“垄断”作负面理解。(6)学术期刊、审稿人和论文作者对内部人稿件的看法及其相应行动随着个体内在特征和所处外部环境的不同而存在明显差异。综合前述分析,本研究认为不能简单地认定含有内部人特征的内部人稿件显著降低了学术论文的质量和影响力,需要具体情况具体分析。同时内部人特征在帮助学术期刊降低与论文作者之间的交易成本时,以内部人稿件占比在中低档增加和中高档减少作为代价,并且这种代价因板块不同而存在差异。基于上述研究结果,本研究站在程序公平和实质公平的角度对学术期刊提出了强化内部流程、提升决策绩效和优化质量与影响力的建议,对论文作者提出了增强研究水平和建立专业声誉的建议。

本文引用格式

李一杉 , 刘金松 . 举贤不避亲:内部人特征降低了学术论文的质量和影响力吗?——以中国大陆教育学术期刊发表的923901篇论文为例[J]. 华东师范大学学报(教育科学版), 2021 , 39(10) : 77 -102 . DOI: 10.16382/j.cnki.1000-5560.2021.10.007

Abstract

Along with the increased level of competition for academic publication, there is a growing debate about the preference for insider manuscripts in academic journals, however, there has been no empirical research to discuss the effect of insider manuscripts on the quality and influence of academic papers in educational research. This study is based on data of 923, 901 papers published in educational academic research journals in mainland China from 2001 to 2019 and textual evidence from 80 interviewees, based on the framework of “cost-benefit” mechanism, rational decision-making perspective and the concept of transaction cost, a research hypothesis and two research assumptions on the effect of insider characteristic on the quality and influence of academic papers are proposed and verified by the combination of quantitative analysis and qualitative analysis of mixed research pattern. The study found that (1) the influence and quality of insider manuscripts are better than that of outsiders in most “Period * Catalog * Download/Cite” sections. (2) From far to near, the insider effect has a different trend in different plates, the effect in CSSCI changed from negative to positive, in CSSCI-E and PKU-CCJ changed from positive to negative, fluctuates in general journals. (3) There is a mediating/indirect effect of the influence of insider characteristic on the total utility of quality, the mediating/indirect effect varies by section, and there is a masking effect, attention should be paid to the mediating/indirect effect of influence on value discovery. (4) The insider characteristic in the middle and low range has more negative effect than that of the middle and high range, the insider characteristic in the middle and high range shows more positive effect than that in the middle and low range. (5) In terms of quality and influence, the fake insider characteristic of outsider characteristic show a downward trend compared with that of insider characteristic, but better than real outsider characteristic, it is not simply a negative definition of monopoly. (6) The opinions of academic journals, reviewers and paper authors on insider manuscripts and their corresponding actions are obviously different with the individual's internal characteristic and external environment. Synthesizing the above analysis, this study argues that it is not possible to simply identify that insider manuscripts with insider characteristic significantly reduce the quality and influence of academic papers, which needs to be analyzed on a case-by-case basis. At the same time, when the characteristic of insider help academic journals to reduce transaction costs with paper authors, the contribution proportion of insider increases in the middle and low sections and decreases in the middle and high sections as the cost, and such cost varies with different sections. Based on the above research results, this study puts forward suggestions on strengthening internal processes, improving decision-making performance and improving quality and influence from the perspective of procedural and substantive fairness for academic journals, and puts forward suggestions on enhancing research level and building professional reputation for paper authors.

参考文献

null 陈国剑 普通高校学报在高校办学中地位的嬗变 河南大学学报: 社会科学版 2013 53 1 152 156 陈国剑. (2013). 普通高校学报在高校办学中地位的嬗变. 河南大学学报: 社会科学版,53(1),152—156.
null 董建军 中国知网收录的基金论文资助现状和被引情况分析 中国科技期刊研究 2013 24 2 307 312 董建军. (2013). 中国知网收录的基金论文资助现状和被引情况分析. 中国科技期刊研究,24(2),307—312.
null 郭峰, 李欣 编辑部偏爱、关系稿与引用率贴水——来自中国经济学权威期刊的证据 经济学: 季刊 2017 16 4 5 28 郭峰, 李欣. (2017). 编辑部偏爱、关系稿与引用率贴水—来自中国经济学权威期刊的证据. 经济学: 季刊,16(4),5—28.
null 李晶, 吴秋翔, 龚钰莹 72家高校社科类学报收录论文内稿率的量化研究 出版科学 2018 26 2 62 69 李晶, 吴秋翔, 龚钰莹. (2018). 72家高校社科类学报收录论文内稿率的量化研究. 出版科学,26(2),62—69.
null 李一杉, 刘金松 教育实证研究改善了学术论文的质量和影响力吗——以中国大陆教育学术研究领域为例 教育发展研究 2021 41 9 63 77 李一杉, 刘金松. (2021). 教育实证研究改善了学术论文的质量和影响力吗—以中国大陆教育学术研究领域为例. 教育发展研究,41(9),63—77.
null 连玉君, 杨柳 Stata中因子变量的使用方法 郑州航空工业管理学院学报 2018 36 2 90 103 连玉君, 杨柳. (2018). Stata中因子变量的使用方法. 郑州航空工业管理学院学报,36(2),90—103.
null 连玉君, 廖俊平 如何检验分组回归后的组间系数差异? 郑州航空工业管理学院学报 2017 35 6 97 109 连玉君, 廖俊平. (2017). 如何检验分组回归后的组间系数差异?. 郑州航空工业管理学院学报,35(6),97—109.
null 王轶 中国学术期刊的综合影响力分析——以40种权威社科期刊为例 重庆大学学报: 社会科学版 2016 22 4 118 125 王轶. (2016). 中国学术期刊的综合影响力分析—以40种权威社科期刊为例. 重庆大学学报: 社会科学版,22(4),118—125.
null 温忠麟, 叶宝娟 中介效应分析: 方法和模型发展 心理科学进展 2014 22 5 731 745 温忠麟, 叶宝娟. (2014). 中介效应分析: 方法和模型发展. 心理科学进展,22(5),731—745.
null 谢娟, 龚凯乐, 成颖, 戚尔鹏 论文下载量与被引量相关关系的元分析 情报学报 2017 36 12 49 63 谢娟, 龚凯乐, 成颖, 戚尔鹏. (2017). 论文下载量与被引量相关关系的元分析. 情报学报,36(12),49—63.
null 姚继军, 田亚惠 匿名审稿制度提高了中国教育类学术期刊的学术品质吗? 教育与经济 2019 35 5 85 96 姚继军, 田亚惠. (2019). 匿名审稿制度提高了中国教育类学术期刊的学术品质吗?. 教育与经济,35(5),85—96.
null 俞立平, 万晓云, 姜春林, 张再杰 高校综合性社科学报内稿比例与学术影响力 情报杂志 2019 38 11 134 137+133 俞立平, 万晓云, 姜春林, 张再杰. (2019). 高校综合性社科学报内稿比例与学术影响力. 情报杂志,38(11),134—137+133.
null 赵仁杰, 刘瑞明 本校偏袒下的学术质量"诅咒效应"——来自中国大陆(2004-2013)高校学报的证据 世界经济文汇 2018 01 02 21 39 赵仁杰, 刘瑞明. (2018). 本校偏袒下的学术质量"诅咒效应"—来自中国大陆(2004-2013)高校学报的证据. 世界经济文汇,01(02),21—39.
null 朱红 决策信息与信息决策的数学公式理论 情报杂志 2003 22 6 2 3 朱红. (2003). 决策信息与信息决策的数学公式理论. 情报杂志,22(6),2—3.
null Abadie, A., Athey, S., Imbens, G. W., & Wooldridge, J. M. (2017). When Should You Adjust Standard Errors for Clustering. arXiv: Statistics Theory. Retrieved from https://arxiv.org/abs/1710.02926.
null Abhijit, B., & Kaivan, M How efficiently is capital allocated? evidence from the knitted garment industry in tirupur The Review of Economic Studies 2004 71 1 19 42 Abhijit, B., & Kaivan, M. (2004). How efficiently is capital allocated? evidence from the knitted garment industry in tirupur. The Review of Economic Studies, 71(1), 19—42.
null Akaike H A new look at statistical model identification IEEE Transactions on Automatic Control 1974 AC19 6 716 723 Akaike H. (1974). A new look at statistical model identification. IEEE Transactions on Automatic Control, AC19(6), 716—723.
null Bramoulle, Y., & Ductor, L Title length Journal of Economic Behavior & Organization 2018 150 6 311 324 Bramoulle, Y., & Ductor, L. (2018). Title length. Journal of Economic Behavior & Organization, 150(6), 311—324.
null Baron, Reuben M. and David A. Kenny Moderator-mediator variables distinction in social psychological Research: Conceptual, Strategic, and Statistical Considerations Journal of Personality and Social Psychology 1986 51 6 1173 82 Baron, Reuben M. and David A. Kenny. (1986). Moderator-mediator variables distinction in social psychological Research: Conceptual, Strategic, and Statistical Considerations. Journal of Personality and Social Psychology, 51(6), 1173—82.
null Berger, J Does presentation order impact choice after delay? Topics in cognitive science 2016 8 3 670 684 Berger, J. (2016). Does presentation order impact choice after delay?. Topics in cognitive science, 8(3), 670—684.
null Berk, J. B., Harvey, C. R., & Hirshleifer, D How to write an effective referee report and improve the scientific review process Journal of Economic Perspectives 2017 31 1 231 244 Berk, J. B., Harvey, C. R., & Hirshleifer, D. (2017). How to write an effective referee report and improve the scientific review process. Journal of Economic Perspectives, 31(1), 231—244.
null Brogaard, J., Engelberg, J., & Parsons, C. A Networks and productivity: causal evidence from editor rotations Journal of Financial Economics 2014 111 1 251 270 Brogaard, J., Engelberg, J., & Parsons, C. A. (2014). Networks and productivity: causal evidence from editor rotations. Journal of Financial Economics, 111(1), 251—270.
null Chernozhukov, V., Fernández-Val, Iván, & Kowalski, A. E. Quantile regression with censoring and endogeneity Journal of Econometrics 2015 186 1 201 221 Chernozhukov, V., Fernández-Val, Iván, & Kowalski, A. E. (2015). Quantile regression with censoring and endogeneity. Journal of Econometrics, 186(1), 201—221.
null Chernozhukov, V., Fernandez-Val, I., Han, S., & Kowalski, A Censored quantile instrumental-variable estimation with stata The Stata Journal 2019 19 4 768 781 Chernozhukov, V., Fernandez-Val, I., Han, S., & Kowalski, A. (2019). Censored quantile instrumental-variable estimation with stata. The Stata Journal, 19(4), 768—781.
null Coase, R. H The nature of the firm Economica 1937 4 16 386 405 Coase, R. H. (1937). The nature of the firm. Economica, 4(16), 386—405.
null Colussi, T Social ties in academia: a friend is a treasure The Review of Economics and Statistics 2017 100 1 45 50 Colussi, T. (2017). Social ties in academia: a friend is a treasure. The Review of Economics and Statistics, 100(1), 45—50.
null Cotgrove, S, & Gaston, J The reward system in british and american science British Journal of Sociology 1979 30 4 534 Cotgrove, S, & Gaston, J. (1979). The reward system in british and american science. British Journal of Sociology, 30(4), 534.
null Doepke, M., Sorrenti, G., & Zilibotti, F The economics of parenting Annual Review of Economics 2019 11 317 55 84 Doepke, M., Sorrenti, G., & Zilibotti, F. (2019). The economics of parenting. Annual Review of Economics, 11(317), 55—84.
null Doepke, M., & Zilibotti, F Parenting with style: altruism and paternalism in intergenerational preference transmission Econometrica 2017 85 5 1331 1371 Doepke, M., & Zilibotti, F. (2017). Parenting with style: altruism and paternalism in intergenerational preference transmission. Econometrica, 85(5), 1331—1371.
null Fisman, R, Paravisini, D., & Vig, V Cultural proximity and loan outcomes American Economic Review 2017 107 2 457 492 Fisman, R, Paravisini, D., & Vig, V. (2017). Cultural proximity and loan outcomes. American Economic Review, 107(2), 457—492.
null Fox, C. W., Paine, C. E., & Sauterey, B Citations increase with manuscript length, author number, and references cited in ecology journals Ecology and Evolution 2016 6 21 7717 7726 Fox, C. W., Paine, C. E., & Sauterey, B. (2016). Citations increase with manuscript length, author number, and references cited in ecology journals. Ecology and Evolution, 6(21), 7717—7726.
null Gerrity, D. M., & Mckenzie, R. B The ranking of southern economics departments: new criterion and further evidence Southern Economic Journal 1978 45 2 608 614 Gerrity, D. M., & Mckenzie, R. B. (1978). The ranking of southern economics departments: new criterion and further evidence. Southern Economic Journal, 45(2), 608—614.
null Huettner, F., & Sunder, M Axiomatic arguments for decomposing goodness of fit according to shapley and owen values Electronic Journal of Statistics 2012 6 1 1239 1250 Huettner, F., & Sunder, M. (2012). Axiomatic arguments for decomposing goodness of fit according to shapley and owen values. Electronic Journal of Statistics, 6(1), 1239—1250.
null Israeli, O A shapley-based decomposition of the r -square of a linear regression Journal of Economic Inequality 2007 5 2 199 212 Israeli, O. (2007). A shapley-based decomposition of the r -square of a linear regression. Journal of Economic Inequality, 5(2), 199—212.
null Jiang, J Making bureaucracy work: patronage networks, performance incentives, and economic development in china American Journal of Political Science 2018 62 2 982 999 Jiang, J. (2018). Making bureaucracy work: patronage networks, performance incentives, and economic development in china. American Journal of Political Science, 62(2), 982—999.
null Johnston, D., Piatti, M., & Torgler, B Citation success over time: theory or empirics Scientometrics 2013 95 3 1023 1029 Johnston, D., Piatti, M., & Torgler, B. (2013). Citation success over time: theory or empirics. Scientometrics, 95(3), 1023—1029.
null Karlson, K. B., & Holm, A. Decomposing primary and secondary effects: a new decomposition method Research in Social Stratification & Mobility 2011 29 2 221 237 Karlson, K. B., & Holm, A. (2011). Decomposing primary and secondary effects: a new decomposition method. Research in Social Stratification & Mobility, 29(2), 221—237.
null Koenker, R., & Bassett, G. W Regression quantiles Econometrica 1978 46 1 211 244 Koenker, R., & Bassett, G. W. (1978). Regression quantiles. Econometrica, 46(1), 211—244.
null Kowalski, A Censored quantile instrumental variable estimates of the price elasticity of expenditure on medical care Journal of Business & Economic Statistics 2016 34 1 107 117 Kowalski, A. (2016). Censored quantile instrumental variable estimates of the price elasticity of expenditure on medical care. Journal of Business & Economic Statistics, 34(1), 107—117.
null Laband, D. N Publishing favoritism: a critique of department rankings based on quantitative publishing performance Southern Economic Journal 1985 52 2 510 515 Laband, D. N. (1985). Publishing favoritism: a critique of department rankings based on quantitative publishing performance. Southern Economic Journal, 52(2), 510—515.
null Laband, D. N, & Piette, M. J Favoritism versus search for good papers: empirical evidence regarding the behavior of journal editors Journal of Political Economy 1994 102 1 194 203 Laband, D. N, & Piette, M. J. (1994). Favoritism versus search for good papers: empirical evidence regarding the behavior of journal editors. Journal of Political Economy, 102(1), 194—203.
null Liang, R., Wang, X., & Yamauchi, F. (2020). Cotton revolution and widow chastity in ming and qing china. American Journal of Agricultural Economics. Retrieved from https://doi.org/10.1002/ajae.12085.
null Ma, C., Li, Y., Guo, F., & Si, K The citation trap: Papers published at year-end receive systematically fewer citations Journal of Economic Behavior and Organization 2019 166 10 667 687 Ma, C., Li, Y., Guo, F., & Si, K. (2019). The citation trap: Papers published at year-end receive systematically fewer citations. Journal of Economic Behavior and Organization, 166(10), 667—687.
null MacKinnon, D. P., Krull, J. L., & Lockwood, C. M Equivalence of the mediation, confounding, and suppression effect Prevention Science 2000 1 4 173 181 MacKinnon, D. P., Krull, J. L., & Lockwood, C. M. (2000). Equivalence of the mediation, confounding, and suppression effect. Prevention Science, 1(4), 173—181.
null Medoff, M. H Editorial favoritism in economics? Southern Economic Journal 2003 70 2 425 434 Medoff, M. H. (2003). Editorial favoritism in economics?. Southern Economic Journal, 70(2), 425—434.
null Patrick, B., Stephen, L., & Giorgio, T Place of work and place of residence: informal hiring networks and labor market outcomes Journal of Political Economy 2008 116 6 1150 1196 Patrick, B., Stephen, L., & Giorgio, T. (2008). Place of work and place of residence: informal hiring networks and labor market outcomes. Journal of Political Economy, 116(6), 1150—1196.
null Parente, P. M. D. C., & Santos Silva, J.M.C Quantile Regression with Clustered Data Journal of Econometric Methods 2016 5 1 15 Parente, P. M. D. C., & Santos Silva, J.M.C. (2016). Quantile Regression with Clustered Data. Journal of Econometric Methods, 5, 1—15.
null Preacher, K. J., & Hayes, A. F SPSS and SAS procedures for estimating indirect effects in simple mediation models Behavior Research Methods Instruments & Computers 2004 36 4 717 731 Preacher, K. J., & Hayes, A. F. (2004). SPSS and SAS procedures for estimating indirect effects in simple mediation models. Behavior Research Methods Instruments & Computers, 36(4), 717—731.
null Preacher, K. J., & Hayes, A. F Asymptotic and resampling strategies for assessing and comparing indirect effects in multiple mediator models Behavior Research Methods 2008 40 3 879 891 Preacher, K. J., & Hayes, A. F. (2008). Asymptotic and resampling strategies for assessing and comparing indirect effects in multiple mediator models. Behavior Research Methods, 40(3), 879—891.
null Powell, D Quantile treatment effects in the presence of covariates Review of Economics and Statistics 2020 102 5 994 1005 Powell, D. (2020). Quantile treatment effects in the presence of covariates. Review of Economics and Statistics, 102(5), 994—1005.
null Qian, N Missing women and the price of tea in china: the effect of sex-specific earnings on sex imbalance Quarterly Journal of Economics 2008 123 3 1251 1285 Qian, N. (2008). Missing women and the price of tea in china: the effect of sex-specific earnings on sex imbalance. Quarterly Journal of Economics, 123(3), 1251—1285.
null Rosen, S Hedonic prices and implicit markets: product differentiation in pure competition Journal of Political Economy 1974 82 1 34 55 Rosen, S. (1974). Hedonic prices and implicit markets: product differentiation in pure competition. Journal of Political Economy, 82(1), 34—55.
null Schwarz, G. E Estimating the dimension of a model The Annals of Statistics 1978 6 2 461 464 Schwarz, G. E. (1978). Estimating the dimension of a model. The Annals of Statistics, 6(2), 461—464.
null Sobel, M. E Asymptotic confidence intervals for indirect effects in structural equation models Sociological Methodology 1982 13 1 290 312 Sobel, M. E. (1982). Asymptotic confidence intervals for indirect effects in structural equation models. Sociological Methodology, 13(1), 290—312.
null Tobin, & James Estimation of relationships for limited dependent variables Econometrica 1958 26 1 24 Tobin, & James. (1958). Estimation of relationships for limited dependent variables. Econometrica, 26(1), 24.
null Voth, Hans-Joachim & Guo, X, 2019. Patronage for Productivity: Selection and Performance in the Age of Sail, CEPR Discussion Papers 13963, C.E.P.R. Discussion Papers. Retrieved from https://ssrn.com/abstract=3464489.
null Wu, & Stephen Recent publishing trends at the aer, jpe and qje Applied Economics Letters 2007 14 1 59 63 Wu, & Stephen. (2007). Recent publishing trends at the aer, jpe and qje. Applied Economics Letters, 14(1), 59—63.
null Zhao, X., Lynch, J. G., & Chen, Q Reconsidering baron and kenny: myths and truths about mediation analysis Journal of Consumer Research 2010 37 2 197 206 Zhao, X., Lynch, J. G., & Chen, Q. (2010). Reconsidering baron and kenny: myths and truths about mediation analysis. Journal of Consumer Research, 37(2), 197—206.
文章导航

/