Journal of Guangxi Teachers Education University (Philosophy and Social Sciences Edition) ›› 2021, Vol. 57 ›› Issue (5): 12-31.doi: 10.16088/j.issn.1001-6597.2021.05.002

Previous Articles     Next Articles

Social Science Experimental Method from A Global Perspective: Its Application Comparison and Development Prospect

ZANG Lei-zhen,TENG Bai-ying, XIONG Feng   

  1. 1. College of Humanities and Development Studies, China Agricultural University, Beijing 100193;
    2. Department of Diplomacy and Foreign Affairs Management, China Foreign Affairs University, Beijing 100032;
    3. School of Economics and Management, Chongqing University of Posts and Telecommunications, Chongqing 400065, China
  • Received:2021-05-30 Online:2021-09-25 Published:2021-10-29

Abstract: With the expanding of social science experiments, relevant researches are fruitful and booming within almost every sub-fields. This paper, based on the historical review of the experiment method, explores the development context, application procedure and context, and influence to social sciences brought by such an approach. Furthermore, by comparing the application of various experiment operation techniques and quasi-experiment analysis models, we get an overall view upon the experiment method employed in social sciences at home and abroad, make a prediction of its development prospect and further lay a theoretical foundation for the further application. The authors tentatively present the differences of regression results of different causal inference methods, such as DIDD model, PSM-DID model, placebo test and synthesis control. Yet, there are probably opposite results during the data mining process when we analyze the same topic or same data under diverse quasi-experiment models. This finding reminds us that the exploration of causality is attributed not so much to the single experiment method as to validation of multiple models within quantitative research. Nevertheless, this article does not intend to provoke a “paradigm dispute” between the traditional qualitative and quantitative methods, or set up an “iterative debate” between the traditional quantitative models and the new model. We are more trying to improve the reliability and validity of our research results under the guidance of inclusive methodological thinking, so as to improve the display of social science and make better contributions to the improvement and perfection of economic and political policies.

Key words: experimental method, multi-model comparison, application scenarios, reliability, validity

CLC Number: 

  • C3
[1] W R,Cook T D, Campbell D T. Experimental and quasi-experimental designs for generalized causal inference[M]. Boston: Houghton Mifflin Company, 2002.
[2] 培根. 新工具[M].许宝骙, 译.北京:商务印书馆,1984.
[3] [美]埃德温·阿瑟·伯特. 近代物理科学的形而上学基础[M].张卜天,译.北京:商务印书馆, 2018.
[4] [美]布鲁斯·罗森布鲁姆, 弗雷德·库特纳. 量子之谜:物理学遇到意识[M].王文浩,译.长沙:湖南科学技术出版社, 2013.
[5] Gross M, Krohn W. Science in a real-world context: constructing knowledge through recursive learning[J]. Philosophy Today, 2004, 48(Supplement):38-50.
[6] Beck N L. political methodology: a welcoming discipline[J]. Journal of the American Statistical Association, 2000, 95(450):651-654.
[7] Emiliano Sacchi. The biopolitical paradox: population and security mechanisms [J]. International Social Science Journal, 2011, 62(205-206):391-401.
[8] 李翔宇, 游腾芳, 郑鸿. 人类学方法在霍桑实验中的应用[J]. 广西师范大学学报(哲学社会科学版), 2013(3):77-85.
[9] Gosnell H F. An experiment in the stimulation of voting[J]. The American Political Science Review, 1926, 20(4):869-874.
[10] Hartmann G W. A field experiment on the comparative effectiveness of “emotional” and “rational” political leaflets in determining election results[J]. The Journal of Abnormal and Social Psychology, 1936, 31(1):99-114.
[11] Eldersveld S J. Experimental propaganda techniques and voting behaviour[J]. The American Political Science Review, 1956, 50(1):15-165.
[12] 臧雷振.政治学研究中的实验方法——近年来的应用进展及研究议题分布[J]. 国外理论动态,2016(5):68-75.
[13] Campbell D T. Reforms as experiments[J]. American Psychologist, 1969, 24(4): 409-429.
[14] 黄荣怀, 王欢欢, 张慕华,等. 面向智能时代的教育社会实验研究[J]. 电化教育研究, 2020(10):5-14.
[15] Hassan Z. What are social laboratories? [J]. Design Management Review, 2014, 25(2):56-59.
[16] Krohn W, Weyer J. Society as a laboratory: the social risks of experimental research[J]. Science and Public Policy, 1994, 21(3):173-183.
[17] Morton R B, Williams K C. Experimentation in political science[M]//The Oxford Handbook of Political Methodology. New York: Oxford University Press, 2008.
[18] 罗俊. 计算·模拟·实验:计算社会科学的三大研究方法[J].学术论坛,2020(1):35-49.
[19] 刘军强,胡国鹏,李振.试点与实验:社会实验法及其对试点机制的启示[J].政治学研究,2018(4):103-116.
[20] 李晓倩.公共管理研究中实验方法的应用:质疑与辨析[J].公共管理评论,2019(3):117-138.
[21] Dickson E S, Scheve K. Social identity, political speech, and electoral competition[J]. Journal of Theoretical Politics, 2006, 18(1):5-39.
[22] Ronchi E, Mayorga D, Lovreglio R, et al. Mobile-powered head-mounted displays versus cave automatic virtual environment experiments for evacuation research[J]. Computer Animation and Virtual Worlds, 2019, 30(6):e1873.
[23] 赖玥, 柳弌祎. 解读 “穷人思维”: 贫困农户风险态度的影响因素分析——来自广西、贵州贫困山区入户实地实验的证据[J]. 贵州财经大学学报, 2019(6):92-101.
[24] 徐慧, 汪斯妤. 留守儿童的公平感与幸福度: 来自实地实验与调查的依据[J]. 南方经济, 2020(4):40-52.
[25] 臧雷振.社会科学研究中实验方法的应用与反思——以政治学科为例[J].中国人民大学学报,2016(5):150-156.
[26] Gerber A S, Green D P, Larimer C W. Social pressure and voter turnout: evidence from a large-scale field experiment[J]. American Political Science Review, 2008, 102(1):33-48.
[27] Levitt S D, List J A. Field experiments in economics: the past, the present, and the future[J]. European Economic Review, 2009, 53(1):1-18.
[28] Parigi P, Santana J J, Cook K S. Online field experiments: studying social interactions in context[J]. Social Psychology Quarterly, 2017, 80(1):1-19.
[29] 王宁. 准实验设计与比较个案研究[J].旅游学刊,2020(12):3-4.
[30] 张开平, 汤峰. 实验方法及其在美国政治研究的应用[J].美国研究,2020(3):142-160.
[31] 王浦劬, 季程远. 论列举实验在敏感问题调查中的应用——以非制度化政治参与为验证[J]. 中国软科学, 2016 (9):135-143.
[32] 张书维, 谭小慧, 梁歆佚, 等. “助推” 生育政策: 信息框架影响生育意愿的调查实验研究[J]. 公共管理与政策评论,2021(1):42-54.
[33] 吕维霞, 宁晶, 刘文静. 基于调查实验法的治理主体与环境治理评价研究[J].中国人口· 资源与环境, 2020(9):31-38.
[34] Alvarez R M, Atkeson L R, Levin I, et al. Paying attention to inattentive Ssrvey respondents[J]. Political Analysis, 2019, 27(8):145-162.
[35] Riambau G, Ostwald K. Placebo statements in list experiments: evidence from a face-to-face survey in Singapore[J]. Political Science Research and Methods, 2021, 9(1):172-179.
[36] McGraw K M, Hoekstra V. Experimentation in political science: historical trends and future directions[J]. Research in Micropolitics, 1994(4):3-29.
[37] Lijphart A. Comparative politics and the comparative method[J]. The American Political Science Review, 1971, 65(3):682-693.
[38] 臧雷振. 争论中的政治学实验方法及其发展前景[J]. 社会科学,2016(11):26-33.
[39] 张杨,宋雄伟.政治学实验的简化与推广:一种理论检验型准实验的概念设计[J].党政研究,2021(3):70-80.
[40] Jensen N M, Findley M G, Nielson D L. Electoral lnstitutions and electoral cycles in investment incentives: a field experiment on over 3,000 Us municipalities[J]. American Journal of Political Science, 2020, 64(4):807-822.
[41] Jäger K. When do campaign effects persist for years? Evidence from a natural experiment[J]. American Journal of Political Science, 2020, 64(4):836-851.
[42] Pellicer M, Wegner E, De Juan A. Preferences for the scope of orotests[J]. Political Research Quarterly, 2021, 74(2):288-301.
[43] Anderson-Nilsson G, Clayton A. Gender and policy persuasion[J].Political Science Research and Methods,2021: 1-14.
[44] Funk C L, Smith K B, Alford J R, et al. Genetic and environmental transmission of political orientations[J]. Political Psychology, 2013, 34(6):805-819.
[45] Hatemi P K, Medland S E, Klemmensen R, et al. Genetic influences on political ideologies: twin analyses of 19 measures of political ideologies from five democracies and genome-wide findings from three populations[J]. Behavior Genetics, 2014, 44(3):282-294.
[46] Hauk E, Nagel R. Choice of partners in multiple Two-person prisoner's dilemma games: an experimental study[J]. Journal of Conflict Resolution, 2001, 45(6):770-793.
[47] Neumann J V, Morgenstern O. Theory of games and economic behavior[M]. Princeton: Princeton University Press, 1953.
[48] Smith V L. An experimental study of competitive market behavior[J]. The Journal of Political Economy, 1962, 70(2):111-137.
[49] Eckel C C. Vernon Smith: economics as a laboratory science[J]. The Journal of Socio-Economics, 2004, 33(1):15-28.
[50] Smith V L. Microeconomic systems as an experimental science[J]. The American Economic Review, 1982, 72(5):923-955.
[51] Plott C R. Industrial organization theory and experimental economics[J]. Journal of Economic Literature, 1982, 20(4):1485-1527.
[52] Roth A E, Malouf M W. Game-theoretic models and the role of information in bargaining[J]. Psychological Review, 1979, 86(6):574-594.
[53] Isaac R M, Walker J M, Thomas S H. Divergent evidence on free riding: an experimental examination of possible explanations[J]. Public Choice, 1984, 43(2):113-149.
[54] 宗计川, 朱婷婷.有限理性再次战胜完全理性——兼评 2017 年度诺贝尔经济学奖得主 Richard Thaler 的贡献[J]. 东北财经大学学报, 2018(1):13-22.
[55] 张延, 张轶龙. 理查德· 塞勒对实验经济学的贡献[J]. 经济学动态, 2017(12):116-132.
[56] 李宝良, 郭其友. 因果关系的实地实验与新实证发展经济学的贫困治理之道——2019 年度诺贝尔经济学奖得主主要经济理论贡献述评[J].外国经济与管理, 2019(11):136-152.
[57] 陈华,程实,韦倩.基因经济学研究进展[J].经济学动态, 2021(4):124-141.
[58] 臧雷振. 社会科学研究中实验方法的应用与反思——以政治学科为例[J]. 中国人民大学学报, 2016(5):150-156.
[59] 马亮.公共管理实验研究何以可能:一项方法学回顾[J].甘肃行政学院学报,2015(4):13-23.
[60] 王思琦, 郭金云. 公共服务满意度测量的问题顺序效应:来自一项嵌入性调查实验的证据[J]. 公共管理评论, 2020(1):94-117.
[61] 张书维,申翊人,周洁.行为公共管理学视角下公共决策的社会许可机制[J].心理学报,2020(2):240-256.
[62] 李晓倩,马亮.公共管理实验研究中的实验报告[J].公共管理与政策评论,2021(1):55-65.
[63] 耿曙,余莎,孔晏.实验方法在公共政策研究中的应用[J].公共管理与政策评论,2016(3):45-52.
[64] 李金铮.定县调查:中国农村社会调查的里程碑[J].社会学研究,2008(2):165-191.
[65] Bositis D A, Steinel D. A synoptic history and typology of experimental research in political science[J]. Political Behavior, 1987, 9(3):263-284.
[66] [美]珍妮特·M. 博克斯-史蒂芬斯迈埃尔,亨利·E. 布雷迪,大卫·科利尔.牛津政治学研究方法手册[M].臧雷振,傅琼,译.北京:人民出版社,2021.
[67] Heckman J J, Ichimura H, Todd P. Matching as an econometric evaluation estimator[J]. The Review of Economic Studies, 1998, 65(2):261-294.
[68] Struthers C L, Hare C, Bakker R. Bridging the pond: measuring policy positions in the United States and Europe[J]. Political Science Research and Methods, 2020, 8(4):677-691.
[69] Reiber F, Pope H, Ulrich R. Cheater detection using the unrelated question model[J]. Sociological Methods & Research, 2020.
[70] Orr L V, Huber G A. The policy basis of measured partisan animosity in the United States[J]. American Journal of Political Science, 2020, 64(3):569-586.
[71] Grigorieff A, Roth C, Ubfal D. Does information change attitudes toward immigrants? [J]. Demography, 2020, 57(3):1117-1143.
[72] [美]艾伦·格伯.唐纳德·格林.实地实验:设计、分析与解释[M].王思琦,译.北京:中国人民大学出版社,2018.
[73] Niemi R G, Bartels L M. New measures of issue aalience: an evaluation[J]. The Journal of Politics, 1985, 47(4):1212-1220.
[74] 臧雷振,潘晨雨.社会科学研究透明度:内涵、价值及其实现路径[J].国外理论动态,2020(5):82-92.
[75] Saylors R, Trafimow D. Why the increasing use of complex causal models is a problem: on the danger sophisticated theoretical narratives pose to truth[J]. Organizational Research Methods, 2021, 24(3):616-629.
[76] [美]戴维·威勒,亨利·沃克.实验设计原理:社会科学理论验证的一种路径[M].杜伟宇,孟琦,译.重庆:重庆大学出版社,2010.
[77] 臧雷振.政治学研究中的数据:不深刻的理解与困境消解[J].马克思主义与现实,2016(5):84-90.
[1] LI Wen-bin, CHEN Xiao-xuan. Application and Reflection on the Experimental Method of Public Management:Taking Citizens' Satisfaction as An Example [J]. Journal of Guangxi Teachers Education University (Philosophy and Social Sciences Edition), 2021, 57(5): 79-94.
[2] HUANG Li-juan, YANG Shi-min. On Forbidding Fluidity Contract [J]. Journal of Guangxi Teachers Education University (Philosophy and Social Sciences Edition), 2017, 53(1): 26-31.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
[1] XIAO Xi-qiang. Reflections on Grammar System of TCSL[J]. Journal of Guangxi Teachers Education University (Philosophy and Social Sciences Edition), 2018, 54(5): 113 -119 .
[2] QU Xuan. An Interpretation of A Good Life in the View of Marxist Philosophy[J]. Journal of Guangxi Teachers Education University (Philosophy and Social Sciences Edition), 2019, 55(2): 37 -43 .
[3] ZHANG Li-Da, TANG Shi-Ru. A Philosophical Reflection on the Boundary of Barrage Culture[J]. Journal of Guangxi Teachers Education University (Philosophy and Social Sciences Edition), 2019, 55(5): 53 -58 .
[4] LIU Guo-xin,YI Xiao-ming. On the Dimension of Distributive Justice of Targeted Poverty Alleviation[J]. Journal of Guangxi Teachers Education University (Philosophy and Social Sciences Edition), 2019, 55(6): 27 -35 .
[5] YU Xin-xin,ZHANG Yue,ZHENG Xue. The Influence and Mechanism of Optimism on College Students’ Health[J]. Journal of Guangxi Teachers Education University (Philosophy and Social Sciences Edition), 2019, 55(6): 83 -90 .
[6] ZHANG Kan. The Contradictory Characteristics of the Concept of “Capital” in The Grundrisse[J]. Journal of Guangxi Teachers Education University (Philosophy and Social Sciences Edition), 2020, 56(1): 11 -19 .
[7] XIE Deng-bin, DUAN Su-ying, XIE Ting. The Construction of the Reasonable Flowing Operation Mechanism and Practical Regulation of Compulsory Education Teachers in Ethnic Areas——On the Background of New Urbanization[J]. Journal of Guangxi Teachers Education University (Philosophy and Social Sciences Edition), 2020, 56(1): 87 -94 .
[8] YUAN Fang-cheng, LI Si-hang. The Risk of Technology Governance and Its Evolution Logic——Take Targeted Poverty Alleviation in Rural Areas as the Analysis Object[J]. Journal of Guangxi Teachers Education University (Philosophy and Social Sciences Edition), 2020, 56(2): 45 -61 .
[9] LI Wen-zhao. Actor-centered Institutionalism: Exploring the Interaction Effect in Policy Process[J]. Journal of Guangxi Teachers Education University (Philosophy and Social Sciences Edition), 2020, 56(3): 19 -42 .
[10] XI Wei-qun. The Effect and Evaluation of Fiscal Policy on Manufacturing Innovation[J]. Journal of Guangxi Teachers Education University (Philosophy and Social Sciences Edition), 2020, 56(3): 52 -63 .