Hostname: page-component-7dd5485656-2pp2p Total loading time: 0 Render date: 2025-10-31T08:22:00.166Z Has data issue: false hasContentIssue false
  • English
  • Français

Self-selection and variations in the laboratory measurement of other-regarding preferences across subject pools: evidence from one college student and two adult samples

Published online by Cambridge University Press:  14 March 2025

Jon Anderson ,
Stephen V. Burks ,
Jeffrey Carpenter ,
Lorenz Götte ,
Karsten Maurer ,
Daniele Nosenzo ,
Ruth Potter ,
Kim Rocha  and
Aldo Rustichini
Jon Anderson
Affiliation:
Division of Science and Mathematics, University of Minnesota Morris, 600 East 4th Street, Morris, MN 56267, USA
Stephen V. Burks
Affiliation:
Division of Social Science, University of Minnesota Morris, 600 East 4th Street, Morris, MN 56267, USA IZA, P.O. Box 7240, 53027 Bonn, Germany CeDEx, University of Nottingham, University Park, Nottingham, NG7 2RD, UK
Jeffrey Carpenter
Affiliation:
IZA, P.O. Box 7240, 53027 Bonn, Germany Department of Economics, Middlebury College, Warner Hall, 303 College Street, Middlebury, VT 05753, USA
Lorenz Götte
Affiliation:
IZA, P.O. Box 7240, 53027 Bonn, Germany Faculty of Business and Economics, University of Lausanne, Internef, 1015 Lausanne, Switzerland
Karsten Maurer
Affiliation:
Department of Statistics, Iowa State University, Snedecor Hall, Ames, IA 50012, USA
Daniele Nosenzo*
Affiliation:
School of Economics, University of Nottingham, University Park, Nottingham, NG7 2RD, UK CeDEx, University of Nottingham, University Park, NG7 2RD Nottingham, UK
Ruth Potter
Affiliation:
Division of Science and Mathematics, University of Minnesota Morris, 600 East 4th Street, Morris, MN 56267, USA
Kim Rocha
Affiliation:
Division of Science and Mathematics, University of Minnesota Morris, 600 East 4th Street, Morris, MN 56267, USA
Aldo Rustichini
Affiliation:
Department of Economics, University of Minnesota, Twin Cities, 4-101 Hanson Hall, 1925 4th Street S, Minneapolis 55455, MN, USA Faculty of Economics, University of Cambridge, Sidgwick Avenue, CB3 9DD Cambridge, UK
*
daniele.nosenzo@nottingham.ac.uk
Get access Rights & Permissions [Opens in a new window]

Abstract

We measure the other-regarding behavior in samples from three related populations in the upper Midwest of the United States: college students, non-student adults from the community surrounding the college, and adult trainee truckers in a residential training program. The use of typical experimental economics recruitment procedures made the first two groups substantially self-selected. Because the context reduced the opportunity cost of participating dramatically, 91 % of the adult trainees solicited participated, leaving little scope for self-selection in this sample. We find no differences in the elicited other-regarding preferences between the self-selected adults and the adult trainees, suggesting that selection is unlikely to bias inferences about the prevalence of other-regarding preferences among non-student adult subjects. Our data also reject the more specific hypothesis that approval-seeking subjects are the ones most likely to select into experiments. Finally, we observe a large difference between self-selected college students and self-selected adults: the students appear considerably less pro-social.

Keywords

MethodologySelection biasLaboratory experimentField experimentOther-regarding behaviorSocial preferencesPrisoner’s dilemmaTruckloadTrucker

JEL classification

C90: General

Information

Type
Article
Information
Experimental Economics , Volume 16 , Issue 2 , June 2013 , pp. 170 - 189
Copyright
Copyright © 2012 Economic Science Association

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Article purchase

Temporarily unavailable

Footnotes

Electronic Supplementary Material The online version of this article (doi:https://doi.org/10.1007/s10683-012-9327-7) contains supplementary material, which is available to authorized users.

References

Bellemare, C., & Kroger, S. (2007). On representative social capital. European Economic Review, 51(1), 183–202. 10.1016/j.euroecorev.2006.03.006 http://www.elsevier.com/wps/find/journaldescription.cws_home/505541/description#description.CrossRefGoogle Scholar
Belot, M., & Duch, R. Miller, L. (2010). Who should be called to the lab? A comprehensive comparison of students and non-students in classic experimental games. University of Oxford, Nuffield College Discussion Papers (2010-001).Google Scholar
Burks, S., Carpenter, J., Götte, L., Monaco, K., Porter, K., Rustichini, A. Bender, S., Lane, J., Shaw, K., Andersson, F., & von Wachter, T. (2008). Using behavioral economic field experiments at a firm: the context and design of the truckers and turnover project. The analysis of firms and employees: quantitative and qualitative approaches, Chicago: NBER and University of Chicago 45–106. 10.7208/chicago/9780226042893.003.0003CrossRefGoogle Scholar
Burks, S., Carpenter, J., & Goette, L. (2009). Performance pay and worker cooperation: evidence from an artefactual field experiment. Journal of Economic Behavior and Organization, 70(3), 458–469. 10.1016/j.jebo.2008.02.012 http://www.elsevier.com/wps/find/journaldescription.cws_home/505559/description#description.CrossRefGoogle Scholar
Burks, S., Carpenter, J., Götte, L., & Rustichini, A. (2009). Cognitive skills affect economic preferences, social awareness, and job attachment. Proceedings of the National Academy of Science (USA), 106(19), 7745–7750. 10.1073/pnas.0812360106CrossRefGoogle ScholarPubMed
Camerer, C. F. (2003). Behavioral game theory: experiments in strategic interaction, Princeton: Princeton University Press.Google Scholar
Camerer, C. F., & Fehr, E. (2006). When does “economic man” dominate social behavior?. Science, 311(5757), 47–52. 10.1126/science.1110600CrossRefGoogle Scholar
Cardenas, J. C. Agarwal, B., & Vercelli, A. (2005). Groups, commons and regulations: experiments with villagers and students in Colombia. Psychology, rationality and economic behaviour: challenging standard assumptions, Basingstoke: Palgrave Macmillan.Google Scholar
Carpenter, J., & Seki, E. (2011). Do social preferences increase productivity? Field experimental evidence from Fishermen in Toyama Bay. Economic Inquiry, 49(2), 612–630. 10.1111/j.1465-7295.2009.00268.x http://www.blackwell-synergy.com/loi/ecin/.CrossRefGoogle Scholar
Carpenter, J., Burks, S., & Verhoogen, E. (2005). Comparing students to workers: the effects of social framing on behavior in distribution games. Research in Experimental Economics, 10, 261–290. 10.1016/S0193-2306(04)10007-0CrossRefGoogle Scholar
Carpenter, J., Connolly, C., & Myers, C. (2008). Altruistic behavior in a representative dictator experiment. Experimental Economics, 11(3), 282–298. 10.1007/s10683-007-9193-x http://www.springerlink.com/link.asp?id=102888.CrossRefGoogle Scholar
Cleave, B., & Nikiforakis, N. Slonim, R. (2011). Is there selection bias in laboratory experiments? Institute for the Study of Labor Discussion Papers (#5488), 1–34.CrossRefGoogle Scholar
Eckel, C., & Grossman, P. (2000). Volunteers and pseudo-volunteers: the effect of recruitment method in dictator experiments. Experimental Economics, 3(2), 107–120 http://www.springerlink.com/link.asp?id=102888.CrossRefGoogle Scholar
Falk, A., & Meier, S. Zehnder, C. (2012, forthcoming). Do lab experiments misrepresent social preferences? The case of self-selected student samples. Journal of the European Economic Association.CrossRefGoogle Scholar
Fehr, E., & Gächter, S. (2000). Cooperation and punishment in public goods experiments. American Economic Review, 90(4), 980–994. 10.1257/aer.90.4.980CrossRefGoogle Scholar
Fehr, E., & List, J. (2004). The hidden costs and returns of incentives–trust and trustworthiness among CEOs. Journal of the European Economic Association, 2(5), 743–771. 10.1162/1542476042782297 http://www.mitpressjournals.org/loi/jeea.CrossRefGoogle Scholar
Fehr, E., Schmidt, K. Kolm, S., & Ythier, J. M. (2006). The economics of fairness, reciprocity and altruism—experimental evidence and new theories. Handbook of the economics of giving, reciprocity and altruism, Amsterdam: Elsevier 615–691.Google Scholar
Fischbacher, U. (2007). Z-tree: Zurich toolbox for ready-made economic experiments. Experimental Economics, 10(2), 171–178. 10.1007/s10683-006-9159-4 http://www.springerlink.com/link.asp?id=102888.CrossRefGoogle Scholar
Fischbacher, U., & Gächter, S. (2010). Social preferences, beliefs, and the dynamics of free riding in public goods experiments. American Economic Review, 100(1), 541–556. 10.1257/aer.100.1.541 http://www.aeaweb.org/aer/.CrossRefGoogle Scholar
Fischbacher, U., Gächter, S., & Fehr, E. (2001). Are people conditionally cooperative? Evidence from a public goods experiment. Economics Letters, 71(3), 397–404. 10.1016/S0165-1765(01)00394-9 http://www.elsevier.com/wps/find/journaldescription.cws_home/505574/description#description.CrossRefGoogle Scholar
Gächter, S., Herrmann, B., & Thoni, C. (2004). Trust, voluntary cooperation, and socio-economic background: survey and experimental evidence. Journal of Economic Behavior and Organization, 55(4), 505–531. 10.1016/j.jebo.2003.11.006 http://www.elsevier.com/wps/find/journaldescription.cws_home/505559/description#description.CrossRefGoogle Scholar
Gächter, S., Nosenzo, D., & Renner, E. Sefton, M. (2012, forthcoming). Who makes a good leader? Cooperativeness, optimism and leading-by-example. Economic Inquiry. doi:10.1111/j.1465-7295.2010.00295.x.CrossRefGoogle Scholar
Güth, W., Schmidt, C., & Sutter, M. (2007). Bargaining outside the lab—a newspaper experiment of a three-person ultimatum game. Economic Journal, 117(518), 449–469. 10.1111/j.1468-0297.2007.02025.x http://www.blackwellpublishing.com/journal.asp?ref=0013-0133.CrossRefGoogle Scholar
Harrison, G., Lau, M., & Rutstrom, E. (2009). Risk attitudes, randomization to treatment, and self-selection into experiments. Journal of Economic Behavior and Organization, 70(3), 498–507. 10.1016/j.jebo.2008.02.011 http://www.elsevier.com/wps/find/journaldescription.cws_home/505559/description#description.CrossRefGoogle Scholar
Henrich, J., Heine, S., & Norenzayan, A. (2010). The weirdest people in the world?. Behavioral and Brain Sciences, 33(2/3), 1–75.CrossRefGoogle ScholarPubMed
Herrmann, B., & Thoni, C. (2009). Measuring conditional cooperation: a replication study in Russia. Experimental Economics, 12(1), 87–92. 10.1007/s10683-008-9197-1 http://www.springerlink.com/link.asp?id=102888.CrossRefGoogle Scholar
Hoffman, M., & Morgan, J. (2011). Who’s naughty? Who’s nice? Social preferences in online industries. University of California, Berkeley (unpublished manuscript).Google Scholar
Kocher, M., Cherry, T., Kroll, S., Netzer, R., & Sutter, M. (2008). Conditional cooperation on three continents. Economics Letters, 101(3), 175–178. 10.1016/j.econlet.2008.07.015 http://www.elsevier.com/wps/find/journaldescription.cws_home/505574/description#description.CrossRefGoogle Scholar
Levitt, S., & List, J. (2007). What do laboratory experiments measuring social preferences reveal about the real world?. Journal of Economic Perspectives, 21(2), 153–174. 10.1257/jep.21.2.153 http://www.aeaweb.org/jep/.CrossRefGoogle Scholar
List, J. (2004). Young, selfish and male: field evidence of social preferences. The Economic Journal, 114, 121–149. 10.1046/j.0013-0133.2003.00180.xCrossRefGoogle Scholar
Long, S. J., & Freese, J. (2006). Regression models for categorical dependent variables using Stata, 2College Station: Stata Press.Google Scholar
Patrick, C., Curtin, J., & Tellegen, A. (2002). Development and validation of a brief form of the multidimensional personality questionnaire. Psychological Assessment, 14(2), 150–164. 10.1037/1040-3590.14.2.150CrossRefGoogle ScholarPubMed
Rosenthal, R., Rosnow, R. Rosenthal, R., & Rosnow, R. L. (1969). The volunteer subject. Artifact in behavioral research, New York: Academic Press 61–118.Google Scholar
Rustagi, D., Engel, S., & Kosfeld, M. (2010). Conditional cooperation and costly monitoring explain success in forest commons management. Science, 330(6006), 961–965. 10.1126/science.1193649CrossRefGoogle ScholarPubMed
Stoop, J., & Noussair, C. N. van Soest, D. (2009). From the lab to the field: cooperation among fishermen. Munich Personal RePEc Archive (#28924).Google Scholar
von Gaudecker, H.-M., & van Soest, A. Wengström, E. (2011). Experts in experiments: how selection matters for estimated distributions of risk preferences. Institute for the Study of Labor Discussion Papers (#5575).CrossRefGoogle Scholar
Voors, M., Bulte, E., Kontoleon, A., List, J., & Turley, T. (2011). Using artefactual field experiments to learn about the incentives for sustainable forest use in developing economies. American Economic Review, 101(3), 329–333. 10.1257/aer.101.3.329 http://www.aeaweb.org/aer/.CrossRefGoogle Scholar
Zizzo, D. (2010). Experimenter demand effects in economic experiments. Experimental Economics, 13(1), 75–98. 10.1007/s10683-009-9230-zCrossRefGoogle Scholar
Supplementary material: File

Anderson et al. supplementary material

Appendix A: Instruction Script for the Social Dilemma Experiment
Download Anderson et al. supplementary material(File)
File 1.4 MB