The impact of choice inconsistencies in discrete choice experiments’ welfare estimates

Beatriz Rocamora Montiel, Sergio Colombo, Klaus Glenk


Choice experiments have become an important tool to provide guidance about the value of environmental goods and services. Several evidences, however, are pointing toward an important mis-match between the rationality principles assumed by this methodology and real respondents’ behaviour, what may be giving rise to inconsistent choices. This paper studies the effects of such inconsistencies by using data from an online survey aimed at valuing the environmental impacts of organic farming in mountainous olive groves. The results are analysed by means of three random parameter models and provide evidence on the necessity to appropriately consider and treat choice inconsistencies as a result of their influence on welfare estimates.


Online questionnaire; Willingness to pay; Inconsistent choices; Rational choice; Implicit prices

Subject classification

C25, H41, Q18, Q50.

Full Text:



Adamowicz, W., Glenk, K. y Meyerhoff, J. (en prensa). "Choice Modelling Research in Environmental and Resource Economics". En Hess, S. y Daly, A. (Eds.): Handbook of Choice Modelling. Edward Elgar Publishers, Cheltenham, Reino Unido.

Bateman, I.J., Burgess, D., Hutchinson, W.G. y Matthews, D.I. (2008). "Learning design contingent valuation (LDCV): NOAA guidelines, preference learning and coherent arbitrariness". Journal of Environmental Economics and Management, 55(2): 127-141.

Ben-Akiva, M. y Lerman, S.R. (1985). Discrete Choice Analysis: Theory and Application to Travel Demand. The Massachusetts Institute of Technology Press. Cambridge.

Bennett, J. (2011). The International Handbook on Non-Market Valuation. Edward Elgar Publishers, Cheltenham, Reino Unido.

Birol, E. y Koundouri, P. (2008). Choice Experiments Informing Environmental Policy: A European Perspective. New Horizons in Environmental Economics. Edward Elgar Publishers, Cheltenham, Reino Unido.

Bush, G., Colombo, S. y Hanley, N. (2009). "Should all choices count? Using the cut-offs approach to edit responses in a choice experiment". Environmental and Resource Economics, 44(3): 397-414.

Campbell, D., Hensher, D.A., Scarpa, R., (2011). "Non-attendance to attributes in environmental choice analysis: A latent class specification". Journal of Environmental Planning and Management, 54(8): 1061-1076.

Colombo, S. y Glenk, K. (2014). "Social preferences for agricultural policy instruments:joint consideration of non-attendance to attributes and to alternatives in modelling discrete choice data". Journal of Environmental Planning and Management,57(2): 215-232.

Colombo, S., Christie, M. y Hanley, N. (2013). "What are the consequences of ignoring attributes in choice experiments? Implications for ecosystem service values". Ecological Economics, 96: 25-35.

Colombo, S., Hanley, N. y Louviere, J. (2009). "Modeling preference heterogeneity in stated choice data: an analysis for public goods generated by agriculture". Agricultural Economics, 40(3): 307-322.

Day, B. y Pinto-Prades, J.L. (2010). "Ordering anomalies in choice experiments".Journal of Environmental Economics and Management, 59(3): 271-285.

Day, B., Bateman, I.J., Carson R.T., Dupont, D., Louviere J.J., Morimoto S., Scarpa R. y Wang, P. (2012). "Ordering effects and choice set awareness in repeat-response stated preference studies". Journal of Environmental Economics and Management, 63(1): 73-91.

Domencich, T. y McFadden, D.L. (1975). Urban Travel Demand: A Behavioral Analysis. North Holland Publishing Company, Oxford, Reino Unido.

Espinosa-Goded, M. y Barreiro-Hurlé, J. (2010). "Las preferencias discontinuas en los experimentos de elección: impacto en el cálculo de la prima de los programas agroambientales". Economía Agraria y Recursos Naturales, 10(1): 155-176.

Hensher, D. y Collins, A. (2011). "Interrogation of Responses to Stated Choice Experiments: Is there sense in what respondents tell us?". Journal of choice modelling, 4(1): 62-89.

Hensher, D., Rose J. y Greene W. (2005). "The implications on willingness to pay of respondents ignoring specific attributes". Transportation, 32(3): 203-222.

Hess, S., Rose, J.M. y Polak, J. (2010). "Non-trading, lexicographic and inconsistent behaviour in stated choice data". Transportation Research Part D, 15(7): 405-417.

Hess, S., Stathopoulos, A., Campbell, D., Gibson, V. y Caussade, S. (2012). "It's not that I don't care, I just don't care very much: Confounding between attribute non-attendance and taste heterogeneity". Transportation, 40(3): 583-607.

Jones, E.E. (1998). "Major developments in five decades of social psychology". En Gilbert, D.T., Fiske, S.T. y Lindzey, G. (Eds.): The Handbook of Social Psychology, McGraw-Hill. Boston: 3-57.

Kragt, M.E. (2013). "The effect of changing cost vectors on choices and scale heterogeneity". Environmental and Resources Economics, 54(2): 201-221.

Lancaster, K. (1966). "A new approach to Consumer Theory". Journal of Political Economy, 74: 132-157.

MacKerron, G. (2011). "Implementation, implementation, implementation: Old and new options for putting surveys and experiments online". Journal of Choice Modelling, 4(2): 20-48.

Mansky, C. (1977). "The Structure of Random Utility Models". Theory and Decision, 8(3): 229-254.

McFadden, D. (1973). "Conditional logit analysis of qualitative choice behaviour". En Zarembka, P. (Ed.): Frontiers in econometrics. New York Academic Press: 105-142.

Payne, J.W., Bettman, J.R., Schkade, D.A. (1999). "Measuring constructed preferences: Towards a building code". Journal of Risk and Uncertainty, 19(1-3): 243-270.

Poe, G.L., Giraud, K.L. y Loomis, J.B. (2005). "Computational methods for measuring the difference of empirical distributions". American Journal of Agricultural Economics, 87(2): 353-365.

Rigby, D. y Burton, M., (2006). "Modelling disinterest and dislike: A bounded Bayesian mixed logit model of the UK market for GM food". Environmental and Resource Economics, 33(4): 485-510.

Rocamora, B., Colombo, S., Sayadi, S. y Estévez, C. (2013). "Los impactos marginales del olivar ecológico de montaña andaluz frente al convencional post-condicionalidad: una visión de los expertos". Revista Española de Estudios Agrosociales y Pesqueros, 234: 49-82.

Rose, J.M., Bain, D. y Bliemer, M. (2011). "Experimental design strategies for stated preferences studies dealing with non-market goods". En Bennett, J. (Ed.): The International Handbook on Non-Market Environmental Valuation. Edward Elgar Publishing, Cheltenham, Reino Unido.

Ryan, M., Watson, V. y Entwistle, V. (2009). "Rationalising the 'irrational': A think aloud study of discrete choice experiment responses". Health Economics, 18(3): 321-336.

Salensminde, K. (2002). "The impact of choice inconsistencies in stated choice studies". Environmental and Resource Economics, 23(4): 403-420.

Scarpa, R., Thiene, M. y Hensher, D.A. (2010). "Monitoring Choice Task Attribute Attendance in Nonmarket Valuation of Multiple Park Management Services: Does It Matter?" Land Economics, 86(4): 817-839.

Spash, C.L., Urama, K., Burton, R., Kenyon, W., Shannon, P. y Hill, G. (2009). "Motives behind willingness to pay for improving biodiversity in a water ecosystem: Economics, ethics and social psychology". Ecological Economics, 68(4): 955-964.

Stern, P.C. (2000). "Toward a coherent theory of environmentally significant behavior". Journal of Social Issues, 56(3): 407-424.

Taylor, H. (2000). "Does internet research work? Comparing on-line survey results with telephone surveys". International Journal of Market Research, 42(1): 51-63.

Tonsor, G. y Shupp, R.S. (2011). "Cheap Talk Scripts and Online Choice Experiments: Looking Beyond the Mean". American Journal of Agricultural Economics, (4): 1015-1031.

Tversky, A. y Simonson, I. (1993). "Context dependent preference". Management Science, 39(10): 1179-1189.

Abstract Views

Metrics Loading ...

Metrics powered by PLOS ALM


  • There are currently no refbacks.

 Universitat Politècnica de València

e-ISSN: 2174-7350   ISSN: 1578-0732