Skip to main content
SpringerLink
Log in

Zur Verhaltensvalidität von Vignettenexperimenten

Theoretische Grundlagen, Forschungsstrategien und Befunde

  • Chapter
  • First Online:
Qualitätssicherung sozialwissenschaftlicher Erhebungsinstrumente

Zusammenfassung

Vignettenexperimente werden zunehmend nicht nur zur Messung von Einstellungen, sondern auch zur Erfassung von Verhaltensintentionen eingesetzt. Bei entsprechenden Studien wird meist implizit angenommen, dass die mittels Vignettenexperimenten geschätzten Effekte auf tatsächliches Verhalten und dessen Determinanten schließen lassen. Die Annahme der Verhaltensvalidität faktorieller Surveys wurde bisher jedoch nur selten explizit thematisiert und methodisch sauber getestet. In diesem Beitrag werden daher vor dem Hintergrund theoretischer Überlegungen und empirischer Befunde die Bedingungen diskutiert, unter welchen die gemessenen Intentionen mit tatsächlichem Verhalten korrespondieren sollten. Insbesondere die Theorie des geplanten Verhaltens erweist sich hierbei als hilfreich, um relevante Einflussfaktoren zu identifizieren. Anschließend werden konkrete Kriterien erarbeitet, die bei Validierungsstudien zu beachten sind und es werden Empfehlungen gegeben, wie sich eine methodisch abgesicherte Validierung realisieren lässt. Demnach ist die Güte einer Validierungsstudie insbesondere dann hoch, wenn eine möglichst große Ähnlichkeit hinsichtlich der verwendeten Stichproben, der Treatments, der Effektschätzung, des Settings und der Skalierung der Outcomes gegeben ist.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 44.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 59.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

Literatur

  • Abraham, M., Auspurg, K., & Hinz, T.(2010). Migration decisions within dual-earner partnerships: A test of bargaining theory. Journal of Marriage and Family, 72(4), 876-892.

    Article  Google Scholar 

  • Ajzen, I.(1985).From intentions to actions: A theory of planned behavior. In J. Kuhl & J. Beckmann (Eds.), Action control. From cognition to behavior (pp. 11-39). Heidelberg: Springer Verlag.

    Chapter  Google Scholar 

  • Ajzen, I. (1991). The theory of planned behavior. Organizational behavior and human decision processes, 50(2), 179-211.

    Google Scholar 

  • Ajzen, I. (2015). Consumer attitudes and behavior: the theory of planned behavior applied to food consumption decisions. Rivista di Economia Agraria, 70(2), 121-138.

    Google Scholar 

  • Ajzen, I., Brown, T. C., & Carvajal, F. (2004). Explaining the discrepancy between intentions and actions: The case of hypothetical bias in contingent valuation. Personality and Social Psychology Bulletin, 30(9), 1108-1121.

    Article  Google Scholar 

  • Ajzen, I., & Fishbein, M. (1980). Understanding and predicting social behavior. Englewood Cliffs: Prentice-Hall.

    Google Scholar 

  • Alexander, C. S., & Becker, H. J. (1978). The use of vignettes in survey research. Public Opinion Quarterly, 42(1), 94-104.

    Article  Google Scholar 

  • Allison, P. D. (2009). Fixed effects regression models. Thousand Oaks: Sage.

    Book  Google Scholar 

  • Angrist, J. D., & Pischke, J. -S. (2015). Mostly harmless econometrics. An empiricit‘s companion. Princeton: Princeton University Press.

    Google Scholar 

  • Armacost, R. L., Hosseini, J. C., Morris, S. A., & Rehbein, K. A. (1991). An empirical comparison of direct questioning, scenario, and randomized response methods for obtaining sensitive business information. Decision Sciences, 22(5), 1073-1099.

    Article  Google Scholar 

  • Armitage, C. J., & Conner, M. (2001). Efficacy of the theory of planned behaviour: A meta-analytic review. British Journal of Social Psychology, 40(4), 471-499.

    Article  Google Scholar 

  • Atzmüller, C., & Steiner, P. M. (2010). Experimental vignette studies in survey research. Methodology: European Journal of Research Methods for the Behavioral and Social Sciences, 6(3), 128-138.

    Article  Google Scholar 

  • Auspurg, K., & Hinz, T. (2015). Factorial survey experiments. London/Thousand Oaks: Sage.

    Book  Google Scholar 

  • Auspurg, K., Hinz, T., Liebig, S., & Sauer, C. (2015). The factorial survey as a method for measuring sensitive issues. In U. Engel, B. Jann, P. Lynn, A. Scherpenzeel, & P. Sturgis (Eds.), Improving survey methods: Lessons from recent research (pp. 137-150). New York/ Hove: Routledge.

    Google Scholar 

  • Barabas, J., & Jerit, J. (2010). Are survey experiments externally valid? American Political Science Review, 104(2), 226-242.

    Article  Google Scholar 

  • Beck, M., & Opp, K. -D. (2001). Der faktorielle Survey und die Messung von Normen. Kölner Zeitschrift für Soziologie und Sozialpsychologie, 53(2), 283-306.

    Article  Google Scholar 

  • Berger, R., & Wolbring, T. (2015). Kontrafaktische Kausalität und eine Typologie sozialwissenschaftlicher Experimente. In M. Keuschnigg & T. Wolbring (Eds.), Experimente in den Sozialwissenschaften. Soziale Welt Sonderband 22 (pp. 34-52). Baden-Baden: Nomos.

    Chapter  Google Scholar 

  • Best, H., & Wolf, C. (Eds.). (2015). The SAGE handbook of regression analysis and causal inference. London et al.: Sage.

    Google Scholar 

  • Burstin, K., Doughtie, E., & Raphaeli, A. (1980). Contrastive vignette technique: An indirect methodology designed to address reactive social attitude measurement. Journal of Applied Social Psychology, 10(2), 147-165.

    Article  Google Scholar 

  • Buskens, V., & Weesie, J. (2000). An experiment on the effects of embeddedness in trust situations. Buying a used car. Rationality and Society, 12(2), 227-253.

    Article  Google Scholar 

  • Campbell, D. T. (1957). Factors relevant to the validity of experiments in social settings. Psychological Bulletin, 54(4), 297-312.

    Article  Google Scholar 

  • Campbell, D. T., & Stanley, J. C. (1963). Experimental and quasi-experimental designs for research. Chicago: Rand-McNally.

    Google Scholar 

  • Carlsson, F., & Martinsson, P. (2001). Do hypothetical and actual marginal willingness to pay differ in choice experiments? Application to the valuation of the environment. Journal of Environmental Economics and Management, 41(2), 179-192.

    Article  Google Scholar 

  • Collett, J. L., & Childs, E. (2011). Minding the gap: Meaning, affect, and the potential shortcomings of vignettes. Social Science Research, 40(2), 513-522.

    Article  Google Scholar 

  • Cook, T. D., & Campbell, D. T. (1979). Quasi-experimentation: Design and analysis issues for field settings. Chicago: Rand McNally.

    Google Scholar 

  • Cronbach, L. J. (1982). Designing evaluations of educational and social programs. San Francisco: Jossey-Bass Publishers.

    Google Scholar 

  • Diehl, C., Andorfer, V. A., Khoudja, Y., & Krause, K. (2013). Not in my kitchen? Ethnic discrimination and discrimination intentions in shared housing among university students in Germany. Journal of Ethnic and Migration Studies, 39(10), 1679-1697.

    Article  Google Scholar 

  • Diekmann, A., & Preisendörfer, P. (1992). Persönliches Umweltverhalten. Diskrepanzen zwischen Anspruch und Wirklichkeit. Kölner Zeitschrift für Soziologie und Sozialpsychologie, 44(2), 226-251.

    Google Scholar 

  • Diekmann, A., & Preisendörfer, P. (2003). Green and greenback: The behavioral effects of environmental attitudes in low-cost and high-cost situations. Rationality and Society, 15(4), 441-472.

    Article  Google Scholar 

  • Dülmer, H. (2016). The factorial survey. Design selection and its impact on reliability and internal validity. Sociological Methods and Research, 45(2), 304-347.

    Article  Google Scholar 

  • Eifler, S. (2007). Evaluating the validity of self-reported deviant behavior using vignette analyses. Quality and Quantity, 41(2), 303-318.

    Article  Google Scholar 

  • Eifler, S.(2010).Validity of a factorial survey approach to the analysis of criminal behavior.Methodology: European Journal of Research Methods for the Behavioral and Social Sciences, 6(3), 139-146.

    Article  Google Scholar 

  • Eifler, S., & Petzold, K.(forthcoming).Validity aspects of vignette experiments: Expected ‘what-if’ differences between reports of behavioral intentions and actual behavior.In P.J.Lavrakas, E.de Leeuw, A.Holbrook, C.Kennedy, M.W.Traugott & B.T.West (Eds.), Experimental methods in survey research: Techniques that combine random sampling with random assignment.Hoboken: John Wiley & Sons.

    Google Scholar 

  • Elwert, F., & Winship, C.(2014).Endogenous selection bias: The problem of conditioning on a collider variable.Annual Review of Sociology, 40, 31-53.

    Article  Google Scholar 

  • Finch, J.(1987).The vignette technique in survey research.Sociology, 21(1), 105-114.

    Google Scholar 

  • Findley, M.G., Laney, B., Nielson, D.L., & Sharman, J.C.(2017).External validity in parallel global field and survey experiments on anonymous incorporation.The Journal of Politics, 79(3), 856-872.

    Article  Google Scholar 

  • Fishbein, M., & Ajzen, I.(2010).Predicting and changing behavior. The reasoned action approach.New York/Hove: Psychology Press.

    Book  Google Scholar 

  • Fisher, R.A.(1935).The design of experiments.Edinburgh: Oliver and Boyd.

    Google Scholar 

  • Friedman, D., & Cassar, A.(2004).Economics lab. An intensive course in experimental economics.London/New York: Routledge.

    Google Scholar 

  • Frodermann, C.(2015).Wer arbeitet wie viel? Entscheidungen über den Erwerbsumfang im Partnerschaftskontext.Zeitschrift für Familienforschung, 27(1), 78-104.

    Article  Google Scholar 

  • Gangl, M.(2010).Causal inference in sociological research.Annual Review of Sociology, 36(1), 21-47.

    Article  Google Scholar 

  • Graeff, P., Sattler, S., Mehlkop, G., & Sauer, C.(2014).Incentives and inhibitors of abusing academic positions: Analysing universty students‘ decision about bribing academic staff.European Sociological Review, 30(2), 230-241.

    Article  Google Scholar 

  • Groß, J., & Börensen, C.(2009).Wie valide sind Verhaltensmessungen mittels Vignetten? Ein methodischer Vergleich von faktoriellem Survey und Verhaltensbeobachtung.In P.Kriwy & C.Gross (Eds.), Klein aber fein! Quantitative Sozialforschung mit kleinen Fallzahlen (pp.149-178).Wiesbaden: VS Verlag für Sozialwissenschaften.

    Google Scholar 

  • Hainmueller, J., Hangartner, D., & Yamamoto, T.(2015).Validating vignette and conjoint survey experiments against real-world behavior.Proceedings of the National Academy of Sciences, 112(8), 2395-2400.

    Article  Google Scholar 

  • Halaby, C.N.(2004).Panel models in sociological research: Theory into practice.Annual Review of Sociology, 30, 504-544.

    Article  Google Scholar 

  • Holland, P.W.(1986).Statistics and causal inference.Journal of the American Statistical Association, 81(4), 945-960.

    Article  Google Scholar 

  • Hughes, R., & Huby, M.(2004).The construction and interpretation of vignettes in social research.Social Work & Social Sciences Review, 11(1), 36-51.

    Article  Google Scholar 

  • Jackson, M., & Cox, D.R.(2013).The principles of experimental design and their application in sociology.Annual Review of Sociology, 39, 27-49.

    Article  Google Scholar 

  • Jasso, G.(2006).Factorial survey methods for studying beliefs and judgements.Sociological Methods and Research, 34(3), 334-423.

    Article  Google Scholar 

  • Jasso, G., & Rossi, P.H.(1977).Distributive justice and earned income.American Sociological Review, 42(4), 639-651.

    Article  Google Scholar 

  • Kerlinger, F.N.(1986).Foundations of behavioral research.New York: Wadsworth Publishing.

    Google Scholar 

  • Krumpal, I.(2013).Determinants of social desirability bias in sensitive surveys: A literature review.Quality and Quantity, 47(3), 2025-2047.

    Article  Google Scholar 

  • Kuhfeld, W.F.(2010).Marketing research methods in SAS. Experimental design, choice, conjoint, and graphical techniques. SAS 9.2 Edition MR-2010.

    Google Scholar 

  • Legewie, J.(2012).Die Schätzung von kausalen Effekten: Überlegungen zu Methoden der Kausalanalyse anhand von Kontexteffekten in der Schule.Kölner Zeitschrift für Soziologie und Sozialpsychologie, 64(1), 123-153.

    Article  Google Scholar 

  • Liebig, S., Sauer, C., & Friedhoff, S.(2015).Using factorial surveys to study justice perceptions: Five methodological problems of attitudinal justice research.Social Justice Research, 28(4), 415-434.

    Google Scholar 

  • Luce, D.R., & Turkey, J.W.(1964).Simultaneous conjoint measurement: A new type of fundamental measurement.Journal of Mathematical Psychology, 1(1), 1-27.

    Article  Google Scholar 

  • Markovsky, B., & Eriksson, K.(2012).Comparing direct and indirect measures of just rewards.Sociological Methods and Research, 41(1), 199-216.

    Article  Google Scholar 

  • Morgan, S.L., & Harding, D.J.(2006).Matching estimators of causal effects.Prospects and pitfalls in theory and practice.Sociological Methods and Research, 35(1), 3-60.

    Article  Google Scholar 

  • Morgan, S.L., & Winship, C.(2015).Counterfactuals and causal inference: Methods and principles for social research.2nd edition.Cambridge: Cambridge University Press.

    Google Scholar 

  • Mutz, D.C.(2011).Population-based survey experiments.Princeton: Princeton University Press.

    Google Scholar 

  • Nisic, N., & Auspurg, K.(2009).Faktorieller Survey und klassische Bevölkerungsumfrage im Vergleich - Validität, Grenzen und Möglichkeiten beider Ansätze.In P.Kriwy & C.Gross (Eds.), Klein aber fein! Quantitative Sozialforschung mit kleinen Fallzahlen (pp.211-245).Wiesbaden: VS Verlag für Sozialwissenschaften.

    Google Scholar 

  • Pager, D., & Quillian, L.(2005).Walking the talk? What employers say versus what they do.American Sociological Review, 70(3), 355-380.

    Article  Google Scholar 

  • Petzold, K.(2017).Mobility experience and mobility decision-making: An experiment on permanent migration and residential multilocality.Population, Space and Place, 23(8), e2065.

    Article  Google Scholar 

  • Petzold, K., & Wolbring, T.(forthcoming).What can we learn from factorial surveys about human behavior? A validation study comparing field and survey experiments on discrimination.Methodology.

    Google Scholar 

  • Rosenbaum, P.R.(2010).The design of observational studies. New York et al.: Springer.

    Book  Google Scholar 

  • Rosenbaum, P.R., & Rubin, D.B.(1983).The central role of the propensity score in observational studies for causal effects.Biometrika, 70(1), 41-55.

    Google Scholar 

  • Rossi, P.H.(1979).Vignette analysis: Uncovering the normative structure of complex judgments.In R.K.Merton, J.S.Coleman, & P.H.Rossi (Eds.), Qualitative and quantitative social research: Papers in honor of Paul F. Lazarsfeld (pp.176-186).New York: Free Press.

    Google Scholar 

  • Rossi, P.H., & Anderson, A.B.(1982).The factorial survey approach: An introduction.In P.H.Rossi & S.L.Nock (Eds.), Measuring social judgments. The factorial approach (pp.15-67).Beverly Hills et al.: Sage Publications.

    Google Scholar 

  • Rost, K., & Arnold, N.(2017).Die Vignettenanalyse in den Sozialwissenschaften. Eine anwendungsorientierte Einführung.München: Rainer Hampp Verlag.

    Google Scholar 

  • Schwalbe, C.S., Fraser, M.W., Day, S.H., & Arnold, E.M.(2004).North Carolina Assessment of Risk (NCAR): Reliability and predictive validity with juvenile offenders.Journal of Offender Rehabilitation, 40(1/2), 1-22.

    Article  Google Scholar 

  • Shadish, W.R., Cook, T.D., & Campbell, D.T.(2002).Experimental and quasi-experimental designs for generalized causal inference.Boston/ New York: Houghton Mifflin Company.

    Google Scholar 

  • Shifter, D.E., & Ajzen, I.(1985).Intention, perceived control, and weight loss: An application of the theory of planned behavior.Journal of Personality and Social Psychology, 49(3), 843-851.

    Article  Google Scholar 

  • Stocké, V.(2004).Entstehungsbedingungen von Antwortverzerrungen durch soziale Erwünschtheit.Zeitschrift für Soziologie, 33(4), 303-320.

    Google Scholar 

  • Stocké, V.(2007).Determinants and consequences of survey respondents’ social desirability beliefs about racial attitudes.Methodology, 3(3), 125-138.

    Google Scholar 

  • Stouffer, S.A., & Toby, J.(1951).Role conflict and personality.American Journal of Sociology, 56(5), 395-406.

    Article  Google Scholar 

  • Telser, H., & Zweifel, P.(2007).Validity of discrete-choice experiments evidence for health risk reduction.Applied Economics, 39(1), 69-78.

    Article  Google Scholar 

  • Treischl, E.& Wolbring, T.(2018): Past, present and future of survey experiments: A review about factorial surveys in the social sciences.Unveröffentlichtes Arbeitspapier, FAU Erlangen-Nürnberg.

    Google Scholar 

  • Tourangeau, R., & Yan, T.(2007).Sensitive questions in surveys.Psychological Bulletin, 133(5), 859-883.

    Article  Google Scholar 

  • Tucker, S., Turner, N., Barling, J., Reid, E., & Elving, C.(2006). Apologies and transformational leadership. Journal of Business Ethics, 63(2), 195-207.

    Article  Google Scholar 

  • Vellinga, A., Smit, J. H., Van Leeuwen, E., Van Tilburg, W., & Jonker, C.(2005). Decision-making capacity of elderly patients assessed through the vignette method: Imagination or reality? Aging and Mental Health, 9(1), 40-48.

    Article  Google Scholar 

  • Wallander, L. (2009). 25 years of factorial surveys in sociology: A review. Social Science Research, 38(3), 505-520.

    Article  Google Scholar 

  • Wienhold, M., & Petzold, K. (2014). Fairnessnormen, Sanktionsmacht und soziale Kontrolle bei Bonuszahlungen in Unternehmen. Ein Multi-Level Factorial Survey Experiment. Soziale Welt. Zeitschrift für sozialwissenschaftliche Forschung und Praxis, 65(3), 345-367.

    Article  Google Scholar 

  • Winship, C., & Morgan, S. L. (1999). The estimation of causal effects from observational data. Annual Review of Sociology, 25(1), 659-706.

    Article  Google Scholar 

  • Wooldridge, J. M. (2012). Introductory econometrics: A modern approach. 5th Edition. Boston: Cengage Learning.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Bochum, Deutschland

    Knut Petzold

  2. Nürnberg, Deutschland

    Tobias Wolbring

Authors
  1. Knut Petzold
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Tobias Wolbring
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Knut Petzold .

Editor information

Editors and Affiliations

  1. GESIS – Leibniz-Institut für Sozialwissenschaften, Mannheim, Germany

    Natalja Menold

  2. FAU Erlangen-Nürnberg, Nürnberg, Germany

    Tobias Wolbring

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Fachmedien Wiesbaden GmbH, ein Teil von Springer Nature

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Petzold, K., Wolbring, T. (2019). Zur Verhaltensvalidität von Vignettenexperimenten. In: Menold, N., Wolbring, T. (eds) Qualitätssicherung sozialwissenschaftlicher Erhebungsinstrumente. Schriftenreihe der ASI - Arbeitsgemeinschaft Sozialwissenschaftlicher Institute. Springer VS, Wiesbaden. https://doi.org/10.1007/978-3-658-24517-7_10

Download citation

  • DOI: https://doi.org/10.1007/978-3-658-24517-7_10

  • Published:

  • Publisher Name: Springer VS, Wiesbaden

  • Print ISBN: 978-3-658-24516-0

  • Online ISBN: 978-3-658-24517-7

  • eBook Packages: Social Science and Law (German Language)

Publish with us

Policies and ethics

Search

Navigation