Abstract
Daily rhythms of arousal explain a broad range of variations in biological, behavioral, and cognitive patterns among humans. In this paper, we consider the effects of individual variations in optimal time-of-day on the stability of consumer responses. Specifically, we explore the effects of gathering questionnaire responses at times of day that match (versus mismatch) consumers' temporal preferences on data reliability. Two studies were conducted using two different scales. Our findings confirm a synchrony effect between participants' testing time and test–retest reliability results. Specifically, we found greater (lower) stability in test–retest scores for surveys administered during times-of-day matching (mismatching) consumers' temporal preferences. We discuss theoretical and practical implications and opportunities for future research.
Similar content being viewed by others
Notes
For all Alpha's we have also calculated their confidence intervals using the computation procedure suggested by Iacobucci and Duhachek (2003).
The following formula was used, throughout the paper, to calculate the magnitude of all experimental effects (effect size): \( r = \left( {\text{eta}} \right) = \sqrt {\frac{{(F)\left( {df\,{\text{effect}}} \right)}}{{(F)\left( {df\,{\text{effect}} + \left( {df\,{\text{error}}} \right)} \right)}}} . \) Rosenthal and Rosnow (1984, p. 356).
References
Andershed, A. (2005). In synchrony with adolescence: The role of morningness-eveningness in development. London: Springer.
Blair, A., Tarone, R., Sandler, D., & Lynch, C. (2001). Reliability of reporting on life-style. Epidemiology (Cambridgem, Mass.), 13(1), 94–99. doi:10.1097/00001648-200201000-00015.
Bodenhausen, V. G. (1990). Stereotypes as judgmental heuristics: Evidence of circadian variations in discrimination. Psychological Science, 1(5), 319–322. doi:10.1111/j.1467-9280.1990.tb00226.x.
Burns, A., & Harrison, M. C. (1979). A test of the reliability of psychographics. Journal of Marketing Research, 26(1), 32–38. doi:10.2307/3150871.
Clancy, K., & Ostlund, L. (1976). Commercial effectiveness measures. Journal of Advertising Research, 16(1), 26–34.
Cohen, J. (1987). Statistical power analysis for the behavioral sciences. Hillsdale: Erlbaum.
Dutt-Bergman, M. (2004). A descriptive narrative of healthy lasting using psychographics. Health Marketing Quarterly, 20(3), 81–101. doi:10.1300/J026v20n03_06.
Fasssnacht, M. (2009). The death of consumer segmentation? Rethinking a traditional marketing tool. Advertising Age, (April), 13.
Freeman, G., & Hovland, C. (1934). Diurnal variation in performance and related physiological processes. Psychological Bulletin, 31, 777–799. doi:10.1037/h0071917.
Goldstein, D., Hahn, C., & Hasher, L. (2007). Time of day, intellectual performance, and behavioral problems in morning versus evening type adolescents: Is there a synchrony effect. Personality and Individual Differences, 42(3), 431–440. doi:10.1016/j.paid.2006.07.008.
Hasher, L., Goldstein, D., & May, C. P. (2005). It’s about time: Circadian rhythms, memory, and aging. In I. Chizuko & N. Ohta (Eds.), Human learning and memory: Advances in theory and application. Mahwah: Erlbaum.
Hendrickson, A., Massey, P., & Cronan, T. (1993). On the test-retest reliability of perceived usefulness and perceived ease of use scales. MIS Quarterly, 13(3), 227–231. doi:10.2307/249803.
Horne, J. A., & Ostberg, C. O. (1976). A self-assessment questionnaire to determine morningness–eveningness in human circadian rhythms. International Journal of Chronobiology, 4(1), 97–110.
Hornik, J. (1988). Diurnal variations in consumer response. The Journal of Consumer Research, 14(4), 588–592. doi:10.1086/209139.
Hornik, J. (1990). Time orientation psychographics, and smoking behavior. Journal of Health Care Marketing, 10(1), 36–46.
Iacobucci, D., & Duhacheck, A. (2003). Advancing alpha: Measuring reliability with confidence. Journal of Consumer Psychology, 13(4), 478–487. doi:10.1207/S15327663JCP1304_14.
Kruglanski, A., & Pierro, A. (2008). Night and day, you are the one: On circadian mismatches and the transference effect in social perception. Psychological Science, 19(3), 296–301. doi:10.1111/j.1467-9280.2008.02083.x.
Lalwani, A. K. (2009). The distinct influence of cognitive busyness and need for closure on cultural differences in socially desirable responding. The Journal of Consumer Research, 36(3) (in press).
Lastovika, J. (1982). On the validity of life-style tarits: A review and illustration. JMR, Journal of Marketing Research, 19(1), 126–138. doi:10.2307/3151537.
Mathews, G., & Davies, R. (2001). Individual differences in energetic arousal and sustained attention: A dual-task study. Personality and Individual Differences, 31(3), 575–589. doi:10.1016/S0191-8869(00)00162-8.
May, C. P., & Hasher, L. (1998). Synchrony effects in inhibitory control over thought and action. Journal of Experimental Psychology. Human Perception and Performance, 24(2), 363–379. doi:10.1037/0096-1523.24.2.363.
McElroy, T., & Mosteller, L. (2006). The influence of circadian type, time of day and class difficulty on students' grades. Electronic Journal of Research in Educational Psychology, 4(3), 611–622.
McKelvie, S. J. (1992). Does memory contaminate test-retest reliability? The Journal of General Psychology, 119(1), 59–72.
Nunnelly, J. C. (1978). Psychometric theory (3rd ed.). New York: McGraw-Hill.
Ottenbacher, K. (1995). An examination of reliability in developmental research. Journal of Developmental and Behavioral Pediatrics, 16, 177–182. doi:10.1097/00004703-199506000-00005.
Peter, P. J. (1979). Reliability: A review of psychometric basics and recent marketing practices. Journal of Marketing Research, 16(1), 6–17.
Plocher, T., Goonetilleke, R., Yan, Z., & Liang, S. -F. M. (2002). Time orientation across cultures. In: J. Coronado, D. L. Day, B. Hall (eds.), Proceedings of the 4th Annual International Workshop on Internationalisation of Products and Systems (IWIPS), (pp. 23–31). Austin, Texas, USA
Roehm, H. A., & Roehm, M. L. (2004). Variety-seeking and time of day: Why leader brands hope young adults shop in the afternoon, but follower brands hope for morning. Marketing Letters, 15(4), 213–221.
Rosenthal, R., & Rosnow, R. L. (1984). Essentials of behavioral research: Methods and data analysis. New York: McGraw-Hill.
Sawyer, A. G., & Ball, D. A. (1981). Statistical power and effect size in marketing research. JMR, Journal of Marketing Research, 28, 275–290. doi:10.2307/3150969.
Shrout, P. E., & Fleiss, J. L. (1979). Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin, 2, 420–428. doi:10.1037/0033-2909.86.2.420.
Silk, A. J. (1977). Test-retest correlations and the reliability of copy testing. JMR, Journal of Marketing Research, 14(3), 476–486. doi:10.2307/3151188.
Taillard, J., Philip, P., & Chastang, J. (2004). Validation of horne and ostberg morningness–eveningness questionnaire. Journal of Biological Rhythms, 19(1), 76–86. doi:10.1177/0748730403259849.
Thayer, R. E. (1996). Toward a psychological theory of multidimensional activation (Arousal). Motivation and Emotion, 2(1), 1–33. doi:10.1007/BF00992729.
Villani, K. E. A., & Lehmann, D. (1975). An examination of the stability of AIO measures. In E. M. Muzze (Ed.), Marketing: The challenges and the opportunities (pp. 484–88). Chicago: American Marketing Association.
Wells, W. D. (1975). Psychographics: A critical review. Journal of Marketing Research, 12(2), 196–213.
Yoon, C. (1997). Age differences in consumers processing strategies: An investigation of moderating influences. The Journal of Consumer Research, 24(4), 329–340. doi:10.1086/209514.
Yoon, C., May, C. P., Goldstein, D., & Hasher, L. (2000). Aging, circadian arousal patterns and cognition. In D. Park & N. Schwarz (Eds.), Cognitive Aging: A Primer (2nd ed.). Philadelphia: Psychology.
Author information
Authors and Affiliations
Corresponding author
Additional information
This research was financially supported by the Henry Crown Center for Business Research, Israel.
Rights and permissions
About this article
Cite this article
Hornik, J., Tal, A. The effect of synchronizing consumers' diurnal preferences with time of response on data reliability. Mark Lett 21, 1–15 (2010). https://doi.org/10.1007/s11002-009-9080-7
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11002-009-9080-7