Abstract
In fall 1995, the worldwide-accessible Web Experimental Psychology Lab (http://www.genpsylab. unizh.ch) opened its doors to Web surfers and Web experimenters. It offers a frequently visited place at which to conduct true experiments over the Internet. Data from 5 years of laboratory running time are presented, along with recommendations for setting up and maintaining a virtual laboratory, including sections on the history of the Web laboratory and of Web experimenting, the laboratory’s structure and design, visitor demographics, the Kids’ Experimental Psychology Lab, access statistics, administration, software and hardware, marketing, other Web laboratories, data security, and data quality. It is concluded that experimental data collection via the Internet has proven to be an enrichment to science. Consequently, the Web Experimental Psychology Lab will continue and extend its services to the scientific community.
Article PDF
Similar content being viewed by others
References
American Psychological Association (1992).Ethical principles of psychologists and code of conduct [on-line document]. Available: http://www.apa.org/ethics/code.html. [Retrieved April 6, 2001]
Anderson, N. H. (1982).Methods of information integration theory. New York: Academic Press.
Birnbaum, M. H. (1999). How to show that 9 > 221: Collect judgments in a between-subjects design.Psychological Methods,4, 243–249.
Birnbaum, M. H. (2000).Psychological experiments on the Internet. San Diego: Academic Press.
Booth-Kewley, S., Edwards, J., &Rosenfeld, P. (1992). Impression management, social desirability, and computer administration of attitude questionnaires: Does the computer make a difference?Journal of Applied Psychology,77, 562–566.
Buchanan, T., &Smith, J. L. (1999). Using the Internet for psychological research: Personality testing on the World Wide Web.British Journal of Psychology,90, 125–144.
Connes, B. (1972). The use of electronic desk computers in psychological experiments.Journal of Structural Learning,3, 51–72.
Dickey, C. E. (1999).Web page hacker arrested, government sites becoming more secure [On-line document]. Available: http://www.dtic.mil/armylink/news/Sep1999/a19990901hacker.html. [Retrieved April 6, 2001]
Eichstaedt, J. (2001). An inaccurate-timing filter for reaction time measurement by JAVA applets implementing Internet-based experiments.Behavior Research Methods, Instruments, & Computers,33, 179–186.
Extreme Digytal (2001).Extreme tracking [On-line document]. Available: http://www.extreme-dm.com/tracking/. [Retrieved April 6, 2001]
Francis, G., Neath, I., &Surprenant, A. (2000). The Cognitive Psychology Online Laboratory. In M. H. Birnbaum (Ed.),Psychological experiments on the Internet (pp. 267–283). San Diego: Academic Press.
Frick, A., Bächtiger, M. T., &Reips, U.-D. (2001). Financial incentives, personal information, and drop out in online studies. In U.-D. Reips & M. Bosnjak (Eds.),Dimensions of Internet science (pp. 209–220). Lengerich: Pabst.
Fx Web Web Technologies (1999).Webtracker version 2 [On-line document]. Available: http://www.fxWeb.com/tracker/. [Retrieved April 6, 2001]
Graphics, Visualization, and Usability Center (1999).GVU’s WWW user surveys [on-line document]. Available: http://www.cc. gatech.edu/gvu/user_surveys. [Retrieved April 6, 2001]
Hänze, M., &Meyer, H. A. (1997). Feldexperimente und nicht-reaktive Messung im World Wide Web [Field experiments and nonreactive measurement on the World-Wide Web]. In D. Janetzko, B. Batinic, D. Schoder, M. Mattingley-Scott, & G. Strube (Eds.),CAW-97. Beiträge zum Workshop “Cognition & Web” (pp. 141–148). Freiburg, Germany: LIG-Berichte 1/97.
Hewson, C. M., Laurent, D., &Vogel, G. M. (1996). Proper methodologies for psychological and sociological studies conducted via the Internet.Behavior Research Methods, Instruments, & Computers,28, 186–191.
Hoffman, R., &MacDonald, J. (1993). Using HyperCard and Apple events in a network environment: Collecting data from simultaneous experimental sessions.Behavior Research Methods, Instruments, & Computers,25, 114–126.
Hoggatt, A. C. (1977). On the uses of computers for experimental control and data acquisition.American Behavioral Scientist,20, 347–365.
Jäger, A. O., Süss, H.-M., &Beauducel, A. (1997).Berliner Intelligenzstruktur-Test (BIS-Test): Form 4 [The Berlin Intelligence Structure Test: Form 4]. Göttingen: Hogrefe.
Janetzko, D. (1999).Statistische Anwendungen im Internet [Statistical applications for the Internet]. Munich: Addison-Wesley.
Kieley, J. M. (1996). CGI scripts: Gateways to World-Wide Web power.Behavior Research Methods, Instruments, & Computers,28, 165–169.
Krantz, J. H., Ballard, J., &Scher, J. (1997). Comparing the results of laboratory and World-Wide Web samples on the determinants of female attractiveness.Behavior Research Methods, Instruments, & Computers,29, 264–269.
Krist, H., & Reips, U.-D. (2001).Length estimation in the archimedic spiral: Studying information integration on the Internet. Manuscript in preparation.
McGraw, K. O., Tew, M. D., &Williams, J. E. (2000). An online psychology laboratory. In M. H. Birnbaum (Ed.),Psychological experiments on the Internet (pp. 219–233). San Diego: Academic Press.
Morrow, R. H., &McKee, A. J. (1998). CGI scripts: A strategy for between-subjects experimental group assignment on the World-Wide Web.Behavior Research Methods, Instruments, & Computers,30, 306–308.
Musch, J., &Reips, U.-D. (2000). A brief history of Web experimenting. In M. H. Birnbaum (Ed.),Psychological experiments on the Internet (pp. 61–85). San Diego: Academic Press.
Psycoloquy (2000). [On-line document]. Available: http://www. princeton. edu/~harnad/psyc.html. [Retrieved April 6, 2001]
Reips, U.-D. (1995).The Web experiment method [On-line document]. Available: http://www.genpsy.unizh.ch/Ulf/Lab/WWWExpMethod. html. [Retrieved April 6, 2001]
Reips, U.-D. (1996a, April). Experimentieren im World-Wide Web [Experimenting in the World-Wide Web] [Abstract].Experimentelle Psychologie: Tagung experimentell arbeitender Psychologen [Proceedings of the Experimental Psychologist’s Conference],38, 256–257.
Reips, U.-D. (1996b, October).Experimenting in the World Wide Web. Paper presented at the 1996 Society for Computers in Psychology Conference, Chicago. Available: http://www.genpsy.unizh.ch/reips/slides/scipchicago96.html. [Retrieved April 6, 2001]
Reips, U.-D. (1997a). Forschen im Jahr 2007: Integration von Web-Experimentieren, Online-Publizieren und Multimedia-Kommunikation [Science in the year 2007: Integration of Web experimenting, online publishing, and multimedia communication]. In D. Janetzko, B. Batinic, D. Schoder, M. Mattingley-Scott, & G. Strube (Eds.),CAW-97: Beiträge zum. Workshop “Cognition & Web” (pp. 141–148). Freiburg, Germany: IIG-Berichte 1/97.
Reips, U.-D. (1997b). Das psychologische Experimentieren im Internet [Psychological experimenting on the Internet], In B. Batinic (Ed.),Internet für Psychologen (pp. 245–265). Göttingen: Hogrefe.
Reips, U.-D. (1999). Online research with children [On-line book]. In U.-D. Reips, B. Batinic, W Bandilla, M. Bosnjak, L. Gräf, K. Moser, & A. Werner (Eds.),Current Internet Science—trends, techniques, results/Aktuelle Online Forschung—Trends, Techniken, Ergebnisse. Zurich: Online Press. Available: http://dgof.de/tband99/. [Retrieved April 6, 2001]
Reips, U.-D. (2000). The Web experiment method: Advantages, disadvantages, and solutions. In M. H. Birnbaum (Ed.),Psychological experiments on the Internet (pp. 89–114). San Diego: Academic Press.
Reips, U.-D. (in press-a). Context effects in Web surveys. In B. Batinic, U.-D. Reips, & M. Bosnjak (Eds.),Online social sciences. Seattle: Hogrefe & Huber.
Reips, U.-D. (in press-b). Theory and techniques of Web experimenting. In B. Batinic, U.-D. Reips, & M. Bosnjak (Eds.),Online social sciences. Seattle: Hogrefe & Huber.
Reips, U.-D., Morger, V., & Meier, B. (2000). Fünfegerade sein lassen: Listenkontexte [Letting five be equal: List contexts]. Manuscript submitted for publication.
Schmidt, W. C. (2000). The server-side of psychology Web experiments. In M. H. Birnbaum (Ed.),Psychological experiments on the Internet (pp. 285–310). San Diego: Academic Press.
Schwarz, S., &Reips, U.-D. (2001). CGI versus JavaScript: A Web experiment on the reversed hindsight bias. In U.-D. Reips & M. Bosnjak (Eds.),Dimensions of Internet science (pp. 75–90). Lengerich: Pabst.
Sullivan, D. (2000, July 7).Search engine sizes [On-line], Available: http://searchenginewatch.com. [Retrieved April 6, 2001]
Wason, P. C. (1968). Reasoning about a rule.Quarterly Journal of Experimental Psychology,20, 273–281.
Wilkening, F. (1979). Combining of stimulus dimensions in children’s and adults’ judgments of area: An information integration analysis.Developmental Psychology,15, 25–33.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Reips, UD. The Web Experimental Psychology Lab: Five years of data collection on the Internet. Behavior Research Methods, Instruments, & Computers 33, 201–211 (2001). https://doi.org/10.3758/BF03195366
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/BF03195366