Abstract
In literature, numerous procedures for developing a research design can be found. In this thesis, the procedure suggested by Döring and Bortz (2016, p. 27) has been used as the basis to develop a research design that answers RQ 2 and RQ 3. It also determines the basic structure of this chapter. First, the specification of the general research design leading to a randomized controlled experimental laboratory study is described in detail.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
Bryman (2012, p. 48) further lists ecological validity as another form of validity. As this is especially relevant for social research, it is not given any further consideration.
- 2.
Construct validity is sometimes also referred to as measurement validity.
- 3.
Statistical validity is sometimes also referred to as statistical inference or statistical conclusion validity.
- 4.
An alternative classification framework for research design can, for example, be found in [Neuman 2014, p. 26]. However, the framework is also similar to the one used in this thesis, as most variants and levels resemble those used in this thesis.
- 5.
For this reason, descriptive studies can also be referred to as observations.
- 6.
Note that Montero and León (2007) further distinguish between descriptive and ex post facto studies. However, ex post facto studies also lack intentional manipulation of variables and therefore fall in the same category as descriptive studies on this level of the framework (Ryan 2007, p. 5).
- 7.
[Neuman 2014, p. 290] lists a total of seven elements, stating, however, that not all experimental designs necessarily consist of all these elements and some designs might have additional elements. Similar steps in designing experimental studies are suggested by [Jackson and Cox 2013, p. 34].
- 8.
The final vote of the Ethics commission can be found in can be found in Appendix E in the electronic supplementary material.
- 9.
Additional preliminary studies have been performed to lay the ground for the development of the final experimental design. The results of these studies can be found in Grau (2020), Albert (2019), and Jolmes (2019).
- 10.
The instructional text can be found in Appendix F in the electronic supplementary material.
- 11.
Detailed information on each questionnaire will be given in Section 4.3.3.
- 12.
For more details on the refilling of the rack, please refer to Section 4.2.4.
- 13.
For details on the NASA-TLX, please refer to Section 4.3.2.
- 14.
Moreover, an analysis of different movements performed in VR using the HTC Vive’s controllers can be found in Nanjappan et al. (2018).
- 15.
Note that a similar restriction in a real experimental setup allowing the picking of only one item with one hand can be found in Finnsgård and Wänström (2013).
- 16.
As the experimental study was carried out in Germany, picking commands were given in German. The original German version of the command in the example would be: E3 P5 4 Stück für A2.
- 17.
Again, those commands were spoken in German, i.e. “Bestätigt” (confirmed) or “Nochmal” (again).
- 18.
A similar system is, for example, used by Vélaz et al. (2014).
- 19.
The datasheet of the sensors and the retroreflectors can be found in Panasonic (2020).
- 20.
Note that the database also contains data from the infrared sensors located at the order bins in which participants had to drop items. However, this data has not been analysed in this thesis.
- 21.
In closed questions, participants are only able to chose from different response options provided in the questionnaire (Bryman 2012, p. 238).
- 22.
Note that questionnaires 1 and 3 contain further items, which are not listed here. These items were added to the questionnaire during the questionnaire design but were later excluded from the analysis for this thesis. For reasons of clarity, only those items that were analysed in this thesis are described in this section. However, for an analysis of further items from the questionnaires, please refer to Elbert et al. (2019) and Makhlouf (2018).
- 23.
In fully verbalized scales, each level of the answer is individually labelled. In endpoint verbalized scales, only the two most extreme answer levels are labelled (Krebs 2012, p. 105).
- 24.
Note that a power analysis was only performed a priori but not retrospectively, because performing power analyses for the purpose of evaluating experimental results is not recommended (Goodman and Berlin 1994).
- 25.
According to [Cohen 1988, p. 26], this is considered a medium effect size.
- 26.
For the case of a trust experiment, Falk and Zehnder (2011) are also able to show that student participants do not differ significantly from non-student participants.
- 27.
Reasons for giving compensation in cash instead of using other values can be found in [Croson 2005, p. 134] and [Davis and Holt 1993, p. 25].
- 28.
Note that the studies by Willemsen et al. (2009) and Sharples et al. (2008) also use a larger total number of participants. However, the total number of participants in Sharples et al. (2008) divides into a total of three experiments, with 71, 37, and 31 participants. Willemsen et al. (2009) only conduct one experiment, but test a total of eight different conditions in a between-subject design so that the number of participants in each condition is lower than in the study at hand.
- 29.
Two participants in group VR did not fill in this question, leading to n = 54 in this group.
- 30.
The parametric Student’s t-test has been used here and in the subsequent tests provided in this section without prior testing for normality of the data because sample sizes are \(>40\) in both groups (Herzog et al. 2019, p. 56; Elliott and Woodward 2007, p. 26).
- 31.
The non-parametric Kruskal-Wallis test has been used instead of a one-way analysis of variance (ANOVA) because previously performed Shapiro-Wilk tests have rejected normality of the data with \(p<.001\) for each time period.
- 32.
As a reminder: Searching times were calculated as the time difference between the start of a picking order and the first entry of the picker’s hands into the picking rack.
Author information
Authors and Affiliations
Corresponding author
4.1 Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
Copyright information
© 2021 The Author(s), under exclusive license to Springer Fachmedien Wiesbaden GmbH, part of Springer Nature
About this chapter
Cite this chapter
Knigge, JK. (2021). Experimental Design for Evaluating the Usability of Virtual Reality for Planning and Training in the Context of Manual Order Picking and Execution of the Study. In: Virtual Reality in Manual Order Picking. Springer Gabler, Wiesbaden. https://doi.org/10.1007/978-3-658-34704-8_4
Download citation
DOI: https://doi.org/10.1007/978-3-658-34704-8_4
Published:
Publisher Name: Springer Gabler, Wiesbaden
Print ISBN: 978-3-658-34703-1
Online ISBN: 978-3-658-34704-8
eBook Packages: Business and ManagementBusiness and Management (R0)