Abstract
Timed picture naming is a common psycholinguistic paradigm. In this task, participants are asked to label visually depicted objects or actions. Naming performance can be influenced by several picture and verb characteristics which demands fully characterized normative data. In this study, we provide a first German normative data set of picture and verb characteristics associated with a compilation of 283 freely available action pictures and 600 action verbs including naming latencies from 55 participants. We report standard measures for pictures and verbs such as name agreement indices, visual complexity, word frequency, word length, imageability and age of acquisition. In addition, we include less common parameters, such as orthographic Levenshtein distance, transitivity, reflexivity, morphological complexity, and motor content of the pictures and their associated verbs. We use repeated measures correlations in order to investigate associations between picture and word characteristics and linear mixed effects modeling for the prediction of naming latency. Our analyses reveal comparable results to previous studies in other languages, indicating high construct validity. We found that naming latency varied as a function of entropy of responses, word frequency and motor content of pictures and words. In summary, we provide first German normative data for action pictures and their associated verbs and identify variables influencing naming latency.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Introduction
Language processing is an intensively studied subject in the field of human behavior and neuroscience. While a considerate amount of research has been devoted to language comprehension, language production is relatively understudied, partially due to the lack of well-characterized stimulus material (for review see Harley, 2014). A well-established task to study language production is timed picture naming (Cattell, 1886; Oldfield & Wingfield, 1964). During the task, participants view pictorial stimuli and label the depicted scene with one word. Behavioral performance is mainly evaluated as naming latency and—in the case of predetermined reference answers—correctness of responses. Using this task, effects of particular picture characteristics or attributes of the associated words on language production can be studied.
There is a large body of evidence on behavioral and neural correlates of labeling visually presented objects, i.e., producing the associated nouns (Bates et al., 2003; Glaser, 1992; Indefrey, 2011; Perret & Bonin, 2018). However, studies indicate that verb and noun processing are subserved by distinct behavioral and neural processes (Mätzig, Druks, Masterson, & Vigliocco, 2009; Vigliocco, Vinson, Druks, Barber, & Cappa, 2011). In contrast to object naming, the production of verbs by describing visually presented actions (action naming) is relatively understudied. This is partly due to the lack of well-characterized stimulus material. While data sets for object naming are widely available, few studies report psycholinguistic variables and naming latencies for pictorial action stimuli (Cuetos & Alija, 2003; Khwaileh, Mustafawi, Herbert, & Howard, 2018; Schwitter, Boyer, Méot, Bonin, & Laganaro, 2004; Shao, Roelofs, & Meyer, 2014; Székely et al., 2005). However, such resources are important for matching stimulus sets for different experimental conditions or groups. Pictorial stimuli may differ among a range of properties which are known to affect naming performance (Perret & Bonin, 2018). These properties relate to characteristics of either the picture (e.g., visual complexity) or of the associated verb. Verb characteristics thereby comprise word form properties (e.g., word length, morphological structure) and attributes pertaining to the usage of a verb by individual speakers or a language community (e.g., age of acquisition, word frequency). Moreover, normative data has to be specific for a subpopulation of speakers, as properties like age or health status affect behavioral performance (Ramsay, Nicholas, Au, Obler, & Albert, 1999; Williamson, Adair, Raymer, & Heilman, 1998).
Picture characteristics
For the production of verbs, the number of different answers per picture (nresponse) and the related variables name agreement (NA) and entropy of responses (H) exert strong and robust effects on response latencies across different languages. These highly correlated response properties, summarized as name agreement indices (Székely et al., 2005), inversely correlate with naming latencies (Cuetos & Alija, 2003; Khwaileh et al., 2018; Schwitter et al., 2004; Shao et al., 2014; Székely et al., 2005).
In contrast, only one former action naming normative study shows that the visual complexity (VC) of a picture has an independent effect on naming performance (Shao et al., 2014), whereas most other studies do not report any influence (Cuetos & Alija, 2003; Khwaileh et al., 2018; Schwitter et al., 2004; Székely et al., 2005). However, most measures of visual complexity used in previous studies are subjective and differ across studies, thus limiting comparability. Thus, several authors stress the advantage of using objective parameters, e.g., file size (Perret & Bonin, 2018; Székely & Bates, 2000).
Verb characteristics
Besides picture attributes, several verb characteristics influence behavioral performance in action naming tasks. Many studies demonstrate that early age of word acquisition (AoA) predicts lower naming latencies of verbal responses, i.e., faster reaction times (Cuetos & Alija, 2003; Schwitter et al., 2004; Shao, Roelofs, & Meyer, 2014; Székely et al., 2005). In contrast, word frequency (FR), a measure that is strongly related to age of acquisition (Johnston & Barry, 2006), exerts inconsistent effects on naming latency, once AoA has been partialed out (Székely et al., 2005). The effect of subjectively rated imageability (IM) of a depicted action on behavioral performance also varies among different studies or languages (Cuetos & Alija, 2003; Khwaileh et al., 2018; Shao et al., 2014). Although frequently studied, word length (LE) and related measures consistently fail to predict naming latency (Cuetos & Alija, 2003; Khwaileh et al., 2018; Schwitter et al., 2004; Shao et al., 2014).
Studies in Parkinson’s disease (PD) patients suggest that behavioral performance in action naming tasks varies as a function of motor content (MC) of the associated verbs (Herrera & Cuetos, 2012; Herrera, Rodríguez-Ferreiro, & Cuetos, 2012). Thereby, PD patients label pictures with high motor content of the respective target word less accurately and slower than pictures with low motor content. Motor content describes “how much movement [is] needed in order to perform the actions” depicted in a stimulus (Herrera et al., 2012). Moreover, behavioral and neural data from healthy participants indicate that verbs with low and high motor content are processed differently (Grossman et al., 2002; Kemmerer, Castillo, Talavage, Patterson, & Wiley, 2008). One Turkish study provides normative data for motor content of responses to action pictures (Bayram, Aydin, Ergenc, & Akbostanci, 2017). However, up to this point, no study has systematically investigated the effect of motor content on naming latencies in healthy participants. Here, we examine the motor content of the word (MCword) and the motor content of the picture (MCpic) and their impact on naming latency.
Furthermore, the neighborhood size of a word can influence naming latency. Neighbors of a word share most of their segments, i.e., phonemes or graphemes (according to the prevalent definition all but one) (Marian, Bartolotti, Chabal, & Shook, 2012). Previous data indicate that dense phonological neighborhoods are associated with higher naming latencies (Sadat, Martin, Costa, & Alario, 2014). As grapheme to phoneme relations in German are relatively transparent, orthographic and phonological neighborhood are highly related (Marian et al., 2012). Thus, orthographic neighborhood can serve as a surrogate parameter for phonological neighborhood. A particular measure of orthographic neighborhood, the orthographic Levenshtein distance 20 (OLD20), refers to the mean number of insertions, deletions and substitutions needed to arrive from a word at its 20 closest orthographic neighbors (Yarkoni, Balota, & Yap, 2008). In lexical decision and pronunciation tasks, low orthographic Levenshtein distance 20 correlates with lower response times (Yarkoni et al., 2008). However, previous action naming studies did not assess the effect of neighborhood size on behavioral performance. We calculate orthographic Levenshtein distance 20 for verbal responses to the action pictures. Further, we explore whether orthographic neighborhood affects response latencies in action naming.
In addition, verbs are characterized by different grammatical properties that can influence naming latencies. Transitivity (TR) describes the number of arguments a verb can take. Intransitive verbs do not demand an object to form a meaningful construct (e.g., “she fell”), while transitive or ditransitive verbs require one or two objects, respectively (e.g., “I need my glasses” and “He passed her the ball”). It has been found that action pictures with intransitive target names are labeled faster than those with transitive targets (Kauschke & von Frankenberg, 2008; Kauschke & Stenneken, 2008). For reflexive verbs, the agent is also the patient of the action (Reflexivity [RE], e.g., “I am washing myself”). While investigations on behavioral effects of reflexivity are missing, data from one neuroimaging study suggests that reflexive and non-reflexive verbs are processed differentially (Shetreet & Friedmann, 2012). Moreover, morphological complexity (CO) has been shown to influence naming latencies (Kauschke & Stenneken, 2008) as well as neuronal processing (Finocchiaro, Basso, Giovenzana, & Caramazza, 2010) for verbs. In German, a prevalent type of morphologically complexity in verbs is prefixation (Heide, Lorenz, Meinunger, & Burchert, 2010), e.g., prefix “aus” + stem “brechen” = “ausbrechen”; to escape). Here, we investigate possible effects of these three grammatical properties on naming latency.
In picture naming, participants may provide several different verbal responses to a given picture. Previous studies therefore restricted their analysis to the verb most frequently produced per picture, i.e., the dominant response. To this end, they excluded pictures, in which dominant responses did not account for a minimum of 40% to 50% of all answers (i.e., name agreement below 40% to 50%), leading to a lower number of items (Khwaileh et al., 2018; Shao et al., 2014). In this study, we overcome this constraint by characterizing a wide range of verbal responses that participants had provided to each picture. This enables us to conduct trial-based statistical analyses, which account for response variability among participants. Specifically, we investigate associations between naming latencies and picture as well as verb characteristics by means of repeated measures correlations and linear mixed effects modeling. Additionally, users of our database are hereby able to (1) flexibly choose the name agreement threshold that should be applied in their study and (2) incorporate verb characteristics into their analysis when the subject’s response deviated from the dominant answer.
It is important to note that the effect of picture and verb characteristics on naming performance is partially language-specific, impeding cross-linguistic application and comparison (Bates et al., 2003). A widespread literature of object naming studies has emerged for several languages (for review, see Perret & Bonin, 2018). Prior investigations of action naming in the German language were based on a substantially smaller data set and did not provide formal normative data (Kauschke & von Frankenberg, 2008). Here, we establish a normative German data set for action naming that is based on a young and healthy population. We thereby consider traditionally assessed picture characteristics, such as name agreement indices and visual complexity of the picture, as well as verb characteristics, such as age of acquisition, word frequency, imageability and word length. In addition, we report less considered variables that might impact language processing, i.e., motor content, orthographic neighborhood, transitivity, reflexivity and morphological complexity.
Methods
Our study consisted of two experiments. In the first experiment, we conducted a timed picture naming task. We used pictures depicting actions from two freely available databases that have previously been validated for other languages (Bayram et al., 2017; Székely et al., 2005) and assessed naming latencies of the associated responses. In addition, we appraised the perceived motor content of the pictures. In a second experiment, we characterized the motor content, imageability and age of acquisition of 600 frequent German verbs including responses of the first study. Both experiments were approved by the local medical ethics committee of the Medical Faculty of the University of Marburg (study number 198/17) and were in accordance with the latest version of the Declaration of Helsinki.
Experiment 1
Participants
In the first experiment, we included 59 participants (37 women, mean ± SD age: 24.6 ± 3 years, formal education: 17.7 ± 2.2 years). Participants were native speakers of German without any history of neurological or psychiatric disorders. All participants provided written informed consent.
Procedure
The experiment was conducted in a dimly lit soundproof testing room. We presented all stimuli on a computer screen at a fixed distance using Psychophysics Toolbox (Brainard, 1997) implemented in MATLAB 2016b (The MathWorks, Natick, MA, USA) and presented on a VG248QE monitor (Asus). Audio responses were recorded with an SF-920 microphone (Elegiant) and motor content ratings were collected via a N001 numeric keypad (Jelly Comb).
After several practice trials, which did not enter analyses, participants viewed 286 black-and-white drawings depicting actions (Fig. 1). We used a combination of action pictures from the International Picture-Naming Project (IPNP) database validated for the English language (129 pictures; Székely et al., 2005, https://crl.ucsd.edu/experiments/ipnp/) and from a recent study conducted in the Turkish language (157 pictures; Bayram et al., 2017, https://osf.io/awj3r).
The pictures were presented in randomized order in six blocks with self-paced breaks between blocks. The first five blocks comprised 50 pictures and the last block 36 pictures. We rescaled all pictures to a fixed width of 500 pixels while maintaining the original aspect ratio of each picture. Participants were instructed to label the image and vocalize their response. We asked the participants to avoid hesitations, corrections or non-lexical utterances and restrict their response to a single word. Each picture was presented for five seconds, which constituted the time limit for the participant’s response. After this period, a motor content rating scale appeared underneath the picture and participants were asked to quantify the amount of movement required for the depicted action. We used a jittered inter-stimulus-interval of 3–4 s. For both tasks, we instructed participants to respond as fast as possible.
Response transcription
We transcribed responses whilst taking into account the context of the respective picture. Thus, in the case of homophones, we chose the verb that most likely matched the depicted scene. Only verbs that were listed in the dictionary DUDEN (www.duden.de) as of August 2018 were considered legitimate. We further error-flagged trials with missing, non-comprehensible or late answers (> 5 s after stimulus onset) along with trials, in which a clear response onset could not be determined due to pre-response utterance, post-response self-correction or answers consisting of more than one word.
Outcome variables
Naming latency We determined naming latencies (RT) for each picture semi-manually using the standalone software CheckVocal (Protopapas, 2007).
Name agreement indices Next, we evaluated the responses given by the participants and quantified the distribution of responses for each picture by calculating three variables. To this end, we defined the dominant answer as the most frequent answer per picture in accordance to previous action naming studies (Shao et al., 2014; Székely et al., 2005).
First, we assessed the number of different answers across participants. Difference was defined on a purely lexical basis: Even semantically comparable words—i.e., (near) synonyms—were counted as distinct when they differed in their word-form (e.g., “einklemmen” and “klemmen”; to jam). Second, we calculated name agreement by dividing the number of times the most frequent response (i.e., the dominant response) was given by the total number of participants who produced an analyzable response. For example, if the dominant response “run” was given by 80% of all participants after exclusion of invalid responses, NA = 0.8.
Third, we assessed the distribution of responses by calculating entropy with nresponse being the number of different answers and pi being the probability of the ith answer occurring (Shannon & Weaver, 1998; Snodgrass & Vanderwart, 1980):
Thus, high entropy indicates a more uniform distribution of responses.
Motor content of the picture Participants were instructed to quantify the amount of movement required for the depicted action by button press. We assessed motor content of the picture on a nine-point scale (ratings from 1–9; 1: no movement; 9: maximal amount of movement). The rating prompt in German translates to “How much movement is needed to perform the depicted action?”
Additional picture characteristics
In accordance with a previous study (Székely et al., 2005), we calculated objective visual complexity based on file size (jpeg format). As stimulus dimensions differed among the two databases employed for the pictures, we first superimposed each picture onto a uniformly sized black background whose dimensions equaled the size of the largest picture.
Experiment 2
Participants
In this experiment, we included 150 healthy participants (103 women, mean ± SD age: 24 ± 4.1 years, education: 16.6 ± 2.4 years). Participants were native speakers of German without any history of neurological or psychiatric disorders. All participants provided written informed consent. Participants evaluated motor content, imageability and age of acquisition of 600 German verbs using an online survey (Leiner, 2014). In order to stay within a feasible time frame per participant, we randomly split the cohort into three groups (n = 50 each), who rated one of the three variables of interest, respectively.
Procedure
Participants viewed a set of 600 verbs in a randomized order on their personal computer screen. We instructed them to rate imageability, motor content or age of acquisition (depending on group membership) of each word as fast and intuitively as possible. On each page, we presented 60 words with 10 pages in total.
As participants gave a total of 1044 unique responses in Experiment 1, we characterized a subset of the most commonly provided verbs for reasons of feasibility. For each picture from Experiment 1, we chose the minimum number of verbs that jointly represented the responses of more than half of the participants (e.g., verb A: 40% of participants, verb B: 30% of participants). For 184 pictures, a single verb accounted for at least 50% of all responses, with successively more verbs required to reach this threshold for the remaining pictures (58 pictures: two verbs, 23 pictures: three verbs, 10 pictures: four verbs, 5 pictures: five verbs, 2 pictures: six verbs and 1 picture: eleven verbs). Due to technical errors in response transcription, 3 of the 286 presented pictures had to be excluded from the data set. This resulted in a total of 299 unique words related to the pictures of Experiment 1, due to a substantial overlap of responses among the pictures. The final data set of 600 words additionally included 301 frequent German verbs from the SUBTLEX-DE database (Brysbaert et al., 2011).
Outcome variables
Imageability The imageability of a word, i.e., how easily a word is able to evoke a mental image, was assessed according to Paivio, Yuille, and Madigan (1968). We instructed participants to indicate the perceived imageability of the verb by button press using a seven-point scale (1: low imageability; 7: high imageability).
Motor content of the word Similarly, motor content of the word was assessed on a nine-point scale (1: lowest amount of movement; 9: highest amount of movement), analogous to Experiment 1 and previous studies (Bayram et al., 2017). Participants had to indicate motor content by button press.
Age of acquisition Further, we asked participants to estimate the age of acquisition of the word, i.e., the age (in years) at which they think they have understood the meaning of the word for the first time. In line with Birchenough, Davies, and Connelly (2017), we instructed participants to report a single year instead of indicating a time period.
Additional word characteristics
For each of the 600 words, we additionally compiled data from external sources and computed word specific properties. First, we derived word frequency from the SUBTLEX-DE database (Brysbaert et al., 2011). We exclusively used the frequency count of the lower-case word form. This was to counter overestimation of word frequency of verbs also used as nouns when capitalized (e.g., “essen” = to eat vs. “Essen” = food). Further, we calculated the orthographic Levenshtein distance 20 of our selected verbs to all words from the SUBTLEX-DE database (Brysbaert et al., 2011) and word length as number of letters. FR, OLD20 and LE were also computed for all other responses in Experiment 1 that were not assessed in Experiment 2. Additionally, two experienced linguists classified the transitivity, reflexivity and morphological complexity of each verb. All three variables were classified into binary categories, respectively (intransitive vs. transitive and ditransitive; reflexive vs. non-reflexive and partly reflexive; complex vs. non-complex).
Quality check
We conducted several quality checks of the data in order to assure that participants completed the survey with due diligence. First, we excluded participants who completed less than 70% of the questionnaire and who exceeded a time limit of 24 hours to complete the survey. Second, we excluded fraudulent cases, i.e., participants who exhibited unusual response patterns (high difference from median entropy and high proportion of answers outside of one median absolute deviation from the median answer) or completion time (high difference from median time to completion) by means of the Minimum Covariance Determinant (Hubert & Debruyne, 2010). These computations were performed separately for each survey.
Statistical analysis
We hypothesized that both the attributes of the presented pictures and characteristics of the associated verbs affect the latency of verbal responses to pictures in Experiment 1. Therefore, we incorporated the variables obtained in Experiment 2, i.e., verb characteristics, into the analysis of Experiment 1. Many studies only used verb characteristics of the dominant verbal response for each picture (Cuetos & Alija, 2003; Khwaileh et al., 2018; Schwitter et al., 2004; Shao et al., 2014; Székely et al., 2005). However, particularly in cases of low name agreement, the characteristics of the dominant response only partially represent the spectrum of verbal associations for a picture. While some studies therefore introduced a cut-off for excluding stimuli with low name agreement values (Schwitter et al., 2004), we characterized a wide range of responses per picture and conducted trial-based analyses instead.
Data preprocessing
For all further analyses, we excluded trials with errors (4.9% of all trials), and those which contained responses given only by a single participant for one picture (7.4% of all trials). In sum, 87.7% of all trials were eligible for statistical analyses and reporting of normative data (i.e., average scores across participants), of which 91% were fully characterized in Experiment 2 (79.8% of all trials). Before calculating correlations and the linear mixed model, we transformed some variables in order to obtain normally distributed values based on visual assessment. To this end, RT, nresponse, VC, AoA, FR and OLD20 were logarithmized and IM was exponentiated. After that, multivariate outlier trials were detected using the Minimum Covariance Determinant on the basis of all trials with full available data (Hubert & Debruyne, 2010). With this procedure, we identified 2% of these trials as outliers and excluded them from further analyses. Finally, variables were z-transformed before entering them into the respective models. As 99.4% of trials fell into the pre-defined category of non-reflexive and partly reflexive verbs, we did not incorporate reflexivity in the models due to lacking variation among trials. TR and CO were coded with dummy variables (0 = intransitive / non-complex, 1 = transitive and ditransitive / complex).
Normative data and descriptive statistics
While correlations and the linear mixed model are based on trial-by-trial data, we additionally report averaged picture and word characteristics across participants, enabling straightforward usability as a normative data set (MCpic, IM, MCword, AoA, FR, OLD20, LE, TR, RE, and CO). For IM, MCword, AoA, TR, RE, and CO, we only considered trials with responses that were evaluated in Experiment 2.
We then computed descriptive statistics for each variable over all pictures.
Repeated measures correlations
We calculated repeated measures correlations between naming latency, picture characteristics (H, nresponse, NA, MCpic, VC) and verb attributes (IM, AoA, MCword, LE, FR, OLD20, TR, CO) using the rmcorr package (Bakdash & Marusich, 2017). This method takes the non-independence of repeated measures within each participant into account and estimates the common association between two variables among participants (Bakdash & Marusich, 2017). We then tested basic assumptions of linearity, homoscedasticity and normal distribution of errors using the Rainbow test, the Breusch-Pagan test, and the Kolmogorov-Smirnov test, respectively. Overall, we did not find any severe violations of these assumptions. We corrected p values for multiple comparisons by means of the Benjamini-Hochberg procedure (Benjamini & Hochberg, 1995) and reported weak (R ≥ 0.1), moderate (R ≥ 0.3) and strong (R ≥ 0.5) correlations following Bakdash and Marusich (2017).
Linear mixed effects model
Thereafter, we employed linear mixed effects modeling incorporating picture characteristics and verb attributes in order to evaluate which of these uniquely contributed to the overall variance in naming latencies explained, using the lmer function from the lme4 package (Bates, Mächler, Bolker, & Walker, 2015). As fixed effects we included H, MCpic, VC, AoA, IM, MCword, FR, LE, OLD20, CO, and TR. We established a maximal random effects structure as dictated by study design (Barr, Levy, Scheepers, & Tily, 2013). We therefore incorporated by-participant random intercepts and by-participant random slopes for H, MCpic, VC, AoA, IM, MCword, FR, LE, OLD20, CO and TR. Likewise, we included by-picture random intercepts and by-picture random slopes for MCpic, AoA, IM, MCword, FR, LE, OLD20, CO and TR. Note that we did not incorporate by-picture random slopes for H and VC as these variables do not show within-picture variation. As name agreement indices are highly intercorrelated, we only included entropy of responses. The full model equation is reported in Table 1. We tested for multicollinearity of predictors by computing the variance inflation factor, which was < 2 for all variables and thus indicated that multicollinearity was not a concern. The model was iteratively estimated by the restricted maximum likelihood procedure, and p values were computed by t tests using Satterthwaite's approximation for degrees of freedom. We tested assumptions of normal distribution of residuals and homoscedasticity visually, using the performance package (Lüdecke, Makowski, Waggoner, & Patil, 2020). We did not detect severe violations of these assumptions.
Results
In Experiment 1, we excluded three participants due to technical problems during data acquisition and one participant due to naming latencies exceeding two standard deviations above the mean. Thus, we included the data of 55 participants in the statistical analysis. In Experiment 2, twenty cases were excluded due to missing data, exceedingly long time to completion or unusual response patterns (see above). Therefore, 130 data sets were confirmed eligible for statistical analysis, i.e., 44 data sets for imageability, 41 for motor content and 45 for age of acquisition.
In addition to the selected verbal responses from Experiment 1, we further included 301 frequent German verbs from the SUBTLEX-DE database (Brysbaert et al., 2011), in order to allow for a wider range of verbal responses to pictures in future experiments. Thus, we provide normative data for a total of 600 verbs (Supplementary Table 1).
Normative data and descriptive statistics
The distributions of normative data for each variable across pictures are illustrated in Figs. 2 and 3. This normative data set is available in an online repository (see Open Practices Statement).
Descriptive statistics of the normative data are reported in Supplementary Table 2.
Correlations of naming latency with picture and verb characteristics
All results from our correlation analysis are summarized in Table 2. Naming latencies strongly increased as a function of H and nresponse and decreased with NA (Fig. 4a). Additionally, naming latencies weakly increased with higher VC and weakly decreased with increasing IM. We did not find any other correlations that at least fulfilled the criteria of a weak correlation (R ≥ 0.1).
Correlations between verb characteristics
We found a strong positive correlation between LE and CO and a likewise negative association between FR and AoA (Fig. 4b). OLD20 correlated positively and moderately with AoA, LE and CO. We additionally detected a moderate positive association between MCword and IM and a moderate decrease of OLD20 with higher FR. Furthermore, higher AoA was accompanied by a weak increase in CO and LE, while word frequency weakly decreased with CO and LE. A small negative correlation could be observed between IM and all remaining word characteristics except FR. We did not find any other correlations that at least fulfilled the criteria of a weak correlation (R ≥ 0.1).
Correlations between verb and picture characteristics
Our analysis revealed a strong positive association between MCpic and MCword (Fig. 4c). Name agreement indices mainly correlated with IM and CO: We observed moderate increases in IM for higher NA, lower H and a smaller nresponse. Similarly, we found CO to weakly decrease with NA and increase with H and nresponse. We further found positive, but only weak correlations between nresponse and TR and between MCpic and IM. Finally, VC decreased weakly with higher MCword, IM and AoA. We did not find any other correlations that at least fulfilled the criteria of a weak correlation (R ≥ 0.1).
Correlations between picture characteristics
Name agreement indices all strongly correlated with each other: We observed a negative association between NA on one side and nresponse and H on the other side, while conversely nresponse and H correlated positively (Fig. 4d). Furthermore, VC correlated with all name agreement indices: It weakly decreased with NA, and moderately increased with H and nresponse. We did not find any other correlations that at least fulfilled the criteria of a weak correlation (R ≥ 0.1).
Linear mixed effects model
The mixed effects model predicting naming latency revealed independent contributions of H, FR, MCword and MCpic (Table 3). Specifically, higher H, FR and MCword predicted slower RT, whereas higher MCpic predicted faster RT. All other picture or verb characteristics did not independently predict naming latency. The combination of fixed and random effects explained 58% of variance in naming latency (R2 [conditional] = 0.58), while fixed effects alone accounted for 25% (R2 [marginal] = 0.25, Table 4). Note that zero-estimates for MCpic and CO (0) random effects indicate a singular fit of the model. In an additional model, we therefore excluded these terms to compute a non-singular fitted model. However, the results of this model were practically identical to the reported model (data not shown). This is in line with Brauer and Curtin (2018), who state that singular model fits do not necessarily affect fixed effects estimates.
Discussion
In the present study, we characterize 283 action pictures compiled from two sources (Bayram et al., 2017; Székely et al., 2005) and the associated verbal responses in German. We obtained data from 55 healthy participants and report normative values for motor content and the distribution of verbal responses to each picture. We additionally report visual complexity, measured as file size. Further, the controlled experimental setup allowed us to obtain precise naming latencies.
Moreover, we provide normative data for 600 German verbs including 299 responses from Experiment 1, as well as additional common German verbs. Three groups of 41–45 healthy participants rated imageability, motor content or age of acquisition of each verb. In addition, we report word frequency, word length, orthographic neighborhood, transitivity, reflexivity and morphological complexity for each verb.
Our data largely confirm results from previous studies regarding the relationship between picture and verb characteristics. We found a strong correlation between age of acquisition and word frequency, with more frequent words being learned earlier in life (Fig. 4b). This is a well-established effect that has already been demonstrated for German (Kauschke & von Frankenberg, 2008; Schröder, Gemballa, Ruppin, & Wartenburger, 2012) and in a range of other languages (Cuetos & Alija, 2003; Schwitter et al., 2004; Shao et al., 2014; Székely et al., 2005). We also found that name agreement increases and entropy of responses decreases moderately as a function of imageability, which are robust findings across studies investigating these variables (Cuetos & Alija, 2003; Kauschke & von Frankenberg, 2008; Khwaileh et al., 2018; Shao et al., 2014). Further, words learned at an earlier age were easier to imagine, which has also been found consistently in previous timed and untimed action naming studies (Akinina et al., 2015; Bayram et al., 2017; Cuetos & Alija, 2003; Kauschke & von Frankenberg, 2008; Khwaileh et al., 2018; Masterson & Druks, 1998; Shao et al., 2014). Together, the replication of results from German and non-German studies regarding associations among picture and verb characteristics indicate that these are robust across groups, settings and languages.
We found differential correlations of picture and verb characteristics with naming latency, such that naming latencies of visually depicted actions strongly increased with the number of different answers associated with a given picture and with its naming entropy but decreased with name agreement (Fig. 4a). These results are in accordance with previous studies investigating action naming. Several studies report similar correlations between naming latency and name agreement indices (Cuetos & Alija, 2003; Kauschke & von Frankenberg, 2008; Khwaileh et al., 2018; Schwitter et al., 2004; Shao et al., 2014; Székely et al., 2005), as well as imageability (Kauschke & von Frankenberg, 2008; Khwaileh et al., 2018; Shao et al., 2014). Our linear mixed model analysis confirmed the effect of entropy of responses on naming latency. This goes in line with a range of picture naming studies for actions and objects in other languages (Perret & Bonin, 2018).
In addition, linear mixed modeling revealed that naming latencies were longer for more frequent words. Most previous normative action naming studies did not find an independent contribution of word frequency to naming latency (Cuetos & Alija, 2003; Kauschke & von Frankenberg, 2008; Khwaileh et al., 2018; Schwitter et al., 2004). In these experiments, the authors used restrictive measures of word frequency based on news articles or books. However, recent studies showed that word frequency derived from television and film subtitles, as used in this study, is superior to estimates based on written sources (Brysbaert et al., 2011; Brysbaert & New, 2009). The higher precision of word frequency estimates may have allowed us to reveal the predictive value of word frequency for naming latency. The somewhat unexpected relationship between higher word frequency and slower naming responses is in line with one previous action naming study (Székely et al., 2005). These authors speculated that participants fall back on high-frequency multipurpose verbs for difficult items, leading to inflated reaction times due to the more effortful (and ultimately unsuccessful) search for a specific verb (Székely et al., 2005). However, this hypothesis remains to be tested in future studies, for example by obtaining parameters capturing semantic specificity. In addition, the relatively weak effect of word frequency in our study warrants further replication in other languages with contemporary word frequency measures and should be interpreted with caution.
In contrast to previous normative action naming studies (Cuetos & Alija, 2003; Schwitter et al., 2004; Shao et al., 2014; Székely et al., 2005), we did not find an effect of age of acquisition on naming latency. A large body of evidence shows that age of acquisition correlates with word frequency (Johnston & Barry, 2006). If one follows the assumption that frequent words occasionally served as fallback verbs for more difficult pictures, one could speculate that these items, which are associated with slow reaction times, obscured the otherwise expected positive correlation between AoA and naming latencies. Furthermore, imageability did not exert an independent effect on naming latency, as previously shown (Kauschke & von Frankenberg, 2008). This suggests that the effect of imageability on naming latency is mediated by name agreement indices.
Beyond the standard variables reported in action naming studies in other languages, we report perceived motor content of the action pictures (Experiment 1) and their associated verbal responses (Experiment 2). Both variables were highly inter-correlated and positively correlated with imageability. An unexpected finding was the opposing effects of MCpic and MCword on RT in the linear mixed model. While high MCpic was associated with faster naming latencies, the contrary was the case for MCword. However, both parameter estimates were small in relation to the effect of H. To our knowledge, both MCpic and MCword have not yet been formally studied in action naming normative studies. A possible dissociation between MCpic and MCword may be investigated in future studies. Moreover, motor content is an interesting variable for studies in patients with movement disorders. Herrera and Cuetos (2012) showed that PD patients without dopaminergic medication exhibited slower responses to pictures with high compared to low motor content . This suggests overlapping neural networks for the processing of motor language and movement (Bak, 2013).
A second rarely reported variable, the orthographic Levenshtein distance 20, positively correlated with word length and age of acquisition and negatively with word frequency, corroborating previous findings (Yarkoni et al., 2008). However, we did not find an effect of orthographic Levenshtein distance 20 on naming latencies, in contrast to the findings of Yarkoni et al. (2008). Morphological complexity and transitivity both showed no considerable association with naming latency. As to be expected, complex verbs were longer and exhibited a sparser orthographic neighborhood than non-complex words, but they were also less imaginable.
To facilitate reproduction of results or reanalyses of our data, we provide data for all trials and subjects in an online repository (see Open Practices Statement). Further, we provide normative data for each picture by means of averaged values across participants in order to facilitate future utilization of the data set. Additionally, all responses with corresponding response frequencies are reported alongside verb characteristics for the full 600 verbs assessed in Experiment 2.
In summary, we provide the first data set of picture and verb characteristics for a compilation of 283 freely available action pictures (Bayram et al., 2017; Székely et al., 2005) for the German language. Additionally, we characterize a set of 600 action verbs. We found very similar relationships between picture and verb characteristics in comparison to action naming studies in other languages, indicating high construct validity. Entropy of responses, motor content of pictures and words, and word frequency constituted independent predictors of naming latency. Thus, future timed picture naming studies should consider controlling for these variables when assessing behavioral performance. We believe that this normative data set including standard and new parameters will be useful for future behavioral and neuroscientific studies on the cognitive processes underlying action naming.
References
Akinina, Y., Malyutina, S., Ivanova, M., Iskra, E., Mannova, E., & Dragoy, O. (2015). Russian normative data for 375 action pictures and verbs. Behavior Research Methods, 47(3), 691–707. https://doi.org/10.3758/s13428-014-0492-9
Bak, T. H. (2013). The neuroscience of action semantics in neurodegenerative brain diseases. Current Opinion in Neurology, 26(6), 671–677. https://doi.org/10.1097/WCO.0000000000000039
Bakdash, J. Z., & Marusich, L. R. (2017). Repeated Measures Correlation. Frontiers in Psychology, 8, 456. https://doi.org/10.3389/fpsyg.2017.00456
Barr, D. J., Levy, R., Scheepers, C., & Tily, H. J. (2013). Random effects structure for confirmatory hypothesis testing: Keep it maximal. Journal of Memory and Language, 68(3). https://doi.org/10.1016/j.jml.2012.11.001
Bates, D., Mächler, M., Bolker, B., & Walker, S. (2015). Fitting Linear Mixed-Effects Models Using lme4. Journal of Statistical Software, 67(1). https://doi.org/10.18637/jss.v067.i01
Bates, E., D'Amico, S., Jacobsen, T., Székely, A., Andonova, E., Devescovi, A., … Tzeng, O. (2003). Timed picture naming in seven languages. Psychonomic Bulletin & Review, 10(2), 344–380. https://doi.org/10.3758/bf03196494
Bayram, E., Aydin, Ö., Ergenc, H. I., & Akbostanci, M. C. (2017). A Picture Database for Verbs and Nouns with Different Action Content in Turkish. Journal of Psycholinguistic Research, 46(4), 847–861. https://doi.org/10.1007/s10936-016-9471-x
Benjamini, Y., & Hochberg, Y. (1995). Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing. Journal of the Royal Statistical Society: Series B (Methodological), 57(1), 289–300. https://doi.org/10.1111/j.2517-6161.1995.tb02031.x
Birchenough, J. M. H., Davies, R., & Connelly, V. (2017). Rated age-of-acquisition norms for over 3,200 German words. Behavior Research Methods, 49(2), 484–501. https://doi.org/10.3758/s13428-016-0718-0
Brainard, D. H. (1997). The Psychophysics Toolbox. Spatial Vision, 10(4), 433–436. https://doi.org/10.1163/156856897X00357
Brauer, M., & Curtin, J. J. (2018). Linear mixed-effects models and the analysis of nonindependent data: A unified framework to analyze categorical and continuous independent variables that vary within-subjects and/or within-items. Psychological Methods, 23(3), 389–411. https://doi.org/10.1037/met0000159
Brysbaert, M., Buchmeier, M., Conrad, M., Jacobs, A. M., Bölte, J., & Böhl, A. (2011). The word frequency effect: A review of recent developments and implications for the choice of frequency estimates in German. Experimental Psychology, 58(5), 412–424. https://doi.org/10.1027/1618-3169/a000123
Brysbaert, M., & New, B. (2009). Moving beyond Kucera and Francis: A critical evaluation of current word frequency norms and the introduction of a new and improved word frequency measure for American English. Behavior Research Methods, 41(4), 977–990. https://doi.org/10.3758/BRM.41.4.977
Cattell, J. M. (1886). The Time It Takes To See And Name Objects. Mind, os-XI(41), 63–65. https://doi.org/10.1093/mind/os-XI.41.63
Cuetos, F., & Alija, M. (2003). Normative data and naming times for action pictures. Behavior Research Methods, Instruments, & Computers, 35(1), 168–177. https://doi.org/10.3758/BF03195508
Finocchiaro, C., Basso, G., Giovenzana, A., & Caramazza, A. (2010). Morphological complexity reveals verb-specific prefrontal engagement. Journal of Neurolinguistics, 23(6), 553–563. https://doi.org/10.1016/j.jneuroling.2010.04.004
Glaser, W. R. (1992). Picture naming. Cognition, 42(1-3), 61–105. https://doi.org/10.1016/0010-0277(92)90040-O
Grossman, M., Koenig, P., DeVita, C., Glosser, G., Alsop, D., Detre, J., & Gee, J. (2002). Neural representation of verb meaning: An fMRI study. Human Brain Mapping, 15(2), 124–134. https://doi.org/10.1002/hbm.10117
Harley, T. A. (2014). The psychology of language: From data to theory (4th ed.). Psychology Press.
Heide, J., Lorenz, A., Meinunger, A., & Burchert, F. (2010). The influence of morphological structure on the processing of German prefixed verbs. In A. Onysko & S. Michel (Eds.), Cognitive Perspectives on Word Formation. https://doi.org/10.1515/9783110223606.375
Herrera, E., & Cuetos, F. (2012). Action naming in Parkinson's disease patients on/off dopamine. Neuroscience Letters, 513(2), 219–222. https://doi.org/10.1016/j.neulet.2012.02.045
Herrera, E., Rodríguez‐Ferreiro, J., & Cuetos, F. (2012). The effect of motion content in action naming by Parkinson’s disease patients. Cortex; a Journal Devoted to the Study of the Nervous System and Behavior, 48(7), 900–904. https://doi.org/10.1016/j.cortex.2010.12.007
Hubert, M., & Debruyne, M. (2010). Minimum covariance determinant. Wiley Interdisciplinary Reviews: Computational Statistics, 2(1), 36–43. https://doi.org/10.1002/wics.61
Indefrey, P. (2011). The spatial and temporal signatures of word production components: A critical update. Frontiers in Psychology, 2, 255. https://doi.org/10.3389/fpsyg.2011.00255
Johnston, R. A., & Barry, C. (2006). Age of acquisition and lexical processing. Visual Cognition, 13(7-8), 789–845. https://doi.org/10.1080/13506280544000066
Kauschke, C., & Frankenberg, J. von (2008). The differential influence of lexical parameters on naming latencies in German. A study on noun and verb picture naming. Journal of Psycholinguistic Research, 37(4), 243–257. https://doi.org/10.1007/s10936-007-9068-5
Kauschke, C., & Stenneken, P. (2008). Differences in noun and verb processing in lexical decision cannot be attributed to word form and morphological complexity alone. Journal of Psycholinguistic Research, 37(6), 443–452. https://doi.org/10.1007/s10936-008-9073-3
Kemmerer, D., Castillo, J. G., Talavage, T., Patterson, S., & Wiley, C. (2008). Neuroanatomical distribution of five semantic components of verbs: Evidence from fMRI. Brain and Language, 107(1), 16–43. https://doi.org/10.1016/j.bandl.2007.09.003
Khwaileh, T., Mustafawi, E., Herbert, R., & Howard, D. (2018). Gulf Arabic nouns and verbs: A standardized set of 319 object pictures and 141 action pictures, with predictors of naming latencies. Behavior Research Methods. Advance online publication. https://doi.org/10.3758/s13428-018-1019-6
Leiner, D. (2014). SoSci Survey (Version 2.5.0) [Computer software]. Retrieved from https://www.soscisurvey.de
Lüdecke, D., Makowski, D., Waggoner, P., & Patil, I. (2020). performance: Assessment of Regression Models Performance (Version 0.4.8) [Computer software]. Retrieved from https://easystats.github.io/performance/
Marian, V., Bartolotti, J., Chabal, S., & Shook, A. (2012). CLEARPOND: Cross-linguistic easy-access resource for phonological and orthographic neighborhood densities. PloS One, 7(8), e43230. https://doi.org/10.1371/journal.pone.0043230
Masterson, J., & Druks, J. (1998). Description of a set of 164 nounsand 102 verbs matched for printed word frequency, familiarityand age-of-acquisition. Journal of Neurolinguistics, 11(4), 331–354. https://doi.org/10.1016/S0911-6044(98)00023-2
Mätzig, S., Druks, J., Masterson, J., & Vigliocco, G. (2009). Noun and verb differences in picture naming: Past studies and new evidence. Cortex; a Journal Devoted to the Study of the Nervous System and Behavior, 45(6), 738–758. https://doi.org/10.1016/j.cortex.2008.10.003
Oldfield, R. C., & Wingfield, A. (1964). The Time it Takes to Name an Object. Nature, 202(4936), 1031–1032. https://doi.org/10.1038/2021031a0
Paivio, A., Yuille, J. C., & Madigan, S. A. (1968). Concreteness, imagery, and meaningfulness values for 925 nouns. Journal of Experimental Psychology, 76(1, Pt.2), 1–25 https://doi.org/10.1037/h0025327
Perret, C., & Bonin, P. (2018). Which variables should be controlled for to investigate picture naming in adults? A Bayesian meta-analysis. Behavior Research Methods. Advance online publication. https://doi.org/10.3758/s13428-018-1100-1
Protopapas, A. (2007). CheckVocal: A program to facilitate checking the accuracy and response time of vocal responses from DMDX. Behavior Research Methods, 39(4), 859–862. https://doi.org/10.3758/bf03192979
Ramsay, C. B., Nicholas, M., Au, R., Obler, L. K., & Albert, M. L. (1999). Verb naming in normal aging. Applied Neuropsychology, 6(2), 57–67. https://doi.org/10.1207/s15324826an0602_1
Sadat, J., Martin, C. D., Costa, A., & Alario, F.-X. (2014). Reconciling phonological neighborhood effects in speech production through single trial analysis. Cognitive Psychology, 68, 33–58. https://doi.org/10.1016/j.cogpsych.2013.10.001
Schröder, A., Gemballa, T., Ruppin, S., & Wartenburger, I. (2012). German norms for semantic typicality, age of acquisition, and concept familiarity. Behavior Research Methods, 44(2), 380–394. https://doi.org/10.3758/s13428-011-0164-y
Schwitter, V., Boyer, B., Méot, A., Bonin, P., & Laganaro, M. (2004). French normative data and naming times for action pictures. Behavior Research Methods, Instruments, & Computers, 36(3), 564–576. https://doi.org/10.3758/BF03195603
Shannon, C. E., & Weaver, W. (1998). The mathematical theory of communication. Univ. of Illinois Press.
Shao, Z., Roelofs, A., & Meyer, A. S. (2014). Predicting naming latencies for action pictures: Dutch norms. Behavior Research Methods, 46(1), 274–283. https://doi.org/10.3758/s13428-013-0358-6
Shetreet, E., & Friedmann, N. (2012). Stretched, jumped, and fell: An fMRI investigation of reflexive verbs and other intransitives. NeuroImage, 60(3), 1800–1806. https://doi.org/10.1016/j.neuroimage.2012.01.081
Snodgrass, J. G., & Vanderwart, M. (1980). A standardized set of 260 pictures: Norms for name agreement, image agreement, familiarity, and visual complexity. Journal of Experimental Psychology Human Learning and Memory, 6(2), 174–215. https://doi.org/10.1037//0278-7393.6.2.174
Székely, A., & Bates, E. (2000). Objective Visual Complexity as a Variable in Studies of Picture Naming. The Newsletter of the Center for Research in Language, 12(2), 3–33.
Székely, A., D'Amico, S., Devescovi, A., Federmeier, K., Herron, D., Iyer, G., . . . Bates, E. (2005). Timed Action and Object Naming. Cortex, 41(1), 7–25. https://doi.org/10.1016/S0010-9452(08)70174-6
Vigliocco, G., Vinson, D. P., Druks, J., Barber, H., & Cappa, S. F. (2011). Nouns and verbs in the brain: A review of behavioural, electrophysiological, neuropsychological and imaging studies. Neuroscience and Biobehavioral Reviews, 35(3), 407–426. https://doi.org/10.1016/j.neubiorev.2010.04.007
Williamson, D. J.G., Adair, J. C., Raymer, A. M., & Heilman, K. M. (1998). Object and Action Naming in Alzheimer's Disease. Cortex, 34(4), 601–610. https://doi.org/10.1016/S0010-9452(08)70517-3
Yarkoni, T., Balota, D., & Yap, M. (2008). Moving beyond Coltheart's N: A new measure of orthographic similarity. Psychonomic Bulletin & Review, 15(5), 971–979. https://doi.org/10.3758/PBR.15.5.971
Acknowledgements
We would like to thank Maria Ewald and Anna Thomas for providing classifications of transitivity, reflexivity and morphological complexity and Marina Wilbert for helpful comments on statistical analyses. We would also like to thank all participants for taking part in this study.
Funding
Open Access funding enabled and organized by Projekt DEAL
Author information
Authors and Affiliations
Contributions
I.W., F.D., C.R.O. and J.L.B. designed the original experiment. J.L.B. and F.S.H. collected the data. C.R.O. and I.W. developed the data analysis strategy. J.L.B. analyzed the data under supervision by C.R.O., I.W. and F.D. All authors interpreted the data, discussed the findings, drafted and approved the final version of the manuscript.
Corresponding author
Ethics declarations
Conflict of Interest
L.T. reports honoraria from Medtronic Inc., Boston Scientific Corporation, Bial, Zambon Pharma, UCB Schwarz Pharma, Desitin Pharma and Abbott Laboratories, outside the submitted work. J.L.B., F.S.H., F.D., I.W. and C.R.O. declare no competing interests.
Additional information
Open Practices Statement
Single trial data and the complete normative data set of this study, including all image files, is available at https://osf.io/hzskb/?view_only=efbe0d5b7963476eb541540616e0bf50.
The pictures originate from https://crl.ucsd.edu/experiments/ipnp/ (Székely et al., 2005) and https://osf.io/awj3r (Bayram et al., 2017). When using the data, please cite the original publications accordingly. Program code is available upon reasonable request. None of the experiments was preregistered.
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Immo Weber and Carina Oehrn shared last authorship bibliographic information
Supplementary Information
ESM 1
(DOCX 27.8 kb)
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Busch, J.L., Haeussler, F.S., Domahs, F. et al. German normative data with naming latencies for 283 action pictures and 600 action verbs. Behav Res 54, 649–662 (2022). https://doi.org/10.3758/s13428-021-01647-w
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.3758/s13428-021-01647-w