Abstract
Grouping objects into discrete categories affects how we perceive the world and represents a crucial element of cognition. Categorization is a widespread phenomenon that has been thoroughly studied. However, investigating categorization learning poses several requirements on the stimulus set in order to control which stimulus feature is used and to prevent mere stimulus–response associations or rote learning. Previous studies have used a wide variety of both naturalistic and artificial categories, the latter having several advantages such as better control and more direct manipulation of stimulus features. We developed a novel stimulus type to study categorization learning, which allows a high degree of customization at low computational costs and can thus be used to generate large stimulus sets very quickly. ‘RUBubbles’ are designed as visual artificial category stimuli that consist of an arbitrary number of colored spheres arranged in 3D space. They are generated using custom MATLAB code in which several stimulus parameters can be adjusted and controlled separately, such as number of spheres, position in 3D-space, sphere size, and color. Various algorithms for RUBubble generation can be combined with distinct behavioral training protocols to investigate different characteristics and strategies of categorization learning, such as prototype- vs. exemplar-based learning, different abstraction levels, or the categorization of a sensory continuum and category exceptions. All necessary MATLAB code is freely available as open-source code and can be customized or expanded depending on individual needs. RUBubble stimuli can be controlled purely programmatically or via a graphical user interface without MATLAB license or programming experience.
Graphical abstract
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Introduction
Being able to observe the weather through your kitchen window and to select an appropriate outfit saves yourself the trouble of running back home after a few minutes to fetch your umbrella. However, when leaving your favorite café after your morning coffee you might confuse your own umbrella with one of the others in the stand next to the door. We are constantly surrounded by an endless number of different contexts and objects that we automatically group into distinct categories. Whereas some categories seem quite abstract or vague, such as ‘good’ or ‘bad’ weather, others include very similar-looking, distinct objects such as ‘umbrella’.
Categorization describes the ability to group sensory stimuli into meaningful categories based on shared characteristics (Freedman & Miller, 2008; Jitsumori & Delius, 2001; Wutz et al., 2018). By definition, distinct objects that belong to the same class or category are treated equivalently and differently from objects in a different category (Mervis & Rosch, 1981). This behavior is generalized to novel objects of either category (Herrnstein, 1990; Jitsumori & Delius, 2001). Focusing on central features that are common in different objects within one category and ignoring irrelevant details reduces memory load and simultaneously influences how objects are perceived (DeGutis & D’Esposito, 2007; Goldstone, 1994). You might still remember that you brought an umbrella with you, however, without remembering whether it was dark blue or black.
Perceptual categorization is not restricted to humans, but a widespread phenomenon in the animal kingdom (Freedman & Miller, 2008; Güntürkün et al., 2018). Most objects in nature that are behaviorally relevant to animals are variable, even though they might require the same behavioral response (Herrnstein, 1990). Being able to recognize these objects above the individual level and to pool multiple sensory inputs into informative signals with ecological relevance is essential for animals and substantially reduces stimulus complexity (Goldstone & Hendrickson, 2009; Herrnstein, 1990; Jitsumori & Delius, 2001; Repp, 1984). Thus, the organization of the sensory world into perceptual categories is a key component of cognition and facilitates everyday life in a constantly changing environment (Cook & Smith, 2006; Freedman et al., 2002, 2003; Knoblich et al., 2002; Mervis & Rosch, 1981).
Previous studies have employed a variety of different visual stimuli, sometimes with arbitrarily chosen category boundaries that are difficult to control in a systematic manner. To resolve this issue, we have developed a novel stimulus type to study categorization learning: ‘RUBubbles’ are designed as an artificial category stimulus by arranging an arbitrary number of colored spheres in a 3D space. They are generated using custom MATLAB code in which several stimulus parameters can be adjusted and controlled separately, such as the number of spheres, 3D sphere position, size, and color. This approach allows to construct RUBubble categories that are specifically tailored to study various aspects of categorization and category learning.
Perceptual categorization: Conversion of continuous stimuli into categorical representations
RUBubbles can be used to generate a continuum between two categories by systematic variation of stimulus parameters. A gradual change of the stimulus parameters is necessary to study one important phenomenon of categorization: the existence of (sharp) category boundaries despite equal physical differences (Freedman et al., 2001). Categorization has been shown to influence sensory perception (Goldstone, 1994; Goldstone & Hendrickson, 2009; Sigala & Logothetis, 2002), and the ability to perceive continuously varying stimuli as belonging to discrete, qualitative categories has been characterized as categorical perception (Repp, 1984). For example, humans tend to group color hues in distinct linguistic categories (Skelton et al., 2017), which might be the reason why we are able to distinguish two colors in certain wavelength ranges but fail in others (Thierry et al., 2009). Perceptual categorization leads to distorted perception such that differences between members of different categories are accentuated whereas differences between members of the same category are attenuated, even when physical differences are actually the same (within-category compression and between category separation)(Goldstone & Hendrickson, 2009; Harnad, 2003). One prominent example of a continuous category stimulus set is the ‘cat and dog’ morphing system (Fig. 1a)(Freedman et al., 2001; Riesenhuber & Poggio, 1999). Freedman et al. used a morphing software to systematically construct morphs between cat and dog prototypes and analyzed categorization behavior and single cell activity in rhesus monkeys. They found clear perceptual category boundaries on the behavioral and neuronal level despite gradual changes in their stimulus set (Freedman et al., 2002; Freedman et al., 2003). Sudden changes in discrimination performance that are not in line with the gradual change of stimulus parameter have also been reported in humans (Emmorey et al., 2003; Harnad, 1987; Liberman et al., 1957), crickets (Wyttenbach et al., 1996), and zebra finches (Caves et al., 2018; Zipple et al., 2019).
Previous studies on categorization
A large number of studies focused on categorization learning using a wide variety of different stimuli for both human and animal subjects. One common approach is an initial training with several stimuli (discrimination acquisition) and subsequent testing of generalization using novel stimuli to exclude categorization by rote (Güntürkün et al., 2018). In most experimental paradigms, subjects were trained to differentiate between stimuli with a particular object or feature and stimuli without (A vs. not A), or to differentiate between two categories (A vs. B) (Jitsumori & Delius, 2001; Wutz et al., 2018). Performance in transfer tests using unfamiliar stimuli was used as measure of successful open-ended categorization (Herrnstein, 1990). Some exemplary category sets that have been used are animate vs. inanimate (Fabre-Thorpe et al., 1998; Kriegeskorte, Mur, Ruff, et al., 2008b), tree vs. non-tree(Vogels, 1999), Picasso vs. Monet paintings (Anderson et al., 2020; Watanabe et al., 1995), and various clip-art images, pictures, drawings, and photographs (Aust & Huber, 2001; Aust & Huber, 2002; Hampson et al., 2004; Herrnstein & Loveland, 1964; Kreiman et al., 2000) (see Fig. 1c–f for an overview). A key concern with many of those sets is the difficulty to control or identify the stimulus element that was used for categorization (especially with photographs). Category-defining features, for instance the presence or absence of humans (Herrnstein & Loveland, 1964), often co-occur with background features or spatial cues, which might be used by the subjects to categorize the stimuli instead (Aust & Huber, 2001; Güntürkün et al., 2018). Researchers have adopted various strategies to examine which feature their research animals actually relied on for categorization. For instance, the category-defining feature was added to a previously learned negative background and then used in transfer tests (Aust & Huber, 2001). Others used partial masking to cover various stimulus parts and investigated resulting impairments in performance (Gibson et al., 2005) or introduced eye or peck tracking to localize the focus of attention (Dittrich et al., 2010; Freedman et al., 2002).
The use of artificial categories provides a higher control of low-level visual features, which might reduce the need of additional control trials, and facilitates a more direct manipulation of category-defining attributes (Jitsumori & Delius, 2001). Further, artificial stimuli are generally ‘neutral’ without potential confounding effects due to ecological or social relevance unlike stimuli such as faces or food (Vogels, 1999). Previous studies have used basic geometric shapes (geons (Peissig et al., 2019); Attneave style polygons (Attneave & Arnoult, 1956; Collin & McMullen, 2002); rectangle vs. circle (Ashby et al., 1998)), stimuli constructed based on binary, multi-level features (bugs (Smith & Minda, 1998); color-charts(Cook & Smith, 2006; Lech et al., 2016); cartoon animals (Bowman et al., 2020; Bozoki et al., 2006)), nonface objects with common spatial configuration (‘greebles’, (Gauthier et al., 1998; Gauthier & Tarr, 1997)), parameterized line drawings (Sigala & Logothetis, 2002)), digital embryos (created by simulating embryonic development (Hauffen et al., 2012; Hegdé et al., 2008; Kromrey et al., 2010)), abstract numerosity (Ditz & Nieder, 2016), and random dot patterns (Antzoulatos & Miller, 2011; Antzoulatos & Miller, 2014; Wutz et al., 2018) (see Fig. 1g–o).
Our new stimuli offer a way to combine the advantages of such artificial categories with a high degree of customization, while remaining easy to produce with only low costs for computation. By using our RUBubbles, it is possible to precisely control individual stimulus features, and thus to analyze their separate impact on categorization performance. In contrast to already-existing stimulus types, it is feasible to quickly generate a large number of unique RUBubble stimuli, which is crucial to study categorization learning. By combining specific generation algorithms and training paradigms, different characteristics and strategies of categorization learning can be investigated on a behavioral and neuronal level. The following sections will explain in detail, how RUBubble stimuli and specific category sets are generated and how each stimulus parameter can be manipulated individually.
Creation of RUBubble stimuli
We provide ‘RUBubble stimuli’ as an easy-to-useMATLAB-based application. RUBubble stimuli can be controlled purely programmatically or via a graphical user interface (‘RUBubblesAPP’). All MATLAB files are freely available and can be customized or expanded depending on individual needs (code can be downloaded from https://gitlab.ruhr-uni-bochum.de/ikn/rububbles, published under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that this article is cited to credit the original authors). An additional MATLAB live script illustrates the creation process and ensure a user-friendly testing and implementation. The RUBubblesAPP can be freely downloaded as well and used as MATLAB app or independently as standalone desktop app without a MATLAB license. For a full list of features, user manual, etc. we have setup a Wiki (https://gitlab.ruhr-uni-bochum.de/ikn/rububbles/-/wikis/home).
RUBubble stimuli are composed of an arbitrary number of colored spheres that are arranged in 3D space (Fig. 2). Three parameters control the stimulus appearance and can be adjusted and manipulated separately: the color, position, and size of each sphere (Fig. 2b). We have developed several MATLAB functions, which are also implemented in a graphical user interface (‘RUBubblesAPP’), to generate various stimulus sets for categorization learning. The first step in stimulus generation is to define a base stimulus for each category. Subsequently, all other category members are generated as derivatives of the base stimulus. Three different main calculation methods can be used to produce a RUBubble category and will be explained in the following sections (for an overview, see Table 1 and the overview table within the Wiki documentation).
Our specifically designed RUBubblesAPP allows an easy, user-friendly manipulation of a wide variety of additional stimulus features. Besides the high level of customization this APP also facilitates the use and testing of RUBubble stimuli away from the code-based implementation and outside of the MATLAB environment.
Category base stimulus
A category base stimulus can be generated using the function ‘RUBubbles’ or via the ‘editRUBubble’ component within the app. In both cases, the desired number of spheres is the only mandatory input argument (Fig. 3). All other stimulus parameters (X, Y, Z coordinates, size, and color) are randomly generated, but can later be customized when using the app (e.g., modification of sphere density, coloring and size, Fig. 4d). In the app, the user can further mark 2D sphere positions and thereby define the general spatial arrangement of all spheres instead of specifying the sphere number.
Visualization of RUBubble stimuli
RUBubble stimuli generated in MATLAB can be visualized using the function ‘drawRUBubbles’, which requires all previously generated stimulus parameters as input argument (see live script ‘bubbles.mlx’). The output is a MATLAB figure that contains the RUBubble stimulus as a 3D object, which is shown along hidden axes (default mode, Fig. 3). It is possible to show the axes for clarification (Fig. 4a, b) or to modify the viewing angle and rotate the stimulus to, for instance, generate 2D images of the same stimulus at different viewing angles (Fig. 4c). RUBubble stimuli can be saved in various image formats (such as .jpg, .png, and MATLAB .fig) and exploited as basis for 3D objects to be used in, for instance, human fMRI studies.
Within the app, a preview of the created RUBubble stimulus is continuously updated to immediately visualize customizations (Fig. 4d). All stimulus parameters and a figure of the generated stimulus can be saved to local folders and used at a later stage for the generation of a full category.
Generation of RUBubble categories
All members of a RUBubble category are generated as derivatives of a category base. Parameters of novel stimuli are pseudo randomly produced using either a Gaussian, or a uniform distribution. Thus, novel stimuli are created by defining either the range (δ), or the standard deviation (σ) of each stimulus parameter relative to the category base. The different calculation methods are implemented in two different functions, which require all parameters of the category base stimulus (mandatory), and a range or standard deviation (optional) to control the deviation of the calculated values from the base stimulus (Fig. 5). The number of spheres remains the same for all stimuli within one category in both methods.
Depending on the parameter distribution used, RUBubble categories differ in their feature distribution (Fig. 5). Using uniformly distributed pseudorandom numbers within a specific range results in clear category boundaries and more or less equally frequent stimulus parameters. Thus, stimuli with higher dissimilarity to the category base are as frequent as stimuli with minor variation. A stimulus set generated based on a Gaussian distribution contains few strongly divergent stimuli, while most category members exhibit similar features. As a result, a clearly defined category border is missing.
When working in MATLAB, the user can choose the desired underlying parameter distribution by selecting the corresponding function (‘newStim_uniform’ or ‘newStim_Gauss’, see live script ‘bubbles.mlx’ for an example). A range that specifies the minimum and maximum deviation of each parameter is used as additional input argument for the function ‘newStim_uniform’. The values that are added or subtracted from the value of the base stimulus are drawn from the given range (marked in grey, see upper right schema in Fig. 5).
Alternatively, novel stimulus parameters can be selected from a Gaussian distribution with the value of the category base as mean (category base delineated by the vertical black line, parameter distribution of novel stimuli outlined by grey shaded Gaussian distribution, Fig. 5). The width of the distribution is defined by the standard deviation σ, which is used as an additional input argument for the function ‘newStim_gauss’. Sigma defines the amount of variation, and the extent to which parameters of novel stimuli vary from the category base. A low standard deviation indicates that stimulus parameters tend to be close to the base stimulus, whereas a high standard deviation indicates a wider spread. Thus, the higher the standard deviation, the higher the percentage of stimuli with larger deviations from the category base.
Using the RUBubblesAPP, the user simply selects the desired parameter distribution after having specified a category base stimulus (‘generateCategory’ component within the app, Fig. 6). This, in turn, enables entering of either minimum and maximum deviation values or standard deviations per stimulus parameter.
The calculations per stimulus parameter for both methods are briefly described in the following paragraphs and explained in more detail in the Wiki documentation. Aside from different parameter distributions, there are other category features that can be controlled when creating RUBubble categories, such as within- and between-category similarity, or the number of category prototypes (see Wiki for more information).
Sphere size
Sphere sizes are either calculated by adding or subtracting uniformly distributed pseudorandom numbers to values of the category base stimulus or selected from a Gaussian distribution with the value of the category base as mean (Wiki, Figs. 1 and 4). Relatively small numerical changes in size values result in a noticeable visual change of sphere size. Figure 7 provides an overview of RUBubble stimuli that were generated using different ranges or standard deviations (all other stimulus parameters unaltered and thus identical to the category base stimulus). As illustrated in Fig. 7, the use of a small range closer to the category base stimulus or a low standard deviation is advisable.
Sphere color
Color values are calculated in the same way as sphere sizes (Wiki, Figs. 1 and 4). The calculations are performed within the HSV color space; thus, RUBubble colors are described by their hue (shade of color), saturation (amount of color), and value (relative brightness). Hue is described on a chromatic circle with red being defined as both 0 and 1 (Fig. 8). Saturation and value describe the amount of color and relative brightness. Color parameter can be modified individually although they are perceptually linked. To prevent the occurrence of colorless, pale, or simply black spheres it is advisable to use values resulting in minor deviations when manipulating saturation and value or to leave both color parameters unaltered (Fig. 8).
Sphere position
To alter their position, all spheres are shifted by a given distance, in a random direction using a polar coordinate system (Wiki, Figs. 3 and 6). Angular values are drawn from a uniform distribution bounded by 0 and 2π and the distances are selected from either a uniform distribution within a given range or a Gaussian distribution (Fig. 9).
In our experiments, RUBubble stimuli were displayed along the x-z axes as 2D images. Thus, the Y coordinate of each new stimulus only affected the order of spheres and co-varied with changes in sphere size. To reduce the degrees of freedom for position changes and to retain a higher similarity between RUBubble stimuli, the Y coordinate is calculated independently from the X-Z coordinates in the same way as size and color parameters. Yet, the MATLAB code could be customized such that sphere positions change on all three axes when generating novel stimuli in 3D.
Generation of a continuous category
A continuum between two RUBubble stimuli is generated using the function ‘morphRUBubbles’ or the RUBubblesAPP component ‘generateContinuum’ (Fig. 10). The number of in-between stimuli and the parameters of two RUBubble stimuli with an equal number of spheres are required as input arguments. Morphing is based on stimulus parameters instead of visual features, which also explains why an equal number of spheres in both parent stimuli is necessary (i.e., sphere 1 of parent1 will be morphed into sphere 1 of parent2). So far, the mapping of individual spheres that are morphed into each other is unsupervised and random. To morph according to sphere position, color, or size would require an extension of the existing code, just as morphing of RUBubble stimuli with differential numbers of spheres. An example on how to gradually morph two RUBubble stimuli is included in the MATLAB live script (‘bubbles.mlx’).
Generation of category exceptions
Category exceptions are stimuli that do not belong to a given category on a perceptual level. They can be generated as independent stimuli and then be assigned to a category. However, in order to control how much and in which respect they differ from all other members of a category, exceptions need to be constructed in a specific way. The function ‘bubbleExceptions’ generates RUBubble stimuli that exhibit specific deviations from an input category but have a consistent number of spheres (Fig. 11a).
The stimulus parameters of category exceptions are calculated based on deviations from the outmost or extreme values of a category. Thus, the upper and lower parameter limits of each RUBubble parameter have to be calculated first (see Wiki). Stimulus parameters of category exceptions are then calculated by either adding values to the upper limit of the category or subtracting values from the lower limit (Fig. 11a). The MATLAB live script gives an example on how to generate category exceptions for a previously generated RUBubble category (‘bubbles.mlx’). Note that even if minimum deviation values are set to 0, the resulting parameter values represent the extreme values of the category and can thus differ profoundly from the category base stimulus or other category members.
The RUBubblesAPP component ‘generateExceptions’ allows another, additional approach to generate exceptions besides the previously described procedure. Here, the user specifically designs a base stimulus for all category exceptions (exception base stimulus, Fig. 11b). Similar to the generation of a RUBubble category, a min/max range per stimulus parameter then defines the potential deviations from this exception base stimulus.
Categorization learning training protocols
One major influencing factor on different categorization strategies is the way in which categories are experienced, or, in experimental studies, the behavioral training protocol. Whether the category is initially learned with only few, highly representative stimuli or a larger set of multiple exemplars should affect how it is represented. Categories can differ in the underlying structure and the distribution of characteristic features. For instance, they can be defined based on a common prototype or on similar features present in multiple exemplars. These different category structures are thought to encourage different strategies, which also involve distinct brain areas. With RUBubble stimuli, it is possible to generate different category structures that can be used to investigate differences in categorization learning. We propose three different training protocols that can be used with distinct RUBubble categories to study and compare different aspects of categorization learning.
Prototype- and exemplar-based categorization
It was initially shown for color that not all category members are equally representative of their category (‘focal colors’ as best examples similar across languages (Heider, 1972; Mervis & Rosch, 1981)). In general, most representative category members are usually learned first, show high within-category similarity, and simultaneously share the fewest attributes with contrasting categories (Mervis & Rosch, 1981). An initial training with only representative stimuli was shown to be more accurate, faster, and ‘superior to training on a range of examples’ (cf. Mervis & Rosch, 1981, Mervis & Pani, 1980). The most typical, ideal example or central tendency of a category is usually referred to as category prototype (based on means, or ideal values, (Goldstone & Hendrickson, 2009); ‘schema’ (Posner & Keele, 1968); ‘super stimulus’ (Jitsumori & Delius, 2001)). The similarity to this prototype, which combines all category-defining features, defines whether a stimulus belongs to the same category or not. Thus, an abstract prototype facilitates categorization of a large number of stimuli since it allows generalization (Jitsumori & Delius, 2001). In contrast, exemplar-based categorization strategies require an extraction of common elements or central features from several category exemplars. Each novel category stimulus is compared to all exemplars in both categories and then assigned to the category it shares the most features with (Minda & Smith, 2001). Category-defining features must be identified and derived from multiple exemplars, which requires a certain familiarity with several exemplars and explains slower initial learning (Minda & Smith, 2001). This abstract and conceptual collection of category-defining features can later be used to determine category membership comparable to a category prototype (‘formation of a prototype […] [as] means of classification’ (Reed, 1972)). Several characteristics of a category, such as category size, structure, and stimulus complexity, promote different strategies in category learning. According to Minda and Smith (2001) initial category learning is based on prototype-based strategies, whereas exemplar-based strategies emerge as secondary processes along with correct categorization of exceptions, which cannot be explained solely on prototype-based categorization (Minda & Smith, 2001). Small set sizes favor exemplar-based strategies such as memorization, whereas large numbers of complex stimuli promote prototype-based strategies (Minda & Smith, 2001). Besides differences in categorization behavior, the underlying neuronal dynamics and involved brain regions have been shown to differ depending on the respective categorization strategy. For instance, prototype representations were found in the (ventromedial) prefrontal cortex, (anterior) hippocampus, and medial temporal lobe (Bowman et al., 2020; Lech et al., 2016). In contrast, exemplar representations were demonstrated in the inferior frontal gyrus and lateral parietal cortex (Bowman et al., 2020). The behavioral training protocol used in experimental studies further affects which categorization strategy might be favorable.
Prototype-based
In a prototype-based training protocol, we suggest to successively increase the number of stimuli depending on the behavioral performance. The subjects initially perform the task with both category prototypes only, which exhibit all category-defining characteristics and central features as category base stimuli (delayed match to sample, Fig. 12). Once they perform at or above a certain behavioral criterion (e.g. 80 % correct) the stimulus number is increased. Thus, the task changes from a delayed match to sample to a delayed match to category paradigm, due to an increasing number of category stimuli. Each session can be subdivided into a set of training blocks, each of which contains a specific number of stimuli per category (compare with the prototype distortion paradigm used by Antzoulatos & Miller, 2011, see example 1, Wiki GitLab). Consequently, the final stimulus number per session is dependent on the performance. Along with an increasing set size, the percentage of novel stimuli also increases (the larger the stimulus set used, the less likely that a randomly selected stimulus was already familiar), which further enhances task difficulty. Due to the small number of highly representative stimuli at the beginning of each session (i.e. only prototypes), the learning curve should be steep at the beginning and then gradually flatten throughout the training session (higher percentage of unfamiliar stimuli as a result of performance-dependent increase in stimulus number). This should be more pronounced for stimulus sets that are composed of stimuli with gradually decreasing similarity to the prototype (i.e. the higher the stimulus number the more dissimilar). RUBubbles present an ideal stimulus type to use this training approach, since large numbers of unique stimuli can be generated.
Exemplar-based
An exemplar-based training protocol differs in the way stimuli are selected. Instead of restricting the stimulus set early in the session to few, highly representative stimuli, all stimuli are randomly chosen from the entire stimulus pool (Fig. 12). Hence, the likelihood to encounter unfamiliar stimuli early in training is very high. This training approach is more difficult due to the unrestricted stimulus set and the fact that category features have to be extracted from various exemplars and cannot be directly deduced from a prototype. Therefore, the learning curve should exhibit a slower initial increase and overall flatter slope in comparison with a prototype-based training session. A flattening of the curve towards the end of the session should, in contrast, be less pronounced.
Continuous
In a training protocol using a continuum between two RUBubble stimuli, subjects have to assign individual sample stimuli to one of the two categories. Variations between adjacent stimuli are gradual, thus, it is possible to investigate whether subjects experience a sharp category boundary despite identical physical differences between stimuli. It is also possible to train subjects on arbitrary category boundaries using a continuous stimulus set and compare changes in neuronal activity when these boundaries are modified and have to be relearned by the subjects (compare with (Freedman et al., 2002)).
Discussion
We introduced RUBubbles as a novel stimulus type to study categorization learning. RUBubbles show several desirable characteristics and represent a valuable supplement for categorization research, which adds to a large number of diverse stimulus types that have already been used in this field (see Fig. 1 for a small selection). RUBubbles can be used to quickly generate large stimulus sets, allow for specific manipulation of individual stimulus parameters, and enable users to adjust the existing code to suit individual requirements. The degree of variability within and between categories can be manipulated via precise specification of stimulus parameters, and a continuum can be produced using two starting RUBubble stimuli.
As an example, the spatial arrangement of individual spheres can be deliberately manipulated by defining the desired movement distance when generating novel stimuli. Hence, it would be possible to study the sensitivity to configural changes as is done in, for instance, face perception research (Gauthier & Tarr, 1997). ‘Greebles’, artificial nonface object stimuli, have been used to disentangle face-specific sensitivity from more general mechanisms, such as specialized knowledge or expertise with visually similar objects (Fig. 1k, Gauthier & Tarr, 1997; Gauthier et al., 1998). These stimuli are three-dimensional objects that share similar elements in common spatial configurations and can be categorized on different levels. RUBubbles can also be generated to represent multiple levels for categorization (for instance by using categories with varying sphere numbers as basic level). The straightforward generation of RUBubble stimuli might facilitate studies that require larger sets of unique stimuli and thus RUBubbles might provide a useful addition to object recognition research.
Nonetheless, some aspects remain that still need to be considered and our RUBubble framework is intended as a live product providing a strong fundament that can be further developed for which we are happy to receive any extension or improvement suggestions.
Naturally, perceptual similarity is challenging to determine for any visual stimulus. This applies to RUBubbles as well as any other already existing category stimulus type. RUBubble stimuli can be subdivided into distinct similarity levels based on mathematical properties, i.e. the deviation of parameter values from the category base stimulus (within-category similarity) or from the base stimulus of a second category (between category similarity). After generating a RUBubble category, the Euclidean distance of each sphere relative to the category base stimulus, and the absolute deviation in size and color values can be calculated for each stimulus (basic, mathematical similarity that provides indications of within-category similarity). However, it remains extremely difficult to interpret such deviations with regard to perceptual similarity, since large changes in numerical parameter values might lead to hardly visible changes in the visualized stimulus, whereas minor changes might completely alter the overall stimulus appearance. When looking at RUBubble stimuli it is obvious that the general impression most likely is more significant than numerical deviations of stimulus parameter (Fig. 13).
The different characteristics of RUBubble stimuli (i.e., color, size, spatial arrangement/position) most likely differ in salience depending on the specific stimulus set, training procedure, or subject. It is plausible that different participants or research animals use different stimulus features for categorization or that they adjust their focus depending on the respective stimulus set properties. Categorization training has been shown to influence perceptual sensitivities and to affect the salience of specific stimulus features (via acquired distinctiveness or acquired equivalence) (Goldstone, 1994). For instance, after having learned to categorize RUBubble stimuli mostly based on differences in sphere size, subjects most likely initially focus their attention on this specific stimulus feature when learning a new set. Besides, despite additional adjustment trials to produce equally discriminable stimuli, Goldstone (1994) reported a clear difference in processing of different dimensions (Goldstone, 1994). A more practical approach to identify the most prominent category-defining feature might be to evaluate which feature subjects relied on most after having learned a specific RUBubble set (e.g., by asking participants or calculating a GLM using performance data and RUBubble stimulus properties). RUBubble categories can be generated to encourage subjects to using specific parameters for categorization (by adjusting the respective variation per parameter within a category or manipulating the between category similarity). Ultimately, controlling and manipulating the saliency of different stimulus dimensions remains the responsibility of the individual researcher and has to be fitted to the respective experimental design and research question.
Alternative methods to assess the perceptual similarity that have been implemented in previous studies to evaluate the similarity of 2D images are multidimensional scaling, MDS (Hegdé et al., 2008), and representational similarity analysis, RSA (Kriegeskorte, Mur, & Bandettini, 2008a). Both could be applied to RUBubble stimuli but are complex, time-consuming, or lack the color dimension. In general, it is difficult to obtain any similarity value without making (too many) assumptions on how the subjects actually perceive the stimuli or on which stimulus parameter they rely for categorization (see Caves et al., 2019 on human biases when studying animal perception).
For instance, color vision differs in various degrees for different animals or even individuals in one species, especially birds show pronounced differences to mammals, which results in quite different color perception. Most monitors are calibrated for human subjects and thus might need other color adjustments when used with nonhuman animals. RUBubble colors are defined in the HSV color space and although all three color parameters (hue, saturation, and value) can be manipulated independently, these parameters represent integral dimensions that are not perceptually separable (Burns and Shepp, 1988; Gottwald and Garner, 1975). Thus, color is generally perceived holistically and classified based on overall similarity rather than on separable dimensions (Goldstone, 1994), which should be kept in mind when manipulating RUBubble color. Besides, RUBubble stimuli can easily be transformed into various shades of grey or black instead or defined within another color space by adapting the code. Another possibility would be to keep sphere colors within one category consistent. In general, a more suitable approach to determine similarity might be to analyze how strongly each stimulus parameter affects the behavioral performance and then use this knowledge to more precisely construct the following RUBubble categories.
Nonetheless, the here presented methods for RUBubble generation allow the creation of countless unique stimulus sets. Typically, stimulus sets contain two RUBubble categories, but they can also be designed to comprise multiple categories instead. The MATLAB code and the complementary RUBubblesAPP are easy to use, freely available, and do not require any additional toolboxes. Using the app allows to generate custom stimulus sets without prior programming experience or a MATLAB license. Besides, RUBubbles are immensely versatile and can be used to study diverse questions in categorization research, such as categorical perception of a sensory continuum or the effect of stimulus statistics on categorization learning.
References
Anderson, C., Parra, R.S., Chapman, H., Steinemer, A., Porter, B., Colombo, M., 2020. Pigeon nidopallium caudolaterale, entopallium, and mesopallium ventrolaterale neural responses during categorisation of Monet and Picasso paintings. Scientific Reports 10, 15971. https://doi.org/10.1038/s41598-020-72650-y
Antzoulatos, E.G., Miller, E.K., 2011. Differences between neural activity in prefrontal cortex and striatum during learning of novel abstract categories. Neuron 71, 243–249. https://doi.org/10.1016/j.neuron.2011.05.040
Antzoulatos, E.G., Miller, E.K., 2014. Increases in functional connectivity between prefrontal cortex and striatum during category learning. Neuron 83, 216–225. https://doi.org/10.1016/j.neuron.2014.05.005
Ashby, F.G., Alfonso-Reese, L.A., Turken, U., Waldron, E.M., 1998. A neuropsychological theory of multiple systems in category learning. Psychological Review 105, 442–481.
Attneave, F., Arnoult, M.D., 1956. The quantitative study of shape and pattern perception. Psychological Bulletin 53, 452–471. https://doi.org/10.1037/h0044049
Aust, U., Huber, L., 2001. The role of item- and category-specific information in the discrimination of people versus nonpeople images by pigeons. Animal Learning & Behavior 29, 107–119. https://doi.org/10.3758/BF03192820
Aust, U., Huber, L., 2002. Target-defining features in a “people-present/people-absent” discrimination task by pigeons. Animal Learning & Behavior 30, 165–176. https://doi.org/10.3758/BF03192918
Bowman, C.R., Iwashita, T., Zeithamova, D., 2020. Tracking prototype and exemplar representations in the brain across learning. eLife 9, e59360. https://doi.org/10.7554/eLife.59360
Bozoki A., Grossman, M., Smith, E.E., 2006. Can patients with Alzheimer’s disease learn a category implicitly? Neuropsychologia 44, 816 –827. https://doi.org/10.1016/j.neuropsychologia.2005.08.001
Burns, B., Shepp, B.E., 1988. Dimensional interactions and the structure of psychological space: The representation of hue, saturation, and brightness. Perception & Psychophysics 43, 494–507.
Caves, E.M., Green, P.A., Zipple, M.N., Peters, S., Johnsen, S., Nowicki, S., 2018. Categorical perception of colour signals in a songbird. Nature 560, 365–367. https://doi.org/10.1038/s41586-018-0377-7
Caves, E.M., Nowicki, S., Johnsen, S., 2019. Von Uexküll revisited: Addressing human biases in the study of animal perception. Integrative and Comparative Biology, 59(6), 1451-1462. https://doi.org/10.1093/icb/icz073
Collin, C.A., McMullen, P.A., 2002. Using Matlab to generate families of similar Attneave shapes. Behavior Research Methods, Instruments, & Computers 34, 55–68. https://doi.org/10.3758/BF03195424
Cook, R.G., Smith, J.D., 2006. Stages of abstraction and exemplar memorization in pigeon category learning. Psychological Science 17, 1059–1067.
DeGutis, J., D’Esposito, M., 2007. Distinct mechanisms in visual category learning. Cognitive, Affective, & Behavioral Neuroscience 7, 251–259. https://doi.org/10.3758/CABN.7.3.251
Dittrich, L., Rose, J., Buschmann, J.-U.F., Bourdonnais, M., Güntürkün, O., 2010. Peck tracking: A method for localizing critical features within complex pictures for pigeons. Animal Cognition 13, 133–143. https://doi.org/10.1007/s10071-009-0252-x
Ditz, H.M., Nieder, A., 2016. Sensory and working memory representations of small and large numerosities in the crow endbrain. The Journal of Neuroscience 36, 12044–12052. https://doi.org/10.1523/JNEUROSCI.1521-16.2016
Ditz, H.M., Nieder, A., 2020. Format-dependent and format-independent representation of sequential and simultaneous numerosity in the crow endbrain. Nature Communications 11, 686. https://doi.org/10.1038/s41467-020-14519-2
Emmorey, K., McCullough, S., Brentari, D., 2003. Categorical perception in American sign language. Language & Cognitive Processes 18, 21–45. https://doi.org/10.1080/01690960143000416
Fabre-Thorpe, M., Richard, G., Thorpe, S.J., 1998. Rapid categorization of natural images by rhesus monkeys. NeuroReport 9, 303–308. https://doi.org/10.1097/00001756-199801260-00023
Freedman, D.J., Miller, E.K., 2008. Neural mechanisms of visual categorization: Insights from neurophysiology. Neuroscience and Biobehavioral Reviews 32, 311–329. https://doi.org/10.1016/j.neubiorev.2007.07.011
Freedman, D.J., Riesenhuber, M., Poggio, T., Miller, E.K., 2001. Categorical representation of visual stimuli in the primate prefrontal cortex. Science 291, 312–316. https://doi.org/10.1126/science.291.5502.312
Freedman, D.J., Riesenhuber, M., Poggio, T., Miller, E.K., 2002. Visual categorization and the primate prefrontal cortex: Neurophysiology and behavior. Journal of Neurophysiology 88, 929–941. https://doi.org/10.1152/jn.2002.88.2.929
Freedman, D.J., Riesenhuber, M., Poggio, T., Miller, E.K., 2003. A comparison of primate prefrontal and inferior temporal cortices during visual categorization. The Journal of Neuroscience 23, 5235–5246. https://doi.org/10.1523/JNEUROSCI.23-12-05235.2003
Gaissert, N., Bülthoff, H.H., Wallraven, C., 2011. Similarity and categorization: From vision to touch. Acta Psychologica 138, 219–230. https://doi.org/10.1016/j.actpsy.2011.06.007
Gauthier, I., Tarr, M.J., 1997. Becoming a ‘Greeble’ expert: Exploring mechanisms for face recognition. Vision Research 37, 1673–82. https://doi.org/10.1016/S0042-6989(96)00286-6
Gauthier, I., Williams, P., Tarr, M.J., Tanaka, J., 1998. Training ‘Greeble’ experts: A framework for studying expert object recognition processes. Vision Research 38, 2401–28. https://doi.org/10.1016/S0042-6989(97)00442-2
Gibson, B.M., Wasserman, E.A., Gosselin, F., Schyns, P.G., 2005. Applying bubbles to localize features that control pigeons’ visual discrimination behavior. Journal of Experimental Psychology. Animal Behavior Processes 31, 376–382. https://doi.org/10.1037/0097-7403.31.3.376
Goldstone, R.L., 1994. Influences of categorization on perceptual discrimination. Journal of Experimental Psychology. General, 123, 178–200. https://doi.org/10.1037/0096-3445.123.2.178
Goldstone, R.L., Hendrickson, A.T., 2009. Categorical perception. Wiley Interdisciplinary Reviews: Cognitive Science 1, 69–78. https://doi.org/10.1002/wcs.26
Gottwald, R.L., Garner, W.R., 1975. Filtering and condensation tasks with integral and separable dimensions. Perception & Psychophysics 18, 26–28. https://doi.org/10.3758/BF03199362
Güntürkün, O., Koenen, C., Iovine, F., Garland, A., Pusch, R., 2018. The neuroscience of perceptual categorization in pigeons: A mechanistic hypothesis. Learning & Behavior 46, 229–241. https://doi.org/10.3758/s13420-018-0321-6
Hampson, R.E., Pons, T.P., Stanford, T.R., Deadwyler, S.A., 2004. Categorization in the monkey hippocampus: A possible mechanism for encoding information into memory. Proceedings of the National Academy of Sciences 101, 3184–3189. https://doi.org/10.1073/pnas.0400162101
Harnad, S., 2003. Categorical Perception. In: Encyclopedia of Cognitive Science. Nature Publishing Group: Macmillan.
Harnad, S., 1987. Psychophysical and cognitive aspects of categorical perception: A critical overview, in: Categorical Perception: The Groundwork of Cognition. Cambridge University Press, p. 24.
Hauffen, K., Bart, E., Brady, M., Kersten, D., Hegdé, J., 2012. Creating objects and object categories for studying perception and perceptual learning. Journal of Visualized Experiments 3358. https://doi.org/10.3791/3358
Hegdé, J., Bart, E., Kersten, D., 2008. Fragment-based learning of visual object categories. Current Biology 18, 597–601. https://doi.org/10.1016/j.cub.2008.03.058
Heider, E.R., 1972. Universals in color naming and memory. Journal of Experimental Psychology 93, 10–20. https://doi.org/10.1037/h0032606
Herrnstein, R.J., 1990. Levels of stimulus control: A functional approach. Cognition 37, 133–166. https://doi.org/10.1016/0010-0277(90)90021-B
Herrnstein, R.J., Loveland, D.H., 1964. Complex visual concept in the pigeon. Science 146, 549–551. https://doi.org/10.1126/science.146.3643.549
Jitsumori, M., Delius, J.D., 2001. Object Recognition and Object Categorization in Animals, in: Matsuzawa, T. (Ed.), Primate Origins of Human Cognition and Behavior. Springer Japan, pp. 269–293. https://doi.org/10.1007/978-4-431-09423-4_13
Knoblich, U., Riesenhuber, M., Freedman, D.J., Miller, E.K., Poggio, T., 2002. Visual categorization: How the monkey brain does It, in: Bülthoff, H.H., Wallraven, C., Lee, S.-W., Poggio, T.A. (Eds.), Biologically Motivated Computer Vision. Springer, pp. 273–281. https://doi.org/10.1007/3-540-36181-2_27
Kreiman, G., Koch, C., Fried, I., 2000. Category-specific visual responses of single neurons in the human medial temporal lobe. Nature Neuroscience 3, 946–953. https://doi.org/10.1038/78868
Kriegeskorte, N., Mur, M., Bandettini, P.A., 2008a. Representational similarity analysis – connecting the branches of systems neuroscience. Frontiers in Systems Neuroscience 2, 1–28. https://doi.org/10.3389/neuro.06.004.2008
Kriegeskorte, N., Mur, M., Ruff, D.A., Kiani, R., Bodurka, J., Esteky, H., Tanaka, K., Bandettini, P.A., 2008b. Matching categorical object representations in inferior temporal cortex of man and monkey. Neuron 60, 1126–1141. https://doi.org/10.1016/j.neuron.2008.10.043
Kromrey, S., Maestri, M., Hauffen, K., Bart, E., Hegdé, J., 2010. Fragment-based learning of visual object categories in non-human primates. PLoS One 5, e15444. https://doi.org/10.1371/journal.pone.0015444
Lech, R.K., Güntürkün, O., Suchan, B., 2016. An interplay of fusiform gyrus and hippocampus enables prototype- and exemplar-based category learning. Behavioural Brain Research 311, 239–246. https://doi.org/10.1016/j.bbr.2016.05.049
Liberman, A.M., Harris, K.S., Hoffman, H.S., Griffith, B.C., 1957. The discrimination of speech sounds within and across phoneme boundaries. Journal of Experimental Psychology 54, 358–368. https://doi.org/10.1037/h0044417
Mervis, C.B., Pani, J.R., 1980. Acquisition of basic object categories. Cognitive Psychology 12, 496–522. https://doi.org/10.1016/0010-0285(80)90018-3
Mervis, C.B., Rosch, E., 1981. Categorization of natural objects. Annual Review of Psychology 32, 89–115. https://doi.org/10.1146/annurev.ps.32.020181.000513
Minda, J.P., Smith, J.D., 2001. Prototypes in category learning: The effects of category size, category structure, and stimulus complexity. Journal of Experimental Psychology. Learning, Memory, and Cognition 27, 775–799. https://doi.org/10.1037/0278-7393.27.3.775
Peissig, J.J., Young, M.E., Wasserman, E.A., Biederman, I., 2019. Pigeons spontaneously form three-dimensional shape categories. Behavioural Processes 158, 70–76. https://doi.org/10.1016/j.beproc.2018.11.003
Posner, M.I., Keele, S.W., 1968. On the genesis of abstract ideas. Journal of Experimental Psychology 77, 353–363. https://doi.org/10.1037/h0025953
Reed, S.K., 1972. Pattern recognition and categorization. Cognitive Psychology 3, 382–407. https://doi.org/10.1016/0010-0285(72)90014-X
Repp, B.H. (1984) Categorical perception: Issues, methods, findings. In: Speech and Language (pp. 243–335). Elsevier. https://doi.org/10.1016/B978-0-12-608610-2.50012-1
Riesenhuber, M., Poggio, T. (1999). A note on object class representation and categorical perception. MIT Libraries: A.I. Memo No. 1679, 1–8
Sigala, N., Logothetis, N.K., 2002. Visual categorization shapes feature selectivity in the primate temporal cortex. Nature 415, 318–320. https://doi.org/10.1038/415318a
Skelton, A.E., Catchpole, G., Abbott, J.T., Bosten, J.M., Franklin, A., 2017. Biological origins of color categorization. Proceedings of the National Academy of Sciences 114, 5545–5550. https://doi.org/10.1073/pnas.1612881114
Smith, J.D., Minda, J.P., 1998. Prototypes in the mist: The early epochs of category learning. Journal of Experimental Psychology. Learning, Memory, and Cognition 24, 1411–1436.
Thierry, G., Athanasopoulos, P., Wiggett, A., Dering, B., Kuipers, J.-R., 2009. Unconscious effects of language-specific terminology on preattentive color perception. Proceedings of the National Academy of Sciences 106, 4567–4570. https://doi.org/10.1073/pnas.0811155106
Vogels, R., 1999. Categorization of complex visual images by rhesus monkeys. Part 1: Behavioural study. The European Journal of Neuroscience 11, 1223–1238. https://doi.org/10.1046/j.1460-9568.1999.00530.x
Watanabe, S., Sakamoto, J., Wakita, M., 1995. Pigeons’ discrimination of paintings by Monet and Picasso. Journal of the Experimental Analysis of Behavior 63, 165–174.
Wutz, A., Loonis, R., Roy, J.E., Donoghue, J.A., Miller, E.K., 2018. Different levels of category abstraction by different dynamics in different prefrontal areas. Neuron 97, 716-726.e8. https://doi.org/10.1016/j.neuron.2018.01.009
Wyttenbach, R.A., May, M.L., Hoy, R.R., 1996. Categorical perception of sound frequency by crickets. Science 273, 1542–1544. https://doi.org/10.1126/science.273.5281.1542
Zipple, M.N., Caves, E.M., Green, P.A., Peters, S., Johnsen, S., Nowicki, S., 2019. Categorical colour perception occurs in both signalling and non-signalling colour ranges in a songbird. Proceedings of the Royal Society B: Biological Sciences 286, 20190524. https://doi.org/10.1098/rspb.2019.0524
Acknowledgements
This research was supported by the Deutsche Forschungsgemeinschaft (DFG) project B13 of the Collaborative Research Centre 874 (Integration and Representation of Sensory Processes, project number 122679504).
Availability of data and materials
Data sharing not applicable to this article as no datasets were generated or analyzed during the current study.
Code availability
All MATLAB code and the supplementary RUBubblesAPP described here can be freely downloaded from https://gitlab.ruhr-uni-bochum.de/ikn/rububbles.
Funding
Open Access funding enabled and organized by Projekt DEAL. This research was supported by the Deutsche Forschungsgemeinschaft (DFG) project B13 of the Collaborative Research Centre 874 (Integration and Representation of Sensory Processes, project number 122679504).
Author information
Authors and Affiliations
Contributions
R. and A. developed the method and wrote custom MATLAB code. A. wrote the manuscript. R. and A. edited the manuscript.
Corresponding author
Ethics declarations
Conflicts of interest/Competing interests
The authors have no financial or proprietary interests in any material discussed in this article.
Ethics approval
Not applicable
Consent to participate
Not applicable
Consent for publication
Not applicable
Additional information
Open Practices Statements
All custom MATLAB code and the supplementary RUBubblesAPP introduced in this article are available at https://gitlab.ruhr-uni-bochum.de/ikn/rububbles.
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Apostel, A., Rose, J. RUBubbles as a novel tool to study categorization learning. Behav Res 54, 1778–1793 (2022). https://doi.org/10.3758/s13428-021-01695-2
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.3758/s13428-021-01695-2