Duration compression induced by visual and phonological repetition of Chinese characters
- 174 Downloads
Our prior experience heavily influences our subjective time. One of such phenomena is repetition compression, that is, repeated stimuli are perceived shorter than novel stimuli. However, most of the studies on repetition compression used identical stimuli, leaving the question whether similar repetition effects could take place in phonological and semantic level repetition. We used Chinese characters to manipulate different levels of repetition in a duration discrimination task. We replicated earlier findings that repetition of visual identical characters shortened the apparent duration and found the repetition compression was spatially independent. Phonological repetition also caused the duration compression though the effect was weaker than the visual repetition. However, we observed no duration compression during the semantic repetition. The results suggest that repetition compression is mediated by visual and phonological representation of a stimulus in an early stage in processing hierarchy. We explained our findings according to the framework of predictive coding.
KeywordsDuration judgment Repetition compression Subjective time
We all experience time flies and time drags. Our subjective time is susceptible to many factors, such as nontemporal properties, attention, emotion, action and intention, and prior experience (Allman, Teki, Griffiths, & Meck, 2014; Droit-Volet & Gil, 2009; Ganzenmüller, Shi, & Müller, 2012; Jia, Shi, & Feng, 2015; Matthews & Meck, 2016; Shi & Burr, 2016; Shi, Church, & Meck, 2013; Shi, Ganzenmüller, & Müller, 2013; Xuan, Zhang, He, & Chen, 2007). The latter, prior experience, causes various types of time distortions, such as spatial-specific duration compression (Johnston, Arnold, & Nishida, 2006), central tendency of duration judgment (Gu, Jurkowski, Shi, & Meck, 2016; Jazayeri & Shadlen, 2010; Shi et al., 2013), odd-ball time dilation (Pariyadath & Eagleman, 2007; Tse, Intriligator, Rivest, & Cavanagh, 2004), and repetition compression (Birngruber, Schröter, & Ulrich, 2015b; Matthews, 2011; Matthews & Gheorghiu, 2016). One remarkable example is that repeating of the first item only once suffices to shortens the apparent duration (Birngruber et al., 2015b; Matthews, 2011), while the first item in a train of repeated displays seems longer than the subsequent items (Rose & Summers, 1995).
Studies have addressed the effect of repetition compression on subjective time by manipulating multiple factors, such as repetition times, repetition probability, novelty, and spatial location (Birngruber, Schroter, & Ulrich, 2015a; Cai, Eagleman, & Ma, 2015; Pariyadath & Eagleman, 2007; Pariyadath & Eagleman, 2008, 2012; Schindel, Rowlands, & Arnold, 2011). Using a stream-based oddball paradigm, Pariyadath and Eagleman (2007, 2008, 2012; Pariyadath & Eagleman, 2007; Pariyadath & Eagleman, 2008, 2012) showed that the duration compression of the repeated standard stimuli positively correlates with the number of repetition in the stream and the novelty of the oddball (but see Birngruber et al., 2015a). Some suggest this duration compression is related to repetition suppression, which assumes repeated signals reduce neural responses (Grill-Spector, Henson, & Martin, 2006; Henson & Rugg, 2003). This also is in line with the predictive coding, which suggests that the brain do little when the incoming stimulus matches the internal expectation but passes prediction errors for further processing when the incoming signal deviates from the prediction (Eagleman & Pariyadath, 2009; Friston, 2005; Rao & Ballard, 1999; Shi & Burr, 2016). However, a recent study by Matthews (2015) reported that the repetition compression of subjective duration is reduced and even reversed when repetition trials become more frequent. The finding suggests there is an interaction between the repetition suppression and the attentional improvement of relevant informative processing modulated by the same high-level expectation (Matthews & Meck, 2016). Studies also showed the temporal repetition compression can be spatial specific (Burr, Tozzi, & Morrone, 2007; Cai et al., 2015), consistent with the notion of the low-level adaptive processing (Johnston et al., 2006). For instance, Cai et al. (2015) found that the repetition compression effect diminished when a repeated comparison stimulus (a bar with the same orientation) was at a different location. These results indicate that the temporal processing is similar for a repeated stimulus compared to an irrelevant (novel) item when the standard and comparison are at different locations.
Earlier research, however, primarily focused on the repetition effect induced by repeating simple visual or auditory items (Birngruber et al., 2015b; Kim & McAuley, 2013; Matthews & Gheorghiu, 2016; Matthews & Meck, 2016). Complex stimuli, such as Chinese characters, not only appear as visual patterns of strokes but also invoke high-level phonological and semantic cognitive processing. An interesting question arises about whether repeating nonvisual constituents of a visual item, such as phonological or semantic repetition of a Chinese character, also could compress apparent duration. Research has shown that phonological or semantic repetition can facilitate cognitive processes of Chinese characters in various tasks, such as identification, categorization, lexical decision, and naming task (Neely, 1991; Perfetti & Liu, 2006). The facilitation by phonological or semantic repetition is correlated with reduced neural activities (Qiao, Zheng, Li, Zhu, & Wang, 2014; Schacter, Wig, & Stevens, 2007; Sekiguchi, Koyama, & Kakigi, 2000; Takahiro, Sachiko, & Ryusuke, 2004; Wheatley, Weisberg, Beauchamp, & Martin, 2005). Similar neural repetition suppression has been proposed to explain the temporal repetition compression (Matthews & Gheorghiu, 2016; Pariyadath & Eagleman, 2007).
Chinese characters have their own visual shapes, pronunciations, and semantic meanings, which allows us to manipulate repetition in different levels. For example, two Chinese characters, 目vs.木, are homophones with no visual similarity or semantic links (“eye” and “wood”) but share the same pronunciation (/mu/). Another example, Chinese characters, 足 (/zu/) and 脚 (/jiao/), have the same semantic meaning “foot” but share no visual or phonological similarity. We hypothesized that if repetition effect occurs at any levels of temporal processing, subjective duration would be compressed for visual, phonological, and semantic repeated characters. If the repetition compression limits to the low-level process, we expect the time compression in visual repetition, but not on the high-level repetition. In addition, if the repetition effect is location-specific (Burr et al., 2007; Cai et al., 2015; Johnston et al., 2006), changing the location of the second item would null the compression effect.
To test the above hypotheses, we used two-interval duration discrimination task in which a standard and a comparison durations were shown sequentially, and participants judged whether the comparison was shorter or longer than the standard one. To address if the effect of repetition is location-specific, the standard and comparison were at the same or separate locations in Experiment 1. In Experiments 2 and 3 we tested whether phonological repetition and semantic repetition would also compress apparent duration.
Twenty-four Chinese volunteers (15 females; mean age 22 years; 12 in each sub-experiment) took part in the experiment. All had normal or corrected-to-normal vision and were naïve to the purpose of the experiment. All participants gave informed consent before the experiment.
Stimuli and apparatus
The experiment took place in a sound-isolated cabin with a dimly luminance. The critical visual stimuli were Chinese characters, including two groups (Groups A and B) with equal frequencies (mean 419 characters/million), and the mean of strokes was 7.5 (Cai & Brysbaert, 2010). Each group includes 77 characters. For half of the participants, the characters from Group A were standard stimuli and the characters from Group B were comparison stimuli and vice versa for the other half of participants. The white characters (about 1.8° of viewing angle) were presented on a black background using a 24-inch BenQ Gaming LCD monitor (1 ms fast response time) with a resolution of 1,024 × 867 pixels and the refresh rate of 100 Hz. The viewing distance was 57 cm. Participants judged the duration of characters by pressing left- and right- arrow key on a standard keyboard. The experiment was controlled by self-coded Matlab program with the support of Psychophysics Toolbox (Brainard, 1997).
Design and procedure
Figure 1 illustrates two typical trial presentations for Experiment 1a and 1b, respectively. A trial started with a fixation cross in the center of the screen. In Experiment 1a, the fixation cross lasted for 800 ms followed by a blank screen of 500 to 800 ms. In Experiment 1b, the fixation cross lasted 500 to 800 ms before the first standard stimulus and remained on the screen until the response. The first standard with a fixed duration of 600 ms was presented, which followed by a random interstimulus interval (ISI) of 300 to 500 ms. The second comparison was shown for a duration randomly selected from 300, 400, 500, 600, 700, 800, and 900 ms. After a 500-ms blank screen, a question mark prompted for a response. Participants had to judge whether the comparison was shorter or longer than the standard by pressing either the left- or the right-arrow key.
All experimental conditions were within-subject design in a random order. There were 7 experimental blocks of 44 trials in Experiment 1a and 14 experimental blocks of 44 trials in Experiment 1b. The intertrial interval was 2,000 ms. Participants could take a break between blocks. Each experimental condition repeated 22 times. Before the formal experiment, each experiment included 2 practice blocks of 28 trials.
Repeated-measures ANOVAs and Bayes Factors (BF) analyses were conducted for each experiment. Bayes Factors with default prior scales were calculated for those marginal and nonsignificant results to show any evidence for supporting the alternative or the null hypothesis (Rouder, Morey, Speckman, & Province, 2012).
To estimate psychometric functions, the proportions of “longer” judgments were plotted as a function of the comparison duration and fitted with a logistic regression for each experimental condition and each participant. From the fitted curves, the 50% threshold, at which participants made equal “longer” and “shorter” judgments, is referred as the point of subjective equality (PSE) (Jia, Shi, Zang, & Müller, 2013; Shi, Jia, & Müller, 2012; Treutwein & Strasburger, 1999). Similarly, the just-noticeable difference (JND), as an index of discrimination sensitivity, was calculated by estimating half the difference in duration between the 25% and 75% thresholds.
We first examined if there were any systematic response biases in the behavioral data, which could be identified by the discrimination errors in the two extreme comparison durations (300 and 900 ms). If there were any systematic response biases, the discrimination errors would be systematically varied across conditions. On average, the discrimination error rates were very low, 0.025 and 0.01 for the repeated and novel conditions in Experiment 1a, and 0.013, 0.006, 0.019, and 0.006 for the sLrC, sLnC, dLrC, and dLnC conditions in Experiment 2b. Bayesian Repeated Measures ANOVAs failed to reveal any significant difference between the repeated and novel conditions (BF = 0.478) in Experiment 1a, and strong evidence that discrimination errors did not differ among the four conditions (BF = 0.297) in Experiment 2b. The findings suggest response biases, if any, could be neglected from further analyses.
Taken together, the findings revealed that the subjective duration of the comparison was shortened when it was a repeated character compared to a novel character. Unlike the adaptation effect (Burr et al., 2007; Cai et al., 2015; Johnston et al., 2006), this repetition compression shown in the comparison task was not location specific. To examine whether the repetition compression can take place at high-level cognitive processes, we compared the visual repetition, phonological repetition to the non-repetition baseline in Experiment 2.
Ten Chinese volunteers (4 females, mean age 21.8 years) took part in this experiment. All had normal or corrected-to-normal vision and were naïve about the purpose of the experiment. They all gave informed consent prior to the experiment.
Stimuli and apparatus
The stimuli presentation and apparatus were the same to those in Experiment 1, except that this experiment used three groups with equal frequencies (mean 381 characters/million) and their mean number of strokes was 7.7. Each group includes 77 characters. Among them, two groups of characters were homophones but sharing no visual or semantic similarity (see supplementary Table 1).
The experimental set-up was the same as used in Experiment 1a, with the following exceptions. There were three conditions: the visual repetition (VR), phonological repetition (PR), and novel (N) conditions. The standard and comparison used the same character in the VR condition whereas they shared the same pronunciation (homophones) but different characters in the PR condition (e.g., 目 /mu/ and 木 /mu/). The novel baseline condition used different characters that differ in both shape and pronunciation (e.g., 目 /mu/ and朵 /duo/). The experiment comprised 1 practice block and 11 experimental blocks, with each of 42 trials. Each combinational experimental condition repeated 22 times, presented in a random order.
The discrimination error rates calculated from the two extreme comparison durations were very row, 0.019, 0.007, and 0.013 for the visual-repetition, phonological-repetition, and novel conditions. Bayesian repeated measures ANOVA failed to reveal any significance among the three conditions (BF = 0.826). That is, we did not observe any significant response biases.
Ten Chinese volunteers (6 females, mean age 21.5 years) took part in this experiment. All had normal or corrected-to-normal vision and were naïve to the purpose of the experiment. They all gave informed consent before the experiment.
Stimuli and apparatus
The stimuli presentation and apparatus were the same as in Experiment 1a, except the followings. In this experiment, 66 characters (mean of strokes 8.7) with equal frequencies (mean 400 characters/million) were used. Twenty-two pairs of characters have close semantic meanings (see Table 1 in the Appendix), whereas the rest of the 22 characters have complete different semantic meanings. Each semantic pair was tested for all comparison durations (i.e., from 300 to 900 ms), such that individual variability of semantic processing among semantic pairs, if any, would not influence a particular test duration.
Following the formal test, participants had to rate the semantic similarity of the presented characters using a 5-point scale rating (“1” means two characters are semantic irrelevant, and “5” semantic highly relevant).
The experimental procedure was the same as in Experiment 2, except the phonological-repetition condition replaced by the semantic-similarity (SS) condition (e.g., 足 /zu/ and 脚 /jiao/ both have the same semantic meaning of foot). The experiment included 2 practice blocks with each of 42 trials and 7 experimental blocks with each of 66 trials.
Like the previous two experiments, the discrimination error rates calculated from the two extreme comparison durations were row, 0.036, 0.002, and 0.006 for the visual-repetition, semantic-similarity, and novel conditions. Bayesian repeated measures ANOVA failed to reveal any significance among the three conditions (BF = 0.854).
In addition, the mean rated (± SE) for the semantically similar judgment was 4.2 (±0.11), indicating the characters used in the SS condition were highly relevant in semantic.
The present study investigated influences of different level of repetition on duration estimation using Chinese characters. We compared three levels of repetition: the visual (e.g., 木-木), phonological (e.g., 目/mu/-木/mu/), and semantic (e.g., 足/zu/ - 脚/jiao/) repetitions. Our findings on the visual repetition replicated the repetition compression effect found in the literature (Birngruber et al., 2015b; Cai et al., 2015; Matthews, 2011; Matthews & Gheorghiu, 2016; Matthews & Meck, 2016). We further showed that the repetition compression was location independent (Experiment 1b). More interestingly, the high-level phonological repetition also shortened the apparent duration, but the compression effect was weaker than the pure visual repetition (Experiment 2). However, the repetition compression diminished when the repetition was on the semantic level (Experiment 3). Among all three experiments, we did not observe any systematic response biases, which suggests the compression effect we found here is unlikely a pure response bias.
Our finding of location-independent repetition compression (Experiment 1b) differs from earlier findings using simple visual stimuli (Cai et al., 2015). Repetition of simple visual stimuli (such as Gabor patch) likely invokes low-level retinotopic specific adaptation (Ayhan, Bruno, Nishida, & Johnston, 2009; Cai et al., 2015; Curran & Benton, 2012). In our study, however, repetition of Chinese characters may activate not only the low-level sensory processing, but also the mnemonic processing (Matthews & Meck, 2016), including phonological and semantic processing. The latter potentially invokes location-independent repetition suppression. As a consequence, the temporal repetition compression remains even when the repeated stimulus changes its location.
The duration compression induced by visual or phonological repetition of Chinese characters replicated and extended earlier research (Birngruber et al., 2015b; Cai et al., 2015; Matthews, 2011, 2015; Schindel et al., 2011). In a recent study by Birngruber et al. (2015b), the subjective duration of repeating strings of consonant was underestimated compared to the novel one in a two-interval paradigm. The effect of repeating consonant strings was similar to the visual repetition. Matthews (2011, 2015) found the repetition compression also happened with facial or scenery pictures. But those complex pictures contain multiple visual features and semantic information, which are difficult to be disassociated in their studies. Our study revealed that the repetition of phonological constituent without visual and semantic similarity significantly produced a shorter subjective duration, though the effect was weaker than the pure visual repetition. The results indicate that visual similarity is not a solely determining factor for the repetition compression. Similarly, phonological repetition could activate the “auditory repetition” automatically.
Unlike phonological repetition, semantic similarity failed to affect apparent duration. Although semantic similarity could facilitate explicit word identification (Neely, 1991; Perfetti & Liu, 2006), the identification task requires a direct semantic processing of the word, which occurs in a late stage compared to visual and phonological information processing (Perfetti & Liu, 2006). The absence of duration compression for semantic repetition may indicate that the temporal repetition compression is likely modulated at the early stage of processing repetition features in the processing hierarchy.
One proposal for the repetition compression is coding efficiency under the framework of predictive coding (Eagleman & Pariyadath, 2009; Matthews et al., 2014), which argues repetition suppression depends on the differences between the predicted and the actual signals. The predictive coding framework (Friston, 2005, Rao & Ballard, 1999) assumes that bottom-up signals are only passed on to the next stage when the information deviates from the top-down predictions. Neural responses are suppressed for the predicted signals and activated for the “surprised” prediction errors. The predictive coding account may offer a unified explanation for the differential repetition effects we found here. In a short sequence, participants tend to keep the same prediction, which plays an important role in the recency effect (Davelaar, Goshen-Gottstein, Ashkenazi, Haarmann, & Usher, 2005; Glanzer, 1972) and the central tendency effect (Cicchini, Arrighi, Cecchetti, Giusti, & Burr, 2012; Jazayeri & Shadlen, 2010; Shi et al., 2013). Similarly, in our duration comparison paradigm, participants likely expect the same stimulus for the second comparison presentation. Prediction error (or “surprise”) thus varied across three different repetition conditions: no surprise for the visual repetition, partial surprise (in vision) for the phonological repetition, but both auditory and visual surprise for the semantic repetition. The auditory and visual novel information contained in the semantic repetition would be similar to the non-repetition condition. In line with predictive coding, magnitudes of prediction error would qualitatively “predict” differential repetition compression observed in three repetition conditions.
One might argue attentional modulation in a repeated presentation contributes to the duration distortion in the present study. A novel (rare) stimulus often captures attention compared to the repeated one, thus according to the attention-gating theory (Zakay & Block, 1997) more temporal information is accumulated for the novel one, resulting in a longer perceived duration for the novel than the repeated one (Matthews & Meck, 2016; Tse et al., 2004). But attentional modulation alone cannot explain our findings of temporal repetition compression. First, earlier studies have shown the repetition may evoke an attentional enhancement of perceptual processing, causing the repeated stimulus appears longer than a novel one (Matthews, 2015; Matthews & Meck, 2016). Second, shift of spatial attention by the location manipulation (Experiment 1b) deteriorated the discrimination sensitivity, but not the duration compression of repeated stimuli. Thus, attentional modulation, if any, did not play a key role in the temporal repetition compression we observed here.
In conclusion, we found visual- and phonological-repetition, but not semantic repetition, of Chinese characters induced a duration compression, and the repetition compression is location independent. The compression effects are likely due to the repetition suppression in both early sensory processing of visual and phonological (auditory) information. Semantic similarity processing, however, may take place at relative late stage, which did not interact with the timing judgment.
This work was supported by the Nature Science Foundation of JiangSu Province in China (Grants No. BK20160171) to LJ and German research foundation DFG SH166 3/1 to ZS. The funding institution had no role in the study design, data collection, analysis decision to publish, or preparation of the manuscript.
- Birngruber, T., Schroter, H., & Ulrich, R. (2015a). Introducing a control condition in the classic oddball paradigm: Oddballs are overestimated in duration not only because of their oddness. Attention, Perception & Psychophysics, 77(5), 1737–1749. doi: 10.3758/s13414-015-0868-7
- Birngruber, T., Schröter, H., & Ulrich, R. (2015b). The influence of stimulus repetition on duration judgments with simple stimuli. Frontiers in Psychology, 6, 1213. doi: 10.3389/fpsyg.2015.01213
- Glanzer, M. (1972). Storage mechanisms in recall. In G. H. Bower (Ed.), The psychology of learning and motivation (Vol. 5, pp. 129–193). New York: Academic Press.Google Scholar
- Gu, B. M., Jurkowski, A. J., Shi, Z., & Meck, W. H. (2016). Bayesian optimization of interval timing and biases in temporal memory as a function of temporal context, feedback, and dopamine levels in young, aged and Parkinson’s disease patients. Timing & Time Perception, 4, 315–342. doi: 10.1163/22134468-00002072 Google Scholar
- Matthews, W. J., Terhune, D. B., Rijn, H. V., Eagleman, D. M., Sommer, M. A., & Meck, W. H. (2014). Subjective duration as a signature of coding efficiency: Emerging links among stimulus repetition, predictive coding, and cortical GABA levels. Timing & Time Perception Reviews, 1(1), 1–11. doi: 10.1163/24054496-00101005 CrossRefGoogle Scholar
- Neely, J. H. (1991). Semantic priming effects in visual word recognition: A selective review of current findings and theories. In D. Besner & G. W. Humphreys (Eds.), Basic processes in reading: Visual word recognition (pp. 264–336). Hillsdale, NJ: Erlbaum.Google Scholar
- Perfetti, C. A., & Liu, Y. (2006). Reading Chinese characters: Orthography, phonology, meaning, and the lexical constituency model. In P. Li, L. H. Tan, E. Bates, & O. J. L. Tzeng (Eds.), The handbook of east Asian psycholinguistics (Vol. 1. Chinese) (pp. 225–236). NY: Cambridge University Press.CrossRefGoogle Scholar