Abstract
Revealing reinforcing mechanisms in associative learning is important for elucidation of brain mechanisms of behavior. In mammals, dopamine neurons are thought to mediate both appetitive and aversive reinforcement signals. Studies using transgenic fruit-flies suggested that dopamine neurons mediate both appetitive and aversive reinforcements, through the Dop1 dopamine receptor, but our studies using octopamine and dopamine receptor antagonists and using Dop1 knockout crickets suggested that octopamine neurons mediate appetitive reinforcement and dopamine neurons mediate aversive reinforcement in associative learning in crickets. To fully resolve this issue, we examined the effects of silencing of expression of genes that code the OA1 octopamine receptor and Dop1 and Dop2 dopamine receptors by RNAi in crickets. OA1-silenced crickets exhibited impairment in appetitive learning with water but not in aversive learning with sodium chloride solution, while Dop1-silenced crickets exhibited impairment in aversive learning but not in appetitive learning. Dop2-silenced crickets showed normal scores in both appetitive learning and aversive learning. The results indicate that octopamine neurons mediate appetitive reinforcement via OA1 and that dopamine neurons mediate aversive reinforcement via Dop1 in crickets, providing decisive evidence that neurotransmitters and receptors that mediate appetitive reinforcement indeed differ among different species of insects.
Similar content being viewed by others
Introduction
Much effort has been made to elucidate reinforcing mechanisms for associative learning. In mammals, dopamine neurons in the ventral tegmental area of the midbrain are thought to play critical roles in mediating both appetitive and aversive reinforcement1,2. In crickets, we observed that administration of octopamine receptor antagonists (epinastine and mianserin) impairs appetitive learning but not aversive learning, whereas administration of dopamine receptor antagonists (flupentixol, fluphenazine, spiperone and chlorpromazine) impairs aversive learning but not appetitive learning and we thus suggested that octopamine and dopamine neurons mediate appetitive and aversive reinforcement, respectively3,4,5,6,7,8. Pharmacological studies in honey bees also suggested participation of octopamine and dopamine in appetitive and aversive learning, respectively9,10,11.
Bases on results of studies using transgenic fruit-flies, on the other hand, it is thought that different types of dopamine neurons mediate appetitive reinforcement and aversive reinforcement, via Dop1 (also referred to as DUMB or DopR1) dopamine receptor and that octopamine neurons transmit a reward signal to dopaminergic reinforcing neurons, in part via OA1 (also referred to as OAMB) octopamine receptor12,13,14,15,16 (for a different view, see in ref. 17). This urged us to reexamine the validity of our suggestion, partly because specificities of receptor antagonists used in our studies are not perfect. We produced Dop1 knockout crickets using the CRISPR/Cas9 system18 and found that Dop1 knockout crickets exhibit impairment in aversive learning but not appetitive learning19. This observation, however, is not decisive, since the possibility that the observed defects are due to defects in brain development cannot be ruled out. One solution to this problem is the use of RNA interference (RNAi): methods to reduce target gene expression by dsRNA injection into the hemolymph have been well established in crickets20,21,22.
In this study we investigated the effects of silencing of the expression of genes that code OA1 octopamine receptor23 and Dop1 and Dop2 dopamine receptors24 by RNAi on appetitive and aversive olfactory learning in crickets. We selected these three receptors for analysis, among several types of octopamine and dopamine receptors reported in insects25,26,27, because genes for these receptors are known to be expressed in the Kenyon cells of the mushroom body, which play critical roles in olfactory learning28,29,30. For examples, studies with in situ hybridization in crickets have shown high levels of expression of Dop1 and Dop2 mRNA in Kenyon cells2 and a high level of OA1 mRNA expression is found in Kenyon cells in fruit-flies31 and honey bees32.
We used olfactory conditioning of the maxillary palpi extension response (MER)8 for evaluation of the effects of gene silencing by RNAi. Crickets extend their maxillary palpi and vigorously swing them when water is applied to the antennae or when filter paper soaked with odor essence is presented near their antennae8,33. We have reported that crickets subjected to pairing of an odor with water as a reward exhibited an increase in the probability of MER to the odor, whereas crickets subjected to pairing of an odor with 20% sodium chloride solution as a punishment exhibited a decrease of MER to the odor8.
Results
Suppression of gene expression by dsRNA injections of OA1, Dop1 and Dop2 in the cricket
We first studied the effects of double-stranded RNA (dsRNA) injection of the OA1, Dop1 or Dop2 gene on the expression levels of target gene mRNA in the cricket head. As a control, the amount of OA1, Dop1 or Dop2 mRNA in the brains of DsRed2 RNAi crickets was also studied. Groups of crickets were injected with 20 pmol OA1, Dop1, Dop2 or DsRed2 dsRNA into the head hemolymph. Target sequences of RNAi for OA1, Dop1 and Dop2 are shown in Methods and in Fig. 1. The amounts of mRNA in the heads of dsRNA-injected crickets were measured by quantitative real-time PCR (qPCR) at 48 hr after injection and the relative amount of mRNA transcribed from the target gene was compared to that in intact crickets. The levels of OA1, Dop1 and Dop2 mRNA in DsRed2 RNAi crickets were similar to those in intact crickets (Fig. 2). In contrast, expression levels of OA1, Dop1 and Dop2 mRNA in the heads of OA1, Dop1 and Dop2 RNAi crickets were, on average, 31%, 29% and 25% of those in intact crickets. Statistical comparisons showed that the levels of OA1, Dop1 and Dop2 mRNA in OA1, Dop1 and Dop2 RNAi crickets were significantly lower than those in DsRed2 RNAi crickets (OA1: t = 3.68, df = 4.60, p = 0.017; Dop1: t = 3.09, df = 8.26, p = 0.014; Dop2: t = 2.31, df = 15.28, p = 0.035, two sample t-test with Welch’s correction). All RNAi crickets exhibited normal viability and their locomotor activities and feeding behaviors were not distinguishable from those of intact animals. Evidence suggesting intact sensory and motor functions of those RNAi crickets is described below.
Effects of the suppression of OA1, Dop1 and Dop2 genes on acquisition and retention in appetitive conditioning
We then studied the effects of gene silencing by RNAi on acquisition and retention performances in appetitive olfactory conditioning. We used conditioning of maxillary palpi extension response (MER) for evaluation of the conditioning effect8. We have reported that presentation of peppermint or apple odor to the antennae of crickets rarely (in less than 20% of crickets) induces MER and that pairing of each odor with water leads to an increase in the probability of MER8.
We first studied acquisition performance in appetitive conditioning in groups of crickets injected with dsRNA. Four groups of crickets were injected with 20 pmol dsRNA of OA1, Dop1, Dop2 or DsRed2. Two days after the injection, they were subjected to 4-trial conditioning to associate an odor with water reward with inter-trial intervals of 5 min. The absence or presence of MER to 3-sec odor (CS) presentation prior to presentation of water (US) was recorded (Fig. 3a).
All groups exhibited significant increases in the percentages of MER to the CS with increasing the number of conditioning trials (Fig. 4a, Cochran’s Q test: OA1: χ2 = 9.8, p = 0.02; Dop1: χ2 = 32.3, p = 0.00000046; Dop2: χ2 = 32.2, p = 0.00000048; DsRed2: χ2 = 31.9, df = 3, p = 0.00000056). Between-group comparison, however, showed that the percentage of MER to the CS in the OA1 RNAi group was significantly lower than that in the control (DsRed2 RNAi) group in the 4th trial (i.e., after the third training, see Fig. 3) (Fisher’s exact test, adjusted by Holm’s method: p = 0.012, sample numbers shown in the figure). In contrast, the percentages of MER to the CS in the Dop1 and Dop2 RNAi groups did not significantly differ from that in the DsRed2 RNAi group (Fisher’s exact test, adjusted by Holm’s method: Dop1: p = 0.781, Dop2: p = 0.189). The results indicate that silencing of OA1 significantly reduces acquisition in appetitive learning, but that of Dop1 or Dop2 does not. Impairment of appetitive learning by silencing of OA1 is not due to impairment of the perception of water US, because the crickets exhibited MER to a drop of water applied to the mouth or palpi. Moreover, perception of CS and behavioral responses to the CS are intact in the OA1 RNAi crickets, as evidenced by their intact aversive learning described below.
Next, retention performance was tested at 30 min after 4-trial appetitive conditioning. The Dop1, Dop2 and DsRed2 RNAi groups exhibited high percentages (more than 70%) of MER to the odor paired with the US (paired odor or CS) and the percentages were significantly greater than those of MER to the odor not used in training (novel odor) (Fig. 4b, McNemar’s test: Dop1: χ2 = 11.1, df = 1, p = 0.0000013; Dop2: χ2 = 9.09, p = 0.0026; DsRed2: χ2 = 19, p = 0.0000013). In the OA1 RNAi group, on the other hand, percentage of MER to the CS did not significantly differ from that to the novel odor (χ2 = 0, p = 1). Thus, the Dop1 and Dop2 RNAi groups exhibited normal retention of CS-specific appetitive memory, but the OA1 RNAi group did not.
Effects of the suppression of OA1, Dop1 and Dop2 genes on acquisition and retention in aversive conditioning
In aversive conditioning experiment, we used vanilla or maple odor, to which crickets exhibited high percentages (more than 70%) of MER8. We observed that repeated presentation of these odors alone led to a decrease of MER percentages8, obviously due to habituation. In order to discriminate pairing-specific decrement in percentages of MER due to aversive conditioning from this non-associative effect, we used a differential conditioning procedure in which one of the two odors was paired with 20% sodium chloride solution (paired odor) and the other was presented alone (unpaired control odor) (Fig. 3b)8 and the percentages of MER to the paired and unpaired odors were statistically compared.
Four groups of crickets were injected with dsRNA of OA1, Dop1, Dop2 or DsRed2 and two days later they received 4-trial differential aversive conditioning training with 5-min inter-trial intervals (Fig. 3). The percentages of MER to the unpaired odor significantly decreased with the increase of the trial number in the OA1, Dop1 and Dop2 RNAi groups (Cochran’s Q test: OA1: χ2 = 22.6, p = 0.000050; Dop1: χ2 = 11.6, p = 0.0088; Dop2: χ2 = 26.6, p = 0.0000071). DsRed2 RNAi group also showed a decrease of percentages of MER to the unpaired control odor, but the decrease was not statistically significant (χ2 = 3.5, df = 3, p = 0.317). This was obviously due to a slightly lower percentage of MER in the first trial, which appeared to reflect incidental data variation due to small sample size.
Percentages of MER to the paired odor significantly decreased with progress of training in all groups (Fig. 5, Cochran’s Q test: OA1: χ2 = 59.9, p = 0.00000000000062; Dop1; χ2 = 13.7, p = 0.0034; Dop2: χ2 = 57.5, p = 0.0000000000020; DsRed2: χ2 = 24.1, df = 3, p = 0.000023). In OA1, Dop2 and DsRed RNAi groups, percentages of MER to the paired odor were significantly lower than those to the unpaired odor in the 3rd trial (McNemar’s test: OA1: χ2 = 4.57, p = 0.033; Dop2: χ2 = 9.31, p = 0.0023, DsRed2: χ2 = 4.5, df = 1, p = 0.033) and 4th trial (OA1: χ2 = 5.4, p = 0.020; Dop2: χ2 = 12, p = 0.00053; DsRed2: χ2 = 6.4, p = 0.011), indicating that aversive conditioning is successful. In the Dop1 RNAi group, on the other hand, the percentages of MER to the paired odor did not significantly differ from those to the unpaired odor in the 3rd trial (McNemar’s test: χ2 = 0.29, p = 0.59) and 4th trial (χ2 = 0.25, p = 0.62). The results suggest that silencing of Dop1, but not that of OA1 or Dop2, impairs acquisition in aversive conditioning.
Retention performance was tested at 30 min after 4-trial differential aversive conditioning. The OA1, Dop2 and DsRed2 RNAi groups exhibited significantly lower percentages of MER to the CS (paired odor) than to the unpaired odor (Fig. 5, McNemar’s test: OA1: χ2 = 4.5, p = 0.034; Dop2: χ2 = 7,14, p = 0.0075; DsRed2: χ2 = 9, df = 1, p = 0.0027). In the Dop1 RNAi group, on the other hand, the percentages of MER to the paired odor did not significantly differ from those to the unpaired odor (McNemar’s test, χ2 = 0.29, p = 0.59). Thus, the OA1 and Dop2 RNAi groups exhibited normal retention of CS-specific aversive memory, but the Dop1 RNAi group did not.
Discussion
There has been a discrepancy in the results of studies on neurotransmitters mediating reinforcement signals in crickets and fruit-flies and the purpose in this study was to fully resolve the discrepancy. Results of studies using transgenic fruit-flies have suggested that different types of dopamine neurons mediate both appetitive and aversive reinforcement signals via the Dop1 receptor12,13,14,15,16,34,35. On the other hand, results of our pharmacological studies have suggested that octopamine and dopamine mediate appetitive and aversive reinforcement signals in crickets3,4,5,6,7,8,36. In accordance with this, moreover, our recent study using Dop1-knockout crickets showed that they are defective in aversive learning but not in appetitive learning19. The results of that study, however, were not conclusive, since the aversive learning defects may be due to defects in the development of brain circuitry.
In this study, we observed that OA1, Dop1 and Dop2 RNAi crickets exhibited ca. 70–75% reduction in expression levels of these genes. These results suggest that silencing of the expression of these genes is successful, though we could not determine amounts of these receptor proteins in the brains of dsRNA-injected crickets because antibodies against these receptors were not available. We observed that Dop1-silenced crickets exhibited impairment of aversive learning but not appetitive learning, whereas OA1-silenced crickets exhibited impairment of appetitive learning but not aversive learning. The impairments in RNAi crickets were not due to defects of odor (CS) or water (US) perception or motor function necessary for performance of MER, because the Dop1-silenced crickets exhibited normal appetitive MER conditioning and the OA1-silenced crickets exhibited normal aversive conditioning. It can be argued that different experimental procedures for appetitive and aversive conditioning (absolute or differential conditioning and the use of different odors) might be the reason for the different effects of Dop1 and OA1 gene silencing. However, this is unlikely because we previously showed that effects of dopamine and octopamine receptor antagonists are conserved among experiments with an absolute or differential conditioning procedure and among different kinds of odors used as the CS (see discussion in ref. 8). The consistency between the results of the present gene silencing study with those of the pharmacological and Dop1 gene knockout study using CRISPR/Cas9 (cited above) strongly suggests that dopamine mediates aversive reinforcement via Dop1 receptors and octopamine mediates appetite reinforcement via OA1 receptors in associative learning in crickets.
Our observation that silencing of OA1 but not that of Dop1 or Dop2 impairs appetitive learning suggests that impairment of appetitive learning by administration of octopamine receptor antagonists observed in our previous studies3,4,5,6 is due to their effect on OA1 receptor. We observed that epinastine and mianserin impair appetitive learning but not aversive learning and, since these drugs are known as potent antagonists of insect octopamine receptors37,38, we suggested that octopamine mediates appetitive reinforcement but not aversive reinforcement. A recent study in honey bees, however, suggested that these drugs antagonize not only OA1 but also Dop239, which raised the possibility that the impairment might be mediated by blockade of the Dop2 receptor, instead of or in addition to the OA1 receptor. The finding in the present study that silencing of Dop2 does not impair appetitive learning refutes this possibility.
Our suggestion that OA1 but not Dop1 mediates appetitive reinforcement with water reward in crickets fundamentally differs from the suggestion based on results of studies using transgenic fruit-flies that Dop1 mediates appetitive reinforcement with sucrose or water reward in addition to aversive reinforcement12,13,14,15,16,34,35. The different conclusions regarding neurotransmitters mediating appetitive reinforcement obtained in studies on crickets and fruit-flies cannot be ascribed to a slight difference in conditioning and testing procedures (see discussion in ref. 8). We thus conclude that neurotransmitters mediating appetitive reinforcement indeed differ in crickets and fruit flies, whereas those for aversive reinforcement are the same.
The results of our studies in crickets raise a question about the diversity and evolution of reinforcement systems for associative learning among animals. There is evidence suggesting that dopamine neurons mediate appetitive reinforcement in mammals1,2, mollusks40 and fruit-flies14,15, whereas octopamine neurons have been suggested to mediate appetitive reinforcement in honey bees9,10. The diversity of neurotransmitters mediating appetitive reinforcement among invertebrates and vertebrates should emerge as a fascinating research subject.
The fact that appetitively reinforcing neurons in mammals and crickets use different neurotransmitters may indicate that they mediate different information for reinforcement. Results of our recent study, however, suggested that the signals that these neurons mediate are conserved between mammals and crickets. In mammals, it has been shown that whether appetitive learning occurs is determined by the discrepancy, or error, between the predicted reward and the actual reward41 and that certain classes of midbrain dopamine neurons mediate reward prediction errors1,2. In crickets, our behavioral and pharmacological studies suggest that octopamine neurons mediate reward prediction error33. We are currently investigating whether dopamine neurons mediate punishment prediction error in aversive learning in crickets.
We found no impairment in appetitive or aversive learning in Dop2 RNAi crickets. Since we did not evaluate to what extent the level of Dop2 protein is reduced in Dop2 RNAi crickets and since Dop2 is known to be expressed in some Kenyon cells in crickets24, more studies are needed to examine the possibility that Dop2 plays some roles in olfactory learning and memory. Insects possess several types of octopamine and dopamine receptors other than Dop1, Dop2 and OA125,26,27. Expression of these genes in the cricket brain and the possible participation of these receptors in learning and memory remain as subjects of our future study.
There is dense expression of Dop1 mRNA in Kenyon cells of crickets24. A high expression level of OA1 mRNA in Kenyon cells of the mushroom body has been reported in the fruit-fly31 and honey bee32 and there is an urgent need to confirm this in crickets. The mushroom body is known to play critical roles in olfactory learning in fruit-flies29, honey bees30, cockroaches42 and crickets43. Anatomical and physiological characterization of dopaminergic and octopaminergic neurons that make synapses with Kenyon cells is the next step for elucidation of the neural mechanisms of appetitive and aversive learning in crickets.
We conclude that the neurotransmitter and the receptor mediating appetitive reinforcement signals differ in crickets and fruit-flies. This urges us to examine neurotransmitter mechanisms for associative learning in different species of insects to evaluate the diversity and evolution, of reinforcing mechanisms in insects. Moreover, consideration of the ubiquity and diversity of reinforcing mechanisms for associative learning in vertebrates and invertebrates should become an important research subject in neuroscience.
Methods
Insects
Adult male crickets, Gryllus bimaculatus, at 1–2 weeks after the imaginal molt were used. They were reared in a 12 h: 12 h light : dark cycle at 27 ± 2 °C and were fed a diet of insect pellets and water ad libitum. Four days before the start of the learning trials, crickets were individually placed in 100-ml glass beakers and fed a diet of insect pellets ad libitum but deprived of drinking water to enhance their motivation to search for water.
cDNA cloning of the octopamine receptor gene
We cloned a cDNA fragment containing the partial open reading frame (ORF) of the OA1 octopamine receptor gene by reverse transcriptase polymerase chain reaction (RT-PCR). Total RNA was extracted from the heads of 6th instar nymphs using ISOGEN (Wako, Japan). This allows faster RNA extraction than that from isolated brains since isolation of the brains takes time due to their small size. cDNA was synthesized using the SuperScript III First-Strand Synthesis System (Invitrogen, Carlsbad, CA, UAS). In order to design gene-specific primers to clone a partial cDNA of the OA1 gene, we searched the cricket genome database (unpublished data) and the following oligonucleotide primers were designed. OA1 Fw (5′-TTCATGAGCTCCAAGCTGCG-3′) and OA1 Rv (5′-AAGAGCGCGTAGATGCAGGG-3′). RT-PCR was performed on this cDNA using LA Taq DNA polymerase (Takara, Japan) and the reaction conditions were 94 °C, 2 min for one cycle; 94 °C, 30 s, 55 °C, 30 sec, 72 °C, 1 min for 40 cycles; and then 72 °C, 5 min for one cycle. The PCR product (1544 bp) was subcloned into a pGEM T-Easy vector (Promega, Madison, Wisconsin, USA) and sequenced using ABI-300.
RNA interference experiments
The procedures for RNAi experiments in this study were according to previous studies21,24 with a slight modification. Double-stranded RNAs (dsRNAs) of Dop1 and Dop2 (Gb’DopRI and Gb’DopRII)23,24, OA1 and Discosoma sp. red fluorescent protein 2 (DsRed2) were synthesized from the corresponding PCR fragments amplified with primers containing the T7 promoter, using the MEGA-script Kit (Applied Biosystems Inc., Foster City, CA). The primer sequences are: OA1 dsRNA T7-Fw, 5′-TAATACGACTCACTATAGGG AACAAGCCCAAGCTCATCTCG-3′; OA1 dsRNA T7-Rv, 5′-TAATACGACTCACTATAGGG TTGATGGCGGAGTTGCAGTA-3′; Dop1 dsRNA T7-Fw, 5′-TAATACGACTCACTATAGGG GGTGTGCGTGGCCATCTA-3′; Dop1 dsRNA T7-Rv, 5′-TAATACGACTCACTATAGGG TCCTTGATGTGGATGTAGCG-3′; Dop2 dsRNA T7-Fw, 5′-TAATACGACTCACTATAGGG GTCCTCCTGCTGCTGTTCTC-3′; Dop2 dsRNA T7-Rv, 5′-TAATACGACTCACTATAGGG ATGACGCACAGGTTGAGGAT-3′.
The dsRNA regions for OA1, Dop1 and Dop2 genes are shown in Fig. 1. DsRed2 dsRNA from pDsRed2-N1 (Clontech Laboratories, Inc., Palo Alto, CA) was used as a control. Their target sizes are 233 bp for OA1, 252 bp for Dop1, 272 bp for Dop2 and 660 bp for DsRed2. There were some degree of overlap in DNA sequence between Dop1 and Dop2 dsRNA regions: The sequence of Dop1 target region has 71% identity to that of Dop2 and that of Dop2 target region has 69% identity to that of Dop1 in maximum. However, we observed that aversive learning is impaired in Dop1 dsRNA-injected crickets but not in Dop2 dsRNA-injected crickets (see Results section), indicating that cross-reaction, if occurred, is weak.
We performed blast searches using all of the designed dsRNA sequences against the DDBJ database, which includes G. bimaculatus EST (cDNAs from early embryos and regenerating nymphal legs, 10,656 sequences) and HTC (high-throughput cDNA sequences from whole bodies of 1st–8th instar nymphs, 32,010 sequences) data, as well as other isolated Gb cDNA sequences. Our searches did not identify significant matches of the OA1, Dop1 or Dop2 dsRNA sequences with any deposited Gb sequences other than the target sequences. After the RNA synthesis, the samples were purified, boiled and gradually cooled down to room temperature for their annealing.
For RNAi experiment, 2 μl of 10 μM dsRNA solution suspended in RNase-free water, was injected into the head hemolymph of each cricket, the method of which is illustrated in Supplementary Figure S1. The cricket injected with dsRNA was individually placed in a beaker for two days until the test of the effect. The amount of injection of dsRNA and the time interval between dsRNA injection and the test were determined based on our previous study22.
Real-time quantitative PCR (qPCR)
Two days after the injection, the heads of crickets were isolated and then homogenized to extract their total RNA using ISOGEN (NIPPON GENE Co., Ltd). The extracted total RNA was reverse-transcribed to cDNA using Superscript-III reverse transcriptase and random hexamers (Invitrogen). For qPCR, primers were designed with Primer Express™ software (Applied Biosystems Inc.). The qPCR was performed using SYBR Green PCR Master Mix (Applied Biosystems Inc.) or THUNDERBIRD SYBR qPCR Mix (ToYoBo Co., Ltd) on a ABI 7300 Real Time PCR System (Applied Biosystems Inc.) under the following conditions: 10 min at 95 °C and then 40 cycles of 15 s at 95 °C, 30 s at 60 °C and 30 s at 72 °C. ß-actin was used as an endogenous reference to calculate the relative expression levels of target genes. Dop1, Dop2 and OA1 to ß-actin ratios were determined by the comparative Ct method44. The qPCR primer sequences are listed below:
OA1 Fw, 5′-GCCCTTCTTCACCATGTACG-3′;
OA1 Rv, 5′-GTAGATGCAGGGGTTGATGG-3′;
Dop1 Fw, 5′-ATCAAGGACCCGCTCAGGTA-3′;
Dop1 Rv, 5′-CTCCAGCAGCCACACCAC-3′;
Dop2 Fw, 5′-GAAGAAGGCGGCTAAGACCT-3′;
Dop2 Rv, 5′-ACAGCCGACACCAATTCTTC-3′;
β-actin Fw, 5′-TTGACAATGGATCCGGAATGT-3′;
β-actin Rv, 5′-AAAACTGCCCTGGGTGCAT-3′.
Olfactory conditioning of MER
The procedures for evaluation of olfactory conditioning of maxillary palpi extension response (MER) have been reported elsewhere8. Crickets tend to extend their maxillary palpi and vigorously swing them when water is applied to the antennae and when they perceive some but not other odors, which we refer to as MER. High percentages of crickets exhibited MER to vanilla and maple odors but exhibited MER only rarely to apple or peppermint odor and the former odors were used for appetitive conditioning experiment, while the latter odors were used for the aversive conditioning experiment8. Hypodermic syringes (1 ml each) were used to apply CS and US. A small filter paper (3 mm × 3 mm) was attached to the needle of syringe at 10 mm from its tip. The syringe was filled with water (reward) or 20% sodium chloride solution (punishment). The filter paper attached to the needle was soaked with odor essence.
We used an absolute appetitive conditioning procedure for appetitive learning and a differential conditioning procedure for aversive learning, since these are the most effective procedures and since we have shown that neurotransmitters involved in appetitive or aversive conditioning did not differ regardless of the conditioning procedure being absolute or differential8. For absolute appetitive conditioning, the filter paper was placed within ~1 cm of the antennae of the cricket for 6 sec and then a drop of water (US) was presented to the mouth for 3 sec (3-sec overlap) four times each with an inter-stimulus interval (ITI) of 5 min. For differential aversive conditioning, a 6-sec CS presentation was similarly followed by 3-sec presentation of sodium chloride solution (US) and another odor was presented alone without pairing with the US four times each with a 5-min ITI. The sequence of the paired trial and unpaired trials was pseudo-randomized. The presence or the absence of MER for the 3-sec period from the onset of CS presentation was recorded.
Retention test
The procedure for the retention test has been described8. For evaluation of retention performance after absolute appetitive conditioning, the percentage of MER to the odor used in training (paired odor) was compared to that to an odor not used in training (novel odor). The odors were presented for 5 sec each with 5-min intervals and the presence or absence of an MER was recorded. For evaluation of retention after differential aversive conditioning, the percentage of MER to the odor paired with the US (paired odor) was compared to that to the odor presented alone (unpaired odor). After the last odor presentation in the test, a drop of water was attached to the mouth or an antenna and the resulting MER was tested. Crickets that did not exhibit an MER to water US were not used for data evaluation. Crickets discarded by this criterion were less than 3% in total.
Analysis of behavioral data
We scored the presence or absence of MER to odor presentation in training and in retention tests as reported previously8. Data in each group were evaluated by calculating the percentage of MER as the number of crickets that exhibited MER to an odor in the total number of crickets studied. Cochran’s Q test was used for comparison of percentages of MER to an odor with the progress of training in acquisition. McNemar’s test was used for pairwise comparison of percentages of MER to two odors in the same group and Fisher’s exact test was used for pairwise comparison of percentages of MER to an odor in acquisition in different groups. The post-hoc Holm’s method was used to adjust the P value when comparing among more than three groups.
Additional Information
How to cite this article: Awata, H. et al. Roles of OA1 octopamine receptor and Dop1 dopamine receptor in mediating appetitive and aversive reinforcement revealed by RNAi studies. Sci. Rep. 6, 29696; doi: 10.1038/srep29696 (2016).
References
Schultz, W. Behavioral theories and the neurophysiology of reward. Annu. Rev. Psychol. 57, 87–115 (2006).
Schultz, W. Updating dopamine reward signals. Curr. Opin. Neurobiol. 23, 229–238 (2013).
Unoki, S., Matsumoto, Y. & Mizunami, M. Participation of octopaminergic reward system and dopaminergic punishment system in insect olfactory learning revealed by pharmacological study. Eur. J. Neurosci. 22, 1409–1416 (2005).
Unoki, S., Matsumoto, Y. & Mizunami, M. Roles of octopaminergic and dopaminergic neurons in mediating reward and punishment signals in insect visual learning. Eur. J. Neurosci. 24, 2031–2038 (2006).
Nakatani, Y. et al. Why the carrot is more effective than the stick: Different dynamics of punishment memory and reward memory and its possible biological basis. Neurobiol. Learn. Mem. 92, 370–380 (2009).
Mizunami M. et al. Roles of octopaminergic and dopaminergic neurons in appetitive and aversive memory recall in an insect. BMC Biol. 7, 46 (2009).
Matsumoto, Y., Hirashima, D. & Mizunami, M. Analysis and modeling of neural processes underlying sensory preconditioning. Neurobiol. Learn. Mem. 101, 103–113 (2013).
Matsumoto, Y., Matsumoto, C. S., Wakuda, R., Ichihara, S. & Mizunami, M. Roles of octopamine and dopamine in appetitive and aversive memory acquisition studied in olfactory conditioning of maxillary palpi extension response in crickets. Front. Behav. Neurosci. 9, 230 (2015).
Hammer, M. R. & Menzel, R. Multiple sites of associative odor learning as revealed by local brain microinjections of octopamine in honeybees. Learn. Mem. 5, 146–156 (1998).
Farooqui, T., Robinson, K., Vaessin, H. & Smith, B. H. Modulation of early olfactory processing by an octopaminergic reinforcement pathway in the honeybee. J. Neurosci. 23, 5370–5380 (2003).
Vergoz, V., Roussel, E., Sandoz, J. C. & Giurfa, M. Aversive learning in honeybees revealed by the olfactory conditioning of the sting extension reflex. PLoS One 2, e288 (2007).
Kim, Y. C., Lee, H. G. & Han, K. A. D1 dopamine receptor dDA1 is required in the mushroom body neurons for aversive and appetitive learning in Drosophila. J Neurosci. 27, 7640–7647 (2007).
Selcho, M., Pauls, D., Han, K. A., Stocker, R. F. & Thum, A. S. The role of dopamine in Drosophila larval classical olfactory conditioning. PLoS One 4, e5897 (2009).
Liu, C. et al. A subset of dopamine neurons signals reward for odour memory in Drosophila. Nature 488, 512–516 (2012).
Burke, C. J. et al. Layered reward signalling through octopamine and dopamine in Drosophila. Nature 492, 433–437 (2012).
Lin, S. et al. Neural correlates of water reward in thirsty Drosophila. Nat. Neurosci. 17, 1536–1542 (2014).
Kim, Y. C., Lee, H. G., Lim, J. & Han, K. A. Appetitive learning requires the alpha1-like octopamine receptor OAMB in the Drosophila mushroom body neurons. J. Neurosci. 33, 1672–1677 (2013).
Cong, L. et al. Multiplex genome engineering using CRISPR/Cas systems. Science 339, 819–823 (2013).
Awata, H. et al. Knockout crickets for the study of learning and memory: Dopamine receptor Dop1 mediates aversive but not appetitive reinforcement in crickets. Sci. Rep. 5, 15885 (2015).
Niwa, N. et al. Correlation of diversity of leg morphology in Gryllus bimaculatus (cricket) with divergence in dpp expression pattern during leg development. Development 127, 4373–4381 (2000).
Shinmyo, Y. et al. Brachyenteronis necessary for morphogenesis for the posterior gut but not for anteroposterior axial elongation from the posterior growth zone in the intermediate-germband cricket Gryllus bimaculatus. Development 133, 4539–4547 (2006).
Takahashi, T. et al. Systemic RNA interference for the study of learning and memory in an insect. J. Neurosci. Methods 179, 9–15 (2009).
Watanabe, T., Sadamoto, H. & Aonuma, H. Molecular basis of the dopaminergic system in the cricket Gryllus bimaculatus. Invert. Neurosci. 13, 107–123 (2013).
Hamada, A. et al. Loss-of-function analyses of the fragile X-related and dopamine receptor genes by RNA interference in the cricket Gryllus bimaculatus. Dev. Dyn. 2238, 2025–2033 (2009).
Mustard, J. A., Beggs, K. T. & Mercer, A. R. Molecular biology of the invertebrate dopamine receptors. Arch. Insect Biochem. Physiol. 9, 103–117 (2005).
Scheiner, R., Baumann, A. & Blenau, W. Aminergic control and modulation of honeybee behaviour. Curr. Neuropharmacol. 4, 259–276 (2006).
Balfanz, S. et al. Molecular, pharmacological and signaling properties of octopamine receptors from honeybee (Apis mellifera) brain. J. Neurochem. 129, 284–296 (2014).
Giurfa, M. Behavioral and neural analysis of associative learning in the honeybee: a taste from the magic well. J. Comp. Physiol. A 193, 801–824 (2007).
Davis, R. L. Traces of Drosophila memory. Neuron 70, 8–19 (2011).
Menzel, R. The honeybee as a model for understanding the basis of cognition. Nat. Rev. Neurosci. 13, 758–768 (2012).
Han, K. A., Millar, N. S. & Davis, R. L. A novel octopamine receptor with preferential expression in Drosophila mushroom bodies. J. Neurosci. 18, 3650–3658 (1998).
McQuillan, H. J., Nakagawa, S. & Mercer, A. R. Mushroom bodies of the honeybee brain show cell population-specific plasticity in expression of amine-receptor genes. Learn. Mem. 19, 151–158 (2012).
Terao, K., Matsumoto, Y. & Mizunami, M. Critical evidence for the prediction error theory in associative learning. Sci. Rep. 5, 8929 (2015).
Waddell, S. Reinforcement signalling in Drosophila; dopamine does it all after all. Curr. Opin. Neurobiol. 23, 324–329 (2013).
Yamagata, N. et al. Distinct dopamine neurons mediate reward signals for short- and long-term memories. Proc. Natl. Acad. Sci. USA 112, 578–583 (2015).
Mizunami, M., Hamanaka, Y. & Nishino, H. Toward elucidating diversity of neural mechanisms underlying insect learning. Zool. Lett. 1, 8 (2015).
Roeder, T., Degen, J. & Gewecke, M. Epinastine, a highly specific antagonist of insect neuronal octopamine receptors. Eur. J. Pharmacol. 349, 171–177 (1998).
Degen, J., Gewecke, M. & Roeder, T. Octopamine receptors in the honey bee and locust nervous system: pharmacological similarities between homologous receptors of distantly related species. Br. J. Pharmacol. 130, 587–594 (2000).
Beggs, K. T., Tyndall, J. D. & Mercer, A. R. Honey bee dopamine and octopamine receptors linked to intracellular calcium signaling have a close phylogenetic and pharmacological relationship. PLoS One 6, e26809 (2011).
Brembs, B. et al. Operant reward learning in Aplysia: neuronal correlates and mechanisms. Science 296, 1706–1709 (2002).
Rescorla, R. A. & Wagner, A. R. A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement Classical Conditioning II, [ Black, A., Prokasy, W. R. (eds.)]. [64–99] (Academic Press, New York, 1972).
Watanabe, H., Matsumoto, S. C., Nishino, H. & Mizunami, M. Critical roles of mecamylamine-sensitive mushroom body neurons in insect olfactory learning. Neurobiol. Learn. Mem. 95, 1–13 (2011).
Scotto-Lomassese, S. et al. Suppression of adult neurogenesis impairs olfactory learning and memory in an adult insect. J. Neurosci. 23, 9289–9296 (2003).
Winer, J., Jung, C. K., Shackel, I. & Williams, P. M. Development and validation of real-time quantitative reverse transcriptase-polymerase chain reaction for monitoring gene expression in cardiac myocytes in vitro. Anal. Biochem. 270, 41–49 (1999).
Acknowledgements
This study was supported by Grants-in-Aid for Scientific Research from the Ministry of Education, Science, Culture, Sports and Technology of Japan (No. 24370030, 24657049 to MM and No. 25650080, 26292176 to TM) and that for JSPS fellows (No. 15J01414 to KT).
Author information
Authors and Affiliations
Contributions
T.M., S.N. and M.M. designed the research. H.A., R.W., Y.I., Y. Matsuoka, S.K., K.T., Y. Matsumoto and Y.H. performed experiments. H.A., T.M. and M.M. wrote the paper. All authors read and approved the final manuscript.
Ethics declarations
Competing interests
The authors declare no competing financial interests.
Electronic supplementary material
Rights and permissions
This work is licensed under a Creative Commons Attribution 4.0 International License. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in the credit line; if the material is not included under the Creative Commons license, users will need to obtain permission from the license holder to reproduce the material. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/
About this article
Cite this article
Awata, H., Wakuda, R., Ishimaru, Y. et al. Roles of OA1 octopamine receptor and Dop1 dopamine receptor in mediating appetitive and aversive reinforcement revealed by RNAi studies. Sci Rep 6, 29696 (2016). https://doi.org/10.1038/srep29696
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/srep29696
- Springer Nature Limited
This article is cited by
-
Conditioned taste aversion in the cricket Gryllus bimaculatus
Scientific Reports (2022)
-
Spontaneous recovery from overexpectation in an insect
Scientific Reports (2022)
-
Appetitive and aversive social learning with living and dead conspecifics in crickets
Scientific Reports (2020)
-
Tyrosine hydroxylase-immunoreactive neurons in the mushroom body of the field cricket, Gryllus bimaculatus
Cell and Tissue Research (2019)
-
Aversive gustatory learning and perception in honey bees
Scientific Reports (2018)