Behavioral flexibility for appropriate action selection is an advantage when animals are faced with decisions that will determine their survival or death. In order to arrive at the right decision, animals evaluate information from their external environment, internal state, and past experiences. How these different signals are integrated and modulated in the brain, and how context- and state-dependent behavioral decisions are controlled are poorly understood questions. Studying the molecules that help convey and integrate such information in neural circuits is an important way to approach these questions. Many years of work in different model organisms have shown that dopamine is a critical neuromodulator for (reward based) associative learning. However, recent findings in vertebrates and invertebrates have demonstrated the complexity and heterogeneity of dopaminergic neuron populations and their functional implications in many adaptive behaviors important for survival. For example, dopaminergic neurons can integrate external sensory information, internal and behavioral states, and learned experience in the decision making circuitry. Several recent advances in methodologies and the availability of a synaptic level connectome of the whole-brain circuitry of Drosophila melanogaster make the fly an attractive system to study the roles of dopamine in decision making and state-dependent behavior. In particular, a learning and memory center—the mushroom body—is richly innervated by dopaminergic neurons that enable it to integrate multi-modal information according to state and context, and to modulate decision-making and behavior.
Making the right decision at the right time is very important for animal survival. These decision-making events are particularly crucial when animals are navigating their complex and dynamic environment for food, mates, breeding sites, or to escape from predators. In order to make decisions, for instance whether to turn, stop, or continue, animals usually evaluate signals from their current external environment and internal state, and integrate them with their past experiences or innate priors. As the environment and context changes and the internal needs fluctuate, animals are constantly making and updating decisions to adapt to both the environment and to their own behavioral state for survival. Because of this, every animal goes through decision-making processes many times a day and innumerable times in their life time. Most of the time, decisions have to be made instantaneously forcing animals to decide quickly and with a low margin of error. A flexible state-dependent decision-making ability thus provides essential adaptability to animals in their environment. Behavioral manifestations of decisions appear simple (e.g., eat, mate, escape, forage), yet the neural mechanisms by which state, context, and experience are integrated to enable flexible decision making involve complex and shared neural circuits in higher brain centers.
Neuromodulation is an excellent way to achieve neuronal and circuit flexibility—and thereby behavioral modification—at different levels and for different timescales by integrating multiple signals and reconfiguring circuits (Bargmann 2012; Bargmann and Marder 2013; Dayan 2012; Marder 2012). These modulations are enabled in animal nervous systems by several, evolutionarily conserved, neuromodulators including biogenic amines, neuropeptides, and neurotransmitters. They can work in concert or independently, locally or globally, and affect different synaptic properties of pre- or postsynaptic neurons to achieve neuromodulation (Marder 2012; Taghert and Nitabach 2012). Dopamine is one such molecule that has multiple, partially conserved, neuromodulatory functions in animal nervous systems (Scaplen and Kaun 2016; Watabe-Uchida and Uchida 2018). Dopamine is a ubiquitous molecule found in a wide spectrum of life forms from microorganisms to humans. It is a biogenic amine biosynthesized from tyrosine. In this biosynthetic pathway, tyrosine is first converted to the intermediate molecule L-DOPA by the action of the enzyme tyrosin hydroxylase (TH), and L-DOPA is further converted to dopamine by the enzyme dopa decarboxylase (DDC) (Budnik and White 1987). Dopaminergic neurons (DANs) synthesize, store, and release dopamine as synaptic transmission or volume transmission depending on the event. While synaptic transmissions are localized events only affecting the postsynaptic target neuron, volume transmission facilitates the release of dopamine into the circulating lymph, whereby it is transported to different parts of the brain (Rice et al. 2011). Therefore, dopamine can act fast and locally as well as slower and systemically. Dopamine is involved in the regulation of voluntary locomotion, learning and memory, and the neuroendocrine axis in several animal species including humans (Berke 2018; Bjorklund and Dunnett 2007; Bromberg-Martin et al. 2010; Coddington and Dudman 2019). In addition, dopamine is associated with motivation, need, and reward (Burke et al. 2014; Ito and Doya 2015; Schultz 2015; Watabe-Uchida and Uchida 2018). DANs encode behavioral and internal states of animals as well as sensory stimuli including odors (Aimon et al. 2019; Berry et al. 2015; Cohn et al. 2015; de Jong et al. 2019; Lewis et al. 2015; Lutas et al. 2019; Menegas et al. 2018; Riemensperger et al. 2005; Siju et al. 2020; Tsao et al. 2018). In particular, recent data strongly suggest that DANs integrate and convey the value of sensory information, current internal and behavioral state to appropriate decision-making centers in the brain, and thereby aid in forming and updating behavior and memory.
Due to a high degree of functional conservation, dopamine and its role in decision-making have been studied in many animal models, from primates to simpler invertebrates. While not appropriate for all aspects of studying decision-making and behavioral adaptation, Drosophila melanogaster along with the remarkable developments in methodologies to monitor, trace, and manipulate neurons and circuits (Owald et al. 2015b), has provided some key insights into the neuronal and neural circuit mechanisms of DANs and their role in higher brain centers (e.g., Aimon et al. 2019; Berry et al. 2015; Boto et al. 2019; Cohn et al. 2015; DasGupta et al. 2014; Felsenberg et al. 2017, 2018; Groschner et al. 2018; Ichinose et al. 2017; Kaun and Rothenfluh 2017; Lewis et al. 2015; Owald et al. 2015a; Owald and Waddell 2015; Riemensperger et al. 2013, 2005; Scaplen and Kaun 2016; Siju et al. 2020; Tomchik 2013; Watabe-Uchida and Uchida 2018; Yamagata et al. 2016)). In the following sections of this review, we provide an account of studies that discuss dopamine and its modulatory role in state-dependent behavior in flies. We aim at highlighting the diverse functions of brain dopamine in adult Drosophila by discussing recent, selected examples in the literature and what they could mean for research in higher animals. This review certainly does not cover all contributions to the field, but instead a selection of works with a particular focus to illustrate the diversity of functions of dopamine.
Diverse roles and mechanisms of dopamine signaling
Pioneering immunocytochemical studies have shown that the Drosophila brain contains around 130–140 DANs present in thirteen distinct clusters per hemisphere spread across different parts of the brain (Budnik and White 1988; Mao and Davis 2009; Nässel and Elekes 1992). DAN clusters are named according to the location of their cell bodies in the brain (Fig. 1a). The majority of these clusters are found in the protocerebral area and show connections to higher brain centers such as the mushroom body (MB) and central complex (CC), which are each involved in control and modulation of several behaviors (Azanchi et al. 2013; Kasture et al. 2018; Mao and Davis 2009).
A mammalian brain contains orders of magnitudes more dopamine-producing neurons. These are mainly found in the ventral tegmental area (VTA) and substantia nigra of the midbrain. DANs from these nuclei send projections mainly to the striatum but also to other brain areas (Bjorklund and Dunnett 2007). Despite their relatively small number as compared to other neuron types, the axon of a single DAN covers a large volume of tissue and can therefore modulate a large number of neurons in its target area (Matsuda et al. 2009). Drosophila DAN axons also densely innervate the MB, in a segregated organization similar to the compartmentalization of the striatum, the main target of DANs in vertebrates (Watabe-Uchida and Uchida 2018). Though it is unlikely that DAN clusters in insect brains can be directly compared with mammalian DAN-containing brain regions, the discrete organization and small overall number of DANs and the small size of the fly brain itself allows the study of complete DAN populations and even whole brain networks.
Importantly, DANs show a remarkable degree of conservation between different species in terms of their cellular biology. In vertebrates, DANs show a continuous, albeit low rate baseline activity known as tonic firing. By contrast, stimulus driven bursting DAN activity was termed a phasic response. Typically, in most of the DANs, the phasic response appears to work as a reward prediction error: DANs fire according to a difference between the actual and the predicted reward (Schultz et al. 1997). However, subsequent work showed that some DANs respond to aversive rather than rewarding stimuli (Matsumoto and Hikosaka 2009), leading to an updated “motivational salience” model where DANs signal the detection of an important stimulus for the animal, thereby promoting a behavioral reaction, and subsequently reinforcing it if and when appropriate (Bromberg-Martin et al. 2010). By now, several additional phasic signals have been reported; in particular, many DANs appear to respond to movement even in the absence of external stimuli (Dodson et al. 2016; Howe and Dombeck 2016; Schultz 2019).
The diversity of responses, cell types, and connectivity led to the proposition of the existence of multiple, heterogeneous DAN populations and systems acting in concert to shape the animal’s behavior (Watabe-Uchida and Uchida 2018). Transient phasic responses to various sensory stimuli and during behavior are now well established in flies (Cognigni et al. 2018; Ichinose et al. 2017). As in mammals, different subsets of DANs respond to attractive or aversive stimuli (e.g., Siju et al. 2020). Furthermore, many DANs across the brain are activated during walk (Aimon et al. 2019). Similar to mammals, a response in a particular fly DAN is elicited when something novel or unexpected occurs (Hattori et al. 2017). The response rapidly decays and disappears after repeated stimulations with this odor as it becomes familiar.
In vertebrates, tonic DAN activity supposedly maintains a steady low concentration of dopamine in the target areas, and may provide a basal firing line enabling the system to signal a negative prediction error or an aversive event between actions (Bromberg-Martin et al. 2010). In addition to these different firing patterns, recent work suggests an important contribution of local regulation of dopamine concentration by the striatum local microcircuit (Berke 2018; Cover et al. 2019; Mohebi et al. 2019; Threlfell et al. 2012). This might be responsible for slow increases of dopamine concomitant to approach behavior and motivation. For technical reasons, most of the neuronal activity recordings of DANs in the fly brain have been performed using calcium imaging. As this technique relies on a relative measurement and very few electrophysiological recordings have been published so far (Pimentel et al. 2016), it is difficult to be certain of whether fly DANs display the same tonic pacemaker activity as mammalian DANs (Ichinose et al. 2017). Nonetheless, some specific DANs show slow spontaneous calcium oscillations reflecting the internal state of the animal (Aimon et al. 2019; Berry 2015; Cohn et al 2015; Placais et al. 2012; Plaçais and Preat 2013; Siju et al. 2020). This pattern resembles the slow oscillatory firing observed in the VTA of anesthetized rats in synchronization with the prefrontal cortex, a region forming reciprocal connections with the VTA (Gao et al. 2007; Shi 2005). Thus, in how far the same categorizations or theories apply to mammalian and non-mammalian models is still unclear.
Dopamine exerts its effect through different dopamine specific receptors present on the target cells. Dopamine receptors are GPCRs segregated in two major classes, D1-like and D2-like, differing in their structure, pharmacology, and their coupling to intracellular signaling cascades (Beaulieu and Gainetdinov 2011). Classically, D1-like receptors have a low affinity for dopamine and are positively coupled to the enzyme adenylyl cyclase, while D2-like receptors have a high affinity for dopamine and are negatively coupled to adenylyl cyclase. Due to their different affinities for dopamine, D1-like receptors respond better to phasic dopamine release and D2-like receptors to tonic dopamine release. Using these different modes of signaling, dopamine receptors can modulate the synaptic strength between two connected neurons both locally at the pre- and postsynaptic side as well as whole neuronal excitability per se (Tritsch and Sabatini 2012). In flies, there are four types of dopamine receptors: D1-like dopamine receptor include Dop1R1 (Dumb) and Dop1R2 (Damb), and a D2-like receptor also called as Dop2R. In addition, Drosophila also express a non-canonical receptor called DopEcR (dopamine/ecdysteroid receptor). As in mammals, fly dopamine receptors participate in different forms of synaptic plasticity (Handler et al. 2019; Modi et al. 2020). For instance, in the fly MB, Dop1R1 and Dop1R2 have been implicated in pre-synaptic depression and potentiation and in memory acquisition and forgetting, respectively (Berry et al. 2012). Even if both receptors are coupled to the adenylyl cyclase and promote the production of cAMP, this activity is primarily important for Dop1R1 and synaptic depression (Himmelreich et al. 2017). Dop1R2 is preferentially coupled to the protein Gαq and promotes the release of calcium from internal stores, leading to synaptic potentiation (Himmelreich et al. 2017). However, in the context of sleep, Dop1R2 hyperpolarizes neurons in the dorsal FB and thereby reduces sleep (Pimentel et al. 2016).
Recent large-scale single-cell transcriptomics and receptor gene expression analysis showed that the same neuron can expresses multiple receptors, for example, Kenyon cells (KCs), principle cells of the MB, harbor two or more dopamine receptor types, and sometimes all four receptors are co-expressed within the same KC axon (Croset et al. 2018; Kondo et al. 2020). Direct functional evidence of co-expression of Dop1R1 and Dop1R2 has been shown for MBON- γ1pedc, where receptors are differentially activated during successive phases of a learning protocol (Pavlowsky et al. 2018). Similarly, differential Dop1R1 and R2 activity appears to be responsible for the opposite timing-dependent effect of dopamine during aversion and relief learning (Handler et al. 2019). Therefore, it is critical to note that the strength and efficiency of neuromodulation also depends on the distribution and expression of the receptors on the target cells (Marder 2012; Marder et al. 2014). Since dopamine can act through different types of dopamine receptors, identifying the receptors that are involved and their respective signaling mechanisms is important to understand dopamine-mediated neuromodulation.
The role of dopamine in state-dependent behavior in Drosophila
The large majority of behaviors are expressed in a state-dependent manner. This state could be both internal state, e.g., metabolic state, and behavioral state, i.e., moving, resting, of an animal. Therefore, a state of an animal is not constant, but instead can change from one moment to the next, within seconds, minutes, hours, or days. Expressing appropriate state-specific behaviors is key for animal survival, for example risking one’s life for foraging only makes sense when in current or foreseeable need of food. This also explains why internal states have a fundamental impact on valence and value perception of external sensory information, and moreover, these perceptions are constantly updated according to ongoing experience and behavioral state. For instance, the value of a reward directly correlates with the animal’s need state and effort invested to obtain it (Berke 2018). Dopamine plays a key role in dynamically representing these different aspects. How exactly DANs fulfill this complex role is insufficiently understood, and fly research has helped to fill some of the gaps in our knowledge.
In flies as in many other animal species, the major internal states include the feeding state, the reproductive state, sleep and wake states, but also emotional states such as aggressiveness, which can be displayed by both males and females. How the nervous system, which ultimately controls behavior senses these metabolic, physiological or emotional states is not well understood. It was hypothesized, and experimental evidence is being gathered, that molecular signals including hormones, neuropeptides, produced by internal organs such as the gut, are being perceived by neurons in the brain. These neurons include DANs.
Chemosensory processing and perception as a model for state-dependent behavior
Several state-specific behaviors are modulated by external chemosensory inputs. One of the most studied sensory systems in flies is the chemosensory system, which comprises both olfactory and gustatory systems. Drosophila has a well-developed olfactory system that consists of peripheral olfactory organs such as antenna and maxillary palp and a main taste organ, the proboscis (legs and wings are also serve as taste organs). Olfactory receptor neurons (ORNs) and gustatory receptor neurons (GRNs) with specific receptors present in the respective organs detect the odorants and tastants, respectively, and transmit neural information to the primary processing centers called antennal lobe (AL) and subesophageal zone (SEZ) in the brain (Scott 2018; Vosshall and Stocker 2007; Wilson 2013). Processed sensory information from the primary olfactory centers are carried by PNs to higher brain centers (Bates et al. 2020). Higher chemosensory brain centers consist of two main structures, the lateral horn (LH) and mushroom body (MB). The LH is considered to be a brain structure that controls innate behaviors (Dolan et al. 2018; Jefferis et al. 2007; Strutz et al. 2014), while the other higher brain center, MB, is involved behavioral adaptation, including learning and memory, and predominantly receives olfactory information (Aso et al. 2014; Heisenberg, 2003; Li et al. 2020a; Modi et al. 2020).
Taste-related motor programs are mostly processed directly at the SEZ. So far, only a few taste PNs to the higher brain areas have been identified (Kim et al. 2017, Li et al. 2020a, Scott 2018). In addition, a previous study showed that taste is also represented in the MB as sparse coding (Kirkhart and Scott 2015).
Dopaminergic neurons of the mushroom body
As described above, several nuclei or clusters of DANs are found in insect brains (Fig. 1). These DANs innervate different areas of the protocerebrum, the CC, and the MB. DANs in the insect protocerebrum have, for example, been implicated in reproduction and sex-specific behaviors of flies (Kuo et al. 2015). Nevertheless, the by far best studied DANs innervate the insect MBs. In parallel to the many studies on the role of the MB in associative (olfactory) memory formation, several recent studies in Drosophila, involving high resolution anatomy, neuronal manipulation, and behavioral analysis have elucidated how MB guide decisions and adapt ongoing behavior (Modi et al. 2020). Drawing heavy parallels from vertebrate studies, the complexity in the circuitry, and convergence of information from different sensory modalities and internal states, the MB possesses all the features of an important state-dependent decision-making center.
Looking at the structural and functional organization of the Drosophila MB led to multiple comparisons to vertebrate brain centers in addition to the already mentioned basal ganglia. Recent development of genetic tools and high-resolution anatomical characterization, both at the light microscopic and electron microscopic level, showed a high level of cellular complexity, circuit connections, and computational power of the MB (Aso et al. 2014, Li et al. 2020b, Takemura et al. 2017, Zheng et al. 2018). One cannot help but notice the striking organizational similarities between the MB and the vertebrate cerebellum (Litwin-Kumar et al. 2017; Modi et al. 2020). Similar to cerebellar granule cells, the axons of around 2000 KCs per hemisphere project as thick bundles of parallel fibers to form the backbone of the MB. The axon bundles form three main lobes, α/α', β/β', and γ (Crittenden et al. 1998). These three lobes form the characteristic MB structure with vertical and horizontal lobes (Fig. 1b). α/α' form the vertical lobe structures, and β/β' and γ together form horizontal lobes (Aso et al. 2014). The cholinergic KC somas form the calyx of the MB, and their dendrites receive sensory inputs predominantly from olfactory PNs (Barnstedt et al. 2016; Vosshall and Stocker 2007; Wilson 2013) and additional inputs from gustatory, thermal and hygrosensory (Marin et al. 2020), and visual centers (Kirkhart and Scott 2015; Scott 2018; Vogt et al. 2016; Yagi et al. 2016). In fact, the most recent connectomics project on the MB circuit found an unexpected number of visual projections, both direct and indirect, to the MB (Li et al. 2020a, 2020b). Furthermore, although the connections between sensory input neurons, such as the olfactory PNs, and the KCs is in large parts random (Caron et al. 2013; Murthy et al. 2008), there is some structured representation of, for instance, the highly aversive odor Geosmin (Stensmyr et al. 2012), which is different from the structured input of food odor vinegar or pheromones, indicating that the MB contains some priors regarding the sensory representation of highly ethologically relevant stimuli (Li et al. 2020a; Zheng et al. 2018). The KCs convey information to the dendrites of 21 types of MB output neurons (MBONs) which innervate 15 specific compartments along the MB lobes (Aso et al. 2014). Importantly, in the same MB compartments, axons of 20 types of DANs innervate and form synapses with KCs and MBONs (Fig. 2a). DANs innervating these compartments originate from two DAN clusters, namely, PAM and PPL1 with cell bodies close to the MB. Their dendrites project to different areas in the superior protocerebrum, where they receive input from other cells including MBONs (Aso et al. 2014, Li et al. 2020a, Mao and Davis 2009, Otto et al. 2020). These 15 compartments, thus, form parallel functional units in which each of the compartments are innervated by axons of KCs, dendrites of specific MBONs and axons of specific DANs. The non-overlapping axonal innervation of DANs in each compartment likely delineates anatomical and functional boundaries of the MB compartments (Aso et al. 2014). Within and between these compartments of the MB occur the possibly most complex synaptic connections in the entire fly brain (Aso et al. 2014; Li et al. 2020a; Takemura et al. 2017; Zheng et al. 2018). In the simplest connection diagram, the KC axons in each compartment make synaptic connection to the dendrites of the corresponding MBONs (KC > MBON), and compartment-specific DANs innervate these KC synapses in order to modulate the KC-MBON synapse according to state and experience. While this simple model is fundamentally still correct and conceptually useful to understand how dopaminergic modulation in the MB can lead to changes in behavior and learning, new connectomics work thoroughly revised this model (Eichler et al. 2017; Li et al. 2020a; Takemura et al. 2017) (Fig. 2a).
Even though the MB compartments are anatomically and functionally independent, most of these compartments are extensively interconnected to each other as DANs receive recurrent input from KCs (KC > DAN) and MBON (MBON > DAN) (Fig. 2b–d). In addition, axons of the DANs can make synaptic connections to the dendrites of the MBON within the compartments (Takemura eta al. 2017; Li et al. 2020a). However, some of the most complex connections are formed between MBONs to DAN. Here, MBON axons show extensive feedback connections on the dendrites of DANs at the MBON output neuropil, namely, CRE, SMP, SIP, and SLP where DANs receive recurrent inputs from MBON (Aso et al. 2014; Li et al. 2020a). Three main types of direct synaptic connections were observed between MBON and DAN. First, MBONs and DANs of the same compartment form a reciprocal feedback loop (Fig. 2b). Second, MBONs of one compartment feedback to DANs of a different compartment. This connection facilitates cross compartment communication (Fig. 2c). Third, MBONs from the same and different compartments feedback to the DAN (Fig. 2d). This connection architecture provides the basis of within and across compartment communication. These rich recurrent feedbacks form an important backbone of memory formation, expression and update, and in addition modulate state and context-dependent behavior in flies (e.g., Felsenberg et al. 2017, 2018; Ichinose et al. 2015; Pavlowsky 2018; Perisse et al. 2016; Sayin et al. 2019; Zhao et al. 2018).
Remarkably, similar to the MB network, within the striatum, DAN inputs show compartmentalized segregation (Berke 2018; Ito and Doya 2015; Watabe-Uchida and Uchida 2018), and the striatum can be subdivided in dorso-lateral, dorso-medial, and ventral parts (Voorn et al. 2004). DAN projections follow this segregation without any clear-cut borders. DANs from the VTA project mainly to the ventral striatum while DANs from the substantia nigra project mainly to the dorsal regions of the striatum. These compartments are also functionally distinct. In a very simplified model and similar to the simplified view of DANs innervating the MB (see below), the ventral striatum is involved in reward processing and motivational control, while the dorsal part of the striatum has been associated with motor control, motor and habit learning. It is indeed known since the first studies on Parkinson’s disease that the loss of dopamine innervation in the dorsal striatum causes movement deficits. Note that this reduction of movement has also been viewed as a reduction of motivation, implicitly (Mazzoni et al. 2007).
DANs as encoders of state, context and experience
Dopamine has been implicated in an overwhelming number of different behaviors in the different models (Scaplen and Kaun 2016). Earlier theoretical models and studies in primates pinpointed a role of dopamine in reward prediction error encoding (Schultz 2015, 2016; Schultz et al. 1997). Newer behavioral studies in rodents and insects have challenged this view and instead suggest that DANs are a highly heterogenous class of neurons that respond, at different time scales, to many types of biological signals including internal, sensory, behavioral state, motivation and punishment (Berke 2018). As a result, a clear or simple answer for “what is dopamine doing?” has not and might never be found. Nevertheless, in our view, one of the most important conclusions of many years of dopamine research is that the, arguably heterogeneous role, of this neuromodulator appears to be conserved across species of very different body plans and living conditions. This remains true for the involvement of specific molecules such as specific types of dopamine receptors to the physiological responses and behavioral functions.
The use of a large array of interdisciplinary approaches has strongly advanced our comprehension of the diversity of DANs and their biological functions in the Drosophila brain. Behavioral analysis has become more ethologically relevant and detailed, capturing the dynamics and different phases of an ongoing behavior rather than simply quantifying the outcome (Branson et al. 2009; Ravbar et al. 2019; Sayin et al. 2019). In vivo imaging and electrophysiology in living and behaving flies has highlighted the diversity of signal type and the importance of timing of DAN activation (Aimon et al. 2019; Handler et al 2019; Siju et al. 2020). DANs respond to various sensory modalities including odor, taste and temperature. These responses are modulated by the internal state (e.g., metabolic and reproductive) and the behavioral state (e.g., moving or not) of the animal (Aimon et al. 2019; Berry et al. 2015; Cohn et al. 2015; Siju et al. 2020; Tomchik 2013; Tsao et al. 2018). Importantly, not all DANs respond the same, and the population activity of DANs across MB compartments can provide more information than individual neuron or compartment responses (Berry et al. 2015; Cohn et al. 2015; Siju et al. 2020). It is worth noting that the population activity of DANs, in line with the somewhat stereotyped odor responses of MBONs (Hige et al. 2015) and the not fully random odor input to KCs (Li et al. 2020a), encodes some information about odor identity (Siju et al. 2020); this might suggest that some odors, or their ethological meaning, could shape responses to other odors as contextual signals during behavior and learning. Consistent with this idea behavioral analysis and imaging provide evidence that DANs contribute to innate valence perception of odors, tastes, and temperature (Siju et al. 2020; Tomchik 2013). Interestingly, while there are some differences between DAN odor and taste responses, valence representation appears to be by and large independent of sensory modality (Fig. 3a–a'''''). Together, many newer and older studies in Drosophila come to similar conclusions as work in rodent models: DANs are heterogeneous and appear to flexibly and experience-dependently encode much of the relevant information animals need not only to learn but also to modify ongoing behavior and make appropriate decisions.
An intriguing question is which neurons convey sensory and state-related information to DANs? And how can such input be used in a timing-dependent manner such that the time of DAN activity and presumably dopamine release relative to the presence of a sensory experience (e.g., before or after odor presentation) can determine whether an experience is positive or negative (Handler et al. 2019; Tanimoto et al. 2004). A recent connectomics study showed that DAN compartments might be further divided into sub-compartments as shown in the case of compartment γ5 (Otto et al. 2020). Here, the authors find that five different DANs with distinct dendritic locations and input neurons innervate γ5, possibly explaining the integrative nature of dopamine signaling in a single compartment but also across compartments. This finding thus stresses that even a highly similar type of DAN can process information differentially depending on its sub-compartment architecture (Otto et al. 2020) (Fig. 3b).
With such an interconnected compartmental organizations and wired to receive multimodal internal and external signals (Berry et al. 2015; Cohn et al. 2015; Lewis et al. 2015; Masek and Scott 2010; Owald et al. 2015b; Owald and Waddell 2015; Siju et al. 2020; Vogt et al. 2016), the fly MB represents a bona fide decision-making center in the fly brain that can modulate behaviors at different levels and time frames, making Drosophila MB DANs an attractive model to study state-dependent decision-making and adaptive behavior.
Dopaminergic modulation and metabolic state
One of the most basic needs of an animal to survive is to forage and feed on food to acquire energy and other essential nutrients and maintain vital body functions. A drop in energy and nutrients will trigger foraging and feeding (Lin et al. 2019; Mahishi and Huetteroth 2019), increase arousal and the motivation to seek and remember food and food-related cues (Krashes et al. 2009; Sayin et al. 2019). Hence, foraging and feeding is a motivational state-dependent behavior tightly controlled by internal energy needs, external sensory stimuli, and prior experience (Lin et al. 2019, Tsao et al. 2018). Because of this, animals, including flies, show great adaptability to optimize their energy expenditure during food search, which in nature can be a long-lasting and dangerous process. Dopamine plays a key role in modulating this state-dependent decision-making in flies by conveying internal metabolic state, sensory value of food and reinforcement signals to maintain or change a behavior (Krashes et al. 2009; Lin et al. 2019; Sayin et al. 2019, Tsao et al. 2018).
Flies predominantly use their olfactory and gustatory senses for finding and evaluating food. Not all food cues are equally positive and some are even aversive. For instance, walking fruit flies show innate avoidance behavior toward CO2 (Suh et al. 2007). However, at the same time, flies feed on fruits which also produce CO2 during ripening and fermentation. Hungry flies overcome their aversion by recruiting pathways in the MB of a specific compartment (β2/β'2a), which is innervated by PAM DANs (Bracker et al. 2013; Lewis et al. 2015). These PAM DANs appear to transmit the valence of a co-incident positive food odor to the MB in a metabolic state-dependent manner, thereby suppressing the CO2 response of the MBONs that drive CO2 aversion (Lewis et al. 2015). This work indicated that flies use their MB not only for learning about the future, but also to modulate their behavior instantaneously in a state-dependent manner. Metabolic state is, at least in part, communicated to the MB in the form of different neuropeptides, neurotransmitters or hormones via DANs. Extensive genetic screening revealed that DANs in compartments α3, β2/β'2a, α'2 α2, γ3, γ2/α'1, and γ1pedc receive different feeding state-related signals, which modulate the corresponding MBONs and ultimately foraging behavior (Tsao et al. 2018, Yamagata et al. 2016). This modulation is also dependent on a dopamine receptor, Damb/Dop1R2, expressed in KCs and MBONs (Tsao et al. 2018). In vivo population imaging of MB DANs recently reported additional metabolic state-sensitive DAN sub-types (β1 and β'1) (Siju et al. 2020). Together, these findings show that feeding state modulates dopaminergic signaling in several MB compartments and thereby adapts feeding related behavior according to the animal’s need.
An important aspect of decision-making is accurately recalling past experiences that are stored as memory. Dopamine, as extensively reviewed by Fiala et al. (same issue), plays an important role in learning and memory in flies (Cognigni et al. 2018; Kaun and Rothenfluh 2017; Modi et al. 2020). In hungry flies, DANs provide reinforcing signals to form and express appetitive memories of food-associated odors (Burke et al. 2012; Krashes et al. 2009; Liu et al. 2012a; Musso et al. 2015; Placais et al. 2012). Such reinforcing signals of sweet taste to form short-term memory are relayed by PAM β'2 and γ4 DANs, whereas reinforcing signals for long term memory formation of the nutritional value of sugar are provided by DANs projecting to γ5, β1, β2, α1, and γ1pedc (Huetteroth et al. 2015; Musso et al. 2015; Pavlowsky et al. 2018; Placais et al. 2017; Siju et al. 2020; Yamagata et al. 2015). Not only formation but also memory expression are directly dependent on the feeding state of the fly. In fed flies, PPL1-γ1pedc DANs inhibit their corresponding MB compartment so that no sugar memory is expressed (Krashes et al. 2009). In a hungry animal, these inhibitory signals are suppressed by the action of neuropeptide dNPF, which is released in response to starvation (Krashes et al. 2009).
Interestingly, hunger modulates not only the strength but also the way a DAN will respond to a stimulus. Slow spontaneous activity of PPL1-γ1pedc DANs together with PPL1-γ2α'1 DANs underpin aversive long-term memory (LTM) formation in fed flies (Placais et al. 2012). By contrast, when starved, the tonic activity of these DANs is drastically reduced blocking the formation of aversive LTM. Thus, in an energy demanding situation like starvation, forming aversive LTM is possibly too costly for the animal such that DANs effectively enable flies to save energy in a feeding-state dependent manner (Hirano et al. 2013; Plaçais and Preat 2013).
As mentioned above, finding food is, for most animals, a dangerous, costly and long-lasting affair, which is, on top of it, not always successful. How do hungry animals decide whether to continue or abandon the search for food? In a recent publication, (Sayin et al. 2019) showed that this strong motivation to maintain and even increase efforts in food search behavior when unrewarded is controlled by subsets of MB DANs (Sayin et al. 2019). Inactivation of subsets of DANs present in the PPL1 and PPL2 clusters led to a strong decrease in odor tracking behavior on a spherical treadmill. Further, they found that Dop1R2 receptor signaling in α/β KCs mediates and modulates this motivated searching behavior (Sayin et al. 2019). Intriguingly, the mechanism and neural circuit driving the maintenance and increase of food-seeking behavior of hungry flies over repeated trials closely resembles the underpinning mechanism of olfactory memory formation. This led to the hypothesis that dopamine enables working memory to update sensory and goal representation during ongoing behavior (Preat and Placais 2019).
Dopamine also modulates behavior once the hungry animal has found the food source. Feeding starts with extending the proboscis, tasting the food, and is followed by food ingestion. The decision to extend the proboscis and initiate the feeding process is controlled by a single DAN (Marella et al. 2012). This DAN, located in the SEZ and known as TH-VUM (tyrosine hydroxylase ventral unilateral medial) neuron, directly influence the proboscis extension response in a metabolic state-dependent manner such that proboscis extension increases when the flies are hungry and the TH-VUM neurons are active (Inagaki et al. 2012; Marella et al. 2012). Moreover, dopamine can modulate sugar sensitivity of SEZ neurons in a starvation-dependent manner, without affecting bitter sensitivity (Inagaki et al. 2012, Inagaki et al. 2014; Marella et al. 2012). An increased sugar sensitivity during foraging reduces the animal’s aversion of food that is not rich in sugar.
Together, these studies show that dopamine can exert metabolic state-dependent modulation at multiple levels in the fly nervous system, from a very early stage of sensory processing up to higher brain centers to enable appropriate foraging and feeding decisions.
Need for specific nutrients are conveyed via dopamine
In particular, during development, flies need various nutrients in addition to just energy, and the need for these nutrients changes with developmental stage. The mechanism by which flies sense and ingest micro and macro nutrients other than sugars are not well understood. However, a recent study showed a clear link to dopaminergic modulation in protein-craving flies (Liu et al. 2017). When male flies are low on protein, especially after mating, their preference for normal food containing sugar is switched to a more protein-rich food. This state-dependent decision to eat protein rich food is regulated by a specific set of DANs in the PPM2 cluster, which are connected to wedge-neurons. Artificially activating these DANs increased the preference for protein rich food compared to sugar even in protein sated males (Liu et al. 2017).
This study provides evidence that dopamine can help animals to make very specific feeding choices by adjusting reward value circuits to current internal state.
Dopamine influences the choice of thirsty flies
Drastic changes in environmental temperature, humidity, body osmolality, and ingestion of certain foods can cause animals to feel thirsty. Since water is crucial for the body, this need is monitored by several modulatory factors and often elicits strong behavioral responses in animals. Thirsty flies detect the presence of moist air through hygroreceptors in their third antennal segment; by contrast, hygroreceptors in the arista are involved in sensing moist air to avoid further water exposure when the animal is sufficiently hydrated (Ji and Zhu 2015; Liu et al. 2007). Once in contact with water, the gustatory system through the osmosensitive channel PPK28 initiates water imbibing (Cameron et al. 2010; Chen et al. 2010). Importantly, water drinking appears to be a rewarding process only for water deprived flies (Lin et al. 2014; Liu et al. 2007; Shyu et al. 2017). Since water is crucial for survival, flies memorize sensory cues associated with water with the help of dopamine: water information, similar to the presence of an attractive odorant (Lewis et al. 2015), is conveyed by β'2 innervating DANs (Lin et al. 2014). Moreover, a recent study reported that Dop1R1 mutant flies consumed less water compared to wild-type flies (Lau et al. 2017). This study further showed that the palpability of water tasting increases because of dopamine release in thirsty animals (Lau 2017). Through DANs, flies can also form short-term memory (STM) and LTM to cues associated with water. LTM for water is reinforced by PAM β'1 neurons and Dumb/Dop1R1 in α'/β' KC (Shyu et al. 2017). On the other hand, DANs innervating the γ4 compartment are required for inducing STM of water (Lin et al. 2014; Shyu et al. 2017). It is interesting to note that, similar to sugar memory formation, STM and LTM for water cues are mediated by two different subsets of DANs, possibly giving the animal higher flexibility in its choices.
Thus, while animals for obvious reasons benefit from remembering where to find water, it is equally important to balance their intake of water and nutrients. In a recent study, Senapati et al. (2019) identified that DANs are involved in prioritizing the expression of water or sugar memory when thirst and hunger arise at the same time (Senapati et al. 2019). Essentially, flies choose whether to drink water or feed on sugar according to two competing needs. Leucokinin, a neuropeptide, which is released in thirsty flies, specifically inhibits two types of DAN subsets, PAM-β'2a and PPL1-γ2 α'1, thereby promoting water memory expression. Leucokinin can also promote sugar memory in flies through the activation of PAM-β'2mp DANs. Surprisingly, when hunger and thirst occur simultaneously, hunger wins. This is because water memory is somehow neutralized by hunger-promoting signals such as neuropeptide dNPF and serotonin in “water” DANs (Senapati et al. 2019). Hence, dopamine enables flies to dynamically prioritize a choice depending on their need by promoting or inhibiting behaviors in a need-dependent manner.
Dopamine regulates reproductive success
One of the most important aspects of animal life is reproduction to ensure gene flow and evolutionary success. As animals go through different reproductive states, they exhibit changes in their physiology and behavior. This plasticity is controlled and coordinated by different neural circuits at different levels in the reproductive machinery (Auer and Benton 2016). In addition to some other neuromodulators, dopamine plays a prominent role in controlling reproductive state behaviors such as courtship, mating or egg laying (Sayin et al. 2018). Courting and mating involve elaborate sequential rituals in flies (Aranha and Vasconcelos 2018). Moreover, courtship and mating are intertwined behaviors: only successful courting will lead to mating (Zhang et al. 2018). Flies recognize their appropriate mating partners using different sensory cues such as visual, acoustic, olfactory, gustatory, and tactile. However, communication via the olfactory system plays a major role in reproductive behaviors (Billeter and Wolfner 2018). Some of the animal’s own cuticular hydrocarbons serve as sex pheromones, and among them, cis-vacenyl acetate (cVA) is the most prominent and most studied (Brieger and Butterworth 1970; Ferveur 2005; Ha and Smith 2006; Keleman et al. 2012; Kohl et al. 2015; Sengupta and Smith 2014).
When to court and when not to court is an important decision for animals, as in some cases, they have to prioritize more pressing needs, for instance, feeding or escaping from predators (Zhang et al 2018). In male flies, the decision to engage or disengage in courting is centrally controlled by male specific command neurons known as P1 (Kimura et al. 2008). This class of neurons integrates motivational control for courtship from the aSP4 DAN of the PAL DAN cluster and courtship related sensory cues, and projects it to a higher brain area called SMPa (Zhang et al. 2018, 2016). A current model suggests that increased dopamine release sustains the motivational level of courtship, which decreases once mating needs are satisfied. Direct evidence was obtained by optogenetically activating courtship reporting neurons, which decreased DAN output activity at the level of the SMPa area, indicating reduced release of the dopamine during mating (Zhang et al. 2018, 2016). Similarly, repeated activity of the DAN also reduced sex drive. However, after a few days, the males, due to rising dopamine levels, started to court again. PAL DAN activity itself is modulated by the activity of NPF neurons that also receive courtship state information from the courtship reporting neurons (Zhang et al. 2019). Similarly, dopaminergic modulation is also involved in age-dependent courtship motivation in male flies. Aged male flies show less vigor in courtship and mating compared to reproductively active younger males, which appears to depend on the activity of a subset of PPL2ab DANs (Kuo et al. 2015).
Dopamine, however, does not only regulate ongoing courting or mating activity. Male flies can with the help of DANs remember their previous sexual experiences and the outcome. When a naïve male fly tries to court an already mated female, the courting will usually not be successful as the female will reject the male. Mated females, importantly, smell different, because they emit male cVA transferred from their previous sex partner. MB γ-compartment DANs and Dop1R1 are important for this “courtship learning” (Keleman et al. 2012). When a male fly experiences rejection by the female, its response toward cVA markedly increases. The dopamine released by PAMγ5/aSP13 DANs activates the γ5 MBON in a recurrent excitatory loop, and thereby determines the duration and strength of the negative courtship memory depending on the number of courtship attempts by the male. Moreover, in another report investigating courtship learning, Montague and Baker showed that courtship memory also involves α/β KCs, in addition to the γ lobes (Montague and Baker 2016).
Not only males but also female flies undergo changes in their perception and behavior upon mating. For instance, food and odor preferences, behavioral priorities, and mating receptivity are different in a mated female as compared to a virgin (Hussain et al. 2016a, 2016b; Liu and Kubli 2003; Walker et al. 2015). Siju et al. (2020) recently showed through in vivo calcium imaging that specific DANs are modulated depending on the mating state of the female. DANs innervating β'1 and α3 compartments of the MB showed higher responses to the sex pheromone cVA in mated females compared to virgin females (Siju et al. 2020). A higher sensitivity to cVA in the DANs after mating provides a hint that the MB could enable mated female flies to express several postmating related behaviors. For instance, since cVA is a pheromone transferred to females during mating, conspecific females might use this cue to locate other mated females to select a substrate that is already used for oviposition by other females (Dumenil et al. 2016; Sarin and Dukas 2009). Alternatively, cVA might suppress a mated female’s attraction to males.
The next step after mating is egg laying or oviposition. Since flies do not take care of their offspring after egg laying, it is crucial for female flies to choose the right substrate for ovipositioning and increase the survival of their offspring. Flies use several sensory cues to locate suitable oviposition substrates (Azanchi et al. 2013; Markow and O’Grady 2008) and to orchestrate behaviors during the egg-laying process (Aranha and Vasconcelos 2018). Females choose egg-laying substrates according to a value-based decision-making process (Yang et al. 2008). In a follow-up study, Yang et al. (2015) showed that a specific subset of DANs is important for an egg-laying preference on sucrose-containing substrates (Yang et al. 2015). These authors showed that increased activity of PAL and PPL2 DANs increased the preference of sucrose-rich substrate for egg laying (Yang et al. 2015). However, they did not find any direct involvement of the MB in this decision-making process (Yang et al. 2015). By contrast, another study by Azanchi et al. implicated the MB and showed that PAM and PPM3 DANs enhance oviposition preference for ethanol-containing substrates, while PPL1 DANs do the opposite. These opposing effects of dopamine may help in deciding whether to deposit eggs on fruits containing low or high concentrations of ethanol: as low concentration is a preferred choice as high alcohol concentration can be detrimental (Azanchi et al. 2013; Yang et al. 2008).
In spite of this clear evidence for role of dopamine in reproductive state-dependent behavior, it is not known which upstream circuits convey state and value signals to the DANs.
Social behavior is tuned by dopaminergic neurons
Aggression is a state-dependent behavior, and most animals show aggressive behaviors in the context of resources, mates, and predators that often culminate into fight (Anderson 2016; Asahina 2017). Moreover, internal states can influence and enhance aggressive behaviors (Anderson 2016). The decision to fight or not to fight is important as aggressive behavior can further deplete energy levels or even lead to death (Hoopfer 2016). Still, hungry, but not fed, flies in the context of limited food resources show aggressive behaviors toward conspecifics (Lim et al. 2014). Similarly, male flies show competitive and aggressive behavior when in the mood for mating (Bath et al. 2017; Chapman and Wolfner 2017). Interestingly, aggressive and courtship behaviors are both elicited by cVA (Wang and Anderson 2010).
Some aspects of these behaviors, or when to express them, are under dopaminergic regulation. For example, two sets of DANs found in both T1 and PPM3 clusters are involved in modulation of aggression in flies (Alekseyenko et al. 2013). Interestingly, both inactivation and activation of these two sets of DANs promote aggression; however, the mechanism involved is not yet fully understood (Alekseyenko et al. 2013). More recently, Kim et al. provided strong evidence that repeated aggressive fights that were lost led to the formation a long-lasting aversive memory in males through a PPL1-γ1pedc- and corresponding MBON-dependent modulation (Kim et al. 2018). This aversive memory could be useful in situations where flies have to prioritize foraging or mating over fighting.
Environmental temperature preference relies on dopamine
Drosophila flies are considered to be tropical in origin coming from east equatorial Africa (Hansson and Stensmyr 2011). Over the course of their cosmopolitan spreading across the world, flies adapted to different temperature ranges from cold to warm (Hansson and Stensmyr 2011; Trotta et al. 2006). Flies are poikilothermic animals, unable to adjust their internal body temperature independent of environmental temperature. If and when environmental temperature changes, flies need to adjust their body temperature by moving to an appropriate environment. Hence, flies constantly evaluate changes in their environmental temperature and show behavioral reactions to the temperature changes (Barbagallo and Garrity 2015; Bellemer 2015; Dillon et al. 2009; Nevo et al. 1998).
Flies sense external temperature through three thermosensory sensilla in the arista. Each of these sensilla houses one cold activated and one hot activated cell (Alpert et al. 2020; Gallio et al. 2011). In addition, flies also have internal thermal sensors in the brain known as anterior cells expressing the dTrpA1 receptor (Hamada et al. 2008). Since changes in temperature need to be evaluated and integrated with context and internal state, it would not be surprising if temperature homeostasis were subject to neuromodulation (Lubawy et al. 2020). Supporting this idea, several studies showed that DANs are involved in temperature preference behavior. More specifically, MB DANs receive temperature stimuli, and silencing the output of a large fraction of DANs changed preferred temperature behavior in flies (Bang et al. 2011; Hong et al. 2008; Tomchik 2013). These behavioral data are corroborated by functional imaging of DANs. DANs in the vertical lobe, especially PPL1-α3/α'3, PPL1-α2α'2, PPL1-γ2α'1, PPL1-γ1pedc respond to decreases in temperature (Tomchik 2013). Interestingly, another study showed that PAM-β'2 and PAM-β2 are involved in modulating cold temperature avoidance in flies (Shih et al. 2015). By contrast, two independent studies showed that DANs are not involved in reflexive responses to high temperature (Galili et al. 2014; Tomchik 2013). Nevertheless, similar to cold temperature avoidance, DANs act as reinforcers in high temperature avoidance learning. (Galili et al. 2014) reported that a larger population of DANs labeled genetically by a TH-D’-GAL4 transgene (Liu et al. 2012b) convey painful temperature very similar to electric shock during aversive olfactory memory formation (Galili et al. 2014). These DANs innervate mostly the vertical lobe and, surprisingly, overlap with the DANs involved in the avoidance of cold temperatures (Galili et al. 2014; Tomchik 2013). How exactly DANs and the MB allow flies to evaluate and chose appropriate temperature environments, and whether these neurons integrate additional factors such as metabolic state or history of temperature changes remains an interesting and open question.
DANs respond to movement
Unless resting, most of the time flies are on the move to find food, mates, oviposition sites, or to escape from predators or harsh environment. It implies that a fly’s movement is influenced by its motivational state, external sensory environments, and behavioral output. Although dopamine activity increases strongly in many regions over the brain during walk without any sensory stimulus (Aimon et al. 2019), recent works have mostly focused on MB DANs (Aimon et al. 2019; Berry et al. 2015; Cohn et al. 2015). For example, the activity of DANs innervating γ2α'1 and γ3 compartments was correlated with walking movement on a ball (Berry et al. 2015; Cohn et al. 2015). Expanding on these results, another study, using population imaging of DANs, showed that walking is correlated with increased activity of several DAN compartments in the horizontal MB lobes. In particular, β1, β2, β'2, and γ3-5 DAN compartments showed strong activity during walking movement (Siju et al. 2020). Interestingly, modulation of DAN activity was similar for movement and internal state such as hunger, mating, and sensory valance (Siju et al. 2020).
Why many DANs show a higher activity during movement is an intriguing question. One possibility is that heightened activity during movement may enable these DANs to get in a more excitable state in which even a little external sensory cue will activate them to modulate behavioral decisions. The behavioral state (e.g., moving vs. grooming) could be important information in itself for further decisions, and dopamine could carry operant learning signals (Sun et al. 2020). Studies looking at the precise timing of activation as well as what aspect of the behavior is coded (for example whether DANs represent just walking or not, the speed of the walk or even the trajectory) will help answer this question.
As said before, this is reminiscent to what happens in the mammalian brain. Indeed, it is known from Parkinson’s disease that dopamine is involved in motor control, and artificial stimulation of overall DANs also promoted movement initiation (da Silva et al. 2018; Howe and Dombeck 2016). Direct observation showed that DANs fire phasically before spontaneous movement initiation non-triggered by an external stimulus (Coddington and Dudman 2018; Dodson et al. 2016; Howe and Dombeck 2016; Syed et al. 2016), and many DANs are also active during the movement (Engelhard et al. 2019; Howe and Dombeck 2016). However, in flies, so far, all available data point to that DAN activity is either synchronized to movement or DAN activation initiates movement. For instance, artificial activation of DANs triggers altered locomotion (Lima and Miesenböck 2005). Therefore, whether DANs primarily control movement, respond to movement or both is difficult to answer with determination at this point. Being able to manipulate DAN activity precisely in time and space has not only substantiated dopamine’s function in learning and change of future behavior, it has also provided evidence for a role of DANs in changing ongoing behavior in insects (Berry et al. 2012; Cohn et al. 2015; Lewis et al. 2015, Tsao et al. 2018) and rodents (Saunders et al. 2018). It is possible that this is, at least in part, explained by the reinforcing action of movement-modulated DANs (Coddington and Dudman 2019).
Sleep is regulated by dopamine
Sustained activity-dependent behaviors and arousal mean that animals stay in a continuous wakeful state for a prolonged time. This continuous wake state puts constraints on the physical and physiological state of the animal and eventually forces them to rest or sleep. Although sleep has been observed in almost all animals, how sleep is initiated, maintained, and modulated remains poorly understood. In flies, a rest period or immobility of 5 min or more with a reduced response to sensory stimuli is termed as sleep (Hendricks et al. 2000). Sleep affects several state-dependent behaviors such as feeding, mating, as well as learning and memory in flies (Donlea et al. 2014). Sleep is also a motivated behavior and both external sensory cues and internal signals can affect sleep (Nall and Sehgal 2014). In line with this, pioneering studies showed that dopamine is an important molecule controlling sleep in flies. Kume et al. identified a dopamine transporter (DAT) gene mutant named fumin and showed that these mutant flies sleep less compared to wild type flies (Kume et al. 2005). This sleep loss was attributed to increased amount of dopamine in synaptic junctions that was not cleared because of the DAT mutation (Kume et al. 2005). In support of this finding, another study showed that an increased concentration of dopamine in flies reduced sleep and promoted wakefulness and activity (Andretic et al. 2005).
Similar to mammals, multiple sleep regulating centers have been found in the fly brain (Dissel 2020). The dorsal fan shaped body (dFB) and MB are thought to be the main sleep centers in flies. It has been found that activation of the dFB neurons promoted sleep in flies (Donlea et al. 2018). By contrast, DANs projecting to dFB disrupt sleep and increase wakefulness. Two independent studies showed that DANs of PPM3 and PPL1 clusters project to dFB and activation of these DANs reduces sleep and increases wakefulness. However, when silencing these DANs, sleep is increased (Liu e al. 2012b; Ueno et al. 2012). Further studies by Pimentel et al. showed that dopamine released by these DANs onto the dFB electrically silences dFB neuron excitability to suppress sleep and increase wakefulness; this silencing is mediated by Dop1R2 receptors present on the dFB cells (Pimentel et al. 2016). The dFB is a part of the CC which also comprises other neuropils such as ventral fan shaped body (vFB), protocerbarl bridge (PB), and ellipsoidal body. Interestingly, some of the recent findings have also implicated vFB and PB in a dopamine-mediated control of sleep (Dag et al. 2019; Duhart et al. 2020). DANs projecting to PB (DA-PB) neurons are involved in sleep modulation in a nutrient-dependent manner, where yeast-deprived male flies show increased wake activity and reduced sleep (Duhart et al. 2020). This finding is in line with a previous observation that starvation reduces sleep in flies (Keene et al. 2010), and together stress that dopaminergic neurons integrate different states and may compare their respective urgency.
Another brain center in the fly that has been implicated in sleep regulation is the MB (Joiner et al. 2006; Pitman et al. 2006). However, a direct link to MB projecting DANs and their involvement in sleep and wake regulation was provided only recently (Berry et al. 2015; Sitaraman, et al., 2015b). Artificial activation of PPL1 and PAM DANs projecting to distinct MB compartments decreased sleep and silencing the activity of PAM DANs, especially PAM-γ5, increased sleep (Sitaraman et al. 2015a). These findings confirm that MB DANs have wake-promoting functions and project primarily to specific wake-promoting MBON compartments such as γ4, γ5, and β'2 (Sitaraman et al. 2015b).
Sleep has been shown to influence learning and memory in flies. Seugnet et al. showed that sleep deprivation impairs learning and the concentration of dopamine in the head was increased in sleep-deprived flies, while Dop1R1 receptor transcripts were downregulated (Seugnet et al. 2009). Sleep is equally important for memory formation and consolidation in flies. In a recent study, Dag et al. showed that sleep and DAN signaling is important to consolidate memory in male flies that have experienced courtship rejection from already mated females (Dag et al. 2019). The PAMγ5/aSP13 DAN that is involved in memory formation of this negative experience is further activated during sleep by sleep promoting vFB neurons, indicating that continued DAN activity during sleep strengthens memory (Dag et al. 2019). Interestingly, another study showed that the same PAM-γ5 when activated increases wakefulness (Sitaraman et al. 2015a). One plausible explanation for this discrepancy is that wake-promoting DANs and vFB-activated DANs may be innervating different sub-compartments of the γ5 compartment of the MB (Dag et al. 2019, Otto et al. 2020).
Although the functional significance of sleep remains unclear (Geissmann et al. 2019), from the above account, it is evident that dopamine plays an important role in sleep regulation in flies. Given that sleep and other behaviors are interlinked, dopamine could integrate information from different states and sensory cues to balance different needs.
Conclusions and future directions
The powerful combination of genetic tools, connectomics, in vivo physiology, and quantitative behavioral analysis in different model systems including Drosophila has led to a significant shift in our view and understanding of dopamine and dopaminergic neurons over the last years. DANs are highly heterogeneous and involved in nearly all processes that increase the animal’s success at survival and reproduction.
How DANs in the fly obtain information about valence, state, or movement is among the open questions that will likely be answered at least in part by connectomics (Li et al. 2020a, Otto et al. 2020). Moreover, DANs not only modulate, they are targets of neuromodulation themselves. While receptors for such neuromodulators have been found in insect DANs, their source is frequently not known. Furthermore, are receptor-expressing neurons responding to local, neuronal, or rather to systemic signals released into circulation by other organs, or both? The high degree of recurrent connections, including long-range connections, to and from DANs in the fly brain, represents an ideal mechanism to implement such an immediate, action or need related feedback from other neurons to DANs.
At this point, we know surprisingly little about what happens in dopamine-receiving cells. While often the receptor involved in a particular behavior has been identified, the nature and timing of signal and subsequent activation remain elusive. And finally, it is well known that DANs can co-release other neurotransmitters such as GABA or glutamate (Zell et al. 2020). How is a coordinated or perhaps even more difficult to explain, alternative release of dopamine and another transmitter controlled? And do they affect the same downstream synapses?
While these points certainly do not exhaust the list of open questions, we believe that these are among the most pressing, which at the same time have answers in reach.
Aimon S, Katsuki T, Jia T, Grosenick L, Broxton M, Deisseroth K, Sejnowski TJ, Greenspan RJ (2019) Fast near-whole-brain imaging in adult Drosophila during responses to stimuli and behavior. PLoS Biol 17:e2006732
Alekseyenko OV, Chan YB, Li R, Kravitz EA (2013) Single dopaminergic neurons that modulate aggression in Drosophila. Proc Natl Acad Sci U S A 110:6151–6156
Alpert MH, Frank DD, Kaspi E, Flourakis M, Zaharieva EE, Allada R, Para A, Gallio M (2020) A circuit encoding absolute cold temperature in Drosophila. Curr Biol 30(2275–2288):e2275
Anderson DJ (2016) Circuit modules linking internal states and social behaviour in flies and mice. Nat Rev Neurosci 17:692–704
Andretic R, van Swinderen B, Greenspan RJ (2005) Dopaminergic modulation of arousal in Drosophila. Curr Biol 15:1165–1175
Aranha MM, Vasconcelos ML (2018) Deciphering Drosophila female innate behaviors. Curr Opin Neurobiol 52:139–148
Asahina K (2017) Neuromodulation and strategic action choice in Drosophila aggression. Annu Rev Neurosci 40:51–75
Aso Y, Hattori D, Yu Y, Johnston RM, Iyer NA, Ngo TT, Dionne H, Abbott LF, Axel R, Tanimoto H, Rubin GM (2014) The neuronal architecture of the mushroom body provides a logic for associative learning. Elife 3:e04577
Auer TO, Benton R (2016) Sexual circuitry in Drosophila. Curr Opin Neurobiol 38:18–26
Azanchi R, Kaun KR, Heberlein U (2013) Competing dopamine neurons drive oviposition choice for ethanol in Drosophila. Proc Natl Acad Sci U S A 110:21153–21158
Bang S, Hyun S, Hong ST, Kang J, Jeong K, Park JJ, Choe J, Chung J (2011) Dopamine signalling in mushroom bodies regulates temperature-preference behaviour in Drosophila. PLoS Genet 7:e1001346
Barbagallo B, Garrity PA (2015) Temperature sensation in Drosophila. Curr Opin Neurobiol 34:8–13
Bargmann CI (2012) Beyond the connectome: how neuromodulators shape neural circuits. BioEssays 34:458–465
Bargmann CI, Marder E (2013) From the connectome to brain function. Nat Methods 10:483–490
Barnstedt O, Owald D, Felsenberg J, Brain R, Moszynski JP, Talbot CB, Perrat PN, Waddell S (2016) Memory-relevant mushroom body output synapses are cholinergic. Neuron 89:1237–1247
Bates AS, Schlegel P, Roberts RJV, Drummond N, Tamimi IFM, Turnbull R, Zhao X, Marin EC, Popovici PD, Dhawan S, Jamasb A, Javier A, Serratosa Capdevila L, Li F, Rubin GM, Waddell S, Bock DD, Costa M, Jefferis G (2020) Complete connectomic reconstruction of olfactory projection neurons in the fly brain. Curr Biol 30(3183–3199):e3186
Bath E, Bowden S, Peters C, Reddy A, Tobias JA, Easton-Calabria E, Seddon N, Goodwin SF, Wigby S (2017) Sperm and sex peptide stimulate aggression in female Drosophila. Nat Ecol Evol 1:0154
Beaulieu JM, Gainetdinov RR (2011) The physiology, signaling, and pharmacology of dopamine receptors. Pharmacol Rev 63:182–217
Bellemer A (2015) Thermotaxis, circadian rhythms, and TRP channels in Drosophila. Temperature 2:227–243
Berke JD (2018) What does dopamine mean? Nat Neurosci 21:787–793
Berry JA, Cervantes-Sandoval I, Chakraborty M, Davis RL (2015) Sleep facilitates memory by blocking dopamine neuron-mediated forgetting. Cell 161:1656–1667
Berry JA, Cervantes-Sandoval I, Nicholas EP, Davis RL (2012) Dopamine is required for learning and forgetting in Drosophila. Neuron 74:530–542
Billeter JC, Wolfner MF (2018) Chemical cues that guide female reproduction in Drosophila melanogaster. J Chem Ecol 44:750–769
Bjorklund A, Dunnett SB (2007) Dopamine neuron systems in the brain: an update. Trends Neurosci 30:194–202
Boto T, Stahl A, Zhang X, Louis T, Tomchik SM (2019) Independent contributions of discrete dopaminergic circuits to cellular plasticity, memory strength, and valence in Drosophila. Cell Rep 27(2014–2021):e2012
Bracker LB, Siju KP, Varela N, Aso Y, Zhang M, Hein I, Vasconcelos ML, Grunwald Kadow IC (2013) Essential role of the mushroom body in context-dependent CO(2) avoidance in Drosophila. Curr Biol 23:1228–1234
Branson K, Robie AA, Bender J, Perona P, Dickinson MH (2009) High-throughput ethomics in large groups of Drosophila. Nat Methods 6:451–457
Brieger G, Butterworth FM (1970) Drosophila melanogaster: identity of male lipid in reproductive system. Science 167:1262
Bromberg-Martin ES, Matsumoto M, Hikosaka O (2010) Dopamine in motivational control: rewarding, aversive, and alerting. Neuron 68:815–834
Budnik V, White K (1987) Genetic dissection of dopamine and serotonin synthesis in the nervous system of Drosophila melanogaster. J Neurogenet 4:309–314
Budnik V, White K (1988) Catecholamine-containing neurons in Drosophila melanogaster: distribution and development. J Comp Neurol 268:400–413
Burke CJ, Dreher JC, Seymour B, Tobler PN (2014) State-dependent value representation: evidence from the striatum. Front Neurosci 8:193
Burke CJ, Huetteroth W, Owald D, Perisse E, Krashes MJ, Das G, Gohl D, Silies M, Certel S, Waddell S (2012) Layered reward signalling through octopamine and dopamine in Drosophila. Nature 492:433–437
Cameron P, Hiroi M, Ngai J, Scott K (2010) The molecular basis for water taste in Drosophila. Nature 465:91–95
Caron SJ, Ruta V, Abbott LF, Axel R (2013) Random convergence of olfactory inputs in the Drosophila mushroom body. Nature 497:113–117
Chapman T, Wolfner MF (2017) Reproductive behaviour: make love, then war. Nat Ecol Evol 1:174
Chen Z, Wang Q, Wang Z (2010) The amiloride-sensitive epithelial Na<sup>+</sup> channel PPK28 is essential for <em>Drosophila</em> gustatory water reception. J Neurosci 30:6247
Coddington LT, Dudman JT (2018) The timing of action determines reward prediction signals in identified midbrain dopamine neurons. Nat Neurosci 21:1563–1573
Coddington LT, Dudman JT (2019) Learning from action: reconsidering movement signaling in midbrain dopamine neuron activity. Neuron 104:63–77
Cognigni P, Felsenberg J, Waddell S (2018) Do the right thing: neural network mechanisms of memory formation, expression and update in Drosophila. Curr Opin Neurobiol 49:51–58
Cohn R, Morantte I, Ruta V (2015) Coordinated and compartmentalized neuromodulation shapes sensory processing in Drosophila. Cell 163:1742–1755
Cover KK, Gyawali U, Kerkhoff WG, Patton MH, Mu C, White MG, Marquardt AE, Roberts BM, Cheer JF, Mathur BN (2019) Activation of the rostral intralaminar thalamus drives reinforcement through striatal dopamine release. Cell Rep 26:1389-1398.e1383
Crittenden JR, Skoulakis EM, Han KA, Kalderon D, Davis RL (1998) Tripartite mushroom body architecture revealed by antigenic markers. PMID: 10454371 PMCID: PMC311260 Learn Mem 5(1-2):38-51
Croset V, Treiber CD, Waddell S (2018) Cellular diversity in the Drosophila midbrain revealed by single-cell transcriptomics. Elife 7:
da Silva JA, Tecuapetla F, Paixão V, Costa RM (2018) Dopamine neuron activity before action initiation gates and invigorates future movements. Nature 554:244–248
Dag U, Lei Z, Le JQ, Wong A, Bushey D, Keleman K (2019) Neuronal reactivation during post-learning sleep consolidates long-term memory in. Elife 8:
DasGupta S, Ferreira CH, Miesenbock G (2014) FoxP influences the speed and accuracy of a perceptual decision in Drosophila. Science 344:901–904
Dayan P (2012) Twenty-five lessons from computational neuromodulation. Neuron 76:240–256
de Jong JW, Afjei SA, Pollak Dorocic I, Peck JR, Liu C, Kim CK, Tian L, Deisseroth K, Lammel S (2019) A neural circuit mechanism for encoding aversive stimuli in the mesolimbic dopamine system. Neuron 101:133-151.e137
Dillon ME, Wang G, Garrity PA, Huey RB (2009) Review: Thermal preference in Drosophila. J Therm Biol 34:109–119
Dissel S (2020) Drosophila as a model to study the relationship between sleep, plasticity, and memory. Front Physiol 11:533
Dodson PD, Dreyer JK, Jennings KA, Syed ECJ, Wade-Martins R, Cragg SJ, Bolam JP, Magill PJ (2016) Representation of spontaneous movement by dopaminergic neurons is cell-type selective and disrupted in parkinsonism. Proc Natl Acad Sci 113:E2180
Dolan MJ, Belliart-Guerin G, Bates AS, Frechter S, Lampin-Saint-Amaux A, Aso Y, Roberts RJV, Schlegel P, Wong A, Hammad A, Bock D, Rubin GM, Preat T, Placais PY, Jefferis G (2018) Communication from learned to innate olfactory processing centers is required for memory retrieval in Drosophila. Neuron 100(651–668):e658
Donlea JM, Pimentel D, Miesenböck G (2014) Neuronal machinery of sleep homeostasis in Drosophila. Neuron 81:1442
Donlea JM, Pimentel D, Talbot CB, Kempf A, Omoto JJ, Hartenstein V, Miesenböck G (2018) Recurrent circuitry for balancing sleep need and sleep. Neuron 97:378-389.e374
Duhart JM, Baccini V, Zhang Y, Machado DR, Koh K (2020) Modulation of sleep-courtship balance by nutritional status in. Elife 9:
Dumenil C, Woud D, Pinto F, Alkema JT, Jansen I, Van Der Geest AM, Roessingh S, Billeter JC (2016) Pheromonal cues deposited by mated females convey social information about egg-laying sites in Drosophila melanogaster. J Chem Ecol 42:259–269
Eichler K, Li F, Litwin-Kumar A, Park Y, Andrade I, Schneider-Mizell CM, Saumweber T, Huser A, Eschbach C, Gerber B, Fetter RD, Truman JW, Priebe CE, Abbott LF, Thum AS, Zlatic M, Cardona A (2017) The complete connectome of a learning and memory centre in an insect brain. Nature 548:175–182
Engelhard B, Finkelstein J, Cox J, Fleming W, Jang HJ, Ornelas S, Koay SA, Thiberge SY, Daw ND, Tank DW, Witten IB (2019) Specialized coding of sensory, motor and cognitive variables in VTA dopamine neurons. Nature 570:509–513
Felsenberg J, Barnstedt O, Cognigni P, Lin S, Waddell S (2017) Re-evaluation of learned information in Drosophila. Nature 544:240–244
Felsenberg J, Jacob PF, Walker T, Barnstedt O, Edmondson-Stait AJ, Pleijzier MW, Otto N, Schlegel P, Sharifi N, Perisse E, Smith CS, Lauritzen JS, Costa M, Jefferis G, Bock DD, Waddell S (2018) Integration of parallel opposing memories underlies memory extinction. Cell 175(709–722):e715
Ferveur JF (2005) Cuticular hydrocarbons: their evolution and roles in Drosophila pheromonal communication. Behav Genet 35:279–295
Galili DS, Dylla KV, Ludke A, Friedrich AB, Yamagata N, Wong JY, Ho CH, Szyszka P, Tanimoto H (2014) Converging circuits mediate temperature and shock aversive olfactory conditioning in Drosophila. Curr Biol 24:1712–1722
Gallio M, Ofstad TA, Macpherson LJ, Wang JW, Zuker CS (2011) The coding of temperature in the Drosophila brain. Cell 144:614–624
Gao M, Liu CL, Yang S, Jin GZ, Bunney BS, Shi WX (2007) Functional coupling between the prefrontal cortex and dopamine neurons in the ventral tegmental area. J Neurosci 27:5414–5421
Geissmann Q, Beckwith EJ, Gilestro GF (2019) Most sleep does not serve a vital function: Evidence from. Sci Adv 5:eaau9253
Groschner LN, Chan Wah Hak L, Bogacz R, DasGupta S, Miesenbock G (2018) Dendritic integration of sensory evidence in perceptual decision-making. Cell 173(894–905):e813
Ha T, Smith D (2006) A pheromone receptor mediates 11-cis-vaccenyl acetate-induced responses in Drosophila. The Journal of neuroscience : the official journal of the Society for Neuroscience 26:8727–8733
Hamada FN, Rosenzweig M, Kang K, Pulver SR, Ghezzi A, Jegla TJ, Garrity PA (2008) An internal thermal sensor controlling temperature preference in Drosophila. Nature 454:217–220
Handler A, Graham TGW, Cohn R, Morantte I, Siliciano AF, Zeng J, Li Y, Ruta V (2019) Distinct dopamine receptor pathways underlie the temporal sensitivity of associative learning. Cell 178(60–75):e19
Hansson BS, Stensmyr MC (2011) Evolution of insect olfaction. Neuron 72:698–711
Hattori D, Aso Y, Swartz KJ, Rubin GM, Abbott LF, Axel R (2017) Representations of novelty and familiarity in a mushroom body compartment. Cell 169:956-969.e917
Heisenberg M (2003) Mushroom body memoir: from maps to models. Nat Rev Neurosci 4:266–275
Hendricks JC, Sehgal A, Pack AI (2000) The need for a simple animal model to understand sleep. Prog Neurobiol 61:339–351
Hige T, Aso Y, Rubin GM, Turner GC (2015) Plasticity-driven individualization of olfactory coding in mushroom body output neurons. Nature 526:258–262
Himmelreich S, Masuho I, Berry JA, MacMullen C, Skamangas NK, Martemyanov KA, Davis RL (2017) Dopamine receptor DAMB signals via Gq to mediate forgetting in Drosophila. Cell reports 21:2074–2081
Hirano Y, Masuda T, Naganos S, Matsuno M, Ueno K, Miyashita T, Horiuchi J, Saitoe M (2013) Fasting launches CRTC to facilitate long-term memory formation in Drosophila. Science 339:443–446
Hong ST, Bang S, Hyun S, Kang J, Jeong K, Paik D, Chung J, Kim J (2008) cAMP signalling in mushroom bodies modulates temperature preference behaviour in Drosophila. Nature 454:771–775
Hoopfer ED (2016) Neural control of aggression in Drosophila. Curr Opin Neurobiol 38:109–118
Howe MW, Dombeck DA (2016) Rapid signalling in distinct dopaminergic axons during locomotion and reward. Nature 535:505–510
Huetteroth W, Perisse E, Lin S, Klappenbach M, Burke C, Waddell S (2015) Sweet taste and nutrient value subdivide rewarding dopaminergic neurons in Drosophila. Curr Biol 25:751–758
Hussain A, Zhang M, Üçpunar HK, Svensson T, Quillery E, Gompel N, Ignell R, Grunwald Kadow IC (2016) Ionotropic chemosensory receptors mediate the taste and smell of polyamines. PLoS Biol 14:e1002454
Hussain A, Üçpunar HK, Zhang M, Loschek LF, Grunwald Kadow IC (2016) Neuropeptides Modulate female chemosensory processing upon mating in Drosophila. PLoS Biol 14:e1002455–e1002455
Ichinose T, Aso Y, Yamagata N, Abe A, Rubin GM, Tanimoto H (2015) Reward signal in a recurrent circuit drives appetitive long-term memory formation. Elife 4:e10719
Ichinose T, Tanimoto H, Yamagata N (2017) Behavioral modulation by spontaneous activity of dopamine neurons. Front Syst Neurosci 11:88
Inagaki HK, Ben-Tabou de-Leon S, Wong AM, Jagadish S, Ishimoto H, Barnea G, Kitamoto T, Axel R, Anderson DJ, (2012) Visualizing neuromodulation in vivo: TANGO-mapping of dopamine signaling reveals appetite control of sugar sensing. Cell 148:583–595
Inagaki HK, Panse KM, Anderson DJ (2014) Independent, reciprocal neuromodulatory control of sweet and bitter taste sensitivity during starvation in Drosophila. Neuron 84:806–820
Ito M, Doya K (2015) Distinct neural representation in the dorsolateral, dorsomedial, and ventral parts of the striatum during fixed- and free-choice tasks. J Neurosci 35:3499–3514
Jefferis GS, Potter CJ, Chan AM, Marin EC, Rohlfing T, Maurer CR Jr, Luo L (2007) Comprehensive maps of Drosophila higher olfactory centers: spatially segregated fruit and pheromone representation. Cell 128:1187–1203
Ji F, Zhu Y (2015) A novel assay reveals hygrotactic behavior in Drosophila. PLoS ONE 10:e0119162
Joiner WJ, Crocker A, White BH, Sehgal A (2006) Sleep in Drosophila is regulated by adult mushroom bodies. Nature 441:757–760
Kasture AS, Hummel T, Sucic S, Freissmuth M (2018) Big lessons from tiny flies: Drosophila melanogaster as a model to explore dysfunction of dopaminergic and serotonergic neurotransmitter systems. Int J Mol Sci 19:
Kaun KR, Rothenfluh A (2017) Dopaminergic rules of engagement for memory in Drosophila. Curr Opin Neurobiol 43:56–62
Keene AC, Duboue ER, McDonald DM, Dus M, Suh GS, Waddell S, Blau J (2010) Clock and cycle limit starvation-induced sleep loss in Drosophila. Curr Biol 20:1209–1215
Keleman K, Vrontou E, Kruttner S, Yu JY, Kurtovic-Kozaric A, Dickson BJ (2012) Dopamine neurons modulate pheromone responses in Drosophila courtship learning. Nature 489:145–149
Kim H, Kirkhart C, Scott K (2017) Long-range projection neurons in the taste circuit of Drosophila. Elife 6:
Kim YK, Saver M, Simon J, Kent CF, Shao L, Eddison M, Agrawal P, Texada M, Truman JW, Heberlein U (2018) Repetitive aggressive encounters generate a long-lasting internal state in Drosophila melanogaster males. Proc Natl Acad Sci U S A 115:1099–1104
Kimura K, Hachiya T, Koganezawa M, Tazawa T, Yamamoto D (2008) Fruitless and doublesex coordinate to generate male-specific neurons that can initiate courtship. Neuron 59:759–769
Kirkhart C, Scott K (2015) Gustatory learning and processing in the Drosophila mushroom bodies. J Neurosci 35:5950–5958
Kohl J, Huoviala P, Jefferis GS (2015) Pheromone processing in Drosophila. Curr Opin Neurobiol 34:149–157
Kondo S, Takahashi T, Yamagata N, Imanishi Y, Katow H, Hiramatsu S, Lynn K, Abe A, Kumaraswamy A, Tanimoto H (2020) Neurochemical organization of the Drosophila brain visualized by endogenously tagged neurotransmitter receptors. Cell Rep 30:284-297.e285
Krashes MJ, DasGupta S, Vreede A, White B, Armstrong JD, Waddell S (2009) A neural circuit mechanism integrating motivational state with memory expression in Drosophila. Cell 139:416–427
Kume K, Kume S, Park SK, Hirsh J, Jackson FR (2005) Dopamine is a regulator of arousal in the fruit fly. J Neurosci 25:7377–7384
Kuo SY, Wu CL, Hsieh MY, Lin CT, Wen RK, Chen LC, Chen YH, Yu YW, Wang HD, Su YJ, Lin CJ, Yang CY, Guan HY, Wang PY, Lan TH, Fu TF (2015) PPL2ab neurons restore sexual responses in aged Drosophila males through dopamine. Nat Commun 6:7490
Lau MT, Lin YQ, Kisling S, Cotterell J, Wilson YA, Wang QP, Khuong TM, Bakhshi N, Cole TA, Oyston LJ, Cole AR, Neely GG (2017) A simple high throughput assay to evaluate water consumption in the fruit fly. Sci Rep 7:16786
Lewis LP, Siju KP, Aso Y, Friedrich AB, Bulteel AJ, Rubin GM, Grunwald Kadow IC (2015) A higher brain circuit for immediate integration of conflicting sensory information in Drosophila. Curr Biol 25:2203–2214
Li F, Lindsey J, Marin EC, Otto N, Dreher M, Dempsey G, Stark I, Bates AS, Pleijzier MW, Schlegel P, Nern A, Takemura S, Yang T, Francis A, Braun A, Parekh R, Costa M, Scheffer L, Aso Y, Jefferis GSXE, Abbott LF, Litwin-Kumar A, Waddell S, Rubin GM (2020a) The connectome of the adult Drosophila mushroom body: implications for function. bioRxiv 2020.2008.2029.273276
Li J, Mahoney BD, Jacob MS, Caron SJC (2020b) Visual input into the Drosophila melanogaster mushroom body. Cell Rep 32:108138
Lim RS, Eyjólfsdóttir E, Shin E, Perona P, Anderson DJ (2014) How food controls aggression in Drosophila. PLoS ONE 9:e105626
Lima SQ, Miesenböck G (2005) Remote control of behavior through genetically targeted photostimulation of neurons. Cell 121:141–152
Lin S, Owald D, Chandra V, Talbot C, Huetteroth W, Waddell S (2014) Neural correlates of water reward in thirsty Drosophila. Nat Neurosci 17:1536–1542
Lin S, Senapati B, Tsao CH (2019) Neural basis of hunger-driven behaviour in Drosophila. Open Biol 9:180259
Litwin-Kumar A, Harris KD, Axel R, Sompolinsky H, Abbott LF (2017) Optimal degrees of synaptic connectivity. Neuron 93(1153–1164):e1157
Liu C, Placais PY, Yamagata N, Pfeiffer BD, Aso Y, Friedrich AB, Siwanowicz I, Rubin GM, Preat T, Tanimoto H (2012) A subset of dopamine neurons signals reward for odour memory in Drosophila. Nature 488:512–516
Liu H, Kubli E (2003) Sex-peptide is the molecular basis of the sperm effect in <em>Drosophila melanogaster</em>. Proc Natl Acad Sci 100:9929
Liu L, Li Y, Wang R, Yin C, Dong Q, Hing H, Kim C, Welsh MJ (2007) Drosophila hygrosensation requires the TRP channels water witch and nanchung. Nature 450:294–298
Liu Q, Liu S, Kodama L, Driscoll MR, Wu MN (2012) Two dopaminergic neurons signal to the dorsal fan-shaped body to promote wakefulness in Drosophila. Curr Biol 22:2114–2123
Liu Q, Tabuchi M, Liu S, Kodama L, Horiuchi W, Daniels J, Chiu L, Baldoni D, Wu MN (2017) Branch-specific plasticity of a bifunctional dopamine circuit encodes protein hunger. Science 356:534–539
Lubawy J, Urbański A, Colinet H, Pflüger H-J, Marciniak P (2020) Role of the insect neuroendocrine system in the response to cold stress. Front in physiol 11:376–376
Lutas A, Kucukdereli H, Alturkistani O, Carty C, Sugden AU, Fernando K, Diaz V, Flores-Maldonado V, Andermann ML (2019) State-specific gating of salient cues by midbrain dopaminergic input to basal amygdala. Nat Neurosci 22:1820–1833
Mahishi D, Huetteroth W (2019) The prandial process in flies. Curr Opin Insect Sci 36:157–166
Mao Z, Davis RL (2009) Eight different types of dopaminergic neurons innervate the Drosophila mushroom body neuropil: anatomical and physiological heterogeneity. Front Neural Circuits 3:5
Marder E (2012) Neuromodulation of neuronal circuits: back to the future. Neuron 76:1–11
Marder E, O’Leary T, Shruti S (2014) Neuromodulation of circuits with variable parameters: single neurons and small circuits reveal principles of state-dependent and robust neuromodulation. Annu Rev Neurosci 37:329–346
Marella S, Mann K, Scott K (2012) Dopaminergic modulation of sucrose acceptance behavior in Drosophila. Neuron 73:941–950
Marin EC, Buld L, Theiss M, Sarkissian T, Roberts RJV, Turnbull R, Tamimi IFM, Pleijzier MW, Laursen WJ, Drummond N, Schlegel P, Bates AS, Li F, Landgraf M, Costa M, Bock DD, Garrity PA, Jefferis G (2020) Connectomics analysis reveals first-, second-, and third-order thermosensory and hygrosensory neurons in the adult Drosophila brain. Curr Biol 30(3167–3182):e3164
Markow TA, O’Grady P (2008) Reproductive ecology ofDrosophila. Funct Ecol 22:747–759
Masek P, Scott K (2010) Limited taste discrimination in <em>Drosophila</em>. Proc Natl Acad Sci 107:14833
Matsuda W, Furuta T, Nakamura KC, Hioki H, Fujiyama F, Arai R, Kaneko T (2009) Single nigrostriatal dopaminergic neurons form widely spread and highly dense axonal arborizations in the neostriatum. J Neurosci 29:444
Matsumoto M, Hikosaka O (2009) Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature 459:837–841
Mazzoni P, Hristova A, Krakauer JW (2007) Why don’t we move faster? Parkinson’s disease, movement vigor, and implicit motivation. J Neurosci 27:7105
Menegas W, Akiti K, Amo R, Uchida N, Watabe-Uchida M (2018) Dopamine neurons projecting to the posterior striatum reinforce avoidance of threatening stimuli. Nat Neurosci 21:1421–1430
Modi MN, Shuai Y, Turner GC (2020) The Drosophila mushroom body: from architecture to algorithm in a learning circuit. Annu Rev Neurosci 43:465–484
Mohebi A, Pettibone JR, Hamid AA, Wong JT, Vinson LT, Patriarchi T, Tian L, Kennedy RT, Berke JD (2019) Dissociable dopamine dynamics for learning and motivation. Nature 570:65–70
Montague SA, Baker BS (2016) Memory elicited by courtship conditioning requires mushroom body neuronal subsets similar to those utilized in appetitive memory. PLoS ONE 11:e0164516
Murthy M, Fiete I, Laurent G (2008) Testing odor response stereotypy in the Drosophila mushroom body. Neuron 59:1009–1023
Musso PY, Tchenio P, Preat T (2015) Delayed dopamine signaling of energy level builds appetitive long-term memory in Drosophila. Cell Rep 10:1023–1031
Nall A, Sehgal A (2014) Monoamines and sleep in Drosophila. Behav Neurosci 128:264–272
Nevo E, Rashkovetsky E, Pavlicek T, Korol A (1998) A complex adaptive syndrome in Drosophila caused by microclimatic contrasts. Heredity 80:9–16
Nässel DR, Elekes K (1992) Aminergic neurons in the brain of blowflies and Drosophila: dopamine- and tyrosine hydroxylase-immunoreactive neurons and their relationship with putative histaminergic neurons. Cell Tissue Res 267:147–167
Otto N, Pleijzier MW, Morgan IC, Edmondson-Stait AJ, Heinz KJ, Stark I, Dempsey G, Ito M, Kapoor I, Hsu J, Schlegel PM, Bates AS, Feng L, Costa M, Ito K, Bock DD, Rubin GM, Jefferis G, Waddell S (2020) Input connectivity reveals additional heterogeneity of dopaminergic reinforcement in Drosophila. Curr Biol 30(3200–3211):e3208
Owald D, Felsenberg J, Talbot CB, Das G, Perisse E, Huetteroth W, Waddell S (2015) Activity of defined mushroom body output neurons underlies learned olfactory behavior in Drosophila. Neuron 86:417–427
Owald D, Lin S, Waddell S (2015) Light, heat, action: neural control of fruit fly behaviour. Philos Trans R Soc Lond B Biol Sci 370:20140211
Owald D, Waddell S (2015) Olfactory learning skews mushroom body output pathways to steer behavioral choice in Drosophila. Curr Opin Neurobiol 35:178–184
Pavlowsky A, Schor J, Placais PY, Preat T (2018) A GABAergic feedback shapes dopaminergic input on the Drosophila mushroom body to promote appetitive long-term memory. Curr Biol 28(1783–1793):e1784
Perisse E, Owald D, Barnstedt O, Talbot CB, Huetteroth W, Waddell S (2016) Aversive learning and appetitive motivation toggle feed-forward inhibition in the Drosophila mushroom body. Neuron 90:1086–1099
Pimentel D, Donlea JM, Talbot CB, Song SM, Thurston AJF, Miesenböck G (2016) Operation of a homeostatic sleep switch. Nature 536:333–337
Pitman JL, McGill JJ, Keegan KP, Allada R (2006) A dynamic role for the mushroom bodies in promoting sleep in Drosophila. Nature 441:753–756
Placais PY, de Tredern E, Scheunemann L, Trannoy S, Goguel V, Han KA, Isabel G, Preat T (2017) Upregulated energy metabolism in the Drosophila mushroom body is the trigger for long-term memory. Nat Commun 8:15510
Placais PY, Trannoy S, Isabel G, Aso Y, Siwanowicz I, Belliart-Guerin G, Vernier P, Birman S, Tanimoto H, Preat T (2012) Slow oscillations in two pairs of dopaminergic neurons gate long-term memory formation in Drosophila. Nat Neurosci 15:592–599
Plaçais PY, Preat T (2013) To favor survival under food shortage, the brain disables costly memory. Science 339:440–442
Preat T, Placais PY (2019) One must imagine Sisyphus happy”: unveiling the intimate secrets of a tenacious fruitfly. Neuron 104:432–435
Ravbar P, Branson K, Simpson JH (2019) An automatic behavior recognition system classifies animal behaviors using movements and their temporal context. J Neurosci Methods 326:108352
Rice ME, Patel JC, Cragg SJ (2011) Dopamine release in the basal ganglia. Neuroscience 198:112–137
Riemensperger T, Issa AR, Pech U, Coulom H, Nguyen MV, Cassar M, Jacquet M, Fiala A, Birman S (2013) A single dopamine pathway underlies progressive locomotor deficits in a Drosophila model of Parkinson disease. Cell Rep 5:952–960
Riemensperger T, Voller T, Stock P, Buchner E, Fiala A (2005) Punishment prediction by dopaminergic neurons in Drosophila. Curr Biol 15:1953–1960
Sarin S, Dukas R (2009) Social learning about egg-laying substrates in fruitflies. Proc Biol Sci 276:4323–4328
Saunders BT, Richard JM, Margolis EB, Janak PH (2018) Dopamine neurons create Pavlovian conditioned stimuli with circuit-defined motivational properties. Nat Neurosci 21:1072–1083
Sayin S, Boehm AC, Kobler JM, De Backer JF, Grunwald Kadow IC (2018) Internal state dependent odor processing and perception-the role of neuromodulation in the fly olfactory system. Front Cell Neurosci 12:11
Sayin S, De Backer JF, Siju KP, Wosniack ME, Lewis LP, Frisch LM, Gansen B, Schlegel P, Edmondson-Stait A, Sharifi N, Fisher CB, Calle-Schuler SA, Lauritzen JS, Bock DD, Costa M, Jefferis G, Gjorgjieva J, Grunwald Kadow IC (2019) A neural circuit arbitrates between persistence and withdrawal in hungry Drosophila. Neuron 104(544–558):e546
Scaplen KM, Kaun KR (2016) Reward from bugs to bipeds: a comparative approach to understanding how reward circuits function. J Neurogenet 30:133–148
Schultz W (2015) Neuronal reward and decision signals: from theories to data. Physiol Rev 95:853–951
Schultz W (2016) Dopamine reward prediction-error signalling: a two-component response. Nat Rev Neurosci 17:183–195
Schultz W (2019) Recent advances in understanding the role of phasic dopamine activity. F1000Res 8:
Schultz W, Dayan P, Montague PR (1997) A neural substrate of prediction and reward. Science 275:1593
Scott K (2018) Gustatory processing in Drosophila melanogaster. Annu Rev Entomol 63:15–30
Senapati B, Tsao CH, Juan YA, Chiu TH, Wu CL, Waddell S, Lin S (2019) A neural mechanism for deprivation state-specific expression of relevant memories in Drosophila. Nat Neurosci 22:2029–2039
Sengupta S, Smith DP (2014) Frontiers in Neuroscience How Drosophila detect volatile pheromones: signaling, circuits, and behavior. In: Mucignat-Caretta C (ed) Neurobiology of chemical communication. CRC Press/Taylor & Francis ©, 2014 by Taylor & Francis Group LLC Boca Raton (FL)
Seugnet L, Suzuki Y, Thimgan M, Donlea J, Gimbel SI, Gottschalk L, Duntley SP, Shaw PJ (2009) Identifying sleep regulatory genes using a Drosophila model of insomnia. J Neurosci 29:7148–7157
Shi WX (2005) Slow oscillatory firing: a major firing pattern of dopamine neurons in the ventral tegmental area. J Neurophysiol 94:3516–3522
Shih HW, Wu CL, Chang SW, Liu TH, Lai JS, Fu TF, Fu CC, Chiang AS (2015) Parallel circuits control temperature preference in Drosophila during ageing. Nat Commun 6:7775
Shyu WH, Chiu TH, Chiang MH, Cheng YC, Tsai YL, Fu TF, Wu T, Wu CL (2017) Neural circuits for long-term water-reward memory processing in thirsty Drosophila. Nat Commun 8:15230
Siju KP, Stih V, Aimon S, Gjorgjieva J, Portugues R, Grunwald Kadow IC (2020) Valence and state-dependent population coding in dopaminergic neurons in the fly mushroom body. Curr Biol 30(2104–2115):e2104
Sitaraman D, Aso Y, Jin X, Chen N, Felix M, Rubin GM, Nitabach MN (2015) Propagation of homeostatic sleep signals by segregated synaptic microcircuits of the Drosophila mushroom body. Curr Biol 25:2915–2927
Sitaraman D, Aso Y, Rubin GM, Nitabach MN (2015) Control of sleep by dopaminergic inputs to the Drosophila mushroom body. Front Neural Circuits 9:73
Stensmyr MC, Dweck HK, Farhan A, Ibba I, Strutz A, Mukunda L, Linz J, Grabe V, Steck K, Lavista-Llanos S, Wicher D, Sachse S, Knaden M, Becher PG, Seki Y, Hansson BS (2012) A conserved dedicated olfactory circuit for detecting harmful microbes in Drosophila. Cell 151:1345–1357
Strutz A, Soelter J, Baschwitz A, Farhan A, Grabe V, Rybak J, Knaden M, Schmuker M, Hansson BS, Sachse S (2014) Decoding odor quality and intensity in the Drosophila brain. Elife 3:e04147
Suh GS, Ben-Tabou de Leon S, Tanimoto H, Fiala A, Benzer S, Anderson DJ (2007) Light activation of an innate olfactory avoidance response in Drosophila. Curr Biol 17:905–908
Sun R, Delly J, Sereno E, Wong S, Chen X, Wang Y, Huang Y, Greenspan RJ (2020) Anti-instinctive Learning Behavior Revealed by Locomotion-Triggered Mild Heat Stress in Drosophila. Frontiers in Behavioral Neuroscience 14:
Syed EC, Grima LL, Magill PJ, Bogacz R, Brown P, Walton ME (2016) Action initiation shapes mesolimbic dopamine encoding of future rewards. Nat Neurosci 19:34–36
Taghert PH, Nitabach MN (2012) Peptide neuromodulation in invertebrate model systems. Neuron 76:82–97
Takemura SY, Aso Y, Hige T, Wong A, Lu Z, Xu CS, Rivlin PK, Hess H, Zhao T, Parag T, Berg S, Huang G, Katz W, Olbris DJ, Plaza S, Umayam L, Aniceto R, Chang LA, Lauchie S, Ogundeyi O, Ordish C, Shinomiya A, Sigmund C, Takemura S, Tran J, Turner GC, Rubin GM, Scheffer LK (2017) A connectome of a learning and memory center in the adult Drosophila brain. Elife 6:
Tanimoto H, Heisenberg M, Gerber B (2004) Experimental psychology: event timing turns punishment to reward. Nature 430:983
Threlfell S, Lalic T, Platt NJ, Jennings KA, Deisseroth K, Cragg SJ (2012) Striatal dopamine release is triggered by synchronized activity in cholinergic interneurons. Neuron 75:58–64
Tomchik SM (2013) Dopaminergic neurons encode a distributed, asymmetric representation of temperature in Drosophila. J Neurosci 33:2166–2176a
Tritsch NX, Sabatini BL (2012) Dopaminergic modulation of synaptic transmission in cortex and striatum. Neuron 76:33–50
Trotta V, Calboli FCF, Ziosi M, Guerra D, Pezzoli MC, David JR, Cavicchi S (2006) Thermal plasticity in Drosophila melanogaster: a comparison of geographic populations. BMC Evol Biol 6:67
Tsao CH, Chen CC, Lin CH, Yang HY, Lin S (2018) Drosophila mushroom bodies integrate hunger and satiety signals to control innate food-seeking behavior. Elife 7:
Ueno T, Tomita J, Tanimoto H, Endo K, Ito K, Kume S, Kume K (2012) Identification of a dopamine pathway that regulates sleep and arousal in Drosophila. Nat Neurosci 15:1516–1523
Vogt K, Aso Y, Hige T, Knapek S, Ichinose T, Friedrich AB, Turner GC, Rubin GM, Tanimoto H (2016) Direct neural pathways convey distinct visual information to Drosophila mushroom bodies. eLife 5:e14009
Voorn P, Vanderschuren LJ, Groenewegen HJ, Robbins TW, Pennartz CM (2004) Putting a spin on the dorsal-ventral divide of the striatum. Trends Neurosci 27:468–474
Vosshall LB, Stocker RF (2007) Molecular architecture of smell and taste in Drosophila. Annu Rev Neurosci 30:505–533
Walker SJ, Corrales-Carvajal VM, Ribeiro C (2015) Postmating circuitry modulates salt taste processing to increase reproductive output in Drosophila. Curr Biol 25:2621–2630
Wang L, Anderson DJ (2010) Identification of an aggression-promoting pheromone and its receptor neurons in Drosophila. Nature 463:227–231
Watabe-Uchida M, Uchida N (2018) Multiple dopamine systems: weal and woe of dopamine. Cold Spring Harb Symp Quant Biol 83:83–95
Wilson RI (2013) Early olfactory processing in Drosophila: mechanisms and principles. Annu Rev Neurosci 36:217–241
Yagi R, Mabuchi Y, Mizunami M, Tanaka NK (2016) Convergence of multimodal sensory pathways to the mushroom body calyx in Drosophila melanogaster. Sci Rep 6:29481
Yamagata N, Hiroi M, Kondo S, Abe A, Tanimoto H (2016) Suppression of dopamine neurons mediates reward. PLoS Biol 14:e1002586
Yamagata N, Ichinose T, Aso Y, Placais PY, Friedrich AB, Sima RJ, Preat T, Rubin GM, Tanimoto H (2015) Distinct dopamine neurons mediate reward signals for short- and long-term memories. Proc Natl Acad Sci U S A 112:578–583
Yang C-h, Belawat P, Hafen E, Jan LY, Jan Y-N (2008) <em>Drosophila</em> egg-laying site selection as a system to study simple decision-making processes. Science 319:1679
Yang CH, He R, Stern U (2015) Behavioral and circuit basis of sucrose rejection by Drosophila females in a simple decision-making task. J Neurosci 35:1396–1410
Zell V, Steinkellner T, Hollon NG, Warlow SM, Souter E, Faget L, Hunker AC, Jin X, Zweifel LS, Hnasko TS (2020) VTA glutamate neuron activity drives positive reinforcement absent dopamine co-release. Neuron
Zhang SX, Miner LE, Boutros CL, Rogulja D, Crickmore MA (2018) Motivation, perception, and chance converge to make a binary decision. Neuron 99(376–388):e376
Zhang SX, Rogulja D, Crickmore MA (2016) Dopaminergic circuitry underlying mating drive. Neuron 91:168–181
Zhang SX, Rogulja D, Crickmore MA (2019) Recurrent circuitry sustains Drosophila courtship drive while priming itself for satiety. Curr Biol 29(3216–3228):e3219
Zhao X, Lenek D, Dag U, Dickson BJ, Keleman K (2018) Persistent activity in a recurrent circuit underlies courtship memory in Drosophila. Elife 7:
Zheng Z, Lauritzen JS, Perlman E, Robinson CG, Nichols M, Milkie D, Torrens O, Price J, Fisher CB, Sharifi N, Calle-Schuler SA, Kmecova L, Ali IJ, Karsh B, Trautman ET, Bogovic JA, Hanslovsky P, Jefferis G, Kazhdan M, Khairy K, Saalfeld S, Fetter RD, Bock DD (2018) A complete electron microscopy volume of the brain of adult Drosophila melanogaster. Cell 174(730–743):e722
We thank Sophie Aimon and Francisco J. Rodriguez for comments on the manuscript and many discussions.
Open Access funding enabled and organized by Projekt DEAL. Research in the Grunwald Kadow lab is supported, primarily, by the German Research foundation (DFG, e.g., SFB870 and FOR2705) and an ERC starting grant (FlyContext).
Conflict of interest
The authors declare that they have no conflict of interest.
This manuscript contains no primary data on animals and therefore did not require an ethical approval.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Siju, K.P., De Backer, JF. & Grunwald Kadow, I.C. Dopamine modulation of sensory processing and adaptive behavior in flies. Cell Tissue Res 383, 207–225 (2021). https://doi.org/10.1007/s00441-020-03371-x
- Mushroom body
- State-dependent behavior