Abstract
Background
Generally, utility based decision making models focus on experimental outcomes. In this paper we propose a utility model based on molecular diffusion to simulate the choice behavior of Drosophila larvae exposed to different light conditions.
Methods
In this paper, light/dark choice-based Drosophila larval phototaxis is analyzed with our molecular diffusion based model. An ISCEM algorithm is developed to estimate the model parameters.
Results
By applying this behavioral utility model to light intensity and phototaxis data, we show that this model fits the experimental data very well.
Conclusions
Our model provides new insights into decision making mechanisms in general. From an engineering viewpoint, we propose that the model could be applied to a wider range of decision making practices.
Similar content being viewed by others
Background
Animals (including human beings) face the problem of choice making at both individual and population levels. Drosophila is a model animal that exhibits choice behaviors in various taxis responses. Decision making theories employ the concept of utility as a basis for choice. Utility maximization is a basic presumption of behavioral decisions [1]. If an animal consistently chooses one option in a given set of circumstances, that option is assigned a higher utility than the competing options at the time of decision. Insofar as choice is adaptive, the utilities of goal objects and activities can be considered subjective estimates of potential contributions to fitness [2]. Because utility plays an import role in decision making theories, it is meaningful to study the utility model from animal behaviors to help us make optimal judgments.
Phototaxis is generally considered a form of light dependent preference behavior in animals. In the fruit fly Drosophila melanogaster, it is well known that wild type adults show positive phototaxis while negative phototaxis is seen in larvae [3–7]. From time of hatching to the early third instar stage, larvae robustly avoid light [3, 8, 9]. Immediately prior to pupation, light avoidance declines dramatically and animals become photoneutral, while adult flies are strongly attracted to light [3, 8, 9]. These behavioral changes undoubtedly reflect an innate search for suitable environments and a quest for survival. Early-instar larvae eat voraciously and, by avoiding light, they immerse themselves in food-rich environments while also avoiding predators. In addition to becoming less photophobic, wandering third instar larvae cease feeding and exit food to pupate. Survival rates are low for larvae that pupate in food. It seems unlikely that a change in visual behavior is the sole reason for larvae to leave the food, but rather that during this stage an array of developmentally programmed behavioral changes occur [9].
Decision making in Drosophila larvae exposed to different light conditions can be tested in a simple light/dark choice assay [3, 4], in which the larvae are free to move towards their preferred light condition. During the phototaxis assay, larval distribution in the different light conditions changes dynamically as larvae seek the preferred condition. The complete mechanism underlying larval phototaxis is not yet clearly understood, but significant progress has been made in recent years [9]. The two small eyes of the larva are much simpler than the compound eye of the adult. Each larval eye, also termed the 'Bolwig Organ' (BO), is composed of only 12 photoreceptor neurons (PRs), which are divided into two subtypes according to the rhodopsin gene they express. Eight PRs express the green-sensitive rhodopsin6 (rh6) and four express the blue-sensitive rhodopsin5 (rh5) [10–12]. When light is detected by the PRs, signals are sent to downstream 5th lateral neurons (LNs) using acetylcholine (Ach) as the neurotransmitter [3, 6, 9]. Further downstream, the so-called NP394 neurons are known to control larval light preference, but how these NP394 neurons trigger motor neuron responses at the output layer remains unknown [5].
Diffusion plays a crucial role in brain function because diffusion moves informational substances between cells [13]. To understand how information is processed between cells in larval phototaxis changes, we need to know how mobility and local interactions of molecules lead to variability in light preference. Changes in the extracellular environment are usually transmitted in the cell through changes in the conformation or association of intracellular proteins. In the simplest case, the information contained in the state of these proteins is transmitted through space by their diffusional mobility [14]. That is, on a fundamental level, fluctuations in intracellular or extracellular molecular positions can occur by diffusion [15]. Fick's Second Law, also known as the Diffusion Equation, describes non-steady-state diffusion and is typically used to model molecular mobility [14–16]. Because the Diffusion Equation is nonlinear, the correct parameters can be obtained by global optimization.
In conventional least square (LS) regressions for nonlinear problems, it is not easy to obtain analytical derivatives with respect to target parameters. Even if the derivatives can be obtained analytically or numerically, one must take care to choose the correct initial values for iterative equation-solving processes, because some undesired, locally optimized solutions may also satisfy the equation. Nonlinear problems may possess multiple local minima; finding the global minimum is usually difficult using conventional LS regressions [17]. On the other hand, one can try to match coefficients of the polynomial with least squares fitting by solving a linear system. The linear system is obtained by minimizing the total square error. However, the linear system is ill-conditioned for high polynomial order [18].
The shuffled complex evolution metropolis algorithm (SCEM-UA) is a global-searching algorithm based on improvements of the shuffled complex evolution algorithm (SCE-UA) developed by Duan et al [19]. The SCEM-UA method adopts Markov Chain Monte Carlo theory (MCMC) and uses the Metropolis-Hastings algorithm (MH), replacing the Downhill Simplex method, to obtain a global optimal estimation [19]. The SCEM-UA algorithm is used to estimate mixed Weibull distribution parameters in automotive reliability analysis. The results are compared with maximum likelihood estimation (MLE) results. In published examples, SCEM-UA has been shown to deliver more accurate results than MLE [20]. Although SCEM-UA can successfully obtain the global optimal solution, its performance depends on correct setting of the minimal and maximal limits. In the current study, we improve the SCEM-UA algorithm so that it can optimize the parameter searching space and obtain the optimal solution. This improved algorithm is termed the ISCEM algorithm.
From the above discussion of larval phototaxis neural mechanism, we infer that molecular mobility (of, for example, acetylcholine) plays a critically important role in larval phototaxis processes. In essence, the larvae convert light stimuli to molecular propagation processes. The molecular mobility in larval phototaxis is apparently based on the diffusion of molecules inside or outside neural cells [14–16]. That is, larval photophobia in Drosophila is a process of larval molecular movement driven by light intensity. Thus, we can use the molecular diffusion model to describe the larval light avoidance behavior, replacing molecular concentration with light intensity as the driving force. Although the underlying molecular mechanism remains unclear, it is possible that some biological molecules are synthesized at high concentration, and are reduced to lower concentration by diffusion; for example, the neurotransmitters or other neuropeptides involved in photophobic behavior. Based on such understanding, we use the Diffusion Equation as our decision making model and then test its compatibility with the experimental data.
In summary, we propose a utility model derived from molecular diffusion to quantitatively investigate the relationship between light intensity and Drosophila larval photophobia, with the aid of a math ISCEM algorithm. By testing the model with experimental data, we find that the dynamic process of larval phototaxis and light intensity-photophobia is well simulated. Although the neural mechanism underlying this utility model is unclear, this model enhances our understanding of decision making mechanisms from an engineering viewpoint. We expect that this model can provide insights into the neural basis of decision making activities.
Materials and methods
Fly stock
Fly strain w1118 larvae were reared on standard medium [21] under conditions of normal light/dark (LD) cycles. In all experiments, early to mid-3rd-instar larvae (72-96h after egg laying) were used.
Behavioral assay
All behavioral tests were performed at room temperature (22-24°C) between 10:00 am and 5:00 pm. The 11-min phototaxis tests were performed following the protocol introduced by Mazzoni et al. with modifications [3, 4]. In brief, 8 cm petri dishes containing 1.5% Bacto Agar, with one half of the lid covered with black electrical tape, were illuminated from above using an 11W energy-saving fluorescent light (Leike Inc). Early third instar larvae were removed from food and washed with fresh distilled water. For each test, 20 larvae were placed on the agar surface and allowed to move freely for 11 minutes before their numbers on each side of the testing plate were counted (Figure 1). The light avoidance index (AI) was calculated as AI = (number of larvae in the dark half - number of larvae in the light half)/(number of larvae in the dark half + number of larvae in the light half). Specifically for the larval dynamic distribution analysis, all larvae were initially placed in the light half but at distances of no more than 1 cm from the dark/light boundary. Light intensities were 150, 350, 550, 750 and 950 lux. The corresponding avoidance indices of w1118 under these light conditions are shown in Table 1.
Building the utility model
According to Fick's second law of diffusion [16], the spatial distribution of particles emitted from a source evolves as:
in which t is the time, x is the distance from the molecule-producing source; D is the diffusion coefficient, and V is the concentration of the molecule at distance x from the source.
Under initial conditions of t = 0 and x > 0, V = 0; under marginal conditions of t > 0 and x = 0, V = V s . When t > 0 and x = ∞, V = 0.
The solution of equation (1) is
where .
From Equation (2), it is apparent that
where V i is the output concentration of source i.
We emphasize that Drosophila larval photophobia is based on molecular movement in the larva, driven by light intensity. As mentioned in the Background section, we understand that larval light avoidance behavior mimics molecular diffusion, and that diffusive processes are involved in photophobia at the cellular level. Equation (3) therefore forms the basis of our decision making model.
ISCEM algorithm: An improved SCEM-UA algorithm
Suppose ŷ = η (ζ | θ), where ŷ × 1 vector of model predictions, ζ is an N × n matrix of input variables and θ is a vector of n unknown parameters. The SCEM-UA algorithm is given below:
-
(1)
To initialize the process, choose the population size s and the number of complexes q. The algorithm tentatively assumes that the number of sequences is identical to the number of complexes.
-
(2)
Generate s samples from the prior distribution {θ 1 ,θ 2 ,...,θ s } and compute the posterior density {p(θ (1) | y),p(θ (2) | y),...,p(θ (s) | y)} at each point [19].
-
(3)
Sort the points in order of decreasing posterior density and store them in an array D[1:s,1:n+1], where n is the number of parameters, so that the first row of D represents the point with the highest posterior density. The extra column stores the posterior density. Initialize the starting points of the parallel sequences, S1,S2,...,S q , such that S k is D[k,1:n+1], where k = 1,2,...,q.
-
(4)
Partition D into q complexes Cl,C2,...,C q , each containing m points, such that the first complex contains every q(j - 1) + 1 ranked point, the second complex contains every q(j - 1) + 2 ranked point of D, and so on, where j = 1,2,...,m.
-
(5)
Initialize L,T,ARmin, cn. For each C k , call the SEM algorithm [19] and run it L times;
-
(6)
Unpack all complexes C back into D and rank the points in order of decreasing posterior density.
-
(7)
Check Gelman and Rubin (GR) convergence statistic. If convergence criteria are satisfied, stop; otherwise, return to step 4.
The ISCEM algorithm is given below:
-
(1)
Suppose Imin≤θ≤Imax , Imin and Imax are interval vectors of θ. The initial Imax is set to be very large. Run the SCEM-UA algorithm and let the output parameter vector with highest posterior density (p o ) be θ o . Set Imax = θ o .
-
(2)
Run the SCEM-UA algorithm again, and let the output parameter vector with highest posterior density (p w ) be θ w . If || p o - p w || ≤ ε , where ε > 0, go to step (4); otherwise set θ o = θ w .
-
(3)
If p o ≤ p w , let Imax = θ w ; otherwise, let Imin = θ w . Let p o = p w , go to step (2).
-
(4)
Output θ w .
Results
Simulating Drosophila larval phototaxis dynamics with the model
To use our utility model to simulate the relationship between light intensity and Drosophila larval photophobia, Equation (3) is rewritten as
in which f(t) denotes photophobia (assessed by AI), α and β are constants, l is light intensity, and t is the time of light exposure (in minutes).
When the light intensity is large enough and/or the testing time is long enough, the larvae may all crawl to the dark section of the plate (i.e. AI = 1). Under these circumstances, the larvae obtain no stimulus from the light. To account for this phenomenon, if f(t) calculated from equation (4) exceeds 1, its value is set to 1; that is, an upper bound of 1 is imposed on f(t).
To validate the model, we simulate experimental data. Best estimates of the model parameters are obtained using the ISCEM method, which can realize parameter estimation of complex functions and has a global optimal search capability. Experimental data shown in Figure 2 are used as inputs.
Feeding these data into the ISCEM algorithm, the parameters of the model are
α = 0.001459, β = 0.56532
and the model equation becomes
With the form of the model now specified, we then predict the time course of the AI under light intensity 550 lux. The predicted data are compatible with experimental AI records, as shown in Figure 2.
The comparison statistics between model prediction and experimental data are: mean of error = -0.002, standard deviation of error = 0.14, mean of absolute error = 0.11, standard deviation of absolute error = 0.09. The determination coefficient R2 = 0.42. The F-value is 14.28 and F0.01(1,20) is 8.10. Because the F-value > F0.01(1,20), the model passes the F-test. Considering that biological data are inherently prone to experimental noise, the model provides good matches to the experimental data.
Validation of the model with experiment data from other light intensities
We externally validate the model further by investigating the relationship between AI and light intensity. In estimates of external validity, some samples should be excluded from the parameter estimation [22]. We replace 550 lux with varying light intensity l. The model described by Equation (5) now becomes:
Setting t = 11, we can compute the AI data for different light intensities (See Table 2). The predicted data align well with experimental AI records, as shown in Figure3. The comparison statistics between model prediction and experimental data are: mean of error = -0.03, standard deviation of error = 0.07, mean of absolute error = 0.05, standard deviation of absolute error = 0.04. The determination coefficient is 0.94. Given these statistics, we conclude that the data predicted from the model closely match the experimental data.
Conclusions
In this paper, we build a utility model to simulate the light preference in Drosophila larval phototaxis behavior. The model can successfully simulate both the dynamics of larval redistribution and the relationship between avoidance index and light intensity, suggesting that our model can be developed into a new form of decision making model.
Fick's second law of diffusion, the basis of the model, has been widely applied in engineering and material studies in addition to biological/medical studies [23–27]. The molecular diffusion process, which decreases the molecular concentration at the source by spreading the particles through a wider volume, is mimicked in certain animal behaviors. When the molecular concentration in the diffusion equation is replaced with the outside stimulus intensity, this model can simulate the processes of various fly behavior preferences, such as phototaxis, thermotaxis, chemotaxis, odortaxis, etc. [5, 28–30].
As the molecular diffusion based utility model can correctly simulate the experimental data of larval phototaxis, it is natural to postulate that specific molecules diffuse around and along the neural network to generate the phototaxis behavior. Currently, how this biological mechanism functions is poorly understood. It is known that neuropeptides and neurotransmitters (such as acetylcholine that mediates signaling between photoreceptors and secondary neurons) play key roles in larval phototaxis [6, 9]. Further study on related neurotransmitters and signaling neuropeptides is required to verify this model at the molecular level.
Since molecular mobility is the neural basis of animal behavior, it is reasonable to postulate that all animal physiological and behavioral functions can be simulated with such a model. For the larval photophobia investigated in this paper, the experimental data matches well with model prediction. We anticipate that this utility model may be applied to decision making behavior in humans, which is very similar to animal choice behavior [31], though more experimental data are needed to confirm this. In any case, the model may aid our understanding of the human decision making process. With further optimization and refinement, the model could provide a new tool by which to study generic decision making behaviors. To this end, the model must be tested over a wide range of choice behaviors; this goal will be addressed in future studies.
References
Montague PR, Berns GS: Neural economics and the biological substrates of valuation. Neuron. 2002, 36: 265-84. 10.1016/S0896-6273(02)00974-1.
Shizgal P: Neural basis of utility estimation. Curr Opin Neurobiol. 1997, 7: 198-208. 10.1016/S0959-4388(97)80008-6.
Mazzoni EO, Desplan C, Blau J: Circadian pacemaker neurons transmit and modulate visual information to control a rapid behavioral response. Neuron. 2005, 45: 293-300. 10.1016/j.neuron.2004.12.038.
Gong Z: Behavioral dissection of Drosophila larval phototaxis. Biochem Biophys Res Commun. 2009, 382: 395-399. 10.1016/j.bbrc.2009.03.033.
Gong Z, Liu J, Guo C, Zhou Y, Teng Y, Liu L: Two pairs of neurons in the central brain control Drosophila innate light preference. Science. 2010, 330: 499-502. 10.1126/science.1195993.
Keene AC, Mazzoni EO, Zhen J, Younger MA, Yamaguchi S, Blau J, Desplan C, Sprecher SG: Distinct visual pathways mediate Drosophila larval light avoidance and circadian clock entrainment. J Neurosci. 2011, 31: 6527-6534. 10.1523/JNEUROSCI.6165-10.2011.
Gao S, Takemura SY, Ting CY, Huang S, Lu Z, Luan H, Rister J, Thum AS, Yang M, Hong ST, Wang JW, Odenwald WF, White BH, Meinertzhagen IA, Lee CH: The neural substrate of spectral preference in Drosophila. Neuron. 2008, 60: 328-342. 10.1016/j.neuron.2008.08.010.
Sawin-McCormack EP, Sokolowski MB, Campos AR: Characterization and genetic analysis of Drosophila melanogaster photobehavior during larval development. J Neurogenet. 1995, 10: 119-135. 10.3109/01677069509083459.
Keene AC, Sprecher SG: Seeing the light: photobehavior in fruit fly larvae. Trends in Neurosciences. 2012
Sprecher SG, Desplan C: Switch of rhodopsin expression in terminally differentiated Drosophila sensory neurons. Nature. 2008, 454: 533-537. 10.1038/nature07062.
Green P, Hartenstein AY, Hartenstein V: The embryonic development of the Drosophila visual system. Cell Tissue Res. 1993, 273: 583-598. 10.1007/BF00333712.
Helfrich-Förster C, Edwards T, Yasuyama K, Wisotzki B, Schneuwly S, Stanewsky R, Meinertzhagen IA, Hofbauer A: The extraretinal eyelet of Drosophila: development, ultrastructure, and putative circadian function. J Neurosci. 2002, 22: 9255-9266.
Nicholson C: Diffusion and related transport mechanisms in brain tissue. Rep Prog Phys. 2001, 64: 815-884. 10.1088/0034-4885/64/7/202.
Dehmelt L, Bastiaens PIH: Spatial organization of intracellular communication: insights from imaging. Nature Reviews Molecular Cell Biology. 2010, 11: 440-452. 10.1038/nrm2903.
Einstein A: The motion of elements suspended in static liquids as claimed in the molecular kinetic theory of heat. Ann Phys. 1905, 17: 549-560.
Smith WF: Foundations of Materials Science and Engineering. 2004, New York: McGraw-Hill, 3
Tomioka S, Nisiyama S, Enoto T: IEEE Transactions on Evolutionary Computation. 2007, 11 (1): 1-16.
Dahlquist G, Björck Å: Numerical methods. 2003, NY: Courier Dover Publications
Vrugt JA, Gupta HV, Bouten W, Sorooshian S: A Shuffled Complex Evolution Metropolis algorithm for optimization and uncertainty assessment of hydrological model parameters. Water Resour Res. 2003, 39: 1201-1238.
Gong Z: Estimation of mixed Weibull distribution parameters using the SCEM-UA algorithm: Application and comparison with MLE in automotive reliability analysis. Reliability Engineering and System Safety. 2006, 91: 915-922.
Guo A, Li L, Xia SZ, Feng CH, Wolf R, Heisenberg M: Conditioned visual flight orientation in Drosophila: dependence on age, practice, and diet. Learn Mem. 1996, 3: 49-59. 10.1101/lm.3.1.49.
Kennedy CE, Turley JP: Time series analysis as input for clinical predictive modeling: Modeling cardiac arrest in a pediatric ICU. Theoretical Biology and Medical Modelling. 2011, 8: 40-10.1186/1742-4682-8-40.
Koutsopoulosa S, Unsworth LD, Nagaia Y, Zhang S: Controlled release of functional proteins through designer self-assembling peptide nanofiber hydrogel scaffold. Proc Natl Aca Sci. 2009, 106: 4623-4628. 10.1073/pnas.0807506106.
Wheatley DN: Diffusion theory, the cell and the synapse. Biosystems. 1998, 45: 151-63. 10.1016/S0303-2647(97)00073-7.
Noblin X, Mahadevan L, Coomaraswamy IA, Weitz DA, Holbrook NM, Zwieniecki MA: Optimal vein density in artificial and real leaves. Proc Natl Aca Sci. 2008, 105: 9140-9144. 10.1073/pnas.0709194105.
Sisomphon K, Franke L: Carbonation rates of concretes containing high volume of pozzolanic materials. Cement and Concrete Research. 2007, 7: 1647-1653.
Dix JA, Verkman AS: Crowding Effects on Diffusion in Solutions and Cells. Annual Review of Biophysics. 2008, 37: 247-263. 10.1146/annurev.biophys.37.032807.125824.
Lahiri S, Shen K, Klein M, Tang A, Kane E, Gershow M, Garrity P, Samuel ADT: Two Alternating Motor Programs Drive Navigation in Drosophila Larva. PLoS ONE. 2011, 6 (8): e23180-10.1371/journal.pone.0023180.
Fishilevich E, Domingos AI, Asahina K, Naef F, Vosshall LB, Louis M: Chemotaxis Behavior Mediated by Single Larval Olfactory Neurons in Drosophila. Current Biology. 2005, 15: 2086-2096. 10.1016/j.cub.2005.11.016.
Gomez-Marin A, Stephens GJ, Louis M: Active sampling and decision making in Drosophila chemotaxis. Nature Communications. 2011, 2: 441-
Louâpre P, Alphen JJMV, Pierre J: Humans, and Insects Decide in Similar Ways. PLoS ONE. 2010, 5 (12): e14251-10.1371/journal.pone.0014251.
Acknowledgements
This research is supported by the National Natural Science Foundation of China (No. 31070944).
Author information
Authors and Affiliations
Corresponding authors
Additional information
Competing interests
The authors declare that they have no competing interests.
Authors' contributions
ZG (Zhejun Gong) conceived the idea and wrote the manuscript. ZG (Zhefeng Gong) designed and undertook the experiments. All authors read and approved the final manuscript.
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
Rights and permissions
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
About this article
Cite this article
Gong, Z., Gong, Z. A molecular diffusion based utility model for Drosophila larval phototaxis. Theor Biol Med Model 9, 3 (2012). https://doi.org/10.1186/1742-4682-9-3
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/1742-4682-9-3