Abstract
Animal movement is essential to our understanding of population dynamics, animal behavior, and the impacts of global change. Coupled with high-resolution biotelemetry data, exciting new inferences about animal movement have been facilitated by various specifications of contemporary models. These approaches differ, but most share common themes. One key distinction is whether the underlying movement process is conceptualized in discrete or continuous time. This is perhaps the greatest source of confusion among practitioners, both in terms of implementation and biological interpretation. In general, animal movement occurs in continuous time but we observe it at fixed discrete-time intervals. Thus, continuous time is conceptually and theoretically appealing, but in practice it is perhaps more intuitive to interpret movement in discrete intervals. With an emphasis on state-space models, we explore the differences and similarities between continuous and discrete versions of mechanistic movement models, establish some common terminology, and indicate under which circumstances one form might be preferred over another. Counter to the overly simplistic view that discrete- and continuous-time conceptualizations are merely different means to the same end, we present novel mathematical results revealing hitherto unappreciated consequences of model formulation on inferences about animal movement. Notably, the speed and direction of movement are intrinsically linked in current continuous-time random walk formulations, and this can have important implications when interpreting animal behavior. We illustrate these concepts in the context of state-space models with multiple movement behavior states using northern fur seal (Callorhinus ursinus) biotelemetry data.
Similar content being viewed by others
Introduction
Animal movement is at the heart of many important ecological processes and considered essential for a better understanding of population dynamics, animal behavior, and the impacts of global change. However, movement is a complex process modulated by many factors acting at different spatial and temporal scales. Our ability to study animal movement has been bolstered by recent advances in animal-borne biologging technology that have permitted the collection of detailed location and biotelemetry data [1-3]. The quality and quantity of information from these devices is rapidly increasing, and there has been a recent flood in the development of sophisticated statistical models that use these data for model-based inferences about animal movement and associated behaviors [4-8].
This myriad of new methods for analyzing movement data can make the selection of any particular method (or model) a difficult task, particularly for ecologists and wildlife biologists without formal statistical training. This poses a dilemma because ecologists and biologists constitute the vast majority of scientists collecting the very data for which these methods were developed. The complexities of animal movement and location data require sophisticated analytical techniques, but we believe that the inconsistent mathematical and statistical jargon used to describe these methods may be discouraging their widespread application by non-statisticians. In our experience, the greatest source of confusion among practitioners, both in terms of implementation and biological interpretation, seems to be the distinction between continuous- and discrete-time formulations of the movement process.
Here we briefly review several of the model-based (non-phenomenological) approaches for analyzing animal location data that have been proposed in recent years. We then focus on how time is formulated in these movement process models, establish some common terminology (see Table 1), elucidate the differences and similarities among them, and identify some potential advantages and limitations. We also present novel mathematical results (see Does a continuous- or discrete-time formulation really matter? ) refuting the overly simplistic view that discrete- and continuous-time conceptualizations are merely different means to the same end in terms of inferences about animal movement. We then illustrate these concepts in the context of state-space models with multiple movement behavior states using northern fur seal (Callorhinus ursinus) movement data collected in the Pribilof Islands of Alaska, USA.
Review
Characterization of the movement process
Regardless of the underlying statistical framework, most analyses of animal location data that are based on hierarchical movement models consist of two components: a mechanistic model for the movement process and a statistical model for the observation process. Although earlier methods ignored error in the location of observations [5,9,10], most contemporary approaches simultaneously model both the movement process and observation process using a so-called’ “state-space” framework [6,8,11,12].
Recent technological advances (e.g., GPS) are making location measurement error less of a concern, and this has allowed greater focus on the development of more realistic (and biologically meaningful) models for the movement process. These developments primarily differ in the spatio-temporal conceptualization of the movement process, including discrete-time and discrete-space [13-15], discrete-time and continuous-space [5,6], continuous-time and discrete-space [16,17], and continuous-time and continuous-space [8,9] movement process models (see Table 2). Although time formulation in continuous space is our primary focus henceforth, discrete-space movement models are often employed in the absence of detailed location data (e.g., capture-mark-recapture studies e.g., [14,16]), or resource selection studies in heterogeneous environments e.g., [17]. Latent behaviors associated with different types of movement can also be treated as continuous [18] or discrete [5,6,19,20] states among which individuals transition in response to changes in their internal and external environment. Other approaches go a step further by attempting to combine “macroscopic” resource selection models with “microscopic” discrete- or continuous-time movement process models [7,21-27].
Before proceeding, we note that hierarchical discrete-time, continuous-space movement process models are often referred to as “state-space” models in the literature. This is not a misnomer. However, based on conventional time series jargon, any approach that simultaneously accounts for the system process (i.e., the movement process) and the observation process through time qualifies as a state-space model. In this sense, all of the hierarchical modeling approaches above employ state-space methods. In the contemporary statistical literature, state-space models are now more commonly referred to as hierarchical models; “hierarchical” because the data arise from a probability distribution that depends on a latent process, which, in turn, is modeled stochastically [34,35]. We also note that discrete-time movement models where each behavioral state is associated with a distinct random walk [5,6,20,30] can be considered as hidden Markov models, a special class of state-space models with a finite number of latent states [36].
In general, animal movement occurs in continuous time but we observe it at fixed discrete-time intervals. Thus, continuous-time models are conceptually and theoretically appealing, but in practice it is perhaps more intuitive to interpret movement in discrete intervals (e.g., turning angle and step length per unit time). It is easier to conceptualize the movement process as a series of steps and turns sampled from particular distributions than to deal with partial differential equations. This may in part explain why the methodological development and application of discrete-time models has thus far exceeded that of continuous-time models.
Whether in discrete or continuous time, most mechanistic movement process models are based on correlated random walks. In discrete time, correlated movement is typically modeled with non-uniform turning angle distributions, usually with mean of zero, which result in short-term directional persistence between successive time steps. The more highly correlated movement exhibits turning angles tending towards zero [5,6]. In continuous time, correlated movement can be expressed through a special type of diffusion model that accounts for dependence between locations, the Ornstein-Uhlenbeck (OU) process [4,10]. The OU process is essentially a continuous-time random walk with a tendency to drift towards a central location. Using an OU process to model movement velocity instead of locations, Johnson et al. [8] developed a correlated random walk model that is a continuous-time analog to the discrete-time model of Jonsen et al. [6].
Both discrete- and continuous-time random walk models can incorporate directed (or oriented) movement, but this is often referred to as “biased” movement in discrete-time models [20,37] and “drift” or “advection” in continuous-time models [4,10]. Directed movements are typically associated with specific locations in space, such as “centers of attraction” or “centers of repulsion,” and can be used to model a general tendency towards the center of a home range [7,10] or patch [4,20,31]. Thus, directional persistence can result from directed movements, but the long-term directional persistence that can result from directed movement is different from the short-term directional persistence associated with a correlated random walk [38]. Under directed movement, longer-term directional persistence results from an individual being constantly pulled towards (or pushed away from) a particular location or gradient (without explicit consideration of the direction of previous movements).
Without correlated movements, the discrete-time models of Morales et al. [5] and Jonsen et al. [6] reduce to simple random walks. Without directed movements, the discrete-time model of McClintock et al. [20] reduces to the correlated random walk model of Morales et al. [5]. The OU process models of Dunn and Gipson [10], Blackwell [4,9], Johnson et al. [8], and Harris and Blackwell [31] reduce to Brownian motion (i.e., a continuous-time simple random walk), using a mathematical limit argument. We note that because the directional persistence in a correlated random walk decays exponentially as the time lapse increases, correlated random walks can be approximated at larger scales with a simple diffusion model [16].
To incorporate both correlated and directed movement, the expected direction of movement must reflect a trade-off between short-term directional persistence and the strength of bias towards (or away from) a center of attraction (or repulsion). This has been examined in discrete time by modeling the expected direction as a weighted average of the strength of bias in the direction of the center of attraction and the previous movement direction [20,37]. Although a similar approach has yet to be thoroughly investigated in continuous time, this would be akin to modeling the drift parameter of an OU process as a function of both directed and correlated movements.
The metrics of movement
Movement metrics also differ among the aforementioned approaches by specifying the movement process on the positions themselves [7,9,28] or on derived quantities, such as the differences between consecutive locations (i.e., velocities) [6,8,19,32,33], step lengths [18], step lengths and turning angles [5], or step lengths and bearings [20,29] (see Table 2). These movement metrics are important for model specification and interpretation. For example, by modeling velocity, the discrete-time model of Jonsen et al. [6] and the continuous-time model of Johnson et al. [8] induce dependence between the speed and direction of movement, so that long steps are possible when turning angles are small, resulting in higher-order auto-correlations than found in standard correlated random walks [5,20]. Although Blackwell [4,9] models position and Johnson et al. [8] model velocity, the speed and direction of movement are intrinsically linked through the drift process of these continuous-time models (see Does a continuous- or discrete-time formulation really matter? ). By modeling turning angles independent of step lengths in discrete-time, Morales et al. [5] could investigate correlated (but not directed) movements independent of speed. By modeling bearings using a similar discrete-time movement process model, McClintock et al. [20] could simultaneously investigate both correlated and directed movements independent of speed.
Does a continuous- or discrete-time formulation really matter?
Outside of fitting them to data and empirically assessing differences, it is not immediately apparent how alternative time formulations of movement models differ analytically. In fact, continuous- and discrete-time formulations are often over simplistically viewed as merely different means to the same end. But this is not the case, and we derive a partial translation here to compare continuous- and discrete-time formulations with a common and intuitive language: step length and bearing.
Kobayashi et al. [39] provides the following necessary result for two independent normally-distributed random variables, A and B. If
then the distance from the origin, \( L=\sqrt{A^2+{B}^2}, \) has a Rice distribution, R(μ, σ 2), where \( \mu =\sqrt{\mu_A^2+{\mu}_B^2}=\left\Vert \boldsymbol{\mu} \right\Vert \) is the distance from the origin to the center of the bivariate normal distribution, σ 2 is a variance parameter, and \( \mathcal{N}\left(\right) \) is the Normal probability density function. The Rice distribution is a generalization of the Rayleigh distribution (for μ ≠ 0) whose expected value increases with increasing values of μ. Further, the bearing θ = tan− 1(B/A), has the conditional von Mises distribution
where κ = lμ/σ 2, ω = tan− 1(μ B /μ A ), and I 0() is the modified Bessel function of the first kind and of order 0. The von Mises distribution is symmetric and centered on the angle ω, and dispersion decreases with increasing κ values.
We can now translate a time step of the continuous-time correlated random walk (CTCRW) model of Johnson et al. [8] to a discrete-time step length and bearing. First, the transformation of the bivariate velocity process to speed (distance unit per time unit) and direction is given by
and
The resulting distributions are obtained by applying the results in Kobayashi et al. [39] to the CTCRW velocity model equations (see Eqs. 3 and 4 in Continuous-time formulation below). Using the velocity process transformation, the location step length \( {S}_t=\sqrt{{\left({X}_{t+1}-{X}_t\right)}^2+{\left({Y}_{t+1}-{Y}_t\right)}^2} \) and bearing ϕ t = tan− 1{(Y t + 1 − Y t )/(X t + 1 − X t )} are distributed as
where Z t is the latent behavioral state, and q z,t is the (1,1) (or, (2,2) as they are the same) entry of the covariance matrix for the velocity process (Q z,t ).
There are now notable differences that one can easily distinguish between the continuous and discrete formulations for step length and bearing distributions. First, unlike the discrete-time model (see Eqs. 1 and 2 in Discrete-time formulation below), the step length and bearing of the continuous-time model are clearly correlated. As step length increases the distribution of the bearing becomes more concentrated around θ t , the latent velocity bearing. Second, given a constant state process, step lengths are independent in the discrete-time formulation. However, in the CTCRW model step lengths are still correlated via the auto-correlated speed process, l t . Thus, unlike the discrete-time model, the CTCRW maintains not just directional persistence, but persistence in speed as well. Note that this result does not depend on latent behavioral state (Z t ) and holds for movement models with a single behavioral state.
We emphasize that these results are not simply attributable to the fact that the CTCRW model is based on an integrated OU velocity. They hold analogously for continuous-time models which use OU process models for position directly [4,9,31], even if X t and Y t are modeled independently (i.e., by setting the off-diagonal elements of the covariance matrix for the bivariate OU process to zero). Using the same result from Kobayashi et al. [39], the distributions of the step length and bearing of an OU process directly modeling position, with central location μ = (μ x , μ y ), are
where D t (μ) and θ t are respectively the distance and bearing from the current position to the central location, and \( {\sigma}_t^2 \) is the variance of the OU process at time t. One can see that the OU model directly applied to the positions still maintains correlation between step length and bearing. Moreover, it also possesses the (potentially undesirable) quality that movement rate depends on distance from the point of attraction, thus necessitating rapid movement that slows as the animal approaches the central location.
Potential advantages and disadvantages
Given the various ways by which similar movement properties can be expressed using either discrete- or continuous-time process models, some potential advantages and disadvantages are evident. Although animal movement clearly occurs in continuous time, discrete-time models are often viewed as more intuitive, and perhaps the biological interpretation of instantaneous movement parameters in continuous time (e.g., those related to OU processes and other diffusion models) can in practice be discouraging to applied ecologists wishing to use or extend continuous-time methods.
Notably, discrete-time models that simultaneously incorporate multiple latent movement behavior states, Markov state-switching, correlated movements, and directed movements have already been developed and fitted to data [5,6,20]. For example, Morales et al. [5] used a discrete-time random walk mixture model to examine time allocations and transition probabilities between two latent movement behaviors in elk: a long-step, directionally-persistent “exploratory” state and a short-step, negatively-correlated (i.e., with animals tending to move in the opposite direction of the previous move) “encamped” state. Similarly, Jonsen et al. [6] investigated analogous “transit” and “foraging” movement behavior states in seals. Also using seal data, McClintock et al. [20] developed a biased, correlated random walk mixture model with five latent movement behavior states allowing for directed and exploratory movement among foraging and haul-out locations.
Similar applications of multistate mixture models have yet to appear in continuous-time (but see Example: northern fur seal ). Blackwell [9] assumed movement behavior states were known, and Johnson et al. [8] assumed states were defined by known covariates, hence neither of these approaches included an estimation framework for both latent movement states and switching behavior. Hanks et al. [19] extended the framework of Johnson et al. [8] and Hooten et al. [17] to accommodate inhomogeneous movement characteristics along the movement path using a change-point model. However, because this approach does not explicitly incorporate distinct movement behavior states or state-switching mechanisms with direct biological interpretation, post hoc cluster analyses were used to identify potential movement behavior states. Harris and Blackwell [31] recently described a continuous-time multistate mixture modeling framework, but fitting these models is challenging, and they have yet to be demonstrated using real data. Part of the difficulty of multistate mixture models in continuous time is due to the underlying relationships these models typically impose on the movement characteristics (e.g., speed or directional persistence) commonly used to distinguish movement behavior states (see Does a continuous- or discrete-time formulation really matter? and Example: northern fur seal ). Because multistate models are of great practical importance for investigating time allocations to different behaviors (i.e., “activity budgets”), this currently remains an advantage of discrete-time models.
Two important disadvantages of discrete-time models are related to the necessary discretization of the movement path into a finite number of temporally-regular time steps [40]. The time step length must be specified a priori, but inferences about animal movement from a discrete-time analysis are not time scale-invariant. For example, inferences about bumblebee movement characteristics from discrete-time analyses using 30-second versus 30-minute time steps would likely be dramatically different. The 30-second analysis would reveal fine-grain movement properties but could potentially mask coarser-grain properties. The 30-minute analysis could reveal coarse-grain properties, but would completely miss fine-grain properties. The specification of time step length in a discrete-time analysis is therefore critical and requires very careful consideration [41-43], and it is particularly important that the time step is chosen to match the scale at which behavioral decisions are made [40]. A major advantage of continuous-time models is that they avoid dependence on a particular timescale. Within reasonable limits, a continuous-time analysis will yield the same results regardless of the temporal resolution of observations; if so desired, movement properties from a continuous-time analysis may be summarized a posteriori for time steps of any length. However, we note that for any continuous- or discrete-time approach to be useful, the temporal resolution of the observed data must be relevant to the specific movement behaviors of interest.
Discrete-time movement models can also be more computationally demanding than continuous-time models. Unless observations exactly match the regular time steps required of a discrete-time model, the movement path must be predicted at temporally-regular intervals. Perfectly observed, temporally-regular observations are very rare in animal telemetry data (especially for marine species). For longer time series, this can result in thousands of additional location parameters that must be estimated. As movement process models incorporate more details and realism, model fitting becomes more complex. This is particularly true for multistate mixture models. Therefore, once multistate model development and fitting in continuous time has caught up with that in discrete time, the computational advantages of continuous-time formulations are likely to be significant.
Example: northern fur seal
To illustrate the concepts elaborated above in the context of state-space models with latent movement behavior states, we apply comparable multistate movement models in discrete and continuous time to a northern fur seal track in the Pribilof Islands of Alaska, USA. The animal was a nursing female equipped with a Mk10-AF satellite tag from Wildlife Computers (see [44] for full study deployment details). The Mk10-AF tag has both Fastloc GPS and time-depth recording capabilities. Using both location and diving activity data, we wish to identify and characterize three latent movement behavior states: “resting,” “foraging,” and “transit”. We define foraging (state F) as movement that is characteristic of area restricted searches and includes foraging dives, where a foraging dive must have a max depth >5 m and at least 5 changes in vertical direction (i.e., sinuosities or “wiggles”). The sinuosities are a characteristic of the animal chasing prey during the dive. We define transit (state T) as predominantly travelling with little to no foraging dives, noting that seals may opportunistically feed while travelling. Resting (state R) is defined by types of movement that do not fall under foraging or transit states, including resting at haulouts and resting at sea. In terms of trajectory, we would expect speeds to be low during resting and low to moderate during foraging, with little directional persistence. During transit, we would expect higher speeds and greater directional persistence.
The diving activity data were summarized as the number of foraging dives for each of N = 242 1-hour time steps between 7–17 October 2007. Although diving data were logged continuously, location data were obtained opportunistically at 15-minute intervals. There are therefore frequent missing location data due to an inability to obtain locations while the seal was underwater. Because the tag possessed GPS capabilities, rather than ARGOS technology, we expect location measurement error to be minimal. The raw location data consist of 241 observations during a single foraging trip (Figure 1), with 40% of the 1-hour time steps containing no observed locations.
Discrete-time formulation
With the location data being temporally irregular, a discrete-time analysis requires that the movement path be estimated at regular time steps. We chose 1-hour time steps to exactly match the temporal resolution of the foraging dive data. Using the same state-space formulation as McClintock et al. [20], for time step t = 1, …, N, and observation i = 1, …, k t , we relate the irregularly observed locations (x t,i , y t,i ) to the temporally regular model locations (X t , Y t ) using
and
where j t,i ∈ [0, 1) is the proportion of the time interval between locations (X t − 1, Y t − 1) and (X t , Y t ) at which the i th observation between times t- 1and t was obtained, \( \left[{\epsilon}_{x_{t,i}}\right]=\mathcal{N}\left(0,{\sigma}_x^2\right), \) \( \left[{\epsilon}_{y_{t,i}}\right]=\mathcal{N}\left(0,{\sigma}_y^2\right),\kern0.5em \left[\dots \right] \) indicates the probability density function for the random variable in brackets, and \( \mathcal{N}\left(\right) \) is the Normal (Gaussian) density. Time steps with no observations (i.e., k t = 0) do not contribute to the observation model.
We then model movement between the temporally regular locations using a multistate correlated random walk model [5,20]. Specifically, we assume that, conditional on the behavioral state, Z t , the step length at time t, S t , is distributed as
where S t ≥ 0, z ∈ {R, F, T} is the unknown latent behavioral state, and a z and b z are state-dependent scale and shape parameters, respectively. The Weibull distribution is popular for modeling step length because of its flexibility; it has fat tails when b z < 1, reduces to an exponential distribution when b z = 1, has exponential tails when b z > 1, and can resemble a normal distribution when b z ≈ 3.4. The bearing of movement, ϕ t , is modeled with the wrapped Cauchy distribution
where 0 ≤ ϕ t < 2π, ϕ t − 1 is the previous bearing, and − 1 < ρ z < 1 is the state-dependent dispersion parameter. Unfamiliar to most non-statisticians, the wrapped Cauchy distribution converges to a uniform distribution over the circle as ρ z goes to zero. As ρ z goes to 1 (or − 1), the distribution tends to a point mass concentrated towards (or away from) the previous bearing. Standard correlated movement is typically modeled with the wrapped Cauchy distribution by constraining 0 ≤ ρ z < 1 [5,45].
It can be difficult to distinguish resting, foraging, and transit states for seals based on trajectory alone [45], particularly because northern fur seals can forage opportunistically while travelling and will often rest at sea or in the vicinity of breeding rookeries. We therefore incorporate the number of foraging dives during each time step, δ t , to help inform the foraging state. Specifically, we assume
with the constraints λ R = 0 and λ F > λ T . This model therefore assumes a priori that time steps with foraging dives are never assigned to resting, and steps with relatively many foraging dives are more likely to be assigned to foraging than transit. Note that by constraining λ F > λ T , we still allow some possibility for steps with foraging dives to be assigned to transit.
Finally, we model switches between behavior states as a first-order Markov process. We assign the conditional distribution to the latent state variable Z t
where for \( z,\ {z}^{\prime}\in \left\{R,F,T\right\},{\psi}_{z,{z}^{\prime }} \) is the probability of switching from state z at time t – 1 to state z′ at time t.
Using Bayesian analysis methods, the joint posterior distribution for our state-space model in discrete time is
where (X 0, Y 0) is the initial (latent) location. Note that, conditional on Z t , this discrete-time model assumes step length, bearing, and the number of foraging dives are independent. Weakly informative priors were used for all parameters, including the conjugate priors \( \left[{\sigma}_x^2\right]={\Gamma}^{-1}\left(0.01,0.01\right), \) \( \left[{\sigma}_y^2\right]={\Gamma}^{-1}\left(0.01,0.01\right), \) [λ z ] = Γ(0.01, 0.01) for z ∈ {F, T}, and [ψ z ] = Dirichlet(1, 1, 1) for z ∈ {R, F, T}, where Γ() and Γ− 1() are the gamma and inverse gamma probability density functions, respectively. For [X 0, Y 0], we specified a joint uniform prior over the region defined by the Bering Sea. We specified a maximum sustainable speed of 3 m/s, such that S t ≤ 10800m, with [a z ] = Unif(0, 10800), [b z ] = Unif(0, 30), and [ρ z ] = Unif(0, 1) for z ∈ {R, F, T}. Similar to McClintock et al. [20,45], we used a Metropolis-within-Gibbs Markov chain Monte Carlo algorithm written in the C programming language [46] to obtain samples from the posterior distribution, performing pre- and post-processing in R via the .C interface [47]. The only notable difference from the MCMC algorithm for the individual-level model of McClintock et al. [45] results from our model for δ t , for which the conjugate prior on λ z yields the full conditional distributions \( \left[{\lambda}_F\left|\cdot \right.\right]={\Gamma}_{\left({\lambda}_T,\infty \right)}\left(0.01+{\displaystyle {\sum}_{t=1}^N{\delta}_t{I}_{\left\{{Z}_t=F\right\}},}0.01+{\displaystyle {\sum}_{t=1}^N{I}_{\left\{{Z}_t=F\right\}}}\right) \) and \( \left[{\lambda}_T\left|\cdot \right.\right]={\Gamma}_{\left(0,{\lambda}_F\right)}\left(0.01+{\displaystyle {\sum}_{t=1}^N{\delta}_t{I}_{\left\{{Z}_t=T\right\}},}0.01+{\displaystyle {\sum}_{t=1}^N{I}_{{}_{\left\{{Z}_t=T\right\}}}}\right), \) where Γ(l,u) is the renormalized gamma density truncated at l and u, 0 ≤ l < u, and I() is the indicator function. When full conditional distributions were analytically intractable, random walk Metropolis-Hastings parameter updates were used. After initial pilot tuning and burn-in, a single chain of 5 million iterations was attained for posterior summaries. The algorithm required approximately 3 hours to run on a machine running 64-bit Windows 7 (3.4GHz Intel Core i7 processor, 16Gb RAM).
Estimated activity budgets to the three movement behavior states were 0.28 (95% HPDI: 0.22-0.37) to resting, 0.36 (0.26-0.39) to foraging, and 0.36 (0.29-0.45) to transit (Figure 2a). Estimated state transition probabilities were \( {\widehat{\psi}}_{R,R} \) = 0.81 (0.71-0.92), \( {\widehat{\psi}}_{F,F} \). = 0.78 (0.67-0.88), and \( {\widehat{\psi}}_{T,T} \) = 0.78 (0.65-0.89), with state-switches more likely to occur between foraging \( {\widehat{\psi}}_{F,T} \) = 0.15 (0.05-0.27) and transit \( {\widehat{\psi}}_{T,F} \) = 0.14 (0.06-0.22). The bivariate posterior densities for step length and turning angle (Figure 3a) indicate some opportunistic foraging during travelling, with foraging movements often exhibiting high speed and directional persistence typically associated with transit. As expected, time steps with >1 foraging dives were rarely assigned to the transit state (Figure 4a). Also as expected, we found lower speeds and less directional persistence during resting movements and higher speed and more directional persistence during transitory movements.
Estimated path and movement behavior states during a foraging trip of a northern fur seal that hauls out in the Pribilof Islands, Alaska. Results are presented for discrete- and continuous-time movement process models. Estimated movement states for the predicted locations correspond to “resting” (red), “foraging” (green), and “transit” (blue) movement behavior states. Uncertainty in the state assignments (<95% posterior probability) are indicated by hollow circles within predicted locations. Uncertainty in predicted locations are indicated by 95% credible bands (dashed lines).
Estimated bivariate densities of northern fur seal step lengths and turning angles for three distinct movement behavior states (“resting”, “foraging”, and “transit”) based on discrete- and continuous-time movement process models with 1-hour time steps. For both models, step lengths and turning angles were calculated from the estimated paths shown in Figure 2.
Hourly probabilities for the number of foraging dives by a northern fur seal while in the foraging and transit states based on discrete- and continuous-time movement process models. Foraging dives were defined as dives with a max depth >5 m with at least 5 sinuosities (i.e., “wiggles”). Probabilities were calculated from the estimated Poisson distribution for δ t based on posterior samples for λ F and λ T . Dashed lines indicate 95% highest posterior density intervals.
The estimated error (in meters) for the observation process model was similar between longitude (σ x = 472; 360 − 596) and latitude (σ y = 489; 381 − 617) coordinates. Although relatively small, these errors are larger than would typically be expected of GPS location measurement error. We therefore suspect the additional error is attributable to deviations from the simple linear model used to relate the temporally irregular observed locations to temporally-regular predicted locations.
Continuous-time formulation
We analyzed the same fur seal data set using a continuous-time model to assess what inferential differences might result by extending the correlated random walk (CRW) models of Jonsen et al. [6] (discrete-time, latent states) and Johnson et al. [8] (continuous-time, state model with known covariates) to a continuous-time CRW model with latent states. The continuous-time correlated random walk (CTCRW) is described by modeling the velocity (instantaneous rate of change) of movement with a bivariate Ornstein-Uhlenbeck (OU) process. The OU process is the continuous-time version of the bivariate autoregressive model Jonsen et al. [6] use to model position difference. The CTCRW locations are then modeled by integrating the velocity process (i.e., the positions are the solution to the stochastic differential equation used to model velocity).
To make the inference comparable between each analysis, we maintained the same hourly structure for the transitions of behavior states. Thus, the models [Z t |ψ Z t − 1 = z] and [δ t |λ Z t = z] are the same as in the previous discrete-time analysis with the minor technical change that the state Z t is assumed to be held constant within the interval [t, t + 1). Also, we use the notation t i to represent the time of the ith observed location in the interval [t, t + 1).
The CTCRW model is defined by a stochastic differential equation model of velocity \( {\boldsymbol{\upnu}}_{t_i}=\left({V}_{x,{t}_i},\ {V}_{y,{t}_i}\right) \) at time t i , such that
for each coordinate axis c ∈ {x, y}, where t ≤ t i < t i + 1 ≤ t + 1, Δi = t i + 1 − t i , γ c is the mean velocity (or drift), β t is an autocorrelation parameter, \( \zeta \left({\Delta}_{\mathrm{i}}\right)=\mathcal{N}\left(0,{\sigma}_t^2\left[1- \exp \left(-2{\beta}_t{\Delta}_{\mathrm{i}}\right)\right]\ /2{\beta}_t\right), \) and σ t is a parameter controlling the overall variability in velocity. The solution to this autoregressive differential equation is the location \( {\boldsymbol{\upmu}}_{t_i}=\left({X}_{t_i},\ {Y}_{t_i}\right) \). Johnson et al. [8] provide details to illustrate that the CTCRW model can be formulated as a linear, Gaussian state-space model that allows efficient calculation of the CTCRW likelihood. For t ≤ t i < t i + 1 ≤ t + 1, observation \( {\mathbf{y}}_{t_i}=\left({x}_{t_i},\ {y}_{t_i}\right), \) and the vector of the true location and velocity process \( {\boldsymbol{\upalpha}}_{t_i}=\left({\boldsymbol{\upmu}}_{t_i},\ {\boldsymbol{\upnu}}_{t_i}\right), \) the state-space model is given by
where \( \left[{\boldsymbol{\upvarepsilon}}_{t_i}\right]=\mathcal{N}\left(\mathbf{0},{\tau}^2\mathbf{I}\right) \) and \( \left[{\boldsymbol{\eta}}_{z,{t}_i}\right]=\mathcal{N}\left(\mathbf{0},{\mathbf{Q}}_{z,{t}_i}\right) \). The entries of \( {\mathbf{T}}_{z,{t}_i} \) and \( {\mathbf{Q}}_{z,{t}_i} \) are functions of Δi and the movement parameters β t and σ t (see [8] for details), and as in the discrete-time analysis, the movement parameters depend on the latent state Z t = z via β t = β z and σ t = σ z .
We used an MCMC sampler for Bayesian inference of movement parameters and states. Similar to Johnson et al. [8], we assumed no drift (i.e., γ c = 0) and similar movement processes in both coordinates (i.e., β c,t = β t and σ c,t = σ t for c ∈ {x, y}). The same priors were used for all common variables between the two analyses (e.g., diving rates, behavior states). For the CTCRW movement parameters, we used vague priors on the log scale with the following constraints: β R > β F > β T and σ R < σ F < σ T . These constraints imply that movement is typically faster and more correlated as one moves from R to T. The flat prior [log τ] > 10 m was used for the measurement error parameter. The sampler was custom coded in R [47] making use of the FORTRAN coded CTCRW likelihood and posterior track simulation in the R package crawl [48]. The CTCRW likelihood computed via the Kalman filter allowed us to sample from the marginal posterior distribution of the states and movement parameters without having to sample the unobserved α t values. The sampled posterior distribution is given by
where the right hand-side of the product is the CTCRW likelihood. Note that the true locations \( \left({X}_{t_i},\ {Y}_{t_i}\right) \) and velocities \( \left({V}_{x,{t}_i},\ {V}_{y,{t}_i}\right) \). have been integrated from the posterior. The benefit of this is that the MCMC sampler for the states and parameters converges more quickly to the approximate posterior distribution. The full algorithm took 66 hours to run (due to coding in R rather than C), however, only 20,000 iterations were necessary to obtain an effective sample of ≥ 4,000 posterior draws. To compare step lengths and turning angles of the CTCRW model to the discrete time model, we needed a sample of hourly locations. To obtain a posterior sample of α t , t = 1, …, N, on the hour, the sampling method of Johnson et al. [49] was used at each MCMC iteration as if α t was a derived parameter. From the sampled α t values, step length and turning angle were calculated for comparison to the equivalent discrete-time quantities.
Estimated activity budgets to the three movement behavior states were 0.10 (95% HPDI: 0.03-0.15) to resting, 0.29 (0.23-0.34) to foraging, and 0.61(0.53-0.67) to transit (Figure 2b). Estimated state transition probabilities were \( {\widehat{\psi}}_{R,R} \) = 0.52 (0.10-0.86), \( {\widehat{\psi}}_{F,F} \) = 0.75 (0.62-0.86), and \( {\widehat{\psi}}_{T,T} \) = 0.82 (0.75-0.89). State-switches to transit were most likely, with \( {\widehat{\psi}}_{R,T} \) = 0.40 (0.09-0.81) and \( {\widehat{\psi}}_{F,T} \) = 0.23 (0.12-0.35). These are noticeably different from the discrete-time analysis, with much less time spent “resting.” The bivariate posterior densities for step length and turning angle (Figure 3b) also reflect this reduction in state R, with more small steps associated with the travel state. However, there were also more large steps associated with the resting state. This calls into question the designation of these states as actually “resting” when using the continuous-time multistate movement model. As in the discrete-time analysis, time steps with >1 foraging dives were rarely assigned to the transit state (Figure 4b). The estimated error (in meters) for the observation process model was \( \widehat{\tau}=64 \) m (55 m-75 m). Because the observed data linear interpolation does not need to be accounted for, the measurement error variance is noticeably smaller here than in the discrete-time analysis.
Although inferences about time spent foraging were similar between the two approaches, we found considerable differences between the discrete-time and continuous-time formulations with respect to resting and travelling activity. This is counter to the simplistic view that time formulations are merely different means to the same end. The reasons for these differences lie in the underlying relationships of the metrics of movement (speed and directional persistence) that are used to define resting and travelling. Because these metrics are dependent and speed is auto-correlated in the continuous-time model (see Does a continuous- or discrete-time formulation really matter? ), the lack of auxiliary information (such as metabolic rate) to help distinguish these movement behavior states induces a tendency for the “resting” state to be associated with sudden switches (or change-points) in movement properties during periods with no foraging dives. In other words, instead of identifying periods of slow movement with no foraging dives as intended, the “resting” state serves to break the momentum of the continuous-time movement process.
Although continuous-time formulations necessarily induce dependence between step length and bearing, the differences between our discrete- and continuous-time analyses are not entirely attributable to time formulation per se. In order to account for short-term directional persistence in continuous time, Johnson et al. [8] used correlation in the velocity process (Jonsen et al. [6] use the same correlation model in discrete time). Whether in continuous or discrete time, the modelling of velocity clearly induces additional dependence between speed and bearing. Correlated random walk models with two latent movement behavior states can be relatively easy to fit in continuous time (D. Johnson, unpublished data) or when modeling velocity in discrete time [6,50]. However, the modelling of velocity can make it more difficult to characterize and identify >2 distinct movement behavior states with straightforward biological interpretation. While this can be easily avoided in discrete time by modelling step length and bearing independently (as was done here), most continuous-time CRW models are formulated on the velocity process [8,31] (but see [22]).
Conclusions
Modern tracking and biologging devices allow us to record detailed information on animal location and physiology, thus opening the possibility to better understand the role of movement in population dynamics, animal behavior, and the environment [51,52]. To make the most of these hard-earned data and learn about important aspects of animal movement such as activity budgets, space use, and behavioral responses to landscape features, sophisticated data analysis tools have been proposed. State-space models, where one explicitly accounts for the fact that the observed data arise from a mechanistic or “biological” model that is in turn sampled by an observation model, are currently regarded as the most correct and elegant methods to fit movement models to data [12,52]. We have shown that there exist underappreciated differences among the current available formulations, and although our northern fur seal example focused on state-space models with multiple movement behavior states, our findings have important implications for single-state mechanistic movement process models, including (discrete-time) step-selection or (continuous-time) partial differential equation resource selection models (e.g., see recent reviews by [26,27]).
Although movement is a continuous-time process, it is perhaps more intuitive to think about (and formulate models for) movement in discrete time. In our experience, practitioners find a discrete-time model (Eqs. 1 and 2) and its parameters easier to interpret than its continuous-time counterpart (Eqs. 3 and 4). As we have demonstrated, current discrete-time formulations also provide both flexibility and feasibility for identifying latent behavioral states and incorporating auxiliary biotelemetry or environmental data to inform these states. However, these advantages of discrete-time models do indeed come at a cost. Because inferences from discrete-time models are not time scale-invariant, it is absolutely critical that the chosen time scale between movement steps appropriately matches the animal’s behavioral scales and the frequency of observations.
In addition to loss of resolution, when observations are irregular and/or the frequency of observations greatly exceeds that of the chosen time scale, discrete-time models can suffer from additional lack of fit due to the need to discretize the movement path into temporally-regular locations. This was apparent in the magnitudes of the measurement error terms in our northern fur seal example, where the discrete-time model had larger errors than would normally be expected for GPS data. The need for temporally-regular positions for the entire movement path can also make it more difficult to deal with missing data in a discrete-time framework. While this is less of a problem for terrestrial animals, missing data is a major issue for marine animals due to our inability to obtain locations while underwater.
Continuous time is clearly a more natural representation of movement than discrete time. These models are not dependent on any particular time scale and do not require temporally-regular observations. It is therefore far easier to deal with missing data or changing observational frequencies in continuous time. However, as demonstrated by our northern fur seal example and Does a continuous- or discrete-time formulation really matter? , current continuous-time formulations may not be well suited for identifying >2 latent movement behavior states. This is unfortunate because the identification of different behaviors, activity budgets, and how these potentially relate to habitat use and demographic parameters is among the most interesting aspects of movement ecology [51].
Although discrete-time approaches thus far have seen greater development and application, we believe further development of continuous-time models is needed to facilitate more widespread application of these models to real data. For example, the continuous formulations of Blackwell [9], Johnson et al. [8], and Harris and Blackwell [31] could potentially be extended to accommodate “stops” where animals can reorient and change movement state, thereby curbing the momentum inherent to these continuous-time movement process models. By overcoming the hurdles identified here and making latent state-switching models more feasible in continuous time, the best of both worlds may soon be within grasp.
Abbreviations
- CRW:
-
Correlated random walk
- CTCRW:
-
Continuous-time correlated random walk
- MCMC:
-
Markov chain Monte Carlo
- OU:
-
Ornstein-Uhlenbeck
References
Cooke SJ, Hinch SG, Wikelski M, Andrews RD, Kuchel LJ, Wolcott TG, Butler PJ: Biotelemetry: a mechanistic approach to ecology. Trends Ecol Evol 2004, 19:334–343.
Wilson RP, Shepard E, Liebsch N: Prying into the intimate details of animal lives: use of a daily diary on animals. Endangered Species Research 2008, 4:123–137.
Rutz C, Hays GC: New frontiers in biologging science. Biol Lett 2009, 5:289–292.
Blackwell P: Random diffusion models for animal movement. Ecol Model 1997, 100:87–102.
Morales JM, Haydon DT, Frair J, Holsinger KE, Fryxell JM: Extracting more out of relocation data: building movement models as mixtures of random walks. Ecology 2004, 85:2436–2445.
Jonsen ID, Flemming JM, Myers RA: Robust state-space modeling of animal movement data. Ecology 2005, 86:2874–2880.
Christ A, Ver Hoef J, Zimmerman DL: An animal movement model incorporating home range and habitat selection. Environ Ecol Stat 2008, 15:27–38.
Johnson DS, London JM, Lea M-A, Durban JW: Continuous-time correlated random walk model for animal telemetry data. Ecology 2008, 89:1208–1215.
Blackwell P: Bayesian inference for Markov processes with diffusion and discrete components. Biometrika 2003, 90:613–627.
Dunn JE, Gipson PS: Analysis of radio telemetry data in studies of home range. Biometrics 1977, 33:85–101.
Anderson-Sprecher R, Ledolter J: State-space analysis of wildlife telemetry data. J Am Stat Assoc 1991, 86:596–602.
Patterson TA, Thomas L, Wilcox C, Ovaskainen O, Matthiopoulos J: State–space models of individual animal movement. Trends Ecol Evol 2008, 23:87–94.
Brownie C, Hines JE, Nichols JD, Pollock KH, Hestbeck J: Capture-recapture studies for multiple strata including non-Markovian transitions. Biometrics 1993, ᅟ 1173–1187.
Schwarz CJ, Schweigert JF, Arnason AN: Estimating migration rates using tag-recovery data. Biometrics 1993, 49:177–193.
Dupuis JA: Bayesian estimation of movement and survival probabilities from capture-recapture data. Biometrika 1995, 82:761–772.
Ovaskainen O, Rekola H, Meyke E, Arjas E: Bayesian methods for analyzing movements in heterogeneous landscapes from mark-recapture data. Ecology 2008, 89:542–554.
Hooten MB, Johnson DS, Hanks EM, Lowry JH: Agent-based inference for animal movement and selection. J Agric Biol Environ Stat 2010, 15:523–538.
Forester JD, Ives AR, Turner MG, Anderson DP, Fortin D, Beyer HL, Smith DW, Boyce MS: State-space models link elk movement patterns to landscape characteristics in Yellowstone National Park. Ecological Monographs 2007, 77:285–299.
Hanks EM, Hooten MB, Johnson DS, Sterling JT: Velocity-based movement modeling for individual and population level inference. PLoS One 2011, 6:e22795.
McClintock BT, King R, Thomas L, Matthiopoulos J, McConnell BJ, Morales JM: A general discrete-time modeling framework for animal movement using multistate random walks. Ecological Monographs 2012, 82:335–349.
Rhodes JR, McAlpine CA, Lunney D, Possingham HP: A spatially explicit habitat selection model incorporating home range behavior. Ecology 2005, 86:1199–1205.
Moorcroft PR, Lewis MA, Crabtree RL: Mechanistic home range models capture spatial patterns and dynamics of coyote territories in Yellowstone. Proc Biol Sci 2006, 273:1651–1659.
Moorcroft PR, Barnett A: Mechanistic home range models and resource selection analysis: a reconciliation and unification. Ecology 2008, 89:1112–1119.
Forester JD, Im HK, Rathouz PJ: Accounting for animal movement in estimation of resource selection functions: sampling and data analysis. Ecology 2009, 90:3554–3565.
Potts JR, Bastille Rousseau G, Murray DL, Schaefer JA, Lewis MA: Predicting local and non‐local effects of resources on animal space use using a mechanistic step selection model. Methods Ecol Evol 2014, 5:253–262.
Potts JR, Lewis MA: How do animal territories form and change? Lessons from 20 years of mechanistic modelling. Proc Biol Sci 2014, 281:20140231.
Thurfjell H, Ciuti S, Boyce MS: Applications of step-selection functions in ecology and conservation. Movement Ecology 2014, 2:4.
Jonsen ID, Myers RA, James MC: Robust hierarchical state–space models reveal diel variation in travel rates of migrating leatherback turtles. J Anim Ecol 2006, 75:1046–1057.
Tracey JA, Zhu J, Crooks KR: Modeling and inference of animal movement using artificial neural networks. Environ Ecol Stat 2011, 18:393–410.
Langrock R, King R, Matthiopoulos J, Thomas L, Fortin D, Morales JM: Flexible and practical modeling of animal telemetry data: hidden Markov models and extensions. Ecology 2012, 93:2336–2342.
Harris KJ, Blackwell PG: Flexible continuous-time modelling for heterogeneous animal movement. Ecol Model 2013, 255:29–37.
Gurarie E, Andrews RD, Laidre KL: A novel method for identifying behavioural changes in animal movement data. Ecol Lett 2009, 12:395–408.
Gurarie E, Ovaskainen O: Characteristic spatial and temporal scales unify models of animal movement. Am Nat 2011, 178:113–123.
Berliner LM: Hierarchical Bayesian time series models. In Maximum entropy and Bayesian methods. Netherlands: Springer; 1996:15–22.
Cressie N, Calder CA, Clark JS, Hoef JMV, Wikle CK: Accounting for uncertainty in ecological analysis: the strengths and limitations of hierarchical statistical modeling. Ecol Appl 2009, 19:553–570.
Zucchini W, MacDonald IL: Hidden Markov models for time series: an introduction using R. New York: CRC Press; 2009.
Barton KA, Phillips BL, Morales JM, Travis JM: The evolution of an ‘intelligent’ dispersal strategy: biased, correlated random walks in patchy landscapes. Oikos 2009, 118:309–319.
Benhamou S: Of scales and stationarity in animal movements. Ecol Lett 2014, 17:261–272.
Kobayashi H, Mark BL, Turin W: Probability, Random Processes, and Statistical Analysis. Cambridge University Press Textbooks; 2011.
Turchin P: Quantitative analysis of movement: measuring and modeling population redistribution in animals and plants. Massachusetts, USA: Sinauer Associates Sunderland; 1998.
Codling E, Hill N: Sampling rate effects on measurements of correlated and biased random walks. J Theor Biol 2005, 233:573–588.
Breed GA, Costa DP, Goebel ME, Robinson PW: Electronic tracking tag programming is critical to data collection for behavioral time-series analysis. Ecosphere 2011, 2:art10.
Hooten M, Hanks E, Johnson D, Alldredge M: Temporal variation and scale in movement-based resource selection functions. Statistical Methodology 2014, 17:82–98.
Kuhn CE, Johnson DS, Ream RR, Gelatt TS: Advances in the tracking of marine species: using GPS locations to evaluate satellite track data and a continuous-time movement model. Mar Ecol Prog Ser 2009, 393:97–109.
McClintock BT, Russell DJ, Matthiopoulos J, King R: Combining individual animal movement and ancillary biotelemetry data to investigate population-level activity budgets. Ecology 2013, 94:838–849.
Kernighan BW, Ritchie DM, Ejeklint P: The C programming language. Englewood Cliffs: Prentice-Hall; 1988.
R Core Team: R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing; 2013.
Johnson DS: Crawl: Fit continuous-time random walk models to animal movement data. 2013, R package version 14–1 http://cran.r-project.org/web/packages/crawl/crawl.pdf.
Johnson DS, London JM, Kuhn CE: Bayesian inference for animal space use and other movement metrics. J Agric Biol Environ Stat 2011, 16:357–370.
Breed GA, Don Bowen W, Leonard ML: Behavioral signature of intraspecific competition and density dependence in colony‐breeding marine predators. Ecology and evolution 2013, 3:3838–3854.
Morales JM, Moorcroft PR, Matthiopoulos J, Frair JL, Kie JG, Powell RA, Merrill EH, Haydon DT: Building the bridge between animal movement and population dynamics. Philos Trans R Soc Lond B Biol Sci 2010, 365:2289–2301.
Schick RS, Loarie SR, Colchero F, Best BD, Boustany A, Conde DA, Halpin PN, Joppa LN, McClellan CM, Clark JS: Understanding movement data and movement processes: current and emerging directions. Ecol Lett 2008, 11:1338–1350.
Acknowledgements
The findings and conclusions in the paper are those of the author(s) and do not necessarily represent the views of the National Marine Fisheries Service, NOAA. Any use of trade, firm, or product names is for descriptive purposes only and does not imply endorsement by the U.S. Government. JMM was funded by CONICET and PICT 20110790.
Author information
Authors and Affiliations
Corresponding author
Additional information
Competing interests
The authors declare that they have no competing interests.
Authors’ contributions
All authors conceived, drafted, read, and approved the manuscript. BTM conducted the discrete-time analysis of the northern fur seal data. DSJ conducted the continuous-time analysis of the northern fur seal data. All authors read and approved the final manuscript.
Rights and permissions
This article is published under an open access license. Please check the 'Copyright Information' section either on this page or in the PDF for details of this license and what re-use is permitted. If your intended use exceeds what is permitted by the license or if you are unable to locate the licence and re-use information, please contact the Rights and Permissions team.
About this article
Cite this article
McClintock, B.T., Johnson, D.S., Hooten, M.B. et al. When to be discrete: the importance of time formulation in understanding animal movement. Mov Ecol 2, 21 (2014). https://doi.org/10.1186/s40462-014-0021-6
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s40462-014-0021-6