Sequence Analysis and Related Approaches pp 185200  Cite as
Combining Sequence Analysis and Hidden Markov Models in the Analysis of Complex Life Sequence Data
Abstract
Life course data often consists of multiple parallel sequences, one for each life domain of interest. Multichannel sequence analysis has been used for computing pairwise dissimilarities and finding clusters in this type of multichannel (or multidimensional) sequence data. Describing and visualizing such data is, however, often challenging. We propose an approach for compressing, interpreting, and visualizing the information within multichannel sequences by finding (1) groups of similar trajectories and (2) similar phases within trajectories belonging to the same group. For these tasks we combine multichannel sequence analysis and hidden Markov modelling. We illustrate this approach with an empirical application to life course data but the proposed approach can be useful in various longitudinal problems.
1 Introduction
Longitudinal data often consists of multiple parallel sequences that ought to be analyzed jointly. For example, life course data may contain sequences of employment, family formation, and residence. Such data is often referred to as multichannel or multidimensional sequence data. A multichannel approach often gives a simpler representation of the data as opposed to combining states across life domains (the extended alphabet approach); the latter approach rapidly grows the state space as the number of channels and/or states grows. If some data is only partially observed, the multichannel approach also allows for handling data as it is instead of having to make difficult decisions on how to combine observed and unobserved states (Helske and Helske 2018).
Joint analysis of complex multidimensional data poses several challenges. Multichannel sequence analysis (Gauthier et al. 2010) has been the standard tool for the analysis of multichannel sequence data (for empirical applications see, e.g., Eerola and Helske 2016; Müller et al. 2012; Spallek et al. 2014). This approach is simple and fast in computing dissimilarities between sequences, and cluster analysis is often used for grouping similar sequences. Describing and visualizing results is, however, often challenging.
We propose an approach for compressing the information within multichannel sequences and for facilitating the interpretation of such data by finding (1) groups of similar trajectories and (2) similar phases within trajectories belonging to the same group. For the first task we use the standard multichannel sequence analysis approach and for the second task we propose using hidden Markov models (HMMs). With the help of HMMs the data can then be illustrated with a graph showing typical phases within trajectories and the transitions between them and/or shown as simplified (singlechannel) trajectories consisting of these typical phases. We illustrate this approach with an empirical application to complex longitudinal life course data but such an approach, and HMMs in general, are useful in various longitudinal problems across disciplines.
Hidden Markov models have been widely used in economics, bioinformatics, and engineering (see, e.g., MacDonald and Zucchini 1997; Durbin et al. 1998; Rabiner 1989), often to study single long sequences such as time series. In social sciences, such models are commonly referred to as latent Markov (chain) models (Wiggins 1955, 1973; Van de Pol and De Leeuw 1986); typically they have been used for analysing panel data with a few measurement points. In the social science framework, Vermunt et al. (1999) extended the HMM to include individual covariates and Bartolucci et al. (2007) further developed it for multichannel observations. See also Taushanov and Berchtold (2018) in this bundle.
Hidden Markov modelling have been applied in various longitudinal settings; for accounting for measurement error and unobserved heterogeneity (e.g., Van de Pol and Langeheine 1990; Poulsen 1990; Breen and Moisio 2004; Vermunt et al. 2008; Pavlopoulos and Vermunt 2015), for finding latent subpopulations (e.g., Van de Pol and Langeheine 1990; McDonough et al. 2010; Bassi 2014), and for detecting true unobservable states (e.g., various periods of the bipolar disorder in Lopez 2008).
To the best of our knowledge, few papers apply HMMs to multichannel social sequence data and they all consider binary observations. Bartolucci et al. (2007) studied criminal trajectories of 11,400 offenders, applying HMMs to tenchannel data with six time points. Ip et al. (2015) analysed and classified 18item profiles of food security among 248 Latino farm worker households in the USA for eight time points. Rijmen et al. (2008) studied 12 parallel trajectories of emotions at 63 time points among 32 anorectic patients. Our analysis extends this framework into multichannel data with much longer and multinomial sequences.
The rest of the paper is structured as follows. We start by giving an introduction to HMMs (we assume that the reader is familiar with sequence analysis and refer to the introduction chapter in this book for the less experienced). We then proceed to framing our goals in the context of complex life course data. We continue by describing the data and the empirical analysis and show the results. We conclude with discussing the usefulness of the method, the challenges it poses, and mention some future directions.
2 Hidden Markov Model
In hidden Markov models, observations are related to a hidden process following a Markov chain. Hidden states can only be detected through the observed sequence(s), as they generate or “emit” observations on varying probabilities.
Let us assume we have multichannel sequence data with N individuals, T timepoints, and C channels and a hidden Markov model with S hidden states. Now z_{i} = (z_{i1}, z_{i2}, …, z_{iT}) represents the hidden state sequence for individual i = 1, …, N from time 1 to time t and y_{itc} denotes the observation of individual i at time t = 1, …, T in channel c = 1, …, C.
 Initial probability vector π = {π_{s}} of length S, where π_{s} is the probability of starting from the hidden state s:$$\displaystyle \begin{aligned}\pi_s = P(z_{i1}=s);\quad s\in \{1, \ldots, S\}.\end{aligned} $$
 Transition probability matrix A = {a_{sr}} of size S × S, where a_{sr} is the probability of moving from the hidden state s at time t − 1 to the hidden state r at time t:$$\displaystyle \begin{aligned}a_{sr} = P(z_{it}=rz_{i(t1)}=s);\quad s, \ r \in\{1, \ldots, S\}.\end{aligned} $$
 C emission probability matrices B_{c} = {b_{s}(m_{c})} of size S × M_{c}, where b_{s}(m_{c}) is the probability of the hidden state s emitting the observed state m_{c} in channel c and M_{c} is the number of observed states in channel c:$$\displaystyle \begin{aligned}b_{s}(m_c)=P(y_{itc}=m_cz_{it}=s); \quad s\in\{1, \ldots, S\}, \ m_c\in\{1, \ldots, M_c\}. \end{aligned}$$
Typically, the maximum likelihood estimates of these probabilities are calculated with the Baum–Welch algorithm, i.e., the expectation–maximization (EM) algorithm for HMMs (Baum and Petrie 1966; Rabiner 1989). The most probable path of hidden states for each subject given their observations and the model can be computed using the Viterbi algorithm (Viterbi 1967; Rabiner 1989). Missing observations are handled straightforwardly. When observation y_{itc} is missing, it does not contribute to the estimation of model parameters nor hidden states. See Helske and Helske (2018) for a more extensive presentation on HMMs for multichannel data.
3 Combining Sequence Analysis and Hidden Markov Models for Complex Life Sequences
 1.
groups with similar life course patterns and
 2.
typical life stages within each group.
SA followed by cluster analysis is a typical strategy for grouping life trajectories. Hidden Markov models, in turn, may be used for finding timevarying latent structures and transitions between them. At first, we use multichannel SA to compute pairwise dissimilarities and then group individuals into clusters. Separate HMMs are then fitted for each cluster. The number and nature of the hidden states are determined independently for each group.
We estimate lefttoright HMMs where transitions to previous hidden states are not allowed. We had several reasons to do this. First, lefttoright models are simpler to estimate since some of the parameters are restricted to zero. Second, due to the nature of the life trajectories, also the observed states tend to show a lefttoright behaviour and many of the HMMs would end up being estimated close to lefttoright models anyway. Third, we find that lefttoright models are often easier to interpret in the context of life course: individuals go through different life stages but even if they return to have a similar life stage compared to a previous one – say remarriage after a divorce – this second life stage comes with a different history compared to the first time.
4 Data
We illustrate the analysis of complex life sequence data using a subsample of the German National Educational Panel Survey (NEPS) (Blossfeld et al. 2011). We restricted the analysis to the life courses of an age cohort born in 1955–1959. Only individuals who were born in Germany or moved there before the age of 14 are included.
The data consisted of monthly life statuses of 1731 individuals in three life domains (labour market participation, partnerships, and parenthood) from age 15 to age 50. For each individual, there were three parallel sequences of length 434, which made altogether 2,253,762 data points (of which 2,232,730 were observed and 21,032 were missing). Using the monthly time scale also allowed for the detection of smaller fluctuations in life courses, e.g. recurrent transitions between shortterm unemployment and employment.
4.1 Sequences
The sequences in three life domains were constructed as follows:
Labour market participation

Studying (in school, vocational training, or vocational preparation)

Employed (fulltime or parttime)

Unemployed

Out of the labour market (for other reason than studies, e.g., parental leave, taking care of children or other family members, military or nonmilitary service, voluntary work, or other gap in the employment history)
Partnerships

Single (never lived with a partner)

Cohabiting

Married/in a registered partnership

Divorced/separated/widowed
Parenthood

No children

Has (had) children (biological, adopted, or foster children)
The coding for parenthood was very simple. A practical reason was that this record was available for most individuals, whereas more detailed information was often missing. On the other hand, we can argue that specifically the experience of becoming a parent is relevant as one step in the developmental process into adulthood.
For the latter two life domains, the status of each month was usually determined from the latest event. An exception was made for the rare partnerships that lasted for less than a month; there separation was coded from the following month onward. In a case of multiple records per month in the career domain, the final status was given according to assumed importance: school and vocational training came before employment, which in turn dominated over vocational preparation, unemployment, and other nonemployment statuses.
Altogether 306 individuals (17.7%) had some missing information in one or two life domains. Thus, at each time point we had at least some information from each individual.
5 Analysis
We have little prior knowledge on the structure of the model; hence, how many clusters to choose and how many hidden states to include in each cluster? Since the complexity of these types of life course trajectories varies a lot (e.g., some individuals have no familyrelated transitions while others have many), we expected the groups to have varying numbers of hidden states.
5.1 Sequence Analysis and Clustering
We started by applying multichannel sequence analysis and computed the dissimilarities between the sequences. These were then used in cluster analysis.
Substitution costs for Hamming distances in three life domains: labour market participation, partnerships, and parenthood
 

We used Ward’s clustering method for the Hamming dissimilarities and chose six clustering solutions with 7–12 clusters for further examination. The choice was based on goodnessoffit statistics, the dendrogram, and the interpretability of the clusters. Ward’s method was chosen because it typically produces usable and relatively evensized clusters compared to most of the other clustering methods (Aassve et al. 2007; Helske et al. 2015). Also, the method is hierarchical (agglomerative), so when two smaller clusters are merged, all other clusters remain the same. This means that among the 7 + 8 + 9 + 10 + 11 + 12 = 57 clusters in the six sets of clustering results, only 7 + 2 + 2 + 2 + 2 + 2 = 17 were unique, resulting in significant decrease in the number of models to be estimated compared to nonhierarchical clustering.
5.2 Hidden Markov Models for Clusters
At the next step, we estimated five HMMs with 4–8 or 5–9 hidden states separately for each of the 17 unique clusters—fewer hidden states for clusters with simpler observed trajectories, more for the more complex ones. Since the goal was to find general life stages between adolescence and middle age in a given group, having too few or too many hidden states was not plausible nor interpretable. When increasing the number of hidden states, at some point they lost their distinctive nature (consecutive states had very similar emission probabilities) and/or they were rarely “visited” in the most probable paths of hidden states.
A wellknown problem with the HMM estimation is that most of the optimization methods are sensitive to initial estimates of the parameters. In order to reduce the risk of being trapped in a poor local optimum, we estimated the models numerous times with random starting values. We continued reestimation until we had found the same optimum for at least 100 times (which turned out to be much more than necessary).
For each cluster, we compared the HMMs with a different number of hidden states to find the best model. Bayesian information criterion (BIC) and other information criteria are common choices for comparison of HMMs with different numbers of hidden states. Another common option for model selection is crossvalidation.
We chose to use BIC as it generally selects parsimonious models. Unfortunately, here BIC kept suggesting models with more and more states. We did, however, use BIC as one source of information for choosing the number of hidden states by looking for turning points in BIC after which additional hidden states offered little improvement. In addition to BIC, the choice of the number of hidden states was based on the interpretability of the model and the prevalence of the hidden states in the individual trajectories.
5.3 Software
Analyses were conducted with the R software (R Core Team 2015) by using the packages TraMineR (Gabadinho et al. 2011) for sequence analysis, cluster (Maechler et al. 2015) for cluster analysis, and seqHMM (Helske and Helske 2018) for hidden Markov modelling. For the estimation of HMMs we used the automatic reestimation routine for the EM algorithm provided in the model estimation function.
6 Results
The number of hidden states per cluster varied between six and eight. The model of eight clusters resulted in the smallest BIC (even the highest likelihood) and was chosen as the best model. We present a few different ways to describe the results: a table showing the most typical transitions in each cluster, a figure illustrating the structure of the HMMs, and a figure of the most probable hidden states, i.e., the trajectories of general life stages for each individual.
Description of clusters by typical timing of the completion of education, type of employment, the timing, number, and types of typical partnerships, and the timing of parenthood. Hidden states are described with changes in the most probable observations (ordered by prevalence) (out = out of the labour market (not studying), div. = divorced or separated). For all clusters, the first two hidden states are omitted as they are approximately the same: hidden state 1 is studies, single, no children and hidden state 2 is employed, single, no children
As an example of how to interpret these figures, let us look at the smallest of the clusters titled Single parents (cluster H). All individuals start from the first hidden state (State 1, indicated with light blue in the hidden state paths), a life stage where they are childless singles and mostly studying. For almost all, the next transition is to State 2 (dark blue), moving to employment. A few make a straight transition to State 3 (light pink), a life stage of becoming parents and being out of the workforce. State 4 (darker purple) describes a life stage during which individuals are singles, have children, and are employed. This is the most prevalent life stage for the members of this cluster and many stay there until the end of the followup. A few move out of employment, mostly to unemployment (State 5, light purple). During the last life stage, experienced by almost half of the members, individuals form their first partnerships (State 6, yellow).
In general, the clusters were well separated from each other by the timing and occurrence of labour market participation and family states. The two largest clusters composing of half of the respondents were characterized by (mostly) short education and family. The biggest difference was in the timing of partnership and parenthood transitions which occurred either earlier in life (cluster A) or later (cluster B). The third largest cluster (cluster C) mostly consisted of individuals, more often men, who had long education and later family transitions. Another cluster with early family transitions (cluster D) consisted of mostly women and was characterized with a long career break for mostly taking care of children.
Two clusters were characterized by no or very late parenthood. They differed in the timing of the partnerships; the larger cluster (cluster E) had earlier first partnerships while in the smaller cluster (cluster F) partnerships were delayed or omitted altogether. The two smallest clusters consisted of parents living divorced or separated (cluster H) or single parents (cluster G).
7 Discussion
When analysing complex sequence data with multiple channels, describing and visualizing the data can be a challenge. By combining sequence analysis and hidden Markov models the information in data can be compressed into hidden states (life stages) and clusters (general patterns in life courses). Hidden states were able to capture general life stages that included not only rather stable episodes such as being employed and married with children (e.g., State 7 for cluster A) but also life stages characterized by change, e.g., moving between unemployment and shortterm employment (State 3 for cluster F).
We presented two different ways of HMMbased visualizations that give complementary information but could also be shown alone—it is up to the researcher to decide which one is more informative in each case. The HMM graphs show the structure of the hidden states and the transitions between them; also parameter estimates could be easily included in the graph. The most probable paths of hidden states show individuallevel information on the approximate prevalence and timing of different life stages.
Despite its usefulness as a data reduction technique, this approach comes with some challenges. A major one is the estimation of several HMMs when the number of hidden states and clusters is unknown. For these challenges, we used a few approaches. In terms of the number of clusters, we used a hierarchical clustering method which reduced the number of models to be estimated compared to nonhierarchical clustering. We then estimated a single model numerous times with randomized starting values to find the one with the highest likelihood, using parallel computation for improved efficiency.
Another issue is that we take the SA clusters as fixed. In reality, there is, of course, a lot of uncertainty which we do not take into account. Also, we do not discuss other trajectory grouping techniques besides SA. To our knowledge, there are not many methods suitable for multichannel sequence data; we experimented with latent class analysis (Collins and Wugalter 1992) which did not lead to satisfactory results. On the other hand, regarding the parameter uncertainty, in theory it is possible to compute asymptotic standard errors from the Hessian matrix obtained from the numerical optimization algorithms, but in practice the underlying asymptions are typically not met (Zucchini and MacDonald 2009).
The mixture hidden Markov model (MHMM) offers a solution to the problem of uncertainty of clustering. In the MHMM, instead of fixing individuals to the clusters defined during the SA step, we could use all data to estimate a mixture of HMMs where each individual belongs to each cluster with some probability (preferably with a large probability for one cluster and a small probability to all others). In a complex setting, SA can be used to determine the range of potential clustering structures. It can also be of aid when setting initial values for the estimation process, which is often essential when using very large models.
Although in theory the MHMM approach allows even more flexibility to the modelling and potential for more interesting ways of inference, there are some practical computational problems in the MHMM methodology. The parameter estimation of HMMs is often very sensitive to initial values, and the computational costs increase rapidly when the number of hidden states grows. These problems are even more prominent in complex MHMMs, especially when the structure of the model (in terms of the number of hidden states and/or clusters) is not known. For this study, we were not able to find stable solutions for MHMMs despite large computational resources available—the multichannel structure, long sequences, and the relatively large number of individuals in our data was too challenging a combination for parameter estimation. Nevertheless, the MHMM can be useful in other settings. It has been successfully used for simpler problems, e.g., for accounting for measurement error and unobserved heterogeneity.
An extention not covered in this paper is the inclusion of external covariates. Personal characteristics and other relevant factors, timeconstant as well as timevarying, could be used to predict transition probabilities between life stages. In MHMMs, timeconstant covariates may also be used to predict cluster memberships. See, e.g., Vermunt et al. (2008) for a general presentation of such models.
We are currently studying algorithmic variations which can reduce the computational complexity of the MHMM estimation. Further research is also needed regarding model selection and the goodnessoffit of lefttoright HMMs and MHMMs. Further theoretical and empirical studies are needed for detecting the reasons for the failure of BIC and for discovering selection criteria that are better suited for finding parsimonious HMMs.
Another topic for future research is the potential of hidden Markov models and Markovian models in general as mechanisms of generating social sequence data.
The aim of our study was to describe complex life sequence data and for that goal, the SAHMM approach gave satisfactory results in a reasonable time. We were able to find meaningful and wellseparating clusters and to visualize their complex life course information by using HMM graphs and the most probable paths of life stages for each individual.
Notes
Acknowledgements
This paper uses data from the National Educational Panel Study (NEPS) Starting Cohort 6–Adults (Adult Education and Lifelong Learning), doi:http://dx.doi.org/10.5157/NEPS:SC6:3.0.1. From 2008 to 2013, the NEPS data were collected as part of the Framework Programme for the Promotion of Empirical Educational Research funded by the German Federal Ministry of Education and Research and supported by the Federal States. As of 2014, the NEPS survey is carried out by the Leibniz Institute for Educational Trajectories (LIfBi).
Satu Helske is grateful for support for this research from the John Fell Oxford University Press (OUP) Research Fund and the Department of Mathematics and Statistics at the University of Jyväskylä, Finland, and Jouni Helske for the Emil Aaltonen Foundation and the Academy of Finland (research grant 284513).
We also wish to thank three anonymous referees for their helpful comments and suggestions.
References
 Aassve, A., Billari, F. C., & Piccarreta, R. (2007). Strings of adulthood: A sequence analysis of young British women’s workfamily trajectories. European Journal of Population/Revue Européenne de Démographie, 23(3–4), 369–388.CrossRefGoogle Scholar
 Bartolucci, F., Pennoni, F., & Francis, B. (2007). A latent Markov model for detecting patterns of criminal activity. Journal of the Royal Statistical Society: Series A (Statistics in Society), 170(1), 115–132.CrossRefGoogle Scholar
 Bassi, F. (2014). Dynamic segmentation of financial markets: A mixture latent class markov approach. In M. Carpita, E. Brentari, & E. M. Qannari (Eds.), Advances in latent variables (pp. 61–72). Berlin/Heidelberg: Springer.Google Scholar
 Baum, L. E., & Petrie, T. (1966). Statistical inference for probabilistic functions of finite state Markov chains. The Annals of Mathematical Statistics, 67(6), 1554–1563.CrossRefGoogle Scholar
 Blossfeld, H.P., Roßbach, H.G., & von Maurice, J. (Eds.) (2011). Education as a lifelong processthe German national educational panel study (NEPS) (Vol. 14) [Special Issue] of Zeitschrift für Erziehungswissenschaft. Wiesbaden: Springer.Google Scholar
 Breen, R., & Moisio, P. (2004). Poverty dynamics corrected for measurement error. The Journal of Economic Inequality, 2(3), 171–191.CrossRefGoogle Scholar
 Collins, L. M., & Wugalter, S. E. (1992). Latent class models for stagesequential dynamic latent variables. Multivariate Behavioral Research, 27(1), 131–157.CrossRefGoogle Scholar
 Durbin, R., Eddy, S., Krogh, A., & Mitchison, G. (1998). Biological sequence analysis: Probabilistic models of proteins and nucleic acids. Cambridge: Cambridge University Press.CrossRefGoogle Scholar
 Eerola, M., & Helske, S. (2016). Statistical analysis of life history calendar data. Statistical Methods in Medical Research, 25(2), 571–597.CrossRefGoogle Scholar
 Gabadinho, A., Ritschard, G., Müller, N. S., & Studer, M. (2011). Analyzing and visualizing state sequences in R with TraMineR. Journal of Statistical Software, 40(4), 1–37.CrossRefGoogle Scholar
 Gauthier, J.A., Widmer, E. D., Bucher, P., & Notredame, C. (2010). Multichannel sequence analysis applied to social science data. Sociological Methodology, 40(1), 1–38.CrossRefGoogle Scholar
 Helske, S., & Helske, J. (2018, forthcoming). Mixture hidden Markov models for sequence data: The seqHMM package in R. Journal of Statistical Software.Google Scholar
 Helske, S., Steele, F., Kokko, K., Räikkönen, E., & Eerola, M. (2015). Partnership formation and dissolution over the life course: Applying sequence analysis and event history analysis in the study of recurrent events. Longitudinal and Life Course Studies, 6(1), 1–25.CrossRefGoogle Scholar
 Ip, E. H., Saldana, S., Arcury, T. A., Grzywacz, J. G., Trejo, G., & Quandt, S. A. (2015). Profiles of food security for US farmworker households and factors related to dynamic of change. American Journal of Public Health, 105(10), e42–e47.CrossRefGoogle Scholar
 Lopez, A. (2008). Markov models for longitudinal course of youth bipolar disorder. Ph.D. thesis, University of Pittsburgh, Ann Arbor, MI.Google Scholar
 MacDonald, I. L., & Zucchini, W. (1997). Hidden Markov and other models for discretevalued time series (Vol. 110). Boca Raton: CRC Press.Google Scholar
 Maechler, M., Rousseeuw, P., Struyf, A., Hubert, M., & Hornik, K. (2015). Cluster: Cluster analysis basics and extensions. R package version 2.0.3.Google Scholar
 McDonough, P., Worts, D., & Sacker, A. (2010). Socioeconomic inequalities in health dynamics: A comparison of Britain and the United States. Social Science & Medicine, 70(2), 251–260.CrossRefGoogle Scholar
 Müller, N. S., Sapin, M., Gauthier, J.A., Orita, A., & Widmer, E. D. (2012). Pluralized life courses? An exploration of the life trajectories of individuals with psychiatric disorders. International Journal of Social Psychiatry, 58(3), 266–277.CrossRefGoogle Scholar
 Pavlopoulos, D., & Vermunt, J. K. (2015). Measuring temporary employment: Do survey or register data tell the truth? Statistics Canada, Catalogue No. 12–001X, 41(1), 197–214.Google Scholar
 Poulsen, C. S. (1990). Mixed Markov and latent Markov modelling applied to brand choice behaviour. International Journal of Research in Marketing, 7(1), 5–19.CrossRefGoogle Scholar
 R Core Team. (2015). R: A language and environment for statistical computing. Vienna: R Foundation for Statistical Computing.Google Scholar
 Rabiner, L. (1989). A tutorial on hidden Markov models and selected applications in speech recognition. Proceedings of the IEEE, 77(2), 257–286.CrossRefGoogle Scholar
 Rijmen, F., Vansteelandt, K., & De Boeck, P. (2008). Latent class models for diary method data: Parameter estimation by local computations. Psychometrika, 73(2), 167–182.CrossRefGoogle Scholar
 Spallek, M., Haynes, M., & Jones, A. (2014). Holistic housing pathways for Australian families through the childbearing years. Longitudinal and Life Course Studies, 5(2), 205–226.CrossRefGoogle Scholar
 Studer, M., & Ritschard, G. (2016). What matters in differences between life trajectories: A comparative review of sequence dissimilarity measures. Journal of the Royal Statistical Society: Series A (Statistics in Society), 179(2), 481–511.CrossRefGoogle Scholar
 Taushanov, Z., & Berchtold, A. (2018). Markovianbased clustering of internet addiction trajectories. In G. Ritschard & M. Studer (Eds.), Sequence analysis and related approaches: Innovative methods and applications. Cham: Springer (this volume).Google Scholar
 Van de Pol, F., & De Leeuw, J. (1986). A latent Markov model to correct for measurement error. Sociological Methods & Research, 15(1–2), 118–141.Google Scholar
 Van de Pol, F., & Langeheine, R. (1990). Mixed Markov latent class models. Sociological Methodology, 20, 213–247.CrossRefGoogle Scholar
 Vermunt, J. K., Langeheine, R., & Bockenholt, U. (1999). Discretetime discretestate latent Markov models with timeconstant and timevarying covariates. Journal of Educational and Behavioral Statistics, 24(2), 179–207.CrossRefGoogle Scholar
 Vermunt, J. K., Tran, B., & Magidson, J. (2008). Latent class models in longitudinal research. In S. Menard (Ed.), Handbook of longitudinal research: Design, measurement, and analysis (pp. 373–385). Burlington: Elsevier.Google Scholar
 Viterbi, A. J. (1967). Error bounds for convolutional codes and an asymptotically optimum decoding algorithm. IEEE Transactions on Information Theory, 13(2), 260–269.CrossRefGoogle Scholar
 Wiggins, L. M. (1955). Mathematical models for the interpretation of attitude and behavior change: The analysis of multiwave panel. Ph.D. thesis, Columbia University, New York.Google Scholar
 Wiggins, L. M. (1973). Panel analysis: Latent probability models for attitude and behavior processes. Oxford: JosseyBass.Google Scholar
 Zucchini, W., & MacDonald, I. L. (2009). Hidden Markov models for time series: An introduction using R (Vol. 110). Boca Raton: CRC Press.Google Scholar
Copyright information
Open Access This chapter is licensed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license and indicate if changes were made.
The images or other third party material in this book are included in the book's Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the book's Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder.