The hierarchical age–period–cohort model: Why does it find the results that it finds?
 3.2k Downloads
 5 Citations
Abstract
It is claimed the hierarchicalage–period–cohort (HAPC) model solves the age–period–cohort (APC) identification problem. However, this is debateable; simulations show situations where the model produces incorrect results, countered by proponents of the model arguing those simulations are not relevant to reallife scenarios. This paper moves beyond questioning whether the HAPC model works, to why it produces the results it does. We argue HAPC estimates are the result not of the distinctive substantive APC processes occurring in the dataset, but are primarily an artefact of the data structure—that is, the way the data has been collected. Were the data collected differently, the results produced would be different. This is illustrated both with simulations and real data, the latter by taking a variety of samples from the National Health Interview Survey (NHIS) data used by Reither et al. (Soc Sci Med 69(10):1439–1448, 2009) in their HAPC study of obesity. When a sample based on a small range of cohorts is taken, such that the period range is much greater than the cohort range, the results produced are very different to those produced when cohort groups span a much wider range than periods, as is structurally the case with repeated crosssectional data. The paper also addresses the latest defence of the HAPC model by its proponents (Reither et al. in Soc Sci Med 145:125–128, 2015a). The results lend further support to the view that the HAPC model is not able to accurately discern APC effects, and should be used with caution when there appear to be period or cohort nearlinear trends.
Keywords
Age–period–cohort Hierarchical age period cohort model Obesity MCMC Identification Multilevel modelling1 Introduction
The hierarchical age period cohort (HAPC) model has, like every age–period–cohort (APC) model that has been proposed in the last 50 years, received a mixed reception since it was first outlined in 2006 (Yang and Land 2006). Whilst it has been taken up enthusiastically in parts of the social and medical sciences, the ability of the model to produce meaningful statistics has also been disputed. This is because it is, apparently, attempting to do the impossible (Bell and Jones 2013): separating age, period and birth cohort effects, including linear effects if they are present. Many, including us, have argued that it doesn’t work, and used simulations to demonstrate the situations in which this is the case (Luo and Hodges 2016; Bell and Jones 2014a). The inventors of the model and others have responded that simulations are an inappropriate method for assessing the importance of APC methods (Reither et al. 2015a). This paper can be considered the next entry in this continuing debate.
This debate is an important one. Many applied researchers now see the HAPC model as the “standard way of analysing generational effects” (Linek and Petrúšek 2016, p. 82), even whilst acknowledging the critics of the method. Whilst the methodological questions remain open, such judgements will continue to be made. This is a problem if, as we believe, the model does not function as its proponents suggest it does, and can produce highly misleading results. The debate also mirrors and complements that taking place elsewhere regarding another APC model called the Intrinsic Estimator (see Pelzer et al. 2015; Te Grotenhuis et al. 2016; Yang and Land 2013b; Luo 2013a, b; Luo et al. 2016).
In the latest rejoinder on this subject to our earlier critique, Reither et al. (2015a) left a number of unanswered questions, and we hope to be able to give our answers to those questions here. However, the key focus of this paper lies in making an argument not just that the HAPC model sometimes doesn’t work, but also in giving a reason why the model produces the results that it does. Moreover, this paper moves the debate around the HAPC model beyond simulations, towards the analysis of real data. This is not to say that we consider previous simulation studies worthless; rather that we believe that the case presented by simulations is already rather convincing, and in showing that similar results occur in reallife data, it lends credence to the argument that those simulations did indeed produce results that are indicative of realworld scenarios, despite Reither et al.’s (2015a) claims to the contrary. We will show, using both real and simulated data, that the results produced are the result not of substantive processes at hand, but an artefact of the structure of the data being analysed. When taking different samples from the same given reallife dataset, you can get different results depending on how you select your sample. This gives insight into why the HAPC model produces the results that it does—simulations have already shown that often the results they produce are incorrect, but have not thus far given any insight as to why.
Key papers (and arguments made) in the debate around the HAPC model
Paper  Argument 

Yang (2006)  Argues the HAPC model can be used in a Bayesian framework. Uses real data on verbal test scores, and simulations (note that the latter’s DGPs have only independent and identically distributed Normal random variation to generate the period and cohort effects). [51 cites in Google Scholar as of 8th Feb 2017] 
Yang and Land (2006)  Argues the treatment of age as quadratic in the HAPC model solves the identification problem. Example using real data on verbal test scores [233] 
Yang and Land (2008)  Uses the Hausman test (on multiple parameters) to test if fixed or random effects should be used for the period and cohort terms. Example using real data on verbal test scores [237] 
Yang and Land (2013a)  Book argues the different treatment of age (fixed) and period/cohort (random) “completely avoids” (p. 70) the identification problem. Uses various real data sources to illustrate this [132] 
Bell and Jones (2014a)  Argues with simulations that the HAPC model is not good at recovering DGPs in the presence of linear effects 
Bell and Jones (2014c)  Argues that results can be reproduced using a completely different DGP do that suggested by those results 
Reither et al. (2015b)  Argues that linear effects do not occur in reallife data, and thus that the model works for real data (this is illustrated, ironically, with simulations) 
Bell and Jones (2015b)  Argues with simulations that even when the DGP does not include exactly linear effects, the HAPC model does not work 
Reither et al. (2015b)  Argues that model fit statistics, and descriptive and modelled graphics, should be used to judge whether the HAPC model is appropriate for use 
Luo and Hodges (2016)  Argues that grouping cohorts in different ways can produce arbitrarily different results, using simulations 
O’Brien (2016)  Demonstrates why treating one or more of APC as random effects allows models to be identified, but shows that the solution that is arrived at is an artefact of the way the log likelihood is maximized 
Fienberg et al. (2015)  Responding to a positive book review they contend that “Yang and Land’s approaches really are no different from previous attempts to resolve the APC identification problem insofar as they impose constraints on the estimated age, period, or cohort effects; the constraints are simply hidden in the technical details of their methodology” (p. 457) 
This paper begins with a brief discussion of the APC identification problem, before outlining our explanation for why the HAPC model produces the results that it does under different data scenarios. We argue that it is the range of the periods and cohorts set by the data structure, rather than any substantive processes, that drives the results that are found. This is illustrated first with simulations and second by attempting to replicate Reither and colleagues’s (2009) study of APC effects on obesity in the United States. Regarding the latter, whilst we were able to replicate the study using the full data (including additional data up to and including 2014) we show that we get different results when we take particular samples of the data, with Reither et al.’s results not replicated when data is sampled based on a narrow range of cohorts. By way of a coda to the article, we rebut the key points made by Reither et al. (2015a) in their most recent rejoinder—particularly regarding the use of model fit statistics, and the use of both descriptive and modelled APC graphical trends to test whether the use of the HAPC model is appropriate. The paper finishes with a summary of the arguments in favour of the HAPC model so far, and suggestions for what substantive researchers interested in APC processes should do in the light of these criticisms.
2 The key critique of the HAPC model
The debate around the HAPC model has been extensive, and the key contributions to it are summarised in Table 1 for readers to consider themselves. The problem that the model is trying to address is that age, period (year) and cohort (year of birth) are linearly related such that age = period − cohort. This is a problem if any of age, period or cohort are linearly related to a given outcome, since different linear combinations of APC can produce identical outcomes.
For us, the key critique of the HAPC model lies in its inability to accurately represent data generating processes (DGPs) in simulation. In particular, we have shown (Bell and Jones 2014c) that results that have been found in previous work in fact could have resulted from an entirely different DGP. This has been shown, both with linear and nonlinear relations (Bell and Jones 2015b); a nonlinear relationship with an outcome does not mean there isn’t also a linear relation that could cause a problems in attempting to uncover true APC trends, even when no linear effect is included in the DGP.
3 What drives the HAPC model to period trends?
All of the above are in our view good reasons why the arguments in favour of the HAPC model should be viewed with scepticism. However, there remain a number of questions that critics of the HAPC model have not yet answered. In particular, why is it that that the HAPC model finds the results that it finds? Simulations have shown that the HAPC model tends to favour period effects over cohort effects, but that this is not consistent when cohorts are grouped (Bell and Jones 2014a). Yet there has been no discussion in the literature to our knowledge as to why that pattern occurs.
Here we present an argument that lies in the imposed structure of the data being analysed. The HAPC model is designed for repeated cross sectional data, where a sample is taken across a number of years, and so this data can be represented in a rectangular agebyperiod table. Similarly, panel data (for which the HAPC model has been adapted—see Suzuki 2012) can also be represented in such a format. The result of such data is that cohorts—represented by the diagonals in an agebyperiod table and measured by year of birth—span a wider range of years than periods. Taking the data used by Reither et al. (2009) in their analysis of obesity, periods span the time period 1976–2002—a range of 26 years, whilst birth cohorts (measured by the year of birth) span the years 1890–1985—a range of 95 years.
In the HAPC model, the estimation method, whether frequentist (e.g. maximum likelihood) or Bayesian (e.g. MCMC), aims to minimise the amount of unexplained variation in the model (O’Brien 2016). In the HAPC model, the period and cohort random effects are considered, at least in part, unexplained, since they are in the random part of the model, whilst the age trend is considered explained since it is in the fixed part. The model will thus apportion variation to the trends in such a way that makes those unexplained components as small as possible, regardless of its effect on the explained part (the age parameter estimates).
Of course, a true DGP is unlikely to be as simple as a single linear effect. But if there is a single linear or nearlinear effect as part of the DGP, the model will assign that trend in such a way that reduces the unexplained variance, and so, all other things being equal, will place it with period effects.
As stated previously, grouping has an effect on this, making the direction of the effect assignment more unpredictable. Whilst grouping does not affect the range spanned by the cohorts, it would affect the number of cohort groups. On one hand, grouping cohorts makes the measurement of cohorts less precise and so make the fit of the cohorts to the data worse, which might lead the model to ‘favour’ during estimation the more finely grouped periods for a trend. On the other hand, if there are fewer groups, there are fewer random effects and so either fewer degrees of freedom consumed (in a Bayesian model) or smaller penalties to the loglikelihood (O’Brien 2016). Whilst on average the results seem to fit the period solution on average, there is more variation around this in possible results from the same DGP (as shown by the simulations in Bell and Jones 2014a), and differently grouping the same dataset will produce fundamentally different results (Luo and Hodges 2016).
The key point is that the data structure, and thus the tendencies towards periods described here, are not the result of any realworld substantive process and thus their influence on the results is a statistical artefact. One could, instead, collect data by cohorts; that is, follow a large number of birth cohorts through their lives. The result would be a rectangular agebycohort table, with periods along the diagonals. In this situation, there would be a much wider range of periods than cohorts, and the model would tend to assign trends to cohorts instead of periods. This change would not be substantive—it would merely be a result of the data structure.
4 Simulations
Here, i represents individual observations, j_{1} represents cohort groups, and j_{2} represents years. This model is run using the same 3year cohort intervals, using MLwiN 2.36 (Rasbash et al. 2011) with the runmlwin command (Leckie and Charlton 2013) in Stata, with a 100,000 iteration chain length, a 5000 iteration burnin, and true starting values (in other words, we are being as kind to the model as possible, by actually giving it the true answers as a starting point).
5 Real data
Reither et al. (2015a) argue that using simulated data “is not a productive way to advance the discussion” (p. 125). Whilst we do not agree with this, we understand that readers may not be convinced by evidence based on data that is in some sense not real. Because of this, we have additionally tested our explanation with real data. This is not easy to do. Whilst one could collect data by cohorts, this would be extremely costly in time and money (to get a full range of age groups, you would have to measure each cohort of people every year for their entire lives). Instead, we take a reallife dataset and take a number of samples that mimic the properties of the data collected by periods and cohorts as described above.
We use the National Health Interview Survey dataset (National Center for Health Statistics 2004) used by Reither et al. (2009) in their study of obesity. We were able to extend Reither et al.’s analysis by including data up to and including 2014. The only other difference between our study’s analyses and that of Reither et al. was that we were unable to replicate exactly the adjustment they performed on their outcome variable, the body mass index (BMI) that measures obesity (whilst we contacted the authors in the hope of replicating this adjustment exactly, no reply was forthcoming). This adjustment is necessary due to (1) a change in the way obesity was measured in 1997 to exclude proxyreporting, and (2) a generallyobserved increase in downwardbias that appears to have been present over the study period (Reither et al. 2009 p. 1441). Instead, we used Fig. 1 in Reither et al. (2009) to attempt an approximate adjustment to the measure of obesity. Specifically, measured BMI was adjusted by adding on 0.5 + 0.03 * (year−1976) for years before 1997, and by adding on 0.75 + 0.03*(year−1976) for years 1997 and onwards. Obesity was then defined as those with an adjusted BMI of 30 or more. The results do not appear to be affected by this adjustment, and, when using the full dataset (both up to 2002 and including data up to 2014), we were able to replicate Reither et al.’s results (see Fig. 4), suggesting the adjustment is good enough to make the methodological point at hand in this paper.
Second, we took a number of samples that were based on age (with an arbitrarily chosen range of 30). In this case, the range of cohorts is still greater than the range of periods, but to a lesser extent than in the overall sample. The purpose of these models was to check whether the results found by HAPC differed across the age range, which might explain any differences found in the cohortsampled models. These samples are represented by the coloured boxes in Fig. 3.
The HAPC model was applied to both the full dataset and the samples outlined here. This was done both without any grouping, and by including grouping for year groups (note, with only a 10 year span of birth cohorts in some models, grouping of cohorts was not possible in the cohortselected samples). All models were run using MCMC estimation (Browne 2009), with 500,000 iterations and a 50,000 iteration burnin, with hierarchical centering to speed up convergence and models checked for convergence using visual diagnostics. Models were again run in MLwiN 2.36 (Rasbash et al. 2009) using the runmlwin command in Stata (Leckie and Charlton 2013).
6 Reallife data results
When data is selected by period, the results are consistent: a nearlinear positive cohort trend and a flat period trend are found, regardless of whether years or cohorts are grouped or not. That is, Reither et al.’s results are not replicated in these scenarios.
These results are entirely consistent with previous simulations (Bell and Jones 2014a, c, 2015b), the simulations presented earlier in this paper, and with the logic we have spelled out in this paper. When cohorts span a wider range than periods, as in standard repeated crosssectional data, the trend tends towards periods, although this is complex when periods or cohorts are grouped. In contrast, when there are more periods than cohorts (i.e data is selected by cohorts), the result consistently finds the opposite result, with the trend being found in cohorts. Finally, as expected, the results are less consistent when grouping is used in one of the sets of random effects. To be clear, this is not to say any particular result found here is right or wrong with regard to obesity; rather that the data and the HAPC model alone give us no indication as to which pattern is correct.
7 Responses to Reither et al. (2015a)
Model fit statistics for an example dataset used in the simulations here (based on the models used in Reither et al. 2015a)
Model  N  Agebycohort data  Agebyperiod data  

df  AIC  BIC  df  AIC  BIC  
APC  20,000  89  84,732.58  85,435.99  43  84,707.87  85,047.72 
AP  20,000  78  86,179.2  86,795.68  23  88,936.46  89,118.24 
AC  20,000  14  93,592  93,702.65  23  88,158.13  88,339.91 
A  20,000  3  10,2007.3  102,031  3  91,701.97  91,725.68 
P  20,000  76  91,382.66  91,983.32  21  94,676.62  94,842.6 
C  20,000  12  94,035.69  94,130.53  21  89,708.2  89,874.18 
AC (both quadratic)  20,000  4  94,427.87  94,459.49  5  91,686.3  91,725.82 
7.1 The use of model fit statistics
In their previous commentary, Reither et al. (2015b) argued that fit statistics should be used to assess whether the full APC model is appropriate. This point is reiterated in their latest rejoinder (Reither et al. 2015a) where they make a number of points that for us are contentious.
First they present the results of model fit statistics applied to simulated datasets. These show that “In no instance do these model selection statistics point to a fully threedimensional data structure” (Reither et al. 2015a, p. 127, emphasis their own). This is true; however the test that they are applying is not really relevant to whether the HAPC model should be used. They are testing a model with linear and quadratic age, and period and cohort dummy fixed effects (the ‘age + period + cohort’ model), against a model with linear and quadratic age and cohort trends (the ‘age + cohort (both quadratic)’ model). The latter has just 5 degrees of freedom, whilst the former has 46, so given the true data generating process (DGP) is primarily formed of age and cohort, it is unsurprising that the model selection criteria choose the more parsimonious option. By arbitrarily adding the quadratic cohort effect, and removing the cohort and period dummy variables from the model, they are testing apples against oranges—it is this change in the degrees of freedom that makes the difference, not the two dimensions per se. No explanation is offered for this test choice, given that in real substantive research, one would not know the true DGP that produced the data.
Reither et al. (2015a) go on to question our judgement that the existence of period and cohort random effects in the DGP meant that model selection that does not find APC effects were incorrect. They argue that, because these random effects are small, it is reasonable for the model to not pick them up as statistically significant. For this reason, the AIC/BIC statistic would not choose the full APC model. This is again true; however it follows from this reasoning that, were these random effects’ variances bigger, or the sample size bigger, these nonlinear variations would be picked up by the model as significant. In these instances, the HAPC model would be selected on the basis of the fit statistics. The linear dependency of APC in the model does not disappear because there is more data, or because the noise around those linear trends is greater. As such, the results that would be found may be incorrect, because, whilst nonlinear APC effects do exist in the DGP (suggesting the HAPC model), linear effects also exist that could still be radically misapportioned. indeed, this is the case in the simulations in Bell and Jones (2014a) in which the HAPC model also performed poorly, yet model fit statistics of the sort used by Reither et al. (2015a) suggest the full APC model is preferable.
The point, here, is that Reither et al. (2015a) do not appreciate that the presence of nonlinear effects in a data generating process does not mean that there aren’t also nearlinear effects, and it does not mean that those nearlinear effects could not be themselves confounded, producing results that are incorrect and highly misleading. Model selection criteria can only tell us about nonlinear effects (because the linear components can be apportioned in an infinite number of different ways), and as such, they should not be used to judge whether the HAPC model should be used.
7.2 Visual tests of whether the HAPC model should be used
In their latest rejoinder, Reither et al. (2015a) introduce new tests for whether the HAPC model should be used: a visual inspection of (a) the raw APC descriptive trends, and (b) the modelled APC trends produced by the HAPC model (unfortunately, these are rather confusingly conflated in the article).
It is unclear exactly why these would be relevant in deciding whether the HAPC is appropriate. Regarding raw descriptive trends, it will often be the case that trends appear similar. For example the mirror image between period and cohort trends will often be present when there has been change over time. The similarities between age and cohort trends are also unsurprising since older people in the sample are generally born earlier. Thus, we agree that the HAPC model should not be used in these circumstances; however we do not agree that differences in the descriptive APC plots (such as those in Fig. 3 of Reither et al. 2009) are in any way a sufficient test for whether the HAPC model produces valid inference.
The reason for this matches our concerns about using model fit statistics—nonmatching APC descriptive plots imply the existence of nonlinear APC effects in the DGP, but do not imply that there aren’t also linear or nearlinear effects in the DGP as well. The argument presented by Reither et al. (2015a) implies that the existence of nonlinear effects in a DGP mean that nearlinear APC effects are no longer problematic; this is simply incorrect. Such nonlinearities simply obscure the nearlinear effects in the descriptive plots—they may still be there, and they can still be apportioned in an infinite number of ways between age, period and cohort. Visual plots do not provide a way forward for they are indeterminate in their diagnosis.
Reither et al. (2015a) similarly argue that similarities in modelled outcomes make the HAPC model unsuitable. But the logic behind this is not clear to us. Each trend is, supposedly, controlled for the other trends, so any similarities in trends are not to do with the collinearity between the variables. It is also unclear what counts as ‘similar’. If age and period both show a general upward trend, are they too similar? How much curvature or random variation is needed in each trend before the HAPC model should be allowed? Such questions quickly reveal the flaws in the logic of these criteria, revealing, once again, that these arguments do not consider the possibility that linear and nonlinear effects might be present in the same DGP, and that the presence of the latter does not imply that the former is benign. Reither et al. (2015a) also correctly point out a typo in the code that produced our graph—a zero where a nine should be. However, as we argue above, we do not see the relevance of this to their argument.
In sum: the new criteria proposed by Reither et al. (2015a) are arbitrary, and readers only need to look to previous work (Bell and Jones 2014a) and this paper for simulated data where these criteria pass and yet the HAPC model fails to produce sensible and ‘correct’ results.
8 Conclusions
If it were the case that there was genuine social process that was driving a certain age, period and cohort combination, we would expect to find it regardless of the data structure at hand. However, the results here show the data structure has a substantial and sometimes determining influence on the results that are produced.
To justify how these results could have occurred whilst still seeing the HAPC model as an appropriate one, one would have to do some fairly dramatic mental gymnastics. First, you would need to argue that the consistency that the reallife results present with simulations has occurred by chance. Second, you would need to come up with a reason why the HAPC model is inappropriate in the data scenarios used here. Third, you would need to argue that there are somehow real differences within these samples that are driving these results to match the simulations (even though the samples heavily overlap with each other). We do not consider any of these arguments to be plausible or defensible. The only sensible explanation in our view is that a statistical artefact of the data structure is driving the results that are found. This explanation also explains those results found by the HAPC models that go against the prevailing academic wisdom (for example Dassonneville 2013, who finds no cohort effects in electoral volatility, despite the literature suggesting such effects should be important).

It works because of the inclusion of the age squared term (Yang and Land 2006, p. 84),

It works because age is treated on a different hierarchical level to periods and cohorts (Yang and Land 2013a, p. 191),

It works because linear effects do not exist in the real world (Reither et al. 2015b),

It only works when a model fit statistic says there is nonlinear variation in all three of APC (Reither et al. 2015a),

It only works when raw descriptive plots of APC look dissimilar (Reither et al. 2015a),

It only works when model predicted plots of APC look similar (Reither et al. 2015a),

It only works on nonsimulated data (Reither et al. 2015a).
In this article, and in our previous contributions, we have provided evidence that every one of these suggestions is flawed, and that the model is never able to reliably apportion near linear APC trends, regardless of what other nonlinear processes are present in the DGP. It seems to us that proponents of the HAPC model do not really know why their model works (because it often does not), and are searching under stones to find reasons to justify the continued use of the model.
A final note on replication: it can be argued that one solution to these problems is replication, and it is true that many papers using the HAPC and IE may have been rejected if reviewers had the possibility to replicate results with different methods to test their robustness. We agree (indeed, replication files for this paper are available as online supplementary files for this reason). However successful replication is a necessary but not sufficient condition for HAPC analyses to be robust. Often the implicit identification strategies of different models will be similar or have similar results, and so a second model may often be wrong in the same direction and magnitude as the first.
So, what should likely disheartened reseachers wanting to find independent APC effects do in the absence of a magical solution to the identification problem? For us there are two options. First, authors could choose to remove any linear effects from analyses and focus on patterns of nonlinear effects. Such an approach does not solve the identification problem; linear effects cannot be assumed on the basis of these nonlinear effects. However often the nonlinear effects are in themselves interesting and worthy of publication, so long as the limits of this are made clear (Chauvel and Schroder 2014; Chauvel et al. 2016). Second, and as we have suggested before, researchers should use theory to justify constraints to APC models such as the HAPC model, and those constraints and the reasoning behind them should be stated transparently and explicitly. This might involve a belief that a particular trend will take a certain value, or a view that a certain combination of APC is the most plausible of those possible given the data (Bell 2014; Bell and Jones 2014b, 2015a; Fosse and Winship 2016).
It is worth noting once again that none of this means the HAPC model should be entirely abandoned. The model structure is intuitive and, when constraints are applied that are appropriate and theoretically driven, rather than arbitrary, hidden and statistically driven, the model can produce interesting and important results. However when the model is applied as a mechanical routinized solution that ‘completely avoids’ to the identification problem, dangerously misleading results can be found. Applied researchers should take note.
Notes
Acknowledgements
Thanks to Phil Jones for research assistance funded by the British Academy's Skills Innovator Award, and attendees at the Research Methods Festival 2016 and Royal Statistical Society conference 2016 for their helpful suggestions and ideas.
Supplementary material
References
 Bell, A.: Life course and cohort trajectories of mental health in the UK, 1991–2008: a multilevel age–period–cohort analysis. Soc. Sci. Med. 120, 21–30 (2014)CrossRefGoogle Scholar
 Bell, A., Jones, K.: The impossibility of separating age, period and cohort effects. Soc. Sci. Med. 93, 163–165 (2013)CrossRefGoogle Scholar
 Bell, A., Jones, K.: Another “futile quest”? A simulation study of Yang and Land’s hierarchical age–period–cohort model. Demogr. Res. 30, 333–360 (2014a)CrossRefGoogle Scholar
 Bell, A., Jones, K.: Current practice in the modelling of age, period and cohort effects with panel data: a commentary on Tawfik et al. (2012), Clarke et al. (2009), and McCulloch (2012). Qual. Quant. 48, 2089–2095 (2014b)CrossRefGoogle Scholar
 Bell, A., Jones, K.: Don’t birth cohorts matter? A commentary and simulation exercise on Reither, Hauser and Yang’s (2009) age–period–cohort study of obesity. Soc. Sci. Med. 101, 176–180 (2014c)CrossRefGoogle Scholar
 Bell, A., Jones, K.: Bayesian informative priors with Yang and Land’s hierarchical age–period–cohortmodel. Qual. Quant. 49(1), 255–266 (2015a)CrossRefGoogle Scholar
 Bell, A., Jones, K.: Should age–period–cohort analysts accept innovation without scrutiny? A response to Reither, Masters, Yang, Powers, Zheng, and Land. Soc. Sci. Med. 128, 331–333 (2015b)CrossRefGoogle Scholar
 Browne, W.J.: MCMC Estimation in MLwiN, Version 2.25. Centre for Multilevel Modelling, University of Bristol, Bristol (2009)Google Scholar
 Chauvel, L., Schroder, M.: Generational inequalities and welfare regimes. Soc. Forces 92(4), 1259–1283 (2014)CrossRefGoogle Scholar
 Chauvel, L., Leist, A.K., Ponomarenko, V.: Testing persistence of cohort effects in the epidemiology of suicide: an age–period–cohort hysteresis model U. S. Tran, ed. PLoS ONE 11(7), 1–20 (2016)CrossRefGoogle Scholar
 Dassonneville, R.: Questioning generational replacement. An age, period and cohort analysis of electoral volatility in The Netherlands, 1971–2010. Elect. Stud. 32(1), 37–47 (2013)CrossRefGoogle Scholar
 Fienberg, S.E., Hodges, J.S., Luo, L.: Letter to the editor. J. Am. Stat. Assoc. 110(509), 457 (2015)CrossRefGoogle Scholar
 Fosse, E., Winship, C.: Nonparametric bounds of ageperiodcohort effects. Working paper, Princeton University. http://qaps.princeton.edu/sites/default/files/qaps/files/apcbounds_draft.pdf (2016). Accessed 23 Feb 2017
 Leckie, G., Charlton, C.: runmlwin: a program to run the MLwiN multilevel modelling software from within stata. J. Stat. Softw. 52(11), (2013)Google Scholar
 Linek, L., Petrúšek, I.: What’s past is prologue, or is it? Generational effects on voter turnout in postcommunist countries, 1990–2013. Elect. Stud. (2016). doi: 10.18637/jss.v052.i11 Google Scholar
 Luo, L.: Assessing validity and application scope of the intrinsic estimator approach to the age–period–cohort problem. Demography 50(6), 1945–1967 (2013a)CrossRefGoogle Scholar
 Luo, L.: Paradigm shift in age–period–cohort analysis: a response to Yang and Land, O’Brien, Held and Riebler, and Fienberg. Demography 50(6), 1985–1988 (2013b)CrossRefGoogle Scholar
 Luo, L., Hodges, J.S.: Block constraints in age–period–cohortmodels with unequalwidth intervals. Sociol. Methods Res. 45(4), 700–726 (2016)CrossRefGoogle Scholar
 Luo, L., et al.: The sensitivity of the intrinsic estimator to coding schemes: comment on Yang, SchulhoferWohl, Fu, and Land. Am. J. Sociol. 122(3), 930–961 (2016)CrossRefGoogle Scholar
 National Center for Health Statistics.: The National Health Interview Survey (NHIS). http://www.cdc.gov/nchs/nhis/ (2004). Accessed 17 June 16
 O’Brien, R.: Mixed models, linear dependency, and identification in age–period–cohort models.(2016) In progressGoogle Scholar
 Pelzer, B., et al.: The nonuniqueness property of the intrinsic estimator in APC models. Demography 52(1), 315–327 (2015)CrossRefGoogle Scholar
 Rasbash, J., et al.: A User’s Guide to MLwiN, Version 2.10. Centre for Multilevel Modelling, University of Bristol, Bristol (2009)Google Scholar
 Rasbash, J., et al.: MLwiN Version 2.24. Centre for Multilevel Modelling, University of Bristol, Bristol (2011)Google Scholar
 Reither, E.N., Hauser, R.M., Yang, Y.: Do birth cohorts matter? Age–period–cohort analyses of the obesity epidemic in the United States. Soc. Sci. Med. 69(10), 1439–1448 (2009)CrossRefGoogle Scholar
 Reither, E.N., Land, K.C., et al.: Clarifying hierarchical age–period–cohort models: a rejoinder to Bell and Jones. Soc. Sci. Med. 145, 125–128 (2015a)CrossRefGoogle Scholar
 Reither, E.N., Masters, R.K., et al.: Should age–period–cohort studies return to the methodologies of the 1970s? Soc. Sci. Med. 128, 356–365 (2015b)CrossRefGoogle Scholar
 Spiegelhalter, D.J., et al.: Bayesian measures of model complexity and fit. J. R. Stat. Soc. Ser. BStat. Methodol. 64, 583–616 (2002)CrossRefGoogle Scholar
 Suzuki, E.: Time changes, so do people. Soc. Sci. Med. 75(3), 452–456 (2012)CrossRefGoogle Scholar
 Te Grotenhuis, M., et al.: The intrinsic estimator, alternative estimates, and predictions of mortality trends: a comment on Masters, Hummer, Powers, Beck, Lin, and Finch. Demography 53(4), 1245–1252 (2016)CrossRefGoogle Scholar
 Yang, Y.: Bayesian inference for hierarchical age–period–cohort models of repeated crosssection survey data. Sociol. Methodol. 36, 39–74 (2006)CrossRefGoogle Scholar
 Yang, Y., Land, K.C.: A mixed models approach to the age–period–cohort analysis of repeated crosssection surveys, with an application to data on trends in verbal test scores. Sociol. Methodol. 36, 75–97 (2006)CrossRefGoogle Scholar
 Yang, Y., Land, K.C.: Age–period–cohort analysis of repeated crosssection surveys—fixed or random effects? Sociol. Methods Res. 36(3), 297–326 (2008)CrossRefGoogle Scholar
 Yang, Y., Land, K.C.: Age–period–cohort Analysis: New Models, Methods, and Empirical Applications. CRC Press, Boca Raton (2013a)Google Scholar
 Yang, Y., Land, K.C.: Misunderstandings, mischaracterizations, and the problematic choice of a specific instance in which the IE should never be applied. Demography 50(6), 1969–1971 (2013b)CrossRefGoogle Scholar
Copyright information
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.