Abstract
Epidemiology has been remarkably successful in the past in identifying the important agents of disease, the impact of the environment, both physical and social, and interrelationship with host susceptibility (genomics). Many of the advances in improving the health of individuals and populations have been the result of epidemiology studies that have identified the specific “agents” of disease and application of public health and preventive medicine. In recent years, large longitudinal studies have dominated epidemiology research, especially long incubation period chronic diseases. The initial hypotheses in these studies have been expanded by vertical extension studies using newer technologies to measure independent variables, vertical pseudopods, and additional studies of other diseases, horizontal pseudopods, of the original longitudinal study. Host susceptibility, i.e. genomics, has also become a prominent component of these longitudinal studies. The critical question addressed in this paper is whether these “pseudopod” epidemiology approaches have enhanced public health or generated a large number of studies of little impact.
Similar content being viewed by others
Introduction
“Pseudopod epidemiology” is the expansion of longitudinal epidemiological studies either vertically by adding new independent variables to evaluate the same dependent measures, e.g. new measures of subclinical cardiovascular disease (CVD) to evaluate the risk of coronary heart disease (CHD), or horizontally which adds new dependent variables including cancer, osteoporosis, or dementia to an original study designed to evaluate CHD. In the 2nd horizontal approach, an investigator can limit the study to the same or new independent variables used to evaluate the original dependent endpoint, e.g. CHD, to the study of dementia, cancer, etc.
The rapidly evolving genomic technologies, proteomics, and metabolomics have been a strong impetus for the continued support of longitudinal studies and their pseudopod additions. The issues that will be reviewed in this paper relate to the successes and problems of pseudopod epidemiology.
Many modern era epidemiologists were trained that longitudinal epidemiological studies. The Framingham Heart Study beginning in the 1940s was the primary or only epidemiology research methodology, especially for long incubation period diseases [1]. Many of the new era epidemiologists assumed that in the 1940s a group of investigators found a town outside of Boston, MA (Framingham), sampled a group of individuals within a specific age range to participate in a longitudinal study that would determine the cause of heart disease, not true; the study was not a random sample, it included both volunteers and household members. Second, the variables selected for study were based on “preconceived hypotheses” based on clinical observations, pathology, animal experimental studies, and smaller case–control studies [2, 3].
Bill Kannel, one of the great epidemiologists and leaders of the Framingham Heart Study, coined the term “risk factors” for variables which were determinants of CVD in the Framingham Heart Study, elevated cholesterol, smoking, and high blood pressure (BP) [4]. Later, in the 1960s and 1970s groups of biostatisticians initially led by Jerry Cornfield at the National Heart Institute and the University of Pittsburgh, developed methods for combining these risk factors into multivariate models and later, longitudinal analysis including time to the event [5].
The development of computer technologies to handle large data sets made it possible to search data files from these longitudinal studies for many independent variables and relate them to the dependent variable, e.g. CVD. Therefore, by the 1970s and 1980s, the successful modern era of epidemiology had begun. Subsequently, the introduction of genetic technologies to study the host, especially Genome-Wide Association Studies (GWAS) [6] gave further impetus to this movement in epidemiology to large longitudinal studies with many pseudopods, both horizontal and vertical [7].
The genomic era and GWAS also greatly impacted epidemiological methods, as a GWAS did not require any specific hypotheses or knowledge of biological plausible mechanisms of the relationship between dependent or independent variables. The GWAS and subsequent approaches to whole genome analysis and epigenetics changed the focus of many longitudinal studies to the host (genetics) and then molecular biology, proteomics, metabolomics, etc. [8–17].
It is important to distinguish studies whose main focus is understanding population biology from epidemiology. The goal in population biology studies is to expand knowledge of specific phenotype, e.g. deep phenotyping [18], such as blood glucose and lipid lowering levels (metabolomics), circulating proteins (proteomics), and the host, genomic determinants of the levels of the phenotypes [19]. The population biology studies have made good use of large sample sizes and availability of specimens, e.g. blood, urine, etc. Such studies are important in improving understanding of pathophysiology of disease and new therapeutic approaches. These studies are not epidemiology.
Recently, epidemiology studies have utilized these new technologies such as proteomics, metabolomics to evaluate numerous biomarkers as “risk factors” for diseases without any prior hypotheses or knowledge of agent and environmental factors that determine, in part, the level of these metabolites, proteins, etc. [20, 21].
The concept of “risk factors” as initially conceived by Kannel, et al. now included almost any variables that had a significant “p value” of relationship between dependent and independent variable [22]. Epidemiology studies were loaded with numerous “p values” (the peppered p value syndrome). Whether these variables were in the causal pathway or the possible pathophysiological basis of the statistically significant associations were not necessarily a high priority [23, 24].
At face value, the use of existing longitudinal epidemiological studies for both vertical and horizontal pseudopod investigations makes excellent sense and should be a cost-effective approach for obtaining new important data. This may not be the case. What are the issues? First, there may be a mistaken concept that the identification of many new variables from traditional biochemistry to metabolomics, proteomics, microRNA, etc. represent the identification of new risk factors for disease, e.g. independent variables. The vast majority of these new identified variables may not be risk factors for the dependent variable, disease, pathology, etc. of interest but, rather: (1) subclinical measurements of the disease [25]; (2) independent levels of variables determined by the extent of subclinical disease [26], e.g. reverse causality; (3) highly correlated variables with previously identified independent variables [27]; (4) related to another dependent variable, e.g. disease with similar characteristics (pleiotropy) [28]; and (5) most important, they could be variables in the causal pathway of the dependent variable, e.g. disease, a true “risk factor” [29].
If the independent variable is in the causal pathway then the next important questions should be the identification of the pathophysiology or cellular, molecular basis for the risk factor association and effects of potential therapeutic, e.g. preventive and public health, interventions. Epidemiology is not only data collection but a basic science of public health and preventive medicine [30].
To date, many pseudopod epidemiological studies have successfully generated observations in 1–4 above and have had little success in identifying “new risk factors in the causal pathway,” especially of sufficient relative and attributable risk to lead to important changes in prevention and treatment of disease. Have we just generated a lot of new data, many publications, many grants that have had relatively little impact? Colleagues will argue that the acquisition of new data, even in 1–4 above, is of considerable importance and could ultimately lead to the identification of specific risk factors and interventions over time. Why have these longitudinal epidemiological studies, and especially the pseudopods, not been able to generate new important ‘risk factors’ that have unique pathophysiology and ‘impact’ on the disease and, most important, resulted in changes in either preventative or clinical therapies [31, 32]? Why have these studies had limited impact?
If we accept epidemiology as a basic science of public health and preventive medicine, then impact could be defined as the identification of new risk factors whose modification results in an increase or decrease in the exposure to the risk factor or level of risk factors resulting in either prevention of disease, e.g. changes in incidence or prevalence, decreasing disability, increase in active life expectancy, or reduction in mortality. This definition requires that a new risk factor to have impact requires not only identification but also successful intervention to reduce the magnitude of the disease. The intervention could be drug therapy, surgery, changes in lifestyle, removal of a specific agent from the social or physical environment, modification of host susceptibility by gene therapy, precision medicine, etc. [33, 34]. This concept closely links observational epidemiology with experimental epidemiology, e.g. clinical trials.
The cigarette smoking epidemic, for example, began in the early 1900s. Excess risk of cancers, especially lung cancer, was recognized long before the US Surgeon General’s Report in 1964 of the risk of cigarette smoking and lung cancer. There have been no clinical trials that have shown that smoking cessation significantly reduced the risk of lung cancer, i.e. p ≤ .05 [35, 36]. Therefore, requiring clinical trial evidence that modification of a new “risk factor” reduced morbidity and mortality is the accepted gold standard but may not always be obtainable, especially for behavioral and community-based interventions. The epidemiological observations from these longitudinal studies can identify new risk factors that precede the understanding of the pathophysiology for many years. The identification of dietary risk factors, e.g. low protein diet, primarily from corn, as a risk factor in the causal pathway of pellagra preceded many years the understanding and identification of the specific vitamin, i.e. nicotinic acid, in the pathophysiology of pellagra [37].
The impact of identification and modification of a new risk factor in these longitudinal epidemiology studies and their pseudopods could also be based on observational changes in the new risk factor(s) and incidence or morbidity and mortality over time or within a specific geographic area, e.g. modification of an “epidemic”. For example, smoking cessation had a substantial effect on both individual risk of lung cancer and with substantial decline in lung cancer mortality rates. The changes in blood cholesterol, BP, and smoking have been linked repeatedly to decline in CHD incidence and mortality rates. A community-based effort to change type of oils, replacement of saturated fat by polyunsaturated fat, used in food preparation resulted in decline in blood cholesterol and CHD [38].
A further argument that is often used to quell the concern of lack of impact of “new risk factors” is that most long incubation period diseases are multifactorial, i.e. many risk factors each with a relatively small effect size but together they contribute a substantial component of the attributable risk of the disease. Therefore, if we keep working at it, our pseudopod studies will identify the 150 risk factors for “CHD”, an extremely dubious proposition.
Recently, Mendelian randomization was developed to separate these “independent variables” with small effects (true risk factors?), i.e. part of multifactorial risk, from the numerous variables not in the causal pathway [39–41].
The concern about issues of risk factors and causality in chronic disease long incubation period epidemiology is not new. In the 1950s, much as today, the relevance of chronic disease epidemiology was questioned as having little relevance especially as compared to the short incubation period or infectious disease epidemiology in which the specific etiological agent was either identified or not identified, e.g. HIV, polio, Zika virus, etc., the risk was either 0 or 100 % [40]. The explanation given in the 1960s by Lilienfeld and others to account for these low relative risks in chronic diseases was that the many variables were vectors of disease in a chain from broad descriptors, such as social class, poor neighborhoods, poverty, low education, that were determinants of the extent of exposure to the true causal factors [1, 42–44]. For example, in Flint, MI, changes in the water supply resulted in acidic water which leached lead out of pipes from older homes resulting in high lead levels in the water [45]. The consumption of this water by children resulted in high blood lead levels and poor cognition [46]. In this model, all of the variables leading to the high blood lead levels would be classified as vectors and not as risk factors. Modern epidemiology would classify all of the markers from the acidic water supply to ultimate blood lead levels as risk factors, a multifactorial model caused by poverty, acidic water supply, lead in the water pipes, elevated blood lead levels, and brain damage. Furthermore, host susceptibility, e.g. genomics, clearly played an important role since not all children who have elevated blood lead levels will develop cognitive changes [46]. An intervention that modified the water supply so that lead did not leach out of the pipes would be a successful public health effort. Traditional longitudinal studies and their pseudopods could utilize a great deal of resources describing the vectors of a specific disease as “risk factors” but fail to identify the specific causal agents, true risk factor(s). Modification of “vectors” can have a big impact on disease, e.g. pellagra [37], as above yet not identify the causal “risk factor”. The big payoff in reducing morbidity and mortality, however, likely occurs by identifying the specific agent(s).
The concept of “multifactorial causes of disease” is probably a misnomer. Most diseases to-date are determined by a single or small number of agents defined by a broad definition to include both biological agents, e.g. viruses, environmental particulate pollution, psychosocial factors [47, 48]. Multiple agents can cause the same or similar disease. For example, exposure to rubella and Zika virus in the first trimester both are associated with an increase in microcephaly and other developmental abnormalities. High ambient temperature and stagnant water are all vectors, e.g. the environment, that lead to an increase in specific type of mosquitos and Zika virus exposure in the population and risk factors of infection by a pregnant woman. Not every woman exposed to the Zika virus in the first trimester will have babies with microcephaly. Other environmental factors, such as prevalence of Dengue virus infection, immunological responses, placental characteristics, and host susceptibility, genetics, contribute to risk of Zika virus and development abnormalities.
Host susceptibility (genomics) after exposure to specific agents is not a new concept. The best example of susceptibility was exposure to polio myelitis. Only few infected with polio virus developed severe paralysis, maybe 1 in 1000 [49]. Part of the difference in risk is clearly genetic or host susceptibility. Other vectors or epi-genetic effects may be important. Risk of clinical paralytic polio is related to age at time of first infection.
Improved nutrition, especially increase in protein intake, played a major role in the risk of clinical tuberculosis given infection with mycobacterium tuberculosis. The agent of disease is the tuberculosis mycobacterium and susceptibility is likely related to genetic, epi-genetic and lifestyle factors, e.g. higher protein intake, etc. Many modern epidemiologists would call this a “multifactorial etiology of disease” [50]. It is likely that for many diseases, the environmental and other cofactors are being measured and attributed as the agent(s) of the disease [50–52].
Discussion
The horizontal and vertical pseudopod studies may not be reaching their goal of impact on public health for the following reasons:
They may not be hypothesis-driven but rather data collection exercises, primarily descriptive, e.g. categories 1–4 above
The goal may be number of publications, grants, and successful identification of “risk factors” with significant p values [53].
They are attached to study designs and populations that are not appropriate for identifying “risk factors”
For example, many pseudopod epidemiological studies are attempting to study inflammation. They define “inflammation” by levels of cytokines [54] or acute phase proteins (APP) [55]. There are numerous cytokines and spliced variants of the same cytokine and similarly many APP are produced in the liver, will be increased or decreased by activation of liver protein synthesis. Some APPs may also decline with progressive liver injury. It may be better to study inflammatory diseases, such as rheumatoid arthritis [56, 57], HIV [58, 59], etc. in which the association of inflammation, specific cytokines, T and B cell function is known and can be modified by drug therapy as part of the treatment armamentarium rather than in pseudopod population longitudinal epidemiological studies [60].
Atherosclerosis is the underlying pathology for clinical CHD, a long incubation period disease driven primarily by levels of low density lipoprotein cholesterol (LDL-C), apolipoprotein-B, and LDL particles, and secondarily by cigarette smoking, elevated BP, insulin resistance, and diabetes. This has been known for at least 60 years [61]. The important unanswered questions are “what are the risk factors for the acute precipitating events that modify atherosclerosis and result in heart attack, especially sudden cardiac death? Such pathophysiology has an incubation period of seconds to minutes”. How best to identify risk factors for thrombosis, coagulation, ruptured or fissured plaques, arrhythmias? The study designs to identify such “agents” require both frequent contact with participants and better methods of identification of possible “agents,” e.g. air pollution, psychosocial stressors, infections, and their relationship to “vulnerable plaques” and thrombosis [62–65]. If inflammation plays an important role in conversion from atherosclerosis to clinical disease, then epidemiology studies need better measures of “inflammation,” e.g. innate and adaptive immune responses and their relationship to coagulation, thrombosis, etc. [18, 66, 67]. Most large epidemiology studies and their pseudopods may not be the best study population or design to answer the specific questions of short term determinants of incident CVD events.
The phenotype or the dependent variable disease is not adequately measured
Many long term large epidemiological studies include aging cohorts leading to new interest in studying dementia and other age-related disorders. The definition of dementia is a change in cognition over time which impacts on function. Dementia, like heart disease, is not one disease but “caused” by different pathologies. The Framingham Study would not have been successful if it had studied “heart disease” rather than “coronary heart disease” and similarly failure to have specificity as to the pathology, amyloid, tau, vascular disease, neurodegeneration, may limit epidemiology study of dementia [68]. New techniques, such as MRI, PET, cerebral spinal fluid examination, cerebral blood flow measurements, have substantially changed the methods of identifying “risk factors”, and host genetic susceptibility of the specific pathology of dementia [69].
Modern era cancer epidemiology studies are based not on site-specific cancer diagnosis only, e.g. breast or colon cancer, but rather on molecular phenotyping of the cancer based on somatic mutations. Mutations may occur many years prior to initial clinical diagnosis which limit the success of identifying etiological agent(s) [31, 70]. A key issue is how to integrate these new technologies into ongoing longitudinal and their pseudopod studies or are new study designs more appropriate [71]? Larger and larger population studies that cannot measure the agent(s) in the causal pathway for a specific cancer are not the answer but rather application of new technologies to measure “agents” in at risk populations.
The independent variables are not accurate or repeatable
The within individual variability over time may be as large as the between individual differences [53, 72, 73]. For long incubation period disease, the level of the risk factors, e.g. the independent variables measured many years before, may be more important than proximate measured variables. For example, blood cholesterol level at younger ages may be a better measure of risk for clinical coronary artery disease. A duration of exposure is an important variable. Possibly epi-genetic markers could provide a window of exposure to an agent, e.g. risk factor that was important many years in the past. Study designs, such as long term life course epidemiology studies, may be a better approach to evaluating “risk factors” that likely change over time, especially if such change is a function of evolving subclinical disease, e.g. inflammatory markers [74, 75]. A potential resource for the long incubation period epidemiology studies could be data collection many years ago, for example, in prior studies of children, young adults.
Many independent variables are measured poorly in longitudinal epidemiological studies, not necessarily the fault of the investigator, especially in relatively homogenous population studies and their pseudopods, leading to spurious associations. For example, measurements of diet in many longitudinal pseudopod studies using food frequency questionnaires or single day dietary recall which fail to discriminate in homogenous populations the within individual versus between individual variation or bias associated with eating behaviors [76]. Much of the knowledge of nutrition and CVD, cancer, etc. has been derived from studying unusual populations, a vegan diet [77]. Populations in southern Europe consuming a Mediterranean-type diet [78, 79] with low risks of CHD, in Japan with very high intake of omega-3 fatty acids and low CHD and other diseases [80] or from well controlled feeding studies and diet trials [81, 82].
Epidemiology studies thrive on studying differences. An epidemic is the rapid increase in frequency of disease, e.g. AIDS which led quickly to the identification of HIV or the recognition of a subpopulation within longitudinal studies with very low cholesterol levels which led to the identification of genetic variant PCSK9 and subsequently a new class of drug therapies to treat hyperlipidemia or the recent observations of very high levels of high density lipoprotein cholesterol (HDL-C) attributed to genetic disorders that led to inability to clear HDL-C in the liver and an increase rather than decrease in the risk of CAD [83, 84].
Similarly, the recognition of much higher incidence and prevalence and mortality from kidney disease among blacks as compared to whites, especially at younger ages, originally attributed in most epidemiological studies to the higher prevalence of hypertension and diabetes among blacks, was in part due to striking differences in the frequency of ApoL, a gene related to susceptibility to trypanosomiasis that is much higher in the black as compared to white population [85, 86]. Similarly, studies of Greenlandic Inuit have led to interesting interrelationships of diet and genetic polymorphisms and possible diseases [87].
Pseudopod studies which focus on evaluation of determinants of unusual attributes using new measurement technologies within these large longitudinal studies likely have the best chance of identifying the agents and understanding of the pathophysiology of the disease, a combination of population biology and epidemiology [88].
The primary study is too short given the incubation period for the disease
The study may have capabilities of measuring intermediate endpoints and short term events, i.e. the beginning of the incubation period. One of the most important aspects of current longitudinal studies is the long term follow up of their cohort(s) and the potential to investigate diseases with very long incubation periods, especially to older ages, for example, dementia, sarcopenia, Parkinson’s disease, macular degeneration. Horizontal and vertical pseudopod studies have successfully utilized these long term longitudinal studies to investigate these diseases with very long incubation periods. Unfortunately, there was a tendency to stop or severely pare down the data collection in longitudinal studies over long periods of time before the cohort has reached the time of highest incidence and uniqueness for the pseudopod studies and especially to be able to identify the susceptibles from the nonsusceptibles at very old ages [89].
In summary, large epidemiological studies and their pseudopods have subsumed the entire repertoire of long incubation period epidemiological research. These studies have provided interesting and important papers, generated collaborative projects across studies, including internationally, and have been a very important resource for genetic studies of host susceptibility and evaluation of new measurement techniques, such as imaging, proteomics, metabolomics, epigenetics, microRNA. Pseudopod studies, as noted, both horizontal and vertical, have become the norm for “new epidemiologists”. Their impact to-date has not been as great as it should be.
Recommendations that can greatly enhance the future of pseudopod epidemiological studies include:
-
1)
First, the most important tenet is that all or nearly all diseases are caused by a single agent or agent(s). Host susceptibility in part determines response of individuals to exposure to the agent. Failure to find “new agents” is not, as some have suggested, due to prior identification of all important “agents”, low hanging fruit, but rather to poor study designs, population selection and lack of utilization of new technologies [31]. Finding these agent(s) should be the cornerstone of pseudopod and new longitudinal epidemiology studies. Rheumatoid arthritis (RA) is one of many autoimmune diseases. The pathobiology of RA and role of innate and adaptive immunity is well-defined and very effect drug therapies are available. The task for epidemiologists is to determine if there are specific etiological agents for RA in ‘susceptible hosts’. The hypothesis is that, similar to infectious diseases, there are one or two important risk factors that are the specific agents of disease and that their distribution and exposure to the individual is determined by physical, social, environmental factors, e.g. vectors. The risk of disease is related to the interaction of these specific agents with host susceptibility factors, as measured by genomics, epi-genetics, RNA analysis, etc. [90].
-
2)
Pseudopod epidemiology studies should be driven by specific well-defined hypotheses identified prior to and independent of the data analysis. Publications especially in epidemiological journals should require a statement of the hypothesis.
-
3)
Epidemiological studies should not only define the hypothesis but also present the possible basis in pathophysiology. In some studies, the hypothesis may be based on clinical observations, smaller studies and unique populations, time trends, geographic variations [91–94].
-
4)
Epidemiological studies thrive on the unusual, innovative ideas and hypotheses and not the same old same old. The most successful longitudinal studies and their pseudopod studies have identified the unusual, as previously noted. Thus, the identification of the unique subpopulations within these longitudinal studies may provide the best application for both vertical and horizontal pseudopod studies. Summary analyses, such as age-, race-, and sex-adjustment, or multivariate analysis without evaluation of variables separately likely have missed important observations. Adjustment for sex probably requires a surgical procedure. For example, several reports have suggested that very physically active athletes may have an increased risk of amyotrophic lateral sclerosis. We further tested this hypothesis in a pseudopod study within the large Women’s Health Initiative which collected excellent data on strenuous physical activity in a large cohort of women. The unique population was the very small number of women who were very physically active within this large sample of women. Studying all physically active women without restriction to very physically active would have missed the initial observation [95]. Innovative ideas and unique studies should receive the highest priority.
-
5)
Commitment to improved research technologies as a “new tool” for pseudopod studies, e.g. imaging, proteomics, metabolomics, whole genome analysis [88, 96, 97], will enhance these pseudopod studies. Maximize the use of new technologies to provide answers to important hypotheses and not just collection of new measures of the same independent or dependent variables continually, circular epidemiology [98]. The hypothesis drives the use of new technologies, not technologies driving the study design. There is a real risk that continued focus on new technologies and “finding new risk factors” can delay implementation of proven preventive approaches, such as in CVD [29, 33, 61, 99].
-
6)
The study of proteomics, metabolomics, genomics, etc. without specific hypotheses is an important research agenda, especially to identify new or better therapies. This is not epidemiological research.
-
7)
In the past, for both infectious and chronic long incubation period disease, epidemiology-type studies that found the specific “agents” have been the big winners. If you do not identify the specific agents of disease or proximate environmental vectors then continued high incidence and prevalence of disease in the population, high morbidity and mortality is very likely compared to those who do not have the disease, i.e. primary prevention is the big winner. The future of high quality epidemiology studies likely will depend on the ability to develop and utilize new approaches for the measurement of “agents”, whether living organisms, environmental toxins, specific nutrients in food, energy expenditure, or psychosocial variables. Especially important for long incubation period epidemiology studies will be methods to evaluate exposures prior to or at incubation period, both at the population and individual level. Studies of unique populations will likely provide the best opportunities for future epidemiology research.
Epidemiology has been remarkably successful in the past in identifying the important agents of disease, the impact of the environment, both physical and social, and interrelationship of host susceptibility. Most important, epidemiologists and others have utilized this new knowledge to impact on the incidence of disease, disability, and ultimately the increase in active life expectancy.
There is certainly nothing wrong with identification of large populations and measuring every known or unknown independent variable in a hope of finding a magic bullet that will lead to better drug or surgical therapies. It is not epidemiology and based on past experience, it is unlikely to be very successful especially compared to epidemiological approaches [100, 101]. Therefore, in the future, as in the past, smart epidemiologists using epidemiology methods, good study designs, and new technologies to identify the “risk factors” for the higher “hanging fruit” and application of such knowledge will remain the cornerstone of improving the health of the population [102].
References
Kuller LH. Epidemiology: then and now. Am J Epidemiol. 2016;183(5):372–80. doi:10.1093/aje/kwv158.
Levy D, Brink S. A change of heart: how the Framingham heart study helped unravel the mysteries of cardiovascular disease. 1st ed. New York: Knopf; 2005. pp. 1–272.
Chen G, Levy D. Contributions of the framingham heart study to the epidemiology of coronary heart disease. JAMA cardiol. 2016;. doi:10.1001/jamacardio.2016.2050.
Kannel WB, McGee D, Gordon T. A general cardiovascular risk profile: the Framingham Study. Am J Cardiol. 1976;38(1):46–51.
Truett J, Cornfield J, Kannel W. A multivariate analysis of the risk of coronary heart disease in Framingham. J Chronic Dis. 1967;20(7):511–24.
Hunter DJ. Lessons from genome-wide association studies for epidemiology. Epidemiology. 2012;23(3):363–7. doi:10.1097/EDE.0b013e31824da7cc.
Ripatti S, Tikkanen E, Orho-Melander M, Havulinna AS, Silander K, Sharma A, et al. A multilocus genetic risk score for coronary heart disease: case-control and prospective cohort analyses. Lancet. 2010;376(9750):1393–400. doi:10.1016/S0140-6736(10)61267-6.
Liang M, Cowley AW Jr, Mattson DL, Kotchen TA, Liu Y. Epigenomics of hypertension. Semin Nephrol. 2013;33(4):392–9. doi:10.1016/j.semnephrol.2013.05.011.
Arnett DK. Gene expression algorithm for prevalent coronary artery disease: a first step in a long journey. Ann Intern Med. 2010;153(7):473–4. doi:10.7326/0003-4819-153-7-201010050-00011.
Rosenberg S, Elashoff MR, Beineke P, Daniels SE, Wingrove JA, Tingley WG, et al. Multicenter validation of the diagnostic accuracy of a blood-based gene expression test for assessing obstructive coronary artery disease in nondiabetic patients. Ann Intern Med. 2010;153(7):425–34. doi:10.7326/0003-4819-153-7-201010050-00005.
Zubakov D, Liu F, van Zelm MC, Vermeulen J, Oostra BA, van Duijn CM, et al. Estimating human age from T-cell DNA rearrangements. Curr Biol: CB. 2010;20(22):R970–1. doi:10.1016/j.cub.2010.10.022.
Strong A, Rader DJ. Clinical implications of lipid genetics for cardiovascular disease. Curr Cardiovascu Risk Rep. 2010;4(6):461–8. doi:10.1007/s12170-010-0131-7.
Paynter NP, Chasman DI, Pare G, Buring JE, Cook NR, Miletich JP, et al. Association between a literature-based genetic risk score and cardiovascular events in women. JAMA. 2010;303(7):631–7. doi:10.1001/jama.2010.119.
Benson MD, Sabatine MS, Gerszten RE. The prospects for cardiovascular proteomics: a glass approaching half full. JAMA Cardiol. 2016;1(3):245–6. doi:10.1001/jamacardio.2016.0279.
Shah SH, Kraus WE, Newgard CB. Metabolomic profiling for the identification of novel biomarkers and mechanisms related to common cardiovascular diseases: form and function. Circulation. 2012;126(9):1110–20. doi:10.1161/CIRCULATIONAHA.111.060368.
Devaux Y, Dankiewicz J, Salgado-Somoza A, Stammet P, Collignon O, Gilje P, et al. Association of circulating MicroRNA-124-3p levels with outcomes after out-of-hospital cardiac arrest: a substudy of a randomized clinical trial. JAMA Cardiol. 2016;1(3):305–13. doi:10.1001/jamacardio.2016.0480.
Lindon JC, Nicholson JK, Holmes E. The handbook of metabonomics and metabolomics. 1st ed. Amsterdam: Elsevier; 2007.
Tracy RP. ‘Deep phenotyping’: characterizing populations in the era of genomics and systems biology. Curr Opin Lipidol. 2008;19(2):151–7. doi:10.1097/MOL.0b013e3282f73893.
Singh SA, Aikawa E, Aikawa M. Current trends and future perspectives of state-of-the-art proteomics technologies applied to cardiovascular disease research. Circ J: Off J Jpn Circ Soc. 2016;80(8):1674–83. doi:10.1253/circj.CJ-16-0499.
Gerstein HC, Pare G, McQueen MJ, Haenel H, Lee SF, Pogue J, et al. Identifying novel biomarkers for cardiovascular events or death in people with dysglycemia. Circulation. 2015;132(24):2297–304. doi:10.1161/CIRCULATIONAHA.115.015744.
Mischak H, Critselis E, Hanash S, Gallagher WM, Vlahou A, Ioannidis JP. Epidemiologic design and analysis for proteomic studies: a primer on-omic technologies. Am J Epidemiol. 2015;181(9):635–47. doi:10.1093/aje/kwu462.
Blankenberg S, Zeller T, Saarela O, Havulinna AS, Kee F, Tunstall-Pedoe H, et al. Contribution of 30 biomarkers to 10-year cardiovascular risk estimation in 2 population cohorts: the MONICA, risk, genetics, archiving, and monograph (MORGAM) biomarker project. Circulation. 2010;121(22):2388–97. doi:10.1161/CIRCULATIONAHA.109.901413.
Greenland S, Senn SJ, Rothman KJ, Carlin JB, Poole C, Goodman SN, et al. Statistical tests, P values, confidence intervals, and power: a guide to misinterpretations. Eur J Epidemiol. 2016;31(4):337–50. doi:10.1007/s10654-016-0149-3.
Goodman SN. STATISTICS. Aligning statistical and scientific reasoning. Science. 2016;352(6290):1180–1. doi:10.1126/science.aaf5406.
Kathiresan S, Larson MG, Keyes MJ, Polak JF, Wolf PA, D’Agostino RB, et al. Assessment by cardiovascular magnetic resonance, electron beam computed tomography, and carotid ultrasonography of the distribution of subclinical atherosclerosis across Framingham risk strata. Am J Cardiol. 2007;99(3):310–4. doi:10.1016/j.amjcard.2006.08.028.
Duivenvoorden R, Mani V, Woodward M, Kallend D, Suchankova G, Fuster V, et al. Relationship of serum inflammatory biomarkers with plaque inflammation assessed by FDG PET/CT: the dal-PLAQUE study. JACC Cardiovasc Imaging. 2013;6(10):1087–94. doi:10.1016/j.jcmg.2013.03.009.
Yeboah J, McClelland RL, Polonsky TS, Burke GL, Sibley CT, O’Leary D, et al. Comparison of novel risk markers for improvement in cardiovascular risk assessment in intermediate-risk individuals. JAMA. 2012;308(8):788–95. doi:10.1001/jama.2012.9624.
Rinella ME. Nonalcoholic fatty liver disease: a systematic review. JAMA. 2015;313(22):2263–73. doi:10.1001/jama.2015.5370.
Stamler J, Stamler R, Neaton JD, Wentworth D, Daviglus ML, Garside D, et al. Low risk-factor profile and long-term cardiovascular and noncardiovascular mortality and life expectancy: findings for 5 large cohorts of young adult and middle-aged men and women. JAMA. 1999;282(21):2012–8.
Galea S. An argument for a consequentialist epidemiology. Am J Epidemiol. 2013;178(8):1185–91. doi:10.1093/aje/kwt172.
Kuller LH, Bracken MB, Ogino S, Prentice RL, Tracy RP. The role of epidemiology in the era of molecular epidemiology and genomics: summary of the 2013 AJE-sponsored Society of Epidemiologic Research Symposium. Am J Epidemiol. 2013;178(9):1350–4. doi:10.1093/aje/kwt239.
Lauer MS. Time for a creative transformation of epidemiology in the United States. JAMA. 2012;308(17):1804–5. doi:10.1001/jama.2012.14838.
Greenland P, Knoll MD, Stamler J, Neaton JD, Dyer AR, Garside DB, et al. Major risk factors as antecedents of fatal and nonfatal coronary heart disease events. JAMA. 2003;290(7):891–7. doi:10.1001/jama.290.7.891.
Song M, Giovannucci E. Preventable incidence and mortality of carcinoma associated with lifestyle factors among white adults in the United States. JAMA Oncol. 2016;. doi:10.1001/jamaoncol.2016.0843.
Anthonisen NR, Connett JE, Murray RP. Smoking and lung function of Lung Health Study participants after 11 years. Am J Respir Crit Care Med. 2002;166(5):675–9. doi:10.1164/rccm.2112096.
Multiple Risk Factor Intervention Trial Research Group. Mortality after 16 years for participants randomized to the Multiple Risk Factor Intervention Trial. Circulation. 1996;94(5):946–51.
Schultz MG. Joseph Goldberger and pellagra. Am J Trop Med Hyg. 1977;26(5 Pt 2 Suppl):1088–92.
Uusitalo U, Feskens EJ, Tuomilehto J, Dowse G, Haw U, Fareed D, et al. Fall in total cholesterol concentration over five years in association with changes in fatty acid composition of cooking oil in Mauritius: cross sectional survey. BMJ. 1996;313(7064):1044–6.
Voight BF, Peloso GM, Orho-Melander M, Frikke-Schmidt R, Barbalic M, Jensen MK, et al. Plasma HDL cholesterol and risk of myocardial infarction: a mendelian randomisation study. Lancet. 2012;380(9841):572–80. doi:10.1016/S0140-6736(12)60312-2.
Nordestgaard BG, Palmer TM, Benn M, Zacho J, Tybjaerg-Hansen A, Davey Smith G, et al. The effect of elevated body mass index on ischemic heart disease risk: causal estimates from a Mendelian randomisation approach. PLoS Med. 2012;9(5):e1001212. doi:10.1371/journal.pmed.1001212.
Okamura T, Sekikawa A, Kadowaki T, El-Saed A, Abbott RD, Curb JD, et al. Cholesteryl ester transfer protein, coronary calcium, and intima-media thickness of the carotid artery in middle-age Japanese men. Am J Cardiol. 2009;104(6):818–22. doi:10.1016/j.amjcard.2009.05.021.
Lilienfeld AM. Epidemiology of infectious and non-infectious disease: some comparisons. Am J Epidemiol. 1973;97(3):135–47.
Krieger N. Proximal, distal, and the politics of causation: what’s level got to do with it? Am J Public Health. 2008;98(2):221–30. doi:10.2105/AJPH.2007.111278.
Vandenbroucke JP. Observational research, randomised trials, and two views of medical science. PLoS Med. 2008;5(3):e67. doi:10.1371/journal.pmed.0050067.
Kennedy C, Yard E, Dignam T, Buchanan S, Condon S, Brown MJ, et al. Blood lead levels among children aged < 6 Years—Flint, Michigan, 2013–2016. MMWR Morb Mortal Wkly Rep. 2016;65(25):650–4. doi:10.15585/mmwr.mm6525e1.
Needleman HL, Gunnoe C, Leviton A, Reed R, Peresie H, Maher C, et al. Deficits in psychologic and classroom performance of children with elevated dentine lead levels. New Engl J Med. 1979;300(13):689–95. doi:10.1056/NEJM197903293001301.
Kivimaki M, Nyberg ST, Batty GD, Fransson EI, Heikkila K, Alfredsson L, et al. Job strain as a risk factor for coronary heart disease: a collaborative meta-analysis of individual participant data. Lancet. 2012;380(9852):1491–7. doi:10.1016/S0140-6736(12)60994-5.
Jones OA, Maguire ML, Griffin JL. Environmental pollution and diabetes: a neglected association. Lancet. 2008;371(9609):287–8. doi:10.1016/S0140-6736(08)60147-6.
Francis T Jr, Korns RF, Voight RB, Boisen M, Hemphill FM, Napier JA, et al. An evaluation of the 1954 poliomyelitis vaccine trials. Am J Public Health Nation’s Health. 1955;45(5 Pt 2):1–63.
Comstock GW. Tuberculosis studies in Muscogee County, Georgia I. Community-wide tuberculosis research. Am J Epidemiol. 2008;168(7):687–91. doi:10.1093/aje/kwn323.
Canoy D, Boekholdt SM, Wareham N, Luben R, Welch A, Bingham S, et al. Body fat distribution and risk of coronary heart disease in men and women in the European Prospective Investigation Into Cancer and Nutrition in Norfolk cohort: a population-based prospective study. Circulation. 2007;116(25):2933–43. doi:10.1161/CIRCULATIONAHA.106.673756.
Heidemann C, Boeing H, Pischon T, Nothlings U, Joost HG, Schulze MB. Association of a diabetes risk score with risk of myocardial infarction, stroke, specific types of cancer, and mortality: a prospective study in the European Prospective Investigation into Cancer and Nutrition (EPIC)-Potsdam cohort. Eur J Epidemiol. 2009;24(6):281–8. doi:10.1007/s10654-009-9338-7.
Chaturvedi AK, Kemp TJ, Pfeiffer RM, Biancotto A, Williams M, Munuo S, et al. Evaluation of multiplexed cytokine and inflammation marker measurements: a methodologic study. Cancer Epidemiol Biomarker Prev: Publ Am Assoc Cancer Res Cosponsored Am Soc Prev Oncol. 2011;20(9):1902–11. doi:10.1158/1055-9965.EPI-11-0221.
Tracy RP. Inflammation markers and coronary heart disease. Curr Opin Lipidol. 1999;10(5):435–41.
Kuller LH, Tracy RP, Shaten J, Meilahn EN. Relation of C-reactive protein and coronary heart disease in the MRFIT nested case-control study. Multiple Risk Factor Intervention Trial. Am J Epidemiol. 1996;144(6):537–47.
Monaco C, Terrando N, Midwood KS. Toll-like receptor signaling: common pathways that drive cardiovascular disease and rheumatoid arthritis. Arthr Care Res. 2011;63(4):500–11. doi:10.1002/acr.20382.
Mackey RH, Kuller LH, Deane KD, Walitt BT, Chang YF, Holers VM, et al. Rheumatoid arthritis, anti-cyclic citrullinated peptide positivity, and cardiovascular disease risk in the women’s health initiative. Arthr Rheumatol. 2015;67(9):2311–22. doi:10.1002/art.39198.
Kuller LH, Tracy R, Belloso W, De Wit S, Drummond F, Lane HC, et al. Inflammatory and coagulation biomarkers and mortality in patients with HIV infection. PLoS Med. 2008;5(10):e203. doi:10.1371/journal.pmed.0050203.
Deeks SG, Tracy R, Douek DC. Systemic effects of inflammation on health during chronic HIV infection. Immunity. 2013;39(4):633–45. doi:10.1016/j.immuni.2013.10.001.
Couzin-Frankel J. Cardiovascular disease. Massive trials to test inflammation hypothesis. Science. 2012;337(6099):1158. doi:10.1126/science.337.6099.1158.
Kuller LH. Prevention of coronary heart disease and the National Cholesterol Education Program. Circulation. 2006;113(5):598–600. doi:10.1161/CIRCULATIONAHA.105.604595.
Johnstone J, Loeb M, Teo KK, Gao P, Dyal L, Liu L, et al. Influenza vaccination and major adverse vascular events in high-risk patients. Circulation. 2012;126(3):278–86. doi:10.1161/CIRCULATIONAHA.111.071100.
Puri R, Nicholls SJ, Ellis SG, Tuzcu EM, Kapadia SR. High-risk coronary atheroma: the interplay between ischemia, plaque burden, and disease progression. J Am Coll Cardiol. 2014;63(12):1134–40. doi:10.1016/j.jacc.2013.05.088.
Huang W, Zhu T, Pan X, Hu M, Lu SE, Lin Y, et al. Air pollution and autonomic and vascular dysfunction in patients with cardiovascular disease: interactions of systemic inflammation, overweight, and gender. Am J Epidemiol. 2012;176(2):117–26. doi:10.1093/aje/kwr511.
Nawrot TS, Perez L, Kunzli N, Munters E, Nemery B. Public health importance of triggers of myocardial infarction: a comparative risk assessment. Lancet. 2011;377(9767):732–40. doi:10.1016/S0140-6736(10)62296-9.
Wilbert-Lampen U, Nickel T, Leistner D, Guthlin D, Matis T, Volker C, et al. Modified serum profiles of inflammatory and vasoconstrictive factors in patients with emotional stress-induced acute coronary syndrome during World Cup Soccer 2006. J Am Coll Cardiol. 2010;55(7):637–42. doi:10.1016/j.jacc.2009.07.073.
Packard RR, Lichtman AH, Libby P. Innate and adaptive immunity in atherosclerosis. Semin Immunopathol. 2009;31(1):5–22. doi:10.1007/s00281-009-0153-8.
Kuller LH, Lopez OL. Dementia and Alzheimer’s disease: a new direction. The 2010 Jay L. Foster Memorial Lecture. Alzheimer’s & Dement: J Alzheimer’s Assoc. 2011;7(5):540–50. doi:10.1016/j.jalz.2011.05.901.
Jack CR Jr, Knopman DS, Jagust WJ, Shaw LM, Aisen PS, Weiner MW, et al. Hypothetical model of dynamic biomarkers of the Alzheimer’s pathological cascade. Lancet Neurol. 2010;9(1):119–28. doi:10.1016/S1474-4422(09)70299-6.
Ogino S, Lochhead P, Chan AT, Nishihara R, Cho E, Wolpin BM, et al. Molecular pathological epidemiology of epigenetics: emerging integrative science to analyze environment, host, and disease. Mod Pathol Off J United States Can Acad Pathol, Inc. 2013;26(4):465–84. doi:10.1038/modpathol.2012.214.
Wu S, Powers S, Zhu W, Hannun YA. Substantial contribution of extrinsic risk factors to cancer development. Nature. 2016;529(7584):43–7. doi:10.1038/nature16166.
Lewis MR, Callas PW, Jenny NS, Tracy RP. Longitudinal stability of coagulation, fibrinolysis, and inflammation factors in stored plasma samples. Thromb Haemost. 2001;86(6):1495–500.
Gow RM, Barrowman NJ, Lai L, Moher D. A review of five cardiology journals found that observer variability of measured variables was infrequently reported. J Clin Epidemiol. 2008;61(4):394–401. doi:10.1016/j.jclinepi.2007.05.010.
Twig G, Yaniv G, Levine H, Leiba A, Goldberger N, Derazne E, et al. Body-mass index in 2.3 million adolescents and cardiovascular death in adulthood. New Engl J Med. 2016;374(25):2430–40. doi:10.1056/NEJMoa1503840.
Daviglus ML, Liu K, Pirzada A, Yan LL, Garside DB, Feinglass J, et al. Favorable cardiovascular risk profile in middle age and health-related quality of life in older age. Arch Intern Med. 2003;163(20):2460–8. doi:10.1001/archinte.163.20.2460.
Boffetta P, Couto E, Wichmann J, Ferrari P, Trichopoulos D, Bueno-de-Mesquita HB, et al. Fruit and vegetable intake and overall cancer risk in the European Prospective Investigation into Cancer and Nutrition (EPIC). J Natl Cancer Inst. 2010;102(8):529–37. doi:10.1093/jnci/djq072.
Key TJ, Appleby PN, Spencer EA, Travis RC, Roddam AW, Allen NE. Cancer incidence in vegetarians: results from the European Prospective Investigation into Cancer and Nutrition (EPIC-Oxford). Am J Clin Nutr. 2009;89(5):1620S–6S. doi:10.3945/ajcn.2009.26736M.
Knoops KT, de Groot LC, Kromhout D, Perrin AE, Moreiras-Varela O, Menotti A, et al. Mediterranean diet, lifestyle factors, and 10-year mortality in elderly European men and women: the HALE project. JAMA. 2004;292(12):1433–9. doi:10.1001/jama.292.12.1433.
Estruch R, Ros E, Salas-Salvado J, Covas MI, Corella D, Aros F, et al. Primary prevention of cardiovascular disease with a Mediterranean diet. New Engl J Med. 2013;368(14):1279–90. doi:10.1056/NEJMoa1200303.
Sekikawa A, Steingrimsdottir L, Ueshima H, Shin C, Curb JD, Evans RW, et al. Serum levels of marine-derived n-3 fatty acids in Icelanders, Japanese, Koreans, and Americans–a descriptive epidemiologic study. Prostaglandins Leukot Essent Fatty Acids. 2012;87(1):11–6. doi:10.1016/j.plefa.2012.04.010.
Hegsted DM, Ausman LM, Johnson JA, Dallal GE. Dietary fat and serum lipids: an evaluation of the experimental data. Am J Clin Nutr. 1993;57(6):875–83.
Cao Y, Mauger DT, Pelkman CL, Zhao G, Townsend SM, Kris-Etherton PM. Effects of moderate (MF) versus lower fat (LF) diets on lipids and lipoproteins: a meta-analysis of clinical trials in subjects with and without diabetes. J Clin Lipidol. 2009;3(1):19–32. doi:10.1016/j.jacl.2008.12.008.
Stein EA, Mellis S, Yancopoulos GD, Stahl N, Logan D, Smith WB, et al. Effect of a monoclonal antibody to PCSK9 on LDL cholesterol. New Engl J Med. 2012;366(12):1108–18. doi:10.1056/NEJMoa1105803.
Couzin-Frankel J. LIPID BIOLOGY—Why high ‘good cholesterol’ can be bad news. Science. 2016;351(6278):1126. doi:10.1126/science.351.6278.1126.
Genovese G, Friedman DJ, Ross MD, Lecordier L, Uzureau P, Freedman BI, et al. Association of trypanolytic ApoL1 variants with kidney disease in African Americans. Science. 2010;329(5993):841–5. doi:10.1126/science.1193032.
Langefeld CD, Divers J, Pajewski NM, Hawfield AT, Reboussin DM, Bild DE, et al. Apolipoprotein L1 gene variants associate with prevalent kidney but not prevalent cardiovascular disease in the Systolic Blood Pressure Intervention Trial. Kidney Int. 2015;87(1):169–75. doi:10.1038/ki.2014.254.
Fumagalli M, Moltke I, Grarup N, Racimo F, Bjerregaard P, Jorgensen ME, et al. Greenlandic Inuit show genetic signatures of diet and climate adaptation. Science. 2015;349(6254):1343–7. doi:10.1126/science.aab2319.
Senthong V, Li XS, Hudec T, Coughlin J, Wu Y, Levison B, et al. Plasma Trimethylamine N-Oxide, a gut microbe-generated phosphatidylcholine metabolite, is associated with atherosclerotic burden. J Am Coll Cardiol. 2016;67(22):2620–8. doi:10.1016/j.jacc.2016.03.546.
Kuller LH, Lopez OL, Becker JT, Chang Y, Newman AB. Risk of dementia and death in the long-term follow-up of the Pittsburgh Cardiovascular Health Study-Cognition Study. Alzheimer’s Dement J Alzheimer’s Assoc. 2016;12(2):170–83. doi:10.1016/j.jalz.2015.08.165.
Nathan C. IMMUNOLOGY. From transient infection to chronic disease. Science. 2015;350(6257):161. doi:10.1126/science.aad4141.
Satizabal CL, Beiser AS, Chouraki V, Chene G, Dufouil C, Seshadri S. Incidence of dementia over three decades in the framingham heart study. New Engl J Med. 2016;374(6):523–32. doi:10.1056/NEJMoa1504327.
Launer LJ, Berger K, Breteler MM, Dufouil C, Fuhrer R, Giampaoli S, et al. Regional variability in the prevalence of cerebral white matter lesions: an MRI study in 9 European countries (CASCADE). Neuroepidemiology. 2006;26(1):23–9. doi:10.1159/000089233.
Bassig BA, Zhang L, Tang X, Vermeulen R, Shen M, Smith MT, et al. Occupational exposure to trichloroethylene and serum concentrations of IL-6, IL-10, and TNF-alpha. Environ Mol Mutagen. 2013;54(6):450–4. doi:10.1002/em.21789.
Shay CM, Stamler J, Dyer AR, Brown IJ, Chan Q, Elliott P, et al. Nutrient and food intakes of middle-aged adults at low risk of cardiovascular disease: the international study of macro-/micronutrients and blood pressure (INTERMAP). Eur J Nutr. 2012;51(8):917–26. doi:10.1007/s00394-011-0268-2.
Eaglehouse YL, Talbott EO, Chang Y, Kuller LH. Participation in physical activity and risk for amyotrophic lateral sclerosis mortality among postmenopausal women. JAMA Neurol. 2016;73(3):329–36. doi:10.1001/jamaneurol.2015.4487.
Li Z, Zhang Y, Su D, Lv X, Wang M, Ding D, et al. The opposite associations of long-chain versus very long-chain monounsaturated fatty acids with mortality among patients with coronary artery disease. Heart. 2014;100(20):1597–605. doi:10.1136/heartjnl-2014-305777.
Lupski JR, Belmont JW, Boerwinkle E, Gibbs RA. Clan genomics and the complex architecture of human disease. Cell. 2011;147(1):32–43. doi:10.1016/j.cell.2011.09.008.
Kuller LH. Circular epidemiology. Am J Epidemiol. 1999;150(9):897–903.
Nichols M, Townsend N, Scarborough P, Rayner M. Trends in age-specific coronary heart disease mortality in the European Union over three decades: 1980–2009. Eur Heart J. 2013;34(39):3017–27. doi:10.1093/eurheartj/eht159.
Kuller L. Is phenomenology the best approach to health research? Am J Epidemiol. 2007;166(10):1109–15. doi:10.1093/aje/kwm258.
DeBord DG, Carreon T, Lentz TJ, Middendorf PJ, Hoover MD, Schulte PA. Use of the “exposome” in the practice of epidemiology: a primer on-omic technologies. Am J Epidemiol. 2016;184(4):302–14. doi:10.1093/aje/kwv325.
Joyner MJ, Paneth N, Ioannidis JP. What happens when underperforming big ideas in research become entrenched? JAMA. 2016;. doi:10.1001/jama.2016.11076.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Kuller, L.H. The limitations of opportunistic epidemiology, pseudopod epidemiology. Eur J Epidemiol 31, 957–966 (2016). https://doi.org/10.1007/s10654-016-0196-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10654-016-0196-9