Abstract
Whether mice can be used as a foot-and-mouth disease (FMD) model has been debated for a long time. However, the major histocompatibility complex between pigs and mice is very different. In this study, the protective effects of FMD vaccines in different animal models were analyzed by a meta-analysis. The databases PubMed, China Knowledge Infrastructure, EMBASE, and Baidu Academic were searched. For this purpose, we evaluated evidence from 14 studies that included 869 animals with FMD vaccines. A random effects model was used to combine effects using Review Manager 5.4 software. A forest plot showed that the protective effects in pigs were statistically non-significant from those in mice [MH = 0.56, 90% CI (0.20, 1.53), P = 0.26]. The protective effects in pigs were also statistically non-significant from those in guinea pigs [MH = 0.67, 95% CI (0.37, 1.21), P = 0.18] and suckling mice [MH = 1.70, 95% CI (0.10, 28.08), P = 0.71]. Non-inferiority test could provide a hypothesis that the models (mice, suckling mice and guinea pigs) could replace pigs as FMDV vaccine models to test the protective effect of the vaccine. Strict standard procedures should be established to promote the assumption that mice and guinea pigs should replace pigs in vaccine evaluation.
Similar content being viewed by others
Introduction
Foot and mouth disease virus (FMDV) belongs to Picornaviridae, which is a single-stranded positive-sense RNA virus of the genus Aftab1. FMD is listed among the highly contagious diseases in animals and is endemic in Africa, most of Asia, the Middle East, and parts of South America2. FMD endemic regions contain three-quarters of the world’s FMD-susceptible livestock and most of the world’s poorer livestock keepers3.
Vaccines play an important role in controlling FMD4. There are serological tests, virus neutralization tests, and enzyme-linked immune sorbent assay (ELISA) methods to evaluate the immune efficacy of FMD vaccines, but the most reliable method is the in vivo protection test to determine the 50% protective dose or the protective rate of systemic hoof infection 5. Efficacy tests of other target animals (such as sheep, goats, or buffaloes) and the use of different methods have not been standardized (OIE Manual Terrestrial)6. It would be very valuable to verify the expected protection rate of a vaccine with cattle and to estimate the possibility that cattle can resist 10,000 infective doses after one vaccination7,8. However, it is difficult to use cattle when evaluating the efficacy of a vaccine. Cattle need many people for their care, they are dangerous, and they are expensive. Particularly in the exploratory stage of vaccine research, the laboratory stage, a new evaluation model would be beneficial for the development of new vaccines6. Different animal models are usually used in the research of FMDV vaccines9. The models used to evaluate laboratory vaccine effects include guinea pigs, mice, and suckling mice10. When studying the protective efficacy of vaccines, mice and guinea pigs are often used as substitutes for pigs11. The use of mice and guinea pigs simplifies the experimental process12. As a model animal, mice have incomparable advantages13, such as simple operations, and a large number of reports with considerable data regarding mice as FMD vaccine models14,15. However, the major histocompatibility complex (MHC) of mice and guinea pigs is very different from that of pigs16,17, and some animal models may not be appropriate for the vaccine evaluation of pigs18,19.
At present, there are no related literature reports on the correlation between the results of mice and pigs for FMDV vaccines. The ultimate goal of this meta-analysis study was to explore the rationality of replacing large animals with small animal models for vaccine testing. A meta-analysis can increase the credibility of the conclusion and support the analysis of controversial arguments20. A meta-analysis increases the statistical efficiency that a single experiment does not have, and has guiding significance for follow-up clinical experiments21. We summarized previous experimental data by employing statistical methods to avoid using and injuring a large number of animals. To clarify the possibility of using different animal models instead of pigs for FMD potency studies, a meta-analysis was performed in the present study.
Materials and methods
Literature search strategy
For this systematic review with meta-analysis (JJ and PW) searched literature published from January 1995 to August 2023. The databases PubMed, China Knowledge Infrastructure (CNKI), EMBASE, and Baidu Academic were used to search for FMDV models. The keywords were as follows: “FMDV, “mice,” “guinea pigs,” “pig or swine,” and “vaccine.” Efforts were made to include relevant gray literature, but none was found.
Inclusion and exclusion criteria
The inclusion standards were as follows: ① published Chinese and English literature on FMDV immune animal models; ② studies that included more than two animal models; ③ documents that included challenge potency (direct potency, not only serology) studies with FMDV; ④ the number of animals in the experiment was reported accurately in the literature; and ⑤ published studies and gray literature dated from January 1995 to August 2023.
The exclusion standards were as follows: ① systematic reviews without animal experiments; ② FMD models were not included; ③ when other reports provide the same data, the latest published data will be taken into account; and ④ the literature did not include a clear number of experimental animals.
Data extraction
Two researchers performed preliminary screening by reading titles and abstracts. Then, we read the full text and selected documents for further analysis according to the inclusion and exclusion criteria. Any differences of opinion were settled through discussion. Data were extracted independently and entered into a specially designed data extraction table. The extracted data included the first author, publication time, number of animals, number of protected animals, and other similar information. "Event" referred to the number of protected animals. The database was built using Microsoft Office Home and Student 2021 software.
Statistical analysis
Meta-analyses were performed using Review Manager 5.4 software (RevMan 5.4) provided by the Cochrane Collaboration. Statistical heterogeneity was quantified using the tau parameter that estimates the dispersion of the true treatment effects across the studies. Combined effect sizes and 95% confidence intervals (CI) were calculated using a random-effects model. The random-effects model used built-in modules in RevMan 5.4 software. The Mantel–Haenszel method was used to analyze the combination of effects. A funnel plot was used for the visual (and fully subjective) investigation of possible small-study effects. For data analysis, the groups were divided by different animal models. To study the protective effects of the different models, we conducted an analysis comparing the swine group with the control group. We conducted a non-inferiority analysis of the data. Non-inferiority was investigated by JMP software. The non-inferiority boundary value was set to 0.5. We used X to fit Y for non-inferiority tests. Through the relationship between the upper and lower limits of 90% difference and the boundary value, the result could be directly judged.
Results
Identified study reports
The literature was searched and screened (Fig. 1). A total of 2861 literature reports were retrieved from PubMed, CNKI, EMBASE, and Baidu Academic. After removing 23 duplicate articles and reading titles and abstracts, 189 articles met the inclusion criteria. A total of 14 articles were included in the meta-analysis.
Characteristics of the reports
Table 1 shows the features of the selected studies. A total of 869 animals were included in the meta-analysis. The animals in this research included mice, guinea pigs, and pigs. The research period was from 1997 to 2023, and it included 14 studies (Table 1).
Meta-analysis
The results of the forest plot showed statistically non-significant differences between different animal models (mice, suckling mice, and guinea pigs) and swine with FMDV [MH = 0.69, 95% CI (0.43, 1.10), P = 0.12] (Fig. 2). The forest plot showed that the protective effects in pigs were statistically non-significant from those in mice [MH = 0.56, 95% CI (0.20, 1.53), P = 0.26] (Fig. 2A).
The results showed that the protective effects of guinea pigs were statistically non-significant from those of pigs [MH = 0.67, 95% CI (0.37, 1.21), P = 0.18] (Fig. 2B). There were statistically non-significant differences between swine and suckling mice [MH = 1.70, 95% CI (0.10, 28.08), P = 0.71] (Fig. 2C). At present, there were only two articles on the relationship between swine and suckling mice.
The forest plot clearly showed serious statistical heterogeneity with study results pointing to different directions. The result of I2 was not consistent with the forest map. Although the value of I2 was small, it also had serious statistical heterogeneity. There were few relevant literature reports because the extraction standard of the meta-analysis required that two controlled experiments must appear in the same article.
A funnel plot was used for the visual (and fully subjective) investigation of possible small-study effects (Fig. 3). Overall, the plot resembled a funnel chart. However, the funnel charts of the three subgroups were not ideal by themselves. The reason may be that there were too few studies included in the subgroups, and the subgroups were not suitable for use in funnel charts.
Non-inferiority test could provide a hypothesis that the models (mice, suckling mice and guinea pigs) could replace pigs as FMDV vaccine models to test the protective effect of the vaccine (Fig.4). Through meta-analysis, we found that there was some heterogeneity in this study (Fig. 2). Even though the null hypothesis was rejected in all tests, the results should be interpreted with caution due to the substantial statistical heterogeneity observed in the forest plot (Fig. 4).
Non-inferiority plot. (A) Non-inferiority was tested with mice and pigs. (B) Non-inferiority was tested with guinea pigs and pigs. (C) Non-inferiority was tested with suckling mice and pigs. (D) Mice, guinea pigs, and suckling mice was made non-inferiority test to pigs. When the blue line (90% confidence interval) is included in the blue interval (upper and lower bounds), a non-inferiority conclusion could be drawn. When the red line (90% confidence interval) is not included in the blue interval (upper and lower bounds), a non-inferiority conclusion cannot be drawn.
Discussion
FMD is a highly contagious and destructive virus30. There are very strict restrictions on FMD experiments, and the requirements for the laboratory are also very high31. These existing conditions restrict the development of experiments and the acquisition of data on FMD. A meta-analysis assumes that the processed data are normally distributed32. In principle, the data should conform to a normal distribution32. The occurrence of zero events has a great impact on META-analysis33. We have tried our best to collect appropriate data.
As model animals, mice have the advantages of clean genetic backgrounds, easy breeding, and simple acquisition14,15. Compared with pigs, mice are more accessible12. It is easy to administer vaccines and drugs to mice by injection13. The injection dose for mice is less than that for pigs, which is more suitable for preliminary research. However, the MHC of mice and pigs is different16,17. Antibodies against the same antigen are also different18,19. The forest plot showed that the protective effects on pigs were statistically non-significant from those of mice [MH = 0.56, 95% CI (0.20, 1.53), P = 0.26] (Fig. 2A).
We innovatively compared different models, which also involved heterogeneity of methods34. Although clinical and methodological heterogeneity was always present, in many studies, mice and guinea pigs were used instead of pigs to evaluate vaccine effects. Although different methods increase heterogeneity, a scientific selection of indicators can reduce heterogeneity as much as possible, so that the results of the two models tend to be similar. We made a direct comparison between mice and pigs, guinea pigs and pigs, and suckling mice and pigs. There was no comparison between mice, suckling mice, and guinea pigs directly. Network meta-analysis (NMA) may help to directly compare different models35. To visually investigate small-study effects in NMA, Chaimani and colleagues developed a tool36,37. Mavridis et al. extended the Copa selection model for publication bias to NMA38. A transitivity assumption is the cornerstone of NMA; it posits that the comparisons do not differ beyond the interventions compared39. However, the different models we studied were not applicable to NMA. We chose RevMan to perform a traditional meta-analysis.
There are some limitations in this study. There are many guidelines for performing a meta-analysis40. A meta-analysis has comprehensive and objective advantages, including data integration41. There may be some heterogeneity and deviations in any research42. First, the inconsistent dosages administered to animals may affect the experimental results, leading to heterogeneity. Second, a funnel plot was used for the visual (and fully subjective) investigation of possible small-study effects. In this study, reducing the occurrence of deviations was of prime importance. Some of the retrieved data may be ignored, such as data in different languages, from different databases, and using different keywords. Inclusion and exclusion criteria may also lead to bias, and deviations may also appear at different steps in the process. However, according to the funnel chart, the bias was within the acceptable range.
In this study, to the best of our knowledge, a systematic review and meta-analysis were used for the first time to analyze the immune effects of different FMD animal models. Non-inferiority test can provide a hypothesis that the models (mice, suckling mice and guinea pigs) can replace pigs as FMDV vaccine models to test the vaccine protection effect. Reasonable selection of animal models can not only reduce the use of experimental animals but also promote the evaluation of vaccine effects, thus improving the protective effects of the vaccine. It is very valuable to compare the effects on a small animal model with the effects on pigs. Our experiment results will improve the rationality of the model. Furthermore, the cost of vaccine research and development is reduced. Animal models have accelerated the speed of vaccine development. Whether the results of the model can be used as an OIE standard still needs further research and efforts.
Conclusion
In conclusion, non-inferiority test could provide a hypothesis that the models (mice, suckling mice and guinea pigs) could replace pigs as FMDV vaccine models to test the protective effect of the vaccine. Strict standard procedures should be established to promote the assumption that mice and guinea pigs should replace pigs in vaccine evaluation.
Data availability
All data generated or analyzed during this study were included in this published article.
References
Zhao, F. R. et al. Transcriptomic analysis of porcine PBMCs in response to FMDV infection. Acta Trop. 173, 69–75 (2017).
Hammond, J. M., Maulidi, B. & Henning, N. Targeted FMD vaccines for Eastern Africa: The AgResults foot and mouth disease vaccine challenge project. Viruses. 13(9), 1830 (2021).
Knight-Jones, T., McLaws, M. & Rushton, J. Foot-and-mouth disease impact on smallholders—What do we know, what don’t we know and how can we find out more. Transbound. Emerg. Dis. 64(4), 1079–1094 (2017).
Di Giacomo, S. et al. Assessment on different vaccine formulation parameters in the protection against heterologous challenge with FMDV in cattle. Viruses 14, 1781 (2022).
Edwards, S. OIE standards for vaccines and future trends. Rev. Sci. Tech. 26(2), 373–378 (2007).
Barnett, P. V., Geale, D. W., Clarke, G., Davis, J. & Kasari, T. R. A review of OIE Country status recovery using vaccinate-to-live versus vaccinate-to-die foot-and-mouth disease response policies I: Benefits of higher potency vaccines and associated NSP DIVA test systems in post-outbreak surveillance. Transbound. Emerg. Dis. 62(4), 367–387 (2015).
Maradei, E. et al. Updating of the correlation between lpELISA titers and protection from virus challenge for the assessment of the potency of polyvalent aphtovirus vaccines in Argentina. Vaccine. 26(51), 6577–6586 (2008).
Periolo, O. H. et al. Large-scale use of liquid-phase blocking sandwich ELISA for the evaluation of protective immunity against aphthovirus in cattle vaccinated with oil-adjuvanted vaccines in Argentina. Vaccine. 11(7), 754–760 (1993).
Li, P. et al. Evaluation of immunogenicity and cross-reactive responses of vaccines prepared from two chimeric serotype O foot-and-mouth disease viruses in pigs and cattle. Vet. Res. 53(1), 56 (2022).
Wu, P. et al. Layered double hydroxide nanoparticles as an adjuvant for inactivated foot-and-mouth disease vaccine in pigs. BMC Vet. Res 16, 474 (2020).
Cubillos, C. et al. Enhanced mucosal immunoglobulin A response and solid protection against foot-and-mouth disease virus challenge induced by a novel dendrimeric peptide. J. Virol. 82(14), 7223–7230 (2008).
Ren, Z. J. et al. Orally delivered foot-and-mouth disease virus capsid protomer vaccine displayed on T4 bacteriophage surface: 100% protection from potency challenge in mice. Vaccine. 26(11), 1471–1481 (2008).
Balani, S., Nguyen, L. V. & Eaves, C. J. Modeling the process of human tumorigenesis. Nat. Commun. 8, 15422 (2017).
Rodríguez-Calvo, T. et al. New vaccine design based on defective genomes that combines features of attenuated and inactivated vaccines. PLoS One. 5(4), e10414 (2010).
Dong, Y. M., Zhang, G. G., Huang, X. J., Chen, L. & Chen, H. T. Promising MS2 mediated virus-like particle vaccine against foot-and-mouth disease. Antiviral Res. 117, 39–43 (2015).
Grafen, A. Of mice and the MHC. Nature. 360(6404), 530 (1992).
Manning, C. J., Wakeland, E. K. & Potts, W. K. Communal nesting patterns in mice implicate MHC genes in kin recognition. Nature. 360(6404), 581–583 (1992).
Xiong, X. et al. Emerging enterococcus pore-forming toxins with MHC/HLA-I as receptors. Cell. 185(7), 1157-1171.e22 (2022).
Chen, F. X. et al. Novel SLA class I alleles of Chinese pig strains and their significance in xenotransplantation. Cell Res. 13(4), 285–294 (2003).
Jiao, J. & Wu, P. A meta-analysis: The efficacy and effectiveness of polypeptide vaccines protect pigs from foot and mouth disease. Sci. Rep. 12(1), 21868 (2022).
Stroup, D. F. et al. Meta-analysis of observational studies in epidemiology: A proposal for reporting. Meta-analysis Of Observational Studies in Epidemiology (MOOSE) group. JAMA. 283, 2008–2012 (2000).
Medina, G. N. et al. Deoptimization of FMDV P1 region results in robust serotype-independent viral attenuation. Viruses. 15(6), 1332 (2023).
Hwang, J. H. et al. A vaccine strain of the A/ASIA/Sea-97 lineage of foot-and-mouth disease virus with a single amino acid substitution in the P1 Region That Is adapted to suspension culture provides high immunogenicity. Vaccines (Basel). 9(4), 308 (2021).
Jo, H. et al. The HSP70-fused foot-and-mouth disease epitope elicits cellular and humoral immunity and drives broad-spectrum protective efficacy. NPJ Vaccines. 6(1), 42 (2021).
Song, H. et al. A novel mucosal vaccine against foot-and-mouth disease virus induces protection in mice and swine. Biotechnol. Lett. 27(21), 1669–1674 (2005).
Li, G. et al. Comparison of immune responses against foot-and-mouth disease virus induced by fusion proteins using the swine IgG heavy chain constant region or beta-galactosidase as a carrier of immunogenic epitopes. Virology. 328(2), 274–281 (2004).
Wu, L. et al. Expression of foot-and-mouth disease virus epitopes in tobacco by a tobacco mosaic virus-based vector. Vaccine. 21(27–30), 4390–4398 (2003).
Chan, E. W. et al. An immunoglobulin G based chimeric protein induced foot-and-mouth disease specific immune response in swine. Vaccine. 19(4–5), 538–546 (2000).
Kuprianova, M. A. et al. Synthetic peptide constructs on the basis of immunoactive fragments of the A22 strain VP1 of the foot-and-mouth disease virus. Russian J. Bioorgan. Chem. 26(12), 832–837 (2000).
Li, K. et al. Virus-host interactions in foot-and-mouth disease virus infection. Front. Immunol. 12, 571509 (2021).
Theerawatanasirikul, S. et al. Small molecules targeting 3C protease inhibit FMDV replication and exhibit virucidal effect in cell-based assays. Viruses 15, 1887 (2023).
Jackson, D. & White, I. R. When should meta-analysis avoid making hidden normality assumptions. Biom. J. 60(6), 1040–1058 (2018).
Efthimiou, O. Practical guide to the meta-analysis of rare events. Evid. Based Ment. Health. 21(2), 72–76 (2018).
Ades, A.E., Welton, N.J., Dias, S., Phillippo, D.M., Caldwell, D.M. Twenty years of network meta-analysis: Continuing controversies and recent developments. Res. Synth. Methods. (2024).
Nikolakopoulou, A. et al. Living network meta-analysis compared with pairwise meta-analysis in comparative effectiveness research: empirical study. BMJ 360, k585 (2018).
Beguelin, A., Dongarra, J.J. Graphical development tools for network-based concurrent supercomputing. 435–444 (1991).
Chaimani, A. & Salanti, G. Using network meta-analysis to evaluate the existence of small-study effects in a network of interventions. Res. Synth. Methods. 3(2), 161–176 (2012).
Mavridis, D., Welton, N. J., Sutton, A. & Salanti, G. A selection model for accounting for publication bias in a full network meta-analysis. Stat. Med. 33(30), 5399–5412 (2014).
Salanti, G. Indirect and mixed-treatment comparison, network, or multiple-treatments meta-analysis: Many names, many benefits, many concerns for the next generation evidence synthesis tool. Res. Synth. Methods. 3(2), 80–97 (2012).
Higgins, J. & Green, S. GSe, Cochrane Handbook for Systematic Reviews of Interventions. Naunyn-Schmiedebergs Archiv für experimentelle Pathologie und Pharmakologie. 5(2), S38 (2011).
Arya, S., Schwartz, T. A. & Ghaferi, A. A. Practical guide to meta-analysis. JAMA Surg 155, 430–431 (2020).
Li, H., Shih, M. C., Song, C. J. & Tu, Y. K. Bias propagation in network meta-analysis models. Res. Synth. Methods 14, 247–265 (2023).
Acknowledgements
We thank LetPub (www.letpub.com) for its linguistic assistance during the preparation of this manuscript. This research was funded by Shihezi university (Grant no. RCZK202048) and (Grant no. CXBJ202105).
Author information
Authors and Affiliations
Contributions
P.W. designed the manuscript. P.W. and J.J. searched documents and extracted data. J.J. operated the software. P.W. and J.J. wrote the main manuscript. All authors examined the manuscript.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Jiao, J., Wu, P. A meta-analysis on the potency of foot-and-mouth disease vaccines in different animal models. Sci Rep 14, 8931 (2024). https://doi.org/10.1038/s41598-024-59755-4
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-024-59755-4
- Springer Nature Limited