Abstract
Background
Multi-drug resistant bacteria are seen increasingly and there are gaps in our understanding of the complexity of antimicrobial resistance, partially due to a lack of appropriate statistical tools. This hampers efficient treatment, precludes determining appropriate intervention points and renders prevention very difficult.
Methods
We re-analysed data from a previous study using additive Bayesian networks. The data contained information on resistances against seven antimicrobials and seven potential risk factors from 86 non-typhoidal Salmonella isolates from laying hens in 46 farms in Uganda.
Results
The final graph contained 22 links between risk factors and antimicrobial resistances. Solely ampicillin resistance was linked to the vaccinating person and disposal of dead birds. Systematic associations between ampicillin and sulfamethoxazole/trimethoprim and chloramphenicol, which was also linked to sulfamethoxazole/trimethoprim were detected. Sulfamethoxazole/trimethoprim was also directly linked to ciprofloxacin and trimethoprim. Trimethoprim was linked to sulfonamide and ciprofloxacin, which was also linked to sulfonamide. Tetracycline was solely linked to ciprofloxacin.
Conclusions
Although the results needs to be interpreted with caution due to a small data set, additive Bayesian network analysis allowed a description of a number of associations between the risk factors and antimicrobial resistances investigated.
Similar content being viewed by others
Background
Antimicrobial resistance (AMR) is a serious global public health challenge putting the use of antimicrobials in jeopardy as microbes develop resistance to essential antimicrobials [1, 2]. Emergence and spread of AMR, including multi-drug resistance (MDR) in bacteria, are seen increasingly. Gaps in our understanding of the complexity of AMR hampers efficient treatment, precludes determining appropriate intervention points and renders prevention very difficult. There is a growing evidence that use of antimicrobials in food producing animals contributes to AMR in Salmonella [3]. Different mechanisms for antibiotic resistance in Salmonella isolates have been described [4]. The presence of multiple resistance determinants within bacterial isolates can be described as patterns of AMR. Due to biological and evolutionary mechanisms, different resistance genes might be linked to each other (e.g. if stored on the same plasmid), thus their dissemination is being co-dependent. Therefore, systematic and distinct patterns of specific combinations of AMR (coded into 0 and 1) rather than solely random patterns of AMR might be observed. In the context of evaluating a potential factor for intervention it is of interest to assess systematic statistical co-dependencies between multiple antimicrobial resistances.
The difficulty of assessing the role of relevant risk factors, and therefore defining efficient intervention points, can be (at least partly) explained by the lack of appropriate statistical tools for analysing such complex data. In classical risk factor studies, the multivariable regression techniques typically utilized have their origins in experimental research. Here, the investigator is able to fix all the factors of scientific interest at pre-defined levels – an option not available in observational studies. Additionally, to benefit from a higher statistical power, the investigator will aim to obtain a balanced design. This entails attempting to have similar numbers of individuals in different groups, i.e. similar numbers of individuals are being exposed and non-exposed to different risk factors. In contrast, in observational studies, data are typically non-balanced, unless specifically considered in the sampling plan to assure that equal numbers of individuals are exposed and unexposed. In observational studies with non-balanced data, frequently the issue of sparse data or data separation is encountered. When cross-tabulating binary variables, the resulting 2 × 2 cross tables might have a zero in at least one of the four cells. In this situation, confidence intervals might go to infinity, and classic measures as odds ratios may not be estimable.
In an observational setting, if standard multivariable regression is used for analysing the data, risk factors are presumably interrelated, thus precluding the separation of single risk factors and differentiating between direct and indirect effects. Furthermore, in the context of AMR, the response variable consists of a number of different resistant phenotypes and/or genes, thus necessitating a multivariate approach in contrast to classical risk factor analysis with one single outcome, i.e. healthy or diseased. Most often, data on AMR with multiple patterns are analysed in a descriptive way. To quantify the association between antimicrobials, resistance and susceptibility indices have been proposed, which could also be adapted for multiple resistances, providing also confidence intervals [5, 6].
Additive Bayesian network (ABN) modelling, an approach originating from machine learning and not yet seen widely applied in veterinary epidemiology, appears to be a promising tool for the analysis of multivariate resistance data [7, 8]. Notable examples of ABN analyses are published by [9,10,11,12]. Still to the authors’ knowledge no study has yet used ABN for the joint analysis of risk factors and binary (resistant/susceptible) antimicrobial resistance data. ABN results are presented in the form of networks, consisting of nodes, representing the variables, and links, designating the conditional probabilities between the variables of interest. ABN modelling is specifically designed to deal with highly correlated and complex data. It is suitable to disentangle direct from indirect statistical associations and can be understood as a generalisation of generalised linear regression models (GLMs). Thus, in contrast to classical regression approaches, the outcome and the predictors are not defined as such beforehand, but within the network different GLMs applicable to the data at hand are evaluated. ABN modelling is a pure data-driven technique, contrasting other approaches where the model is theory driven such as Structural Equation Modeling [13, 14]. Consequently, the first step in an ABN analysis is to find the optimal or most complex network still supported by the data, based on a metric which is controlling for complexity, allowing for the maximum number of links or associations between all variables included. In a second step, measures are undertaken to adjust for potential overfitting and to trim off links that are not supported by the data, given a specific cut-off.
In applied research with binomial (two states random variables) variables, data separation is a surprisingly common issue. It arises when one predictor predicts perfectly the outcome variable. Similarly, the term sparse data is used when only few observations of a possible combination are present in the dataset. Classical approaches, i.e. logistic regression modelling, often fail to accurately estimate the regression coefficient in this situation. The ABN approach requires to perform regressions between all the possible combinations of the variables. Hence, sparsity of the dataset is a major concern and should be addressed properly [15]. The general approach is to control the likelihood in order to prevent it to become infinite. In a Bayesian framework this could be done using an appropriate prior. Equivalently, it can be done using a bias reduction approach [16].
The aim of this study was to determine if specific risk factors are associated with single AMRs and if specific AMRs are linked to each other. For this study we used a data set from a previous study [17].
Methods
Sample collection and identification
Non-typhoidal Salmonella isolates used in this study were isolated from poultry fecal samples from three districts in Uganda. All flocks were sampled once. The study design and sampling is described in full and reported in [18]. In total 86 isolates originated from 43 farms. Furthermore, the samples were distributed rather homogeneously with 16 farms providing one resistant isolate, 14 farms with two resistant isolates, 10 farms with three resistant isolates and 3 farms with four resistant isolates. A standardized sampling scheme was adapted from previous studies. Culture and isolation followed ISO 6579:2002/Amd 1:2007 Annex D: Detection of Salmonella spp. in animal faeces and in environmental samples from the primary production [19]. These analyses were carried out at the food microbiology laboratory at the College of Veterinary Medicine, Animal Resources and Biosecurity, Makerere University, Kampala Uganda. The isolates were serotyped at the Norwegian Veterinary Institute, Oslo, using Kauffman–White–Le–Minor technique [20].
Antimicrobial resistance testing
Phenotypic antimicrobial susceptibility testing was performed using the Kirby-Bauer disk diffusion methods on Muller-Hinton agar and is described in detail in [18]. The antibiotics were selected based on those commonly used in Uganda and those recommended by World Health Organization (WHO) for routine monitoring and surveillance.
Statistical analysis: additive Bayesian networks
The following seven risk factors were selected to be included in the ABN analysis: 1) Gender of the manager (binomial, baseline male or female), 2) “Pets”, presence of pets (binomial, baseline no or yes), 3) “Farm size” of the poultry farm (multinomial, baseline small with less than 500 birds, medium between 500 and 1000 birds and large with more than 1000 birds), 4) “Management”, i.e. management practice (binomial, baseline free-range to semi-intensive or intensive), 5) “Eggtrays”, indicating if the egg trays were re-used (binomial, baseline no or yes), 6) “Vaccinator” describing who vaccinates (multinomial, baseline “private service”, “self or family member” or “employee”), 7) “Disposal” of dead birds (multinomial, baseline “burrying”, “burning”, “throw away”, “giving to animals (dogs and pigs)”, and “drop in a pit”). Data on antimicrobial resistance against the following seven different antibiotics ampicillin (AMP), chloramphenicol (CHL), ciprofloxacin (CIPR), sulfamethoxazole/trimethoprim (SXT), sulfonamide (SULFA), tetracycline (TET), and trimethoprim (TRIM), were included as binary variables (baseline no resistance).
The entire statistical analysis was conducted using R [21]. As ABN requires a complete dataset, under the assumption of missing at random, missing values were imputed with the R package missforest [22]. ABN analysis was performed with the R package abn [23]. Here, a scoring procedure (BIC, Bayesian information criterion) is implemented to identify the maximum a posteriori Bayesian network based on information theoretic metrics [15] and controls internally for model complexity. Estimations of the effect size was done with the function fitabn.mle() in the ABN package which is essentially a wrapper for the multinom() function in [24] for multinomial random variables. Additionally, for the purpose of comparison and if estimation of standard errors was not stable, the function bayesgln() from the arm package [24] was used. The latter uses as default a student distributed prior that help estimation with sparse dataset [25]. We used an exact search [26] to find first an optimal network, meaning the optimal level of complexity in terms of the simultaneous presence of different GLMs with potential covariates in the data at hand. In this approach, networks of different increasing complexity, i.e. allowing for more links or covariates to be included, were evaluated. For a plausibility check, the magnitude of the marginal likelihood for each model, i.e. individual GLMs, in the network was assessed visually. In order to adjust for overfitting, a non-parametric bootstrapping analysis with 10′000 bootstraps was performed. This means that a part of the data (95% thereof) was randomly selected, then the entire procedure to find the best network was applied. With the aim to obtain robust results, i.e. associations or links between variables being highly supported by the data, a 50% threshold was applied.
Results
Descriptive analysis of risk factors and pattern of antimicrobial resistance
In Table 1, the proportions of the seven included risk factors are presented together with the frequencies of susceptible and resistant isolates per antibiotic tested. Antimicrobial resistance testing of 86 isolates originating from 43 farms resulted in 11 different patterns of antimicrobial resistance (Table 2). When looking at the resistance patterns which are at least present with a frequency of n = 10, at least 76% originate from different farms. This renders a large clustering effect at farm level implausible in this data set, possibly due to sampling. Out of the 14 farms with two isolates, in seven farms one single pattern was detected and in the other 7 farms there were two distinct patterns. Among the 10 farms with three resistant isolates, in one farm all isolates shared the same single pattern, in seven cases there were two patterns and in 2 farms there were three different patterns. For the 3 farms providing 4 isolates, 2 farms had two patterns and 1 farm had 3 distinct patterns. While 32 isolates (37.2%) were not resistant to any of the seven antibiotics tested, 27 isolates (31.4%) showed resistance against one antibiotic, 16 isolates (18.6%) against two antibiotics, 9 isolates (10.5%) against three antibiotics and 2 against four antibiotics (2.3%). In descending order, the following percentages of isolates were found to be resistant against antibiotics (95% binomial confidence intervals based on Jeffreys approximate method) [27]: ciprofloxacin 46.5% (36 to 58), sulfonamide 24.4% (16 to 34), tetracycline 15.1% (0 to 30), trimethoprim and trimethoprim-sulfamethoxazole both 7.0% (0 to 20), chloramphenicol and ampicillin both 4.6% (1 to 10).
Additive Bayesian networks
The results of the final adjusted network are presented graphically, in a table indicating the direction of the associations found (Table 3), as well as numerically with odds ratios on the log.odds and odds scale and standard errors for binomial and multinomial variables (Table 4). In the case of the latter ones, assuming three levels (e.g. vaccination performed by a private service, oneself or a family member, employee) the resulting estimated are referring to the corresponding baseline values.
Six missing values (farm size n = 2, management n = 1, egg trays = 3) were imputed. The networks before and after bootstrapping are identical with 22 links contained (shown in Fig. 1). Thus, no arcs were pruned. In Fig. 2, the results of the bootstrapping, i.e. the number of arcs in the bootstrapped networks are presented. Based on the number of networks containing more than 22 arcs, corresponding to approximately 31% of the bootstrapped networks, it becomes evident that randomness was actually included by non-parametric bootstrapping and underlines the robustness of the network with 22 arcs.
Results of bootstrap analysis: number of arcs in 10,000 bootstrapped networks. The network resulting from the exact search contained 22 arcs. Out of the 10,000 bootstrapped networks more than a third contained more than 22 arcs. This indicates that substantial randomness was introduced and let to overfitting, i.e. spurious arcs and confirms the robustnest of the network with 22 arcs
Regarding the associations between risk factors and antibiotic resistance, solely ampicillin was found to be linked to vaccinator and disposal. Here, ampicillin resistance was more likely, i.e. with a positive log-odds, to occur if vaccination was done by the manager him- or herself and by an employee compared to a private service. Still this needs to be interpreted with caution as there were only four isolates with ampicillin resistance which are of the same pulsotype [17]. These isolates originate from four different farms in two districts.
The following antimicrobial resistance characteristics were linked to each other: resistance towards trimethoprim was linked positively to resistance towards sulfonamide and sulfamethoxazole/trimethoprim, but negatively to ciprofloxacin. Resistance towards sulfonamide was also linked positively to resistance to ciprofloxacin. There was also a positive association between resistance to chloramphenicol and ampicillin, with all isolates being either both susceptible or resistant (n = 4). Resistance to ampicillin and to sulfamethoxazole-trimethoprim were negatively associated. There were negative associations between chloramphenicol and sulfamethoxazole/trimethoprim, which was also negatively associated with ciprofloxacin. Tetracycline was also negatively associated with ciprofloxacin.
Regarding the associations between the seven risk factors: intensively managed farms were more likely to have a male compared to a female manager. Female manager compared to male manager were more likely to doing the vaccinations by herself or a family member instead of a public service or by an employee. Medium and large size farms were less likely to have pets compared to small size farms. Intensively managed farms were more likely to reuse egg trays compared to free range or semi-intensive farms.
In Table 4 the corresponding coefficients on a log-odds and an odds scale of the graph before bootstrapping are displayed. Relatively large or small log-odds values and standard errors are indicative of sparse data (at least one zero in a contingency table) with leads to unstable estimation of the effect size. Although the magnitude of the effect size is not necessarily meaningful, the direction of the association is still relevant. For binomial variables, in case the function multinom() did not yield stable standard error estimates, the results of the bayesglm() function are also shown. In all cases, there is agreement about the direction of the association, being positive or negative.
Discussion
Based on the data from the previously published data [18], despite the presence of sparse data and data separation, it was possible to obtain networks including seven potential risk factors and seven antibiotic resistances. Due to sparse data, the results need to be carefully interpreted. Only resistance to ampicillin was found to be linked directly to the vaccinating person and disposal.
It is a well-known fact that many of the genes coding for AMR characteristics are located on mobile genetic elements, and that these genes are disseminated between related and unrelated bacteria through horizontal gene transmission mechanisms. However, we do not have any data on the location of the genes encoding the AMR characteristics in the bacterial isolates analysed in this study, and can therefore only speculate that one explanation for the AMR linkages observed in the ABN analysis is the physical linkage of genes on the same mobile genetic element. What we do know from the Odoch et al. 2018-study, is that six S. Hadar isolates harbored class1 integron genes (int1) that were also associated with the gene determinant dfrA15 encoding trimethoprim resistance. As int1 always are associated with the sul1 determinant encoding for sulfonamide resistance, this int1-sul1-dfrA15 linkage is a molecular explanation for the observed association. Use of antimicrobials is a main driver for development and dissemination of AMR, and the very often standard simultaneous administration of trimethoprim and sulfonamides (trimethoprim-sulfamethoxazole) can probably be regarded as an important driver for evolution of this genetic linkage.
The use of chloramphenicol is banned in poultry, still four isolates were found to be resistant, and the underlying source and mechanisms are unclear. An earlier study identified chloramphenicol resistance encoding gene, cmlA in one of these isolates [17]. This requires further investigations.
To our knowledge the only two studies that relied an ABN for analysis on antimicrobial data are Hidano et al. (2015) and Ludwig et al. (2013) [10, 11]. In both studies, not binary data (being resistant or not) but continuous data, assumed to be Gaussian, as zones of inhibition measured in mm were considered. In our study, due to recent adaptions in the abn code, it was possible to directly include the dichotomized antimicrobial resistance data, based on CLSI, without encountering the issue of sparse data. Still due to sparse data, inevitably present in a small data set, not all associations were estimable resulting in very large estimates and standard errors, still with two different approaches, there was agreement about the direction of the association. Another novelty lies in the opportunity to also include multinomial data.
Conclusions
Although, due to the small sample size and the relative low proportion of resistances against some antimicrobials, the results need to be considered carefully, we are confident, that the actual version of ABN allows for valuable insights in future analyses of larger data sets. The particular added value lies in the opportunity to disentangle the role of single risk factors on the multivariate outcome of antimicrobial resistance data.
Availability of data and materials
The dataset from which these results were generated are not publically available at this point as this study is part of an on-going PhD research at Norwegian University of Life Sciences and the university takes responsibility of storing the primary data. But this can be made available on reasonable request from the second author.
Abbreviations
- ABN:
-
Additive Bayesian network
- AMP:
-
Ampicillin
- AMR:
-
Antimicrobial resistance
- CHL:
-
Chloramphenicol
- CIPR:
-
Ciprofloxacin
- GLM:
-
Generalised regression model
- MDR:
-
Multi-drug resistance
- SULFA:
-
Sulfonamide
- SXT:
-
Sulfamethoxazole/trimethoprim
- TET:
-
Tetracycline
- TRIM:
-
Trimethoprim
References
Brown ED, Wright GD. Antibacterial drug discovery in the resistance era. Nature. 2016;529:336–43.
WHO. Antimicrobial resistance: global report on surveillance. 2014. https://www.who.int/drugresistance/documents/surveillancereport/en/. Accessed 28 Nov 2018.
Crump JA, Sjölund-Karlsson M, Gordon MA, Parry CM. Epidemiology, clinical presentation, laboratory diagnosis, antimicrobial resistance, and antimicrobial management of invasive Salmonella infections. Clin Microbiol Rev. 2015;28:901–37.
Frye JG, Jackson CR. Genetic mechanisms of antimicrobial resistance identified in Salmonella enterica, Escherichia coli, and Enteroccocus spp. isolated from U.S. food animals. Front Microbiol. 2013;4:135.
Ruddat I, Kadlec K, Schwarz S, Kreienbrock L. Statistical methods for description of phenotypic susceptibility data. Berl Munch Tierarztl Wochenschr. 2014;127:349–58.
Ruddat I, Schwarz S, Tietze E, Ziehm D, Kreienbrock L. A quantitative approach to analyse linkages between antimicrobial resistance properties in Salmonella Typhimurium isolates. Epidemiol Infect. 2012;140:157–67.
Lewis FI, Ward MP. Improving epidemiologic data analyses through multivariate regression modelling. Emerg Themes Epidemiol. 2013;10:4.
Lewis FI, McCormick BJJ. Revealing the complexity of health determinants in resource-poor settings. Am J Epidemiol. 2012;176:1051–9.
Ågren ECC, Frössling J, Wahlström H, Emanuelson U, Sternberg Lewerin S. A questionnaire study of associations between potential risk factors and Salmonella status in Swedish dairy herds. Prev Vet Med. 2017;143:21–9. https://doi.org/10.1016/j.prevetmed.2017.05.004 .
Hidano A, Yamamoto T, Hayama Y, Muroga N, Kobayashi S, Nishida T, Tsutsui T. Unraveling antimicrobial resistance genes and phenotype patterns among Enterococcus faecalis isolated from retail chicken products in Japan. PLoS One. 2015;10:e0121189.
Ludwig A, Berthiaume P, Boerlin P, Gow S, Léger D, Lewis FI. Identifying associations in Escherichia coli antimicrobial resistance patterns using additive Bayesian networks. Prev Vet Med. 2013;110:64–75.
McCormick BJJ, van Breda LK, Ward MP. Bayesian network analysis of piglet scours. Sci Rep. 2017;7:6202.
Cha E, Sanderson M, Renter D, Jager A, Cernicchiaro N, Bello NM. Implementing structural equation models to observational data from feedlot production systems. Prev Vet Med. 2017;147:163–71.
Detilleux J, Theron L, Beduin J-M, Hanzen C. A structural equation model to evaluate direct and indirect factors associated with a latent measure of mastitis in Belgian dairy herds. Prev Vet Med. 2012;107:170–9.
Kratzer G, Furrer R. Information-theoretic scoring rules to learn additive Bayesian network applied to epidemiology; 2018;arXiv. p. 1808.011.
Kosmidis I, Firth D. Bias reduction in exponential family nonlinear models. Biometrika. 2009;96:793–804.
Odoch T, Sekse C, L'Abee-Lund TM, Høgberg Hansen HC, Kankya C, Wasteson Y. Diversity and antimicrobial resistance genotypes in non-Typhoidal Salmonella isolates from poultry farms in Uganda. Int J Environ Res Public Health. 2018. https://doi.org/10.3390/ijerph15020324 .
Odoch T, Wasteson Y, L'Abée-Lund T, Muwonge A, Kankya C, Nyakarahuka L, et al. Prevalence, antimicrobial susceptibility and risk factors associated with non-typhoidal Salmonella on Ugandan layer hen farms. BMC Vet Res. 2017;13:365.
ISO. ISO 6579:2002/Amd 1:2007: Annex D: Detection of Salmonella spp. in animal faeces and in environmental samples from the primary production stage 2007.
Grimont PAD, Weill F-X, editors. Antigenic formulae of the Salmonella serovars. 9th ed. Paris, France: Institut Pasteur; 2007.
R Core Team. R: a language and environment for statistical computing. 2018. http://www.R-project.org/. Accessed 28 Nov 2018.
Stekhoven DJ, Bühlmann P. MissForest non-parametric missing value imputation for mixed-type data. Bioinformatics. 2012;28:112–8.
Kratzer G, Pittavino M, Lewis FI, Furrer R. Abn: an R package for modelling multivariate data using additive Bayesian networks. 2017. https://CRAN.R-project.org/package=abn. Accessed 28 Nov 2018.
Gelman A, Yu-Sung S. Arm: data analysis using regression and multilevel/hierarchical models. 2018. https://CRAN.R-project.org/package=arm. Accessed 28 Nov 2018.
Kratzer G, Furrer R, Pittavino M. Comparison between suitable priors for the additive Bayesian networks 2018: arXiv:1809.06636.
Koivisto M, Sood K. Exact Bayesian structure discovery in Bayesian networks. J Mach Learn Res. 2004;5:549–73.
Meeker WQ, Hahn GJ, Escobar LA. Statistical intervals: a guide for practitioners and researchers. Hoboken, New Jersey: Wiley; 2017.
Acknowledgements
Sincere thanks to Dr. Clovice Kankya for ensuring that the required resources were availed in time. Special thanks and gratitude to Professor Paul Torgerson at University of Zurich (UZH) for additional logistical support that enabled data analysis to be done at UZH. We thank all the researchers and technical staff at the department of Food Safety and Infection Biology at NMBU for their contributions.
Funding
This work was supported by the Norwegian Programme for Capacity Development in Higher Education and Research for Development (NORHED project No.UGA-13/0031) based at Makerere University, Kampala Uganda and Norwegian University of Life Sciences (NMBU, Oslo. The funding body was not involved in the design of the study and collection, analysis, interpretation of data and in writing the manuscript.
Author information
Authors and Affiliations
Contributions
SH was repsonsible for the data analysis and manuscript writing. TO contributed to conception, analysis and writing of the manuscript. GK provided the adapted code for the analysis and was involved in manuscript writing. RF contributed to the design and review of the manuscript. YW contributed to writing and editing. TML participated in drafting and reviewing of the manuscript. ES contributed to writing and editing. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
The original field study was approved and granted permission (number A532) by Uganda National Council of Science and Technology (UNCST). All farmers (respondents) who participated were asked for verbal consent before being interviewed. According to UNCST this is acceptable especially for the purpose of not excluding illiterate respondents and where no samples were to be taken from humans and live chicken.
Consent for publication
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
About this article
Cite this article
Hartnack, S., Odoch, T., Kratzer, G. et al. Additive Bayesian networks for antimicrobial resistance and potential risk factors in non-typhoidal Salmonella isolates from layer hens in Uganda. BMC Vet Res 15, 212 (2019). https://doi.org/10.1186/s12917-019-1965-y
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s12917-019-1965-y