Abstract
An efficient and versatile implementation of offline multiple hypothesis tracking with Algorithm X for optimal association search was developed using Python. The code is intended for scientific applications that do not require online processing. Directed graph framework is used and multiple scans with progressively increasing time window width are used for edge construction for maximum likelihood trajectories. The current version of the code was developed for applications in multi-phase hydrodynamics, e.g., bubble and particle tracking, and is capable of resolving object motion, merges and splits. Feasible object associations and trajectory graph edge likelihoods are determined using weak mass and momentum conservation laws translated to statistical functions for object properties. The code is compatible with n-dimensional motion with arbitrarily many tracked object properties. This framework is easily extendable beyond the present application by replacing the currently used heuristics with ones more appropriate for the problem at hand. The code is open-source and will be continuously developed further.
Graphical abstract
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Data availability
Both input for and output of MHT-X, as well as associated visuals are available on demand – please contact the corresponding authors.
Code availability
The MHT-X code is open source and is currently available on GitHub: https://github.com/Peteris-Zvejnieks/MHT-X. It is frequently updated and a comprehensive documentation is also currently in the works.
References
Akashi M, Keplinger O, Shevchenko N, Anders S, Reuter M (2019) X-ray radioscopic visualization of bubbly flows injected through a top submerged lance into a liquid metal. Metall Mater Trans B. https://doi.org/10.1007/s11663-019-01720-y
Anders S, Noto D, Seilmayer M, Eckert S (2019) Spectral random masking: a novel dynamic masking technique for piv in multiphase flows. Exp Fluids 60:68. https://doi.org/10.1007/s00348-019-2703-8
Anders S, Noto D, Tasaka Y, Eckert S (2020) Simultaneous optical measurement of temperature and velocity fields in solidifying liquids. Exp Fluids. https://doi.org/10.1007/s00348-020-2939-3
Birjukovs M, Dzelme V, Jakovics A, Thomsen K, Trtik P (2020) Phase boundary dynamics of bubble flow in a thick liquid metal layer under an applied magnetic field. Phys Rev Fluids. https://doi.org/10.1103/PhysRevFluids.5.061601
Birjukovs M, Dzelme V, Jakovics A, Thomsen K, Trtik P (2020) Argon bubble flow in liquid gallium in external magnetic field. Int J Appl Electromagn Mech 63:1–7. https://doi.org/10.3233/JAE-209116
Birjukovs M, Trtik P, Kaestner A, Hovind J, Klevs M, Gawryluk DJ, Thomsen K, Jakovics A (2021) Resolving gas bubbles ascending in liquid metal from low-snr neutron radiography images. Appl Scis. https://doi.org/10.3390/app11209710
Blackman S (2004) Multiple hypothesis tracking for multiple target tracking. IEEE Aerosp Electron Syst Magaz 19:5–18. https://doi.org/10.1109/MAES.2004.1263228
Brasó G, Leal-Taixé L (2020) Learning a neural solver for multiple object tracking. In: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 6246–6256 . https://doi.org/10.1109/CVPR42600.2020.00628
Cox IJ, Hingorani SL (1996) An efficient implementation of reid’s multiple hypothesis tracking algorithm and its evaluation for the purpose of visual tracking. IEEE Trans Pattern Anal Mach Intell 18:138–150. https://doi.org/10.1109/34.481539
Dzelme V, Jakovics A, Vencels J, Köppen D, Baake E (2018) Numerical and experimental study of liquid metal stirring by rotating permanent magnets. In: IOP Conference Series: Materials Science and Engineering 424:012047. https://doi.org/10.1088/1757-899X/424/1/012047
Heitkam S, Lappan T, Trtik P, Eckert K (2019) Tracking of particles in froth using neutron imaging. Chemie Ingenieur Technik. https://doi.org/10.1002/cite.201800127
Keplinger O, Shevchenko N, Eckert S (2018) Visualization of bubble coalescence in bubble chains rising in a liquid metal. Int J Multiph Flow 105:159–169. https://doi.org/10.1016/j.ijmultiphaseflow.2018.04.001
Keplinger O, Shevchenko N, Eckert S (2019) Experimental investigation of bubble breakup in bubble chains rising in a liquid metal. Int J Multiph Flow 116:39–50. https://doi.org/10.1016/j.ijmultiphaseflow.2019.03.027
Kim C, Li F, Ciptadi A, Rehg J (2015) Multiple hypothesis tracking revisited, pp 4696–4704 . https://doi.org/10.1109/ICCV.2015.533
Knuth DE (2000) Dancing links arXiv:cs/0011047. Accessed 2020-12-06
Lappan T, Sarma M, Heitkam S, Trtik P, Mannes D, Eckert K, Eckert S (2020) Neutron radiography of particle-laden liquid metal flow driven by an electromagnetic induction pump. Magnetohydrodynamics 56:167–176
Obiso D, Akashi M, Kriebitzsch S, Meyer B, Reuter M, Richter A (2020) Cfd modeling and experimental validation of top-submerged-lance gas injection in liquid metal. Metall Mater Trans B. https://doi.org/10.1007/s11663-020-01864-2
Reid D (1979) An algorithm for tracking multiple targets. IEEE Trans Autom Control 24(6):843–854. https://doi.org/10.1109/TAC.1979.1102177
Rubio JC, Serrat J, López A (2012) Multiple target tracking and identity linking under split, merge and occlusion of targets and observations. In: ICPRAM 2012—Proceedings of the 1st international conference on pattern recognition applications and methods 2, 15–24 . https://doi.org/10.5220/0003710600150024
Sarma M, Ščepanskis M, Jakovics A, Thomsen K, Nikoluškins R, Vontobel P, Beinerts T, Bojarevics A, Platacis E (2015) Neutron radiography visualization of solid particles in stirring liquid metal. Phys Proc 69:457–463. https://doi.org/10.1016/j.phpro.2015.07.064
Ščepanskis M, Sarma M, Vontobel P, Trtik P, Thomsen K, Jakovics A, Beinerts T (2017) Assessment of electromagnetic stirrer agitated liquid metal flows by dynamic neutron radiography. Metall Mater Trans B 48:1045–1054. https://doi.org/10.1007/s11663-016-0902-8
Acknowledgements
This research is a part of the ERDF project “Development of numerical modelling approaches to study complex multiphysical interactions in electromagnetic liquid metal technologies” (No. 1.1.1.1/18/A/108). Neutron images were acquired at the Swiss spallation neutron source SINQ, Paul Scherrer Institute (PSI). The authors are grateful to Pavel Trtik (PSI), Jevgenijs Telicko (UL), Jan Hovind (PSI) and Knud Thomsen (PSI) for invaluable support in the neutron radiography experiments, and express gratitude to Natalia Shevchenko (HZDR) for her key role in the X-ray radiography experiments. The authors would like to acknowledge the math.stackexchange.com user Watercrystal for pointing out that the association optimization problem can be treated as an exact cover problem. Her involvement, while in the form of a single comment, was crucial to the development of this algorithm: https://math.stackexchange.com/questions/3720630/finding-the-solution-set-for-binary-matrix-and-vector-multiplication/3720965#3720965.
Author information
Authors and Affiliations
Contributions
Peteris Zvejnieks is the main developer of MHT-X and has written all parts of the Python implementation. Both Peteris Zvejnieks and Mihails Birjukovs contributed to algorithm and method development. Martins Klevs performed the bubble flow simulations and provided the data for analysis. Megumi Akashi processed the X-ray radiography images and provided the data for analysis. Neutron radiography images were processed by Mihails Birjukovs. Visualization was done by Peteris Zvejnieks and Mihails Birjukovs, both of whom also came up with the original manuscript draft. Sven Eckert and Andris Jakovics were responsible for funding acquisition and research supervision. All co-authors contributed to manuscript editing and review prior to submission.
Corresponding authors
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Zvejnieks, P., Birjukovs, M., Klevs, M. et al. MHT-X: offline multiple hypothesis tracking with algorithm X. Exp Fluids 63, 55 (2022). https://doi.org/10.1007/s00348-022-03399-5
Received:
Revised:
Accepted:
Published:
DOI: https://doi.org/10.1007/s00348-022-03399-5