Skip to main content
SpringerLink
Log in

3D-2D Registration Using X-Ray Simulation and CMA-ES

  • Conference paper
  • First Online:
Applications of Evolutionary Computation (EvoApplications 2021)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 12694))

Abstract

Radiographs of the hand are useful in diagnosing and staging diseases such as rheumatoid arthritis (RA) and other musculoskeletal diseases. Radiographs are projections of the 3D anatomy, with the useful information such as pose and pathology becoming lost in the process. We propose a 3D hand pose recovery method for radiographs of hands using a novel hybrid image registration method. Our pose recovery pipeline consists of aligning a simulated X-ray (digitally reconstructed radiograph) of an articulated phantom mesh model to a real hand radiograph using Covariance Matrix Adaptation Evolution Strategy. Early results demonstrate that our approach works well. Further inquiry is required to evaluate the applicability of our registration approach to other articulated musculoskeletal anatomy.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Andrade, N., Faria, F.A., Cappabianco, F.A.M.: A practical review on medical image registration: from rigid to deep learning based approaches. In: 2018 31st SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI), pp. 463–470. IEEE (2018)

    Google Scholar 

  2. Aubert, B., Vazquez, C., Cresson, T., Parent, S., de Guise, J.A.: Toward automated 3D spine reconstruction from biplanar radiographs using CNN for statistical spine model fitting. IEEE Trans Med Imaging 38(12), 2796–2806 (2019)

    Google Scholar 

  3. Blank, J., Deb, K.: Pymoo: multi-objective optimization in python. IEEE Access 8, 89497–89509 (2020)

    Article  Google Scholar 

  4. Englander, Z.A., Martin, J.T., Ganapathy, P.K., Garrett, W.E., DeFrate, L.E.: Automatic registration of MRI-based joint models to high-speed biplanar radiographs for precise quantification of in vivo anterior cruciate ligament deformation during gait. J. Biomech. 81, 36–44 (2018)

    Article  Google Scholar 

  5. Esteban, J., Grimm, M., Unberath, M., Zahnd, G., Navab, N.: Towards fully automatic X-ray to CT registration. In: International Conference on Medical Image Computing and Computer-Assisted Intervention. pp. 631–639. Springer (2019)

    Google Scholar 

  6. Folkerts, M., Jia, X., Gu, X., Choi, D., Majumdar, A., Jiang, S.:MO-FF-A4-05: implementation and evaluation of various DRR algorithms on GPU. Med. Phys. 37(6Part6), 3367-3367 (2010)

    Google Scholar 

  7. Gao, C., Liu, X., Gu, W., Killeen, B., Armand, M., Taylor, R., Unberath, M.: Generalizing spatial transformers to projective geometry with applications to 2D/3D registration. arXiv preprint arXiv:2003.10987 (2020)

  8. Gómez, O., Ibáñez, O., Valsecchi, A., Bermejo, E., Molina, D., Cordón, O.: Performance analysis of real-coded evolutionary algorithms under a computationally expensive optimization scenario: 3D–2D comparative radiography. Appl. Soft Comput. 97, (2020)

    Google Scholar 

  9. Gómez, O., Ibanez, O., Valsecchi, A., Cordón, O., Kahana, T.: 3D–2D silhouette-based image registration for comparative radiography-based forensic identification. Pattern Recogn. 83, 469–480 (2018)

    Article  Google Scholar 

  10. Gong, R.H., Stewart, J., Abolmaesumi, P.: Multiple-object 2-D-3-D registration for noninvasive pose identification of fracture fragments. IEEE Trans. Biomed. Eng. 58(6), 1592–1601 (2011)

    Article  Google Scholar 

  11. Graham, R.N., Perriss, R.W., Scarsbrook, A.F.: DICOM demystified: a review of digital file formats and their use in radiological practice. Clin. Radiol. 60(11), 1133–1140 (2005)

    Article  Google Scholar 

  12. Hansen, N., Ostermeier, A.: Completely derandomized self-adaptation in evolution strategies. Evol. Comput. 9(2), 159–195 (2001)

    Article  Google Scholar 

  13. Huang, J., Yagel, R., Filippov, V., Kurzion, Y.: An accurate method for voxelizing polygon meshes. In: Kaufman, A.E., Yagel, R., Lorensen, W.E. (eds.) Proceeding of the 1998 IEEE Symposium on Volume Visualization, VVS 1998, Research Triangle Park, NC, USA, 19–20 October 1998, pp. 119–126. ACM/IEEE Comput Soc (1998)

    Google Scholar 

  14. International Journal of Computer Assisted Radiology and Surgery Registration and motion analysis. 9(1), 31–34 (2014). https://doi.org/10.1007/s11548-014-1017-9

  15. Neumann, E., Lefèvre, S., Zimmermann, B., Gay, S., Müller-Ladner, U.: Rheumatoid arthritis progression mediated by activated synovial fibroblasts. Trends Mol. Med. 16(10), 458–468 (2010)

    Article  Google Scholar 

  16. N. Freud, P.Duvauchelle, Létang, J.M., D.Babot: Fast and robust ray casting algorithms for virtual X-ray imaging. Nuclear Instruments and Methods in Physics Research Section B: Beam Interactions with Materials and Atoms 248(1), 175–180 (2006)

    Google Scholar 

  17. Illustrated Handbook of Rheumatic and Musculo-Skeletal Diseases. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-03664-5_9

  18. Rajpurkar, P., et al.: Mura: Large dataset for abnormality detection in musculoskeletal radiographs. arXiv preprint arXiv:1712.06957 (2017)

  19. Schett, G.: Erosive arthritis. Arthritis Res. Therapy 9(1), 1–6 (2007)

    Article  Google Scholar 

  20. Valsecchi, A., Bermejo, E., Damas, S., Cordón, O.: Metaheuristics for Medical Image Registration. In: Martí, R., Pardalos, P.M., Resende, M.G.C. (eds.) Handbook of Heuristics, pp. 1079–1101. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-07124-4_56

    Chapter  Google Scholar 

  21. Vidal, F.P., Garnier, M., Freud, N., Létang, J.M., John, N.W.: Simulation of X-ray attenuation on the GPU. In: Proceedings of Theory and Practice of Computer Graphics 2009, pp. 25–32. Eurographics Association, Cardiff, UK, Jun 2009

    Google Scholar 

  22. Vidal, F.P., Villard, P.F.: Development and validation of real-time simulation of X-ray imaging with respiratory motion. Comput. Med. Imaging Graph. 49, 1–15 (2016)

    Article  Google Scholar 

  23. Viergever, M.A., Antoine Maintz, J., Klein, S., Murphy, K., Staring, M., Pluim, J.P.: A survey of medical image registration-under review. Med. Image Anal. 33, 140–144 (2016)

    Article  Google Scholar 

  24. Wang, M., Li, P.: A review of deformation models in medical image registration. J. Med. Biol. Eng. 39(1), 1–17 (2019)

    Article  MathSciNet  Google Scholar 

  25. Wen, T., Mihail, R., Al-maliki, S., Létang, J.M., Vidal, F.P.: Registration of 3D triangular models to 2D X-ray projections using black-box optimisation and X-ray simulation. In: Computer Graphics and Visual Computing (CGVC), pp. 105–113. The Eurographics Association (2019)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Computer Science and Electronic Engineering, Bangor University, Bangor, UK

    Tianci Wen & Franck P. Vidal

  2. Department of Computer Science, Valdosta State University, Georgia, USA

    Radu P. Mihail

Authors
  1. Tianci Wen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Radu P. Mihail
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Franck P. Vidal
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Tianci Wen .

Editor information

Editors and Affiliations

  1. ETSIIT-CITIC, University of Granada, Granada, Spain

    Pedro A. Castillo

  2. Université Le Havre Normandie, Le Havre, France

    Juan Luis Jiménez Laredo

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Wen, T., Mihail, R.P., Vidal, F.P. (2021). 3D-2D Registration Using X-Ray Simulation and CMA-ES. In: Castillo, P.A., Jiménez Laredo, J.L. (eds) Applications of Evolutionary Computation. EvoApplications 2021. Lecture Notes in Computer Science(), vol 12694. Springer, Cham. https://doi.org/10.1007/978-3-030-72699-7_29

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-72699-7_29

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-72698-0

  • Online ISBN: 978-3-030-72699-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation