Skip to main content

Fundamental Technologies for Integration of Multiscale Spatiotemporal Morphology in MCA

  • Chapter
  • First Online:
Multidisciplinary Computational Anatomy

Abstract

This chapter presents the achievements of multiscale spatiotemporal statistical models during the whole period of the multidisciplinary computational anatomy project. Shimizu et al. built spatiotemporal statistical models along a time axis of embryos and children, in which a modeling method to deal with a small sample of data was developed and smoothness constraints along a time axis were introduced into the spatiotemporal statistical model. Modelling of organs with nested and neighbouring constraints was also studied by their group. Multiscale models were constructed, in which Shimizu et al. presented super-resolution techniques by dictionary learning and deep learning, and Shouno et al. studied super-resolution under a noisy environment in order to solve mapping problems among multimodal images. Kobayashi et al. developed algorithms for image understanding of microscopic images of a KPC mouse, where 3D tissues structures were recognised from pancreatic serial section images and from hyperspectral images.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 69.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 89.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 119.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Durrleman S, Pennec X, Trouvé A, Braga J, Gerig G, Ayache N. Toward a comprehensive framework for the spatiotemporal statistical analysis of longitudinal shape data. Int J Comput Vis. 2013;103(1):22–59.

    Article  CAS  Google Scholar 

  2. Kishimoto M, Saito A, Takakuwa T, Yamada S, Matsuzoe H, Hontani H, Shimizu A. A spatiotemporal statistical model for eyeballs of human embryos. IEICE Trans Inf Syst. E100-D, 7:1505–15.

    Google Scholar 

  3. Kasahara K, Saito A, Takakuwa T, Yamada S, Matsuzoe H, Hontani H, Shimizu A. A spatiotemporal statistical shape mode of the brain surface during human embryonic development. Adv Biomed Eng. 2018;7:146–55.

    Article  Google Scholar 

  4. Kameda T, Yamada S, Uwabe C, Suganuma N. Digitization of clinical and epidemiological data from the Kyoto collection of human embryos: maternal risk factors and embryonic malformations. Congenit Anom. 2012;52(1):48–54.

    Article  Google Scholar 

  5. Saito A, Nakayama K, Porras AR, Mansoor A, Biggs E, Linguraru MG, Shimizu A. Construction of a spatiotemporal statistical shape model of pediatric liver from cross-sectional data. Proc of Medical Image Computing and Computer-Assisted Intervention., Part I, LNCS. 2018;11071:676–83.

    Google Scholar 

  6. Saito A, Tsujikawa M, Takakuwa T, Yamada S, Shimizu A. Level set distribution model of nested structures using logarithmic transformation. Med Image Anal. 2019;56:1–10. https://doi.org/10.1016/j.media.2019.05.003.

    Article  PubMed  Google Scholar 

  7. Shimizu A, Hontani H, Kobayashi N, Shono H, Mori K, Iwamoto C, Ouchida K, Oda Y, Hashizume M. A multi-scale and multi-modality statistical model of pancreas. Int J Comput Assist Radiol Surg. 2016;10(suppl 1):S165–6.

    Google Scholar 

  8. Ishida J, Saito A, Shimizu A. Multi-modality statistical model between a thoracic CT volume and photographs of lung cryosections of a cadaver. Int J Comput Assist Radiol Surg. 2017;12(suppl 1):S192.

    Google Scholar 

  9. Timofte R, Smet VD, Gool LV. Anchored neighborhood regression for fast example-based super-resolution. Proc of IEEE International Conference on Computer Vision. 2013;

    Google Scholar 

  10. Tozawa K, Saito A, Kido S, Inai K, Kimura H, Shimizu A. Super resolution of a lung CT volume using a generative adversarial network. Int J Comput Assist Radiol Surg. 2018;13(suppl 1):S170.

    Google Scholar 

  11. Ledig C, Theis L, Huszar F, Caballero J, Cunningham A, Acosta A, Aitken A, Tejani A, Totz J, Wang Z, Shi W. Photo-realistic single image super-resolution using a generative adversarial network. Proc of CVPR. 2017:4681–90.

    Google Scholar 

  12. Jiwon K, Lee JK, Lee KM. Accurate image super resolution using very deep Convoutional networks. In: IEEE Conf. On CVPR; 2016. p. 1646–54.

    Google Scholar 

  13. Zhang K, Zuo W, Chen Y, Meng D, Zhang L. Beyond a Gaussian Denoiser: residual learning of deep CNN for image Denoising. IEEE Trans Image Processing. 2017;26(7):3142–55.

    Article  Google Scholar 

  14. Haralick RM, Shanmugam K, Dinstein I. Texture feature for image classification. IEEE Trans Syst Man Cybernet. 1973;SMC-3:6.

    Article  Google Scholar 

  15. Galloway MM. Texture analysis using gray level run lengths. Computer Graphics and Image Processing. 1975;4(2):172–9.

    Article  Google Scholar 

  16. Cortes C, Vapnik V. Support-vector networks. Mach Learn. 1995;20:273–97.

    Google Scholar 

  17. Komagata H, Ishikawa M, Shinoda K, Kobayashi N, Iwamoto C, Ohuchida K, Hashizume M. 3-Dimensional Anatomical Reconstruction from Pancreas Serial Sections Using Texture Features and Machine Learning. In: Proc. of the 6th IIEEJ International Conference on Image Electronics and Visual Computing (IEVC 2019); 2019.

    Google Scholar 

  18. Komagata H, Ishikawa M, Shinoda K, Kobayashi N, Iwamoto C, Ohuchida K, Hashizume M. 3D reconstruction of pancreatic ducts and collagen fibers from pathological images of pancreas serial sections. In: Image Electronics and Visual Computing Workshop; 2017.

    Google Scholar 

  19. Ishikawa M, Okamoto C, Shinoda K, Komagata H, Iwamoto C, Ohuchida K, Hashizume M, Shimizu A, Kobayashi N. Detection of pancreatic tumor cell nuclei via a hyperspectral analysis of pathological slides based on stain spectra. OSA Biomedical Optics Express. 2019;10(9):4568–88.

    Article  CAS  Google Scholar 

  20. Hashimoto E, Ishikawa M, Shinoda K, Hasegawa M, Komagata H, Kobayashi N, Mochidome N, Oda Y, Iwamoto C, Ohuchida K, Hashizume M. Tissue classification of liver pathological tissue specimens image using spectral features. In: SPIE Medical imaging; 2017.

    Google Scholar 

  21. Ogawa S, Shinoda K, Hasegawa M, Kato S, Ishikawa M, Komagata H, Kobayashi N. Demosaicking method for multispectral images based on spatial gradient and inter-channel correlation. In: International symposium on multispectral colour science; 2016. p. 157–66.

    Google Scholar 

  22. Yanagi Y, Shinoda K, Hasegawa M, Kato S, Ishikawa M, Komagata H, Kobayashi N. Optimal transparent wavelength and arrangement for multispectral filter array. In: IS & T international symposium on electronic imaging, IPAS-024; 2016. p. 1–5.

    Google Scholar 

  23. Shinoda K, Ogawa S, Yanagi Y, Hasegawa M, Kato S, Ishikawa M, Komagata H, Kobayashi N. Multispectral filter array and demosaicking for pathological images. APSIPA ASC. 2015:697–703.

    Google Scholar 

  24. Yanagi Y, Shinoda K, Hasegawa M, Kato S, Ishikawa M, Komagata H, Kobayashi N. Optimal multispectral filter array considering transparent wavelength and arrangement. IEICE Trasn Info Syst. 2016;J99-D(8):794–804. (Japanese)

    Google Scholar 

  25. Shinoda K, Kobayashi N, Katoh A, Komagata H, Ishikawa M, Murakami Y, Yamaguchi M, Abe T, Hashiguchi A, Sakamoto M. An efficient wavelet-based ROI coding for multiple regions. IEICE Trans on Fundamentals. 2015;E98-A(4):1006–20.

    Article  Google Scholar 

  26. Shinoda K, Kawase M, Hasegawa M, Ishikawa M, Komagata H, Kobayashi N. Joint optimization of multispectral filter arrays and demosaicking for pathological images. IIEEJ Transactions on Image Electronics and Visual Computing. 2018;6(1):13–21.

    Google Scholar 

  27. Shinoda K, Kawase M, Hasegawa M, Ishikawa M, Komagata H, Kobayashi N. Optimal spectral sensitivity of multispectral filter array for pathological images. Image Electronics and Visual Computing Workshop. 2017;1P-10

    Google Scholar 

Download references

Acknowledgements

Studies of Subsection 4.2 were approved by the ethics committee of the Graduate School and Faculty of Medicine of Kyoto University (R0316, R0989) and the ethics committee of Tokyo University of Agriculture and Technology (No. 30-28). Study of a part of Subsection 4.2.2 was approved by the ethics committee at Children’s National Medical Center (approval no. 00003792) and the ethics committee of Tokyo University of Agriculture and Technology (No. 30-31). Study of a part of Subsection 4.3 was approved by the ethics committee at Fukui University (approval no. 20100064) and the ethics committee of Tokyo University of Agriculture and Technology (No. 30-27).

The studies in Sect. 4.2 were collaboration researches with Prof. Hontani (Nagoya Institute of Technology), Prof. Matsuzoe (Nagoya Institute of Technology), Prof. Yamada (Kyoto University), Prof. Takakuwa (Kyoto University) and Dr. Linguraru (Children’s National Health System). The micro-CT volumes resected from a KPC mouse of pancreatic cancer in Sections 4.3 and 4.4 was provided by Prof. Hashizume (Kyushu University), Prof. Ouchida, Dr. Iwamoto (Kyushu University) and Prof. Mori (Nagoya University). The studies in Sect. 4.3.2 were collaboration researches with Prof. Kido (Yamaguchi University) and Prof. Inai (Fukui University). The authors would like to thank all these people for valuable data, discussions and comments.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Akinobu Shimizu .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Shimizu, A., Kobayashi, N., Shouno, H. (2022). Fundamental Technologies for Integration of Multiscale Spatiotemporal Morphology in MCA. In: Hashizume, M. (eds) Multidisciplinary Computational Anatomy. Springer, Singapore. https://doi.org/10.1007/978-981-16-4325-5_4

Download citation

  • DOI: https://doi.org/10.1007/978-981-16-4325-5_4

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-16-4324-8

  • Online ISBN: 978-981-16-4325-5

  • eBook Packages: MedicineMedicine (R0)

Publish with us

Policies and ethics