Abstract
This chapter presents the achievements of multiscale spatiotemporal statistical models during the whole period of the multidisciplinary computational anatomy project. Shimizu et al. built spatiotemporal statistical models along a time axis of embryos and children, in which a modeling method to deal with a small sample of data was developed and smoothness constraints along a time axis were introduced into the spatiotemporal statistical model. Modelling of organs with nested and neighbouring constraints was also studied by their group. Multiscale models were constructed, in which Shimizu et al. presented super-resolution techniques by dictionary learning and deep learning, and Shouno et al. studied super-resolution under a noisy environment in order to solve mapping problems among multimodal images. Kobayashi et al. developed algorithms for image understanding of microscopic images of a KPC mouse, where 3D tissues structures were recognised from pancreatic serial section images and from hyperspectral images.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Durrleman S, Pennec X, Trouvé A, Braga J, Gerig G, Ayache N. Toward a comprehensive framework for the spatiotemporal statistical analysis of longitudinal shape data. Int J Comput Vis. 2013;103(1):22–59.
Kishimoto M, Saito A, Takakuwa T, Yamada S, Matsuzoe H, Hontani H, Shimizu A. A spatiotemporal statistical model for eyeballs of human embryos. IEICE Trans Inf Syst. E100-D, 7:1505–15.
Kasahara K, Saito A, Takakuwa T, Yamada S, Matsuzoe H, Hontani H, Shimizu A. A spatiotemporal statistical shape mode of the brain surface during human embryonic development. Adv Biomed Eng. 2018;7:146–55.
Kameda T, Yamada S, Uwabe C, Suganuma N. Digitization of clinical and epidemiological data from the Kyoto collection of human embryos: maternal risk factors and embryonic malformations. Congenit Anom. 2012;52(1):48–54.
Saito A, Nakayama K, Porras AR, Mansoor A, Biggs E, Linguraru MG, Shimizu A. Construction of a spatiotemporal statistical shape model of pediatric liver from cross-sectional data. Proc of Medical Image Computing and Computer-Assisted Intervention., Part I, LNCS. 2018;11071:676–83.
Saito A, Tsujikawa M, Takakuwa T, Yamada S, Shimizu A. Level set distribution model of nested structures using logarithmic transformation. Med Image Anal. 2019;56:1–10. https://doi.org/10.1016/j.media.2019.05.003.
Shimizu A, Hontani H, Kobayashi N, Shono H, Mori K, Iwamoto C, Ouchida K, Oda Y, Hashizume M. A multi-scale and multi-modality statistical model of pancreas. Int J Comput Assist Radiol Surg. 2016;10(suppl 1):S165–6.
Ishida J, Saito A, Shimizu A. Multi-modality statistical model between a thoracic CT volume and photographs of lung cryosections of a cadaver. Int J Comput Assist Radiol Surg. 2017;12(suppl 1):S192.
Timofte R, Smet VD, Gool LV. Anchored neighborhood regression for fast example-based super-resolution. Proc of IEEE International Conference on Computer Vision. 2013;
Tozawa K, Saito A, Kido S, Inai K, Kimura H, Shimizu A. Super resolution of a lung CT volume using a generative adversarial network. Int J Comput Assist Radiol Surg. 2018;13(suppl 1):S170.
Ledig C, Theis L, Huszar F, Caballero J, Cunningham A, Acosta A, Aitken A, Tejani A, Totz J, Wang Z, Shi W. Photo-realistic single image super-resolution using a generative adversarial network. Proc of CVPR. 2017:4681–90.
Jiwon K, Lee JK, Lee KM. Accurate image super resolution using very deep Convoutional networks. In: IEEE Conf. On CVPR; 2016. p. 1646–54.
Zhang K, Zuo W, Chen Y, Meng D, Zhang L. Beyond a Gaussian Denoiser: residual learning of deep CNN for image Denoising. IEEE Trans Image Processing. 2017;26(7):3142–55.
Haralick RM, Shanmugam K, Dinstein I. Texture feature for image classification. IEEE Trans Syst Man Cybernet. 1973;SMC-3:6.
Galloway MM. Texture analysis using gray level run lengths. Computer Graphics and Image Processing. 1975;4(2):172–9.
Cortes C, Vapnik V. Support-vector networks. Mach Learn. 1995;20:273–97.
Komagata H, Ishikawa M, Shinoda K, Kobayashi N, Iwamoto C, Ohuchida K, Hashizume M. 3-Dimensional Anatomical Reconstruction from Pancreas Serial Sections Using Texture Features and Machine Learning. In: Proc. of the 6th IIEEJ International Conference on Image Electronics and Visual Computing (IEVC 2019); 2019.
Komagata H, Ishikawa M, Shinoda K, Kobayashi N, Iwamoto C, Ohuchida K, Hashizume M. 3D reconstruction of pancreatic ducts and collagen fibers from pathological images of pancreas serial sections. In: Image Electronics and Visual Computing Workshop; 2017.
Ishikawa M, Okamoto C, Shinoda K, Komagata H, Iwamoto C, Ohuchida K, Hashizume M, Shimizu A, Kobayashi N. Detection of pancreatic tumor cell nuclei via a hyperspectral analysis of pathological slides based on stain spectra. OSA Biomedical Optics Express. 2019;10(9):4568–88.
Hashimoto E, Ishikawa M, Shinoda K, Hasegawa M, Komagata H, Kobayashi N, Mochidome N, Oda Y, Iwamoto C, Ohuchida K, Hashizume M. Tissue classification of liver pathological tissue specimens image using spectral features. In: SPIE Medical imaging; 2017.
Ogawa S, Shinoda K, Hasegawa M, Kato S, Ishikawa M, Komagata H, Kobayashi N. Demosaicking method for multispectral images based on spatial gradient and inter-channel correlation. In: International symposium on multispectral colour science; 2016. p. 157–66.
Yanagi Y, Shinoda K, Hasegawa M, Kato S, Ishikawa M, Komagata H, Kobayashi N. Optimal transparent wavelength and arrangement for multispectral filter array. In: IS & T international symposium on electronic imaging, IPAS-024; 2016. p. 1–5.
Shinoda K, Ogawa S, Yanagi Y, Hasegawa M, Kato S, Ishikawa M, Komagata H, Kobayashi N. Multispectral filter array and demosaicking for pathological images. APSIPA ASC. 2015:697–703.
Yanagi Y, Shinoda K, Hasegawa M, Kato S, Ishikawa M, Komagata H, Kobayashi N. Optimal multispectral filter array considering transparent wavelength and arrangement. IEICE Trasn Info Syst. 2016;J99-D(8):794–804. (Japanese)
Shinoda K, Kobayashi N, Katoh A, Komagata H, Ishikawa M, Murakami Y, Yamaguchi M, Abe T, Hashiguchi A, Sakamoto M. An efficient wavelet-based ROI coding for multiple regions. IEICE Trans on Fundamentals. 2015;E98-A(4):1006–20.
Shinoda K, Kawase M, Hasegawa M, Ishikawa M, Komagata H, Kobayashi N. Joint optimization of multispectral filter arrays and demosaicking for pathological images. IIEEJ Transactions on Image Electronics and Visual Computing. 2018;6(1):13–21.
Shinoda K, Kawase M, Hasegawa M, Ishikawa M, Komagata H, Kobayashi N. Optimal spectral sensitivity of multispectral filter array for pathological images. Image Electronics and Visual Computing Workshop. 2017;1P-10
Acknowledgements
Studies of Subsection 4.2 were approved by the ethics committee of the Graduate School and Faculty of Medicine of Kyoto University (R0316, R0989) and the ethics committee of Tokyo University of Agriculture and Technology (No. 30-28). Study of a part of Subsection 4.2.2 was approved by the ethics committee at Children’s National Medical Center (approval no. 00003792) and the ethics committee of Tokyo University of Agriculture and Technology (No. 30-31). Study of a part of Subsection 4.3 was approved by the ethics committee at Fukui University (approval no. 20100064) and the ethics committee of Tokyo University of Agriculture and Technology (No. 30-27).
The studies in Sect. 4.2 were collaboration researches with Prof. Hontani (Nagoya Institute of Technology), Prof. Matsuzoe (Nagoya Institute of Technology), Prof. Yamada (Kyoto University), Prof. Takakuwa (Kyoto University) and Dr. Linguraru (Children’s National Health System). The micro-CT volumes resected from a KPC mouse of pancreatic cancer in Sections 4.3 and 4.4 was provided by Prof. Hashizume (Kyushu University), Prof. Ouchida, Dr. Iwamoto (Kyushu University) and Prof. Mori (Nagoya University). The studies in Sect. 4.3.2 were collaboration researches with Prof. Kido (Yamaguchi University) and Prof. Inai (Fukui University). The authors would like to thank all these people for valuable data, discussions and comments.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this chapter
Cite this chapter
Shimizu, A., Kobayashi, N., Shouno, H. (2022). Fundamental Technologies for Integration of Multiscale Spatiotemporal Morphology in MCA. In: Hashizume, M. (eds) Multidisciplinary Computational Anatomy. Springer, Singapore. https://doi.org/10.1007/978-981-16-4325-5_4
Download citation
DOI: https://doi.org/10.1007/978-981-16-4325-5_4
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-16-4324-8
Online ISBN: 978-981-16-4325-5
eBook Packages: MedicineMedicine (R0)