Skip to main content
SpringerLink
Log in

Cameras with On-chip Memory CMOS Image Sensors

  • Chapter
  • First Online:
The Micro-World Observed by Ultra High-Speed Cameras

Abstract

In this article we give an overview of ultra high-speed (UHS) CMOS image sensors with on-chip analog memories placed on the periphery of pixel array and high speed cameras with the UHS CMOS image sensors for the visualization of UHS phenomena. The developed image sensors consist of 400H × 256V pixels and 128 memories/pixel, and the readout speed of 1 T pixel/s is obtained, leading to 10 Mfps full resolution video capturing with consecutive 128 frames, and 20 Mfps half resolution video capturing with consecutive 256 frames. The first development chip was employed in the high-speed video camera and put in practical use in 2012. By the development of dedicated process technologies, photosensitivity improvement and power consumption reduction were simultaneously achieved, and the performance-improved chip has been utilized in the commercialized high-speed video camera since 2015 offering 10 Mfps with ISO 16000 photosensitivity. Due to the improved photosensitivity, clear images can be captured and analyzed even under low light condition, such as under a microscope, and capturing of UHS light emission phenomena.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. N. Kudo, K. Okada, K. Yamamoto, Sonoporation by single-shot pulsed ultrasound with microbubbles. Biophys. J. 96, 4866–4876 (2009)

    Article  Google Scholar 

  2. M. Versluis, High-speed imaging in fluids. Exp. Fluids 54, 1–35 (2013)

    Article  Google Scholar 

  3. N. Kawahara, K. Tsuboi, E. Tomita, Laser-induced plasma generation and evolution in a transient spray. Opt. Express 22, A44–A52 (2014)

    Article  Google Scholar 

  4. T. Belmonte, A. Hamdan, F. Kosior, C. Noel, G. Henrion, Interaction of discharges with electrode surface in dielectric liquids: application to nanoparticle synthesis, J. Phys. D: Appl. Phys. 47, 224016-1-18 (2014)

    Google Scholar 

  5. K. Kurosawa, Y. Nagaoka, H. Senshu, K. Wada, S. Hasegawa, S. Sugita, T. Matsui, Dynamic of hypervelocity jetting during oblique impacts of spherical projectiles investigated via ultrafast imaging, J. Geophys. Res.: Planets 120, 1237–1251 (2015)

    Google Scholar 

  6. N. Kawai, S. Zama, W. Takemoto, K. Moriguchi, K. Arai, S. Hasegawa, E. Sato, Stress wave and damage propagation in transparent materials subjected to hypervelocity impact. Proc. Eng. 103, 287–293 (2015)

    Article  Google Scholar 

  7. H. Zhu, F. Pierron, Exploration of Saint-Venant’s principle in inertial high strain rate testing of materials. Exp. Mech. 56, 3–23 (2016)

    Article  Google Scholar 

  8. F. Shao, D. Kimoto, K. Furukawa, H. Sugo, T. Takeda, K. Miyauchi, Y. Tochigi, R. Kuroda, S. Sugawa, Ultra-high speed video capturing of time dependent dielectric breakdown of metal oxide-silicon capacitor up to 10 Mfps, in Proceedings IS&T/SPIE Electronic Imaging, vol 9022, pp. 902205-1-9, San Francisco, USA, 2-6 Feb 2014

    Google Scholar 

  9. R. Kuroda, F. Shao, D. Kimoto, K. Furukawa, H. Sugo, T. Takeda, K. Miyauchi, Y. Tochigi, A. Teramoto, and S. Sugawa, A novel analysis of oxide breakdown based on dynamic observation using ultra-high speed video capturing up to 10,000,000 frames per second, in Proceedings of the 2014 International Reliability Physics Symposium, pp. 3F.3.1–3F.3.4, Waikoloa, USA, 1–5 June 2014

    Google Scholar 

  10. S. Sugawa, Ultra-high speed imaging, in IEEE International Solid-State CIRC. Conference on Forum, Scientific Imaging, San Francisco, USA, 17–21 Feb 2013

    Google Scholar 

  11. T. G. Etoh, D.H. Nguyen, S.V.T. Dao, C.L. Vo, M. Tanaka, K. Takehara, T. Okinaka, H.V. Kuijk, W. Klassens, J. Bosiers, M. Lasser, D. Ouellette, H. Maruyama, T. Hayashida, T. Arai, A 16 Mfps 165 kpixel backside-illuminated CCD, in IEEE International Solid-State CIRC. Conference, Dig. Tech., pp. 406–407, San Francisco, USA, 20–24 Feb 2011

    Google Scholar 

  12. J. Crooks, B. Marsh, R. Turchetta, K. Taylor, W. Chan, A. Lahav, A. Fenigstein, Kirana: a solid-state megapixel uCMOS image sensor for ultra-high speed imaging, in Proceedings of the IS&T/SPIE Electronic Imaging, vol 8659, 865903-1-14, Burlingame, USA, 3–7 Feb 2013

    Google Scholar 

  13. J. Crooks, B. Marsh, R. Turchetta, K. Taylor, W. Chan, A. Lahav, A. Fenigstein, Ultra-high speed imaging at megaframes per second with a megapixel CMOS image sensor, in Proceedings of the International Image Sensor Workshop, pp. 369–372, Snowbird, USA, 12–16 June 2013

    Google Scholar 

  14. Y. Tochigi, K. Hanzawa, Y. Kato, R. Kuroda, H. Mutoh, R. Hirose, H. Tominaga, K. Takubo, Y. Kondo, S. Sugawa, A global-shutter CMOS image sensor with readout speed of 1-Tpixel/s burst and 780-Mpixel/s continuous. IEEE J. Solid-St. Circ. 48, 329–338 (2013)

    Article  Google Scholar 

  15. K. Miyauchi, T. Takeda, K. Hanzawa, Y. Tochigi, S. Sakai, R. Kuroda, H. Tominaga, R. Hirose, K. Takubo, Y. Kondo, S. Sugawa, Pixel structure with 10 nsec fully charge transfer time for the 20 M frame per second burst CMOS image sensor, in Proceedings of the IS&T/SPIE Electronic Imaging, vol 9022, 902203-1-12, San Francisco, USA, 2–6 Feb 2014

    Google Scholar 

  16. S. Sugawa, R. Kuroda, T. Takeda, F. Shao, K. Miyauchi, and Y. Tochigi, A 20 Mfps global shutter CMOS image sensor with improved sensitivity and power consumption, in Proceedings of the International Image Sensor Workshop, pp. 166–169, Vaals, the Netherlands, 8–11 June 2015

    Google Scholar 

  17. R. Kuroda, Y. Tochigi, K. Miyauchi, T. Takeda, H. Sugo, F. Shao, S. Sugawa, A 20Mfps global shutter CMOS image sensor with improved light sensitivity and power consumption performances. ITE Trans. MTA 4, 149–154 (2016)

    Google Scholar 

  18. F. Mochizuki, K. Kagawa, S-I. Okihara, W-M. Seo, B. Zhang, T. Takasawa, K. Yasutomi, S. Kawahito, Single-shot 200Mfps 5 × 3-aperture compressive CMOS imager, in IEEE International Solid-State CIRC. Conference on Dig. Tech., pp. 116–117, San Francisco, USA, 22-26 Feb. 2015

    Google Scholar 

  19. G. Meynants, G. Lepage, J. Bogaerts, G. Vanhorebeek, X. Wang, Limitations to the frame rate of high speed image sensors, in International Image Sensor Workshop, P-16, Bergen, Norway, June 2009

    Google Scholar 

  20. G. Meynants, High-speed CMOS image sensor architectures, in IEEE International Solid-State CIRC. Conference on Forum, High-Speed Image-Sensor Technologies, San Francisco, USA, 7-11 Feb. 2010

    Google Scholar 

  21. JIS Z 8120. Glossary of optical terms

    Google Scholar 

  22. Y. Tochigi, K. Hanzawa, Y. Kato, N. Akahane, R. Kuroda, S. Sugawa, A prototype high-speed CMOS image sensor with 10,000,000 fps burst-frame rate and 10,000 fps continuous-frame rate, in Proceedings of the IS&T/SPIE Electronic Imaging, Digital Photography VII, 78760G-1-8, Barlingame, USA, 23–27 Jan 2011

    Google Scholar 

  23. M.F. Tompsett, G.M. Amelio, W.J. Bertram, R. Buckley, W.J. McNamara, J.C. Mikkelsen Jr., D.A. Sealer, Charge-coupled imaging devices: experimental results. IEEE T. Electron Dev. 18, 992–996 (1971)

    Article  Google Scholar 

  24. Zhou, B. Pain, E. Fossum, frame-transfer CMOS active pixel sensor with pixel binning, IEEE T. Electron Dev. 44, 1764–1768 (1997)

    Google Scholar 

  25. R. Kuroda, S. Kawada, S. Nasuno, T. Nakazawa, Y. Koda, K. Hanzawa, S. Sugawa, A highly ultraviolet light sensitive and highly robust image sensor technology based on flattened Si surface. ITE Trans. MTA 2, 123–130 (2014)

    Google Scholar 

  26. Y. Kondo, K. Takubo, H. Tominaga, R. Hirose, N, Tokuoka, Y. Kawaguchi, Y. Takaie, A. Ozaki, S. Nakaya, F. Yano, T. Daigen, Development of “Hyper-Vision HPV-X” high-speed video camera, Shimadzu Review, SR13_002E, 2013

    Google Scholar 

  27. A.M. Knisely, J.M. Austin, geometry and test-time effects on hypervelocity shock-boundary layer interaction, in 54th AIAA Aerospace Sciences Meeting, AIAA SciTech, AIAA 2016–1979, pp. 1–15, San Diego, USA, 4–8 Jan 2016

    Google Scholar 

  28. T. Shibata, Y. Zama, T. Furuhata, H. Kusano, Ultra-high speed PIV measurement for gasoline spray ejected from a multiple hole DI injector, in 18th International Symposium on the Applications of Laser and Imaging Techniques to Fluid Mechanics, Lisbon, USA, 4–7 July 2016

    Google Scholar 

  29. K. Johansen, J.H. Song, K. Johnston, P. Prentice, Deconvolution of acoustically detected bubble-collapse shock waves. Ultrasonics 73, 144–153 (2017)

    Article  Google Scholar 

  30. N. Kudo, N. Tokuoka, High-speed microscopic observation of ultrasonically activated micron-sized bubbles interacting with biological cells of low image contrast, in Proceedings of the 31st International Congress on High-speed Imaging and Photonics, pp. 783–786, Osaka, Japan, 7–10 Nov 2016

    Google Scholar 

  31. A. Rack, M. Olbinado, M. Scheel, C. Schmitt, O. Betz, F. Garcia-Moreno, J. Banhart, X. Just, P. Lhuissier, J.-L. Gelet, J. Morse, Real-time X-ray microimaging using hard synchrotron radiation, in Proceedings of the 31st International Congress on High-speed Imaging and Photonics, pp. 629–632, Osaka, Japan, 7–10 Nov 2016

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Graduate School of Engineering, Tohoku University, 6-6-11 Aza-Aoba Aramaki, Sendai, 980-8579, Japan

    Rihito Kuroda & Shigetoshi Sugawa

Authors
  1. Rihito Kuroda
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Shigetoshi Sugawa
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Rihito Kuroda .

Editor information

Editors and Affiliations

  1. Shimadzu Europa GmbH, Duisburg, Germany

    Kinko Tsuji

1 Electronic supplementary material

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG

About this chapter

Cite this chapter

Kuroda, R., Sugawa, S. (2018). Cameras with On-chip Memory CMOS Image Sensors. In: Tsuji, K. (eds) The Micro-World Observed by Ultra High-Speed Cameras. Springer, Cham. https://doi.org/10.1007/978-3-319-61491-5_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-61491-5_5

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-61490-8

  • Online ISBN: 978-3-319-61491-5

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation