Generation of an Omnidirectional Video without Invisible Areas Using Image Inpainting

  • Norihiko Kawai
  • Kotaro Machikita
  • Tomokazu Sato
  • Naokazu Yokoya
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5995)


Omnidirectional cameras usually cannot capture the entire direction of view due to a blind side. Thus, such an invisible part decreases realistic sensation in a telepresence system. In this study, an omnidirectional video without invisible areas is generated by filling in the missing region using an image inpainting technique for highly realistic sensation in telepresence. This paper proposes a new method that successfully inpaints a missing region by compensating for the change in appearance of textures caused by the camera motion and determining a searching area for similar textures considering the camera motion and the shape of the scene around the missing region. In experiments, the effectiveness of the proposed method is demonstrated by inpainting missing regions in a real image sequence captured with an omnidirectional camera and generating an omnidirectional video without invisible areas.


Camera Motion Missing Region Panoramic Image World Coordinate System Inpainted Image 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Ikeda, S., Sato, T., Yokoya, N.: Immersive Telepresence System with a Locomotion Interface Using High-resolution Omnidirectional Videos. In: Proc. IAPR Conf. on Machine Vision Applications, pp. 602–605 (2005)Google Scholar
  2. 2.
    Hori, M., Kanbara, M., Yokoya, N.: Novel Stereoscopic View Generation by Image-Based Rendering Coordinated with Depth Information. In: Proc. Scandinavian Conf. on Image Analysis, pp. 193–202 (2007)Google Scholar
  3. 3.
    Bertalmio, M., Sapiro, G., Caselles, V., Ballester, C.: Image Inpainting. In: Proc. ACM SIGGRAPH 2000, pp. 417–424 (2000)Google Scholar
  4. 4.
    Criminisi, A., Perez, P., Toyama, K.: Region Filling and Object Removal by Exemplar-Based Inpainting. IEEE Trans. on Image Processing 13, 1200–1212 (2004)CrossRefGoogle Scholar
  5. 5.
    Komodakis, N., Tziritas, G.: Image Completion Using Global Optimization. In: Proc. IEEE Conf. on Computer Vision and Pattern Recognition, pp. 442–452 (2006)Google Scholar
  6. 6.
    Matsushita, Y., Ofek, E., Ge, W., Tang, X., Shum, H.: Full-Frame Video Stabilization with Motion Inpainting. IEEE Trans. on Pattern Analysis and Machine Intelligence 28(7), 1150–1163 (2006)CrossRefGoogle Scholar
  7. 7.
    Jia, J., Tai, Y., Wu, T., Tang, C.: Video Repairing under Variable Illumination Using Cyclic Motions. IEEE Trans. on Pattern Analysis and Machine Intelligence 28(5), 832–839 (2006)CrossRefGoogle Scholar
  8. 8.
    Shen, Y., Lu, F., Cao, X., Foroosh, H.: Video Completion for Perspective Camera Under Constrained Motion. In: Proc. IEEE Int. Conf. on Pattern Recognition, pp. 63–66 (2006)Google Scholar
  9. 9.
    Patwardhan, K., Sapiro, G., Bertalmio, M.: Video Inpainting Under Constrained Camera Motion. IEEE Trans. on Image Processing 16, 545–553 (2007)CrossRefMathSciNetGoogle Scholar
  10. 10.
    Wexler, Y., Shechtman, E., Irani, M.: Space-Time Completion of Video. Trans. on Pattern Analysis and Machine Intelligence 29, 463–476 (2007)CrossRefGoogle Scholar
  11. 11.
    Cheung, V., Frey, B., Jojic, N.: Video epitomes. In: Proc. IEEE Conf. on Computer Vision and Patern Recognition, pp. 141–152 (2005)Google Scholar
  12. 12.
    Sato, T., Ikeda, S., Yokoya, N.: Extrinsic Camera Parameter Recovery from Multiple Image Sequences Captured by an Omni-directional Multi-camera System. In: Pajdla, T., Matas, J(G.) (eds.) ECCV 2004. LNCS, vol. 3022, pp. 326–340. Springer, Heidelberg (2004)Google Scholar
  13. 13.
    Kawai, N., Sato, T., Yokoya, N.: Image Inpainting Considering Brightness Change and Spatial Locality of Textures and Its Evaluation. In: Proc. Pacific-Rim Symp. on Image and Video Technology, pp. 271–282 (2009)Google Scholar
  14. 14.
    Point Grey Research Inc.: Ladybug,

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Norihiko Kawai
    • 1
  • Kotaro Machikita
    • 1
  • Tomokazu Sato
    • 1
  • Naokazu Yokoya
    • 1
  1. 1.Graduate School of Information ScienceNara Institute of Science and TechnologyNaraJapan

Personalised recommendations