Motion segmentation and depth ordering based on morphological segmentation
In this paper the motion segmentation and depth ordering problem for monocular image sequences with and without camera motion is addressed. We show how a new multiscale morphological segmentation technique, based on the watershed, can produce a superset of the motion boundaries. Regions with similar motion then have to be merged. The difficulties of motion estimation at object boundaries with occlusion are analyzed and a solution combining segmentation and robust estimation is presented. Region merging is then performed using the obtained motion parameters. We then present a new technique for the depth ordering of the resulting image partition. We show how the modelling error on either side of the motion boundary can be used to indicate the occlusion relationship of the objects. The algorithm is then applied to several synthetic and natural image sequences. The results demonstrate that the technique is robust and that the depth ordering requires only minimal motion to perform correctly. This is due to the fact that, unlike existing techniques for depth ordering, the motion between two frames only has to be analyzed. We then point out possible improvements and indicate how temporal integration of the information can further increase stability.
KeywordsMotion Estimation Motion Parameter Object Boundary Motion Boundary Motion Measurement
- 1.J. Cichosz and F. Meyer. Morphological multiscale image segmentation. In Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS'97), pages 161–166, Louvain-la-Neuve (Belgium), June 1997.Google Scholar
- 2.Trevor Darrell and David Fleet. Second-order method for occlusion relationships in motion layers. Technical Report 314, MIT Media Lab Vismod, 1995.Google Scholar
- 3.E. Decencière Ferrandière, C. de Fouquet, and F. Meyer. Applications of kriging to image sequence coding. Accepted for publication in Signal Processing: Image Communication, 1997.Google Scholar
- 7.W. B. Thompson, K. M. Mutch, and V. A. Berzins. Dynamic occlusion analysis in optical flow fields. IEEE Transactions on Pattern Analysis and Machine Intelligence, 7:374–383, 1985.Google Scholar
- 8.Zhengyou Zhang. Parameter estimation techniques: A tutorial with application to conic fitting. Technical Report 2676, Institut National de Recherche en Informatique et en Automatique, Sophia-Antipolis Cedex, France, October 1995.Google Scholar