Knowledge-Assisted Image and Video Analysis

Definition

Knowledge-assisted image and video analysis refers to the use of domain-specific prior knowledge about images or video.

Segmentation of images and video is generally an ill-posed problem, i.e. for a given natural image or image sequence, there exists no unique solution to the segmentation problem. In order for the segmentation problem to be transformed to a well-posed one, restriction of the number of admissible solutions is necessary. To this end, the introduction of prior knowledge to the segmentation procedure, leading to the development of domain-specific knowledge-assisted analysis techniques, has been proposed.

Prior knowledge for a domain (e.g. F1 racing) typically includes the important objects that can be found in any given image or frame belonging to this domain (e.g. car, road, grass, sand, etc.), their characteristics (e.g. corresponding color models) and any relations between them. See example in Fig. 1. Given this knowledge, there exists the well-posed problem...