Signal Composition, Rendering and Presentation

Abstract

Signal composition and rendering methods are applied in the context of generation (production) and presentation (consumption) of multimedia signals. This involves mixing of signals which stem from different sources, adaptation and projection as required by the format of the composite signal or the output device. Further, some more aspects of editing, rendering and output are introduced. In this context, image warping, 3D and image-based rendering for view adaptation play an important role. Mosaicking and stitching are methods that combine image planes from several camera views into one single picture. Video frame rate conversion is necessary for adaptation in display and mixing using varying frame rate, as well as replay with modified speed. For audio signal mixing and rendering, generation of various audio effects are introduced, and spatialization in terms of room property modeling and 3D audio output is discussed.