Reduced rendering of six-degree of freedom video
摘要
說明書
Texture and depth 2D image patch representations are formed at each projection angle. The 2D patch image representations for a projection angle can be created by projecting only those points for which a projection angle has the closest normal. In other words, the 2D patch image representation is taken for the points that maximize the dot product of the point normal and the plane normal. Texture patches from the separate projections are combined into a single texture image, which is referred to as the geometry image. Metadata to represent the patches and how they were packed into a frame are described in the occupancy map and auxiliary patch info. The occupancy map metadata includes an indication of which image sample positions are empty (e.g. do not contain corresponding point cloud information). The auxiliary patch info indicates the projection plane to which a patch belongs, and can be used to determine a projection plane associated with a given sample position. The texture images and depth images are encoded using a 2D conventional video encoder, such as a high efficiency video coding (HEVC) encoder. The metadata can be separately compressed using metadata encoding logic. In the test model decoder, the texture images and depth images are decoded using an HEVC video decoder. A point cloud is reconstructed, using the decoded texture and depth images, along with the occupancy map and auxiliary patch info metadata.
