FIG. 18A-18B illustrate a system for encoding and decoding 6DoF textured geometry data. FIG. 18A shows a 6DoF textured geometry encoding system 1800. FIG. 18B shows a 6DoF textured geometry decoding system 1820. 6DoF textured geometry encoding and decoding can be used to enable a variant of 6DoF immersive video in which video data is applied as a texture to geometry data, allowing new intermediate views to be rendered based on the position and orientation of a head mounted display. Data recorded by multiple video cameras can be combined with 3D models, particularly for static objects.
As shown in FIG. 18A, a 6DoF textured geometry encoding system 1800 can receive video data 1802 for a base view and video data 1805A-1805C for additional views. The video data 1802, 1805A-1805C includes texture and depth data that can be processed by a reprojection and occlusion detection unit 1806. Output from the reprojection and occlusion detection unit 1806 can be provided to a patch decomposition unit 1807 and a geometry image generator 1808. Output from the patch decomposition unit 1807 is provided to a patch packing unit 1809 and an auxiliary patch information compressor 1813. The auxiliary patch information (patch-info) provides information used to reconstruct patches of video texture and depth data. The patch packing unit 1809 outputs packed patch data to the geometry image generator 1808, a texture image generator 1810, an attribute image generator 1811, and an occupancy map compressor 1812.
