The multi-layer video decoder (150-2) may combine residual image data received in one or more enhancement layers (e.g., EL FC video stream 112-3) with image data received in a base layer (e.g., BL FC video stream 112-1) to produce full resolution LE and RE output image frames (e.g., 162-L and 162-R) that comprise high spatial frequency content in both vertical and horizontal directions. For example, a demultiplexer (DeMux, 160) may be configured to de-multiplex the multiplexed 3D image frames (158-H and 858-V) into LE and RE output image frames (162-L and 162-R) with high spatial frequency content. While the multiplexed 3D image frames (158-H and 858-V) each comprise image data for both left and right eyes, each of the LE and RE output image frames (162-L and 162-R) is only for one of left and right eyes. A first LE image data portion in the first multiplexed 3D image frame (158-H) may be combined with a second LE image data portion in the second multiplexed 3D image frame (158-V) to form the LE output image (162-L) that comprises high spatial frequency content in both vertical and horizontal directions. Similarly, a first RE image data portion in the first multiplexed 3D image frame (158-H) may be combined with a second RE image data portion in the second multiplexed 3D image frame (158-V) to form the RE output image (162-R) that comprises high spatial frequency content in both vertical and horizontal directions.