A real-time system and method for displaying video on a display are disclosed. Received compressed video data is decoded to produce an uncompressed first video frame, a first frame syntax element, an uncompressed second video frame, and a second frame syntax element. A computationally intensive process is applied to the uncompressed first video frame to produce an enhanced first video frame. A block having a portion of the enhanced first video frame from the enhanced first video frame is adaptively transferred to the uncompressed second video frame to produce an enhanced second video frame without applying the computationally intensive process to the uncompressed second video frame. The transferring is guided by the first frame syntax element and the second frame syntax element. The enhanced first video frame and the enhanced second video frame are displayed.