According to the present technology, a filter process is performed to apply an offset to pixels of a decoded image. Furthermore, the offset is inhibited from being applied to an edge portion depending on the occurrence of a transform unit in a transformation skip mode in which orthogonal transformation is not performed on a predicted residual. Therefore, an offset for correcting a DC component is applied to a transform unit where orthogonal transformation is skipped, making less conspicuous the boundary between a transform unit where orthogonal transformation is performed and the transform unit where orthogonal transformation is skipped. The image quality of the decoded image is thus restrained from being lowered. The advantages described in the present description are only illustrative, but not limitative, with additional advantages being not precluded.