The transform unit 110 obtains a transform coefficient value by transforming a pixel value. In this case, DCT (discrete cosine transform) or wavelet transform can be used. The quantizing unit 115 quantizes the transform coefficient value outputted from the transform unit 110. The coding control unit 120 controls whether to perform intra prediction coding or inter prediction coding on a specific block or frame. The dequantizing unit 125 dequantizes the transform coefficient value. And, the inverse transform unit 130 reconstructs the dequantized transform coefficient value into an original pixel value. The deblocking filtering unit 135 is applied to each coded macroblock to reduce block distortion. A deblocking-filtered picture is stored in the decoded picture storing unit 140 to be used as a reference picture. The motion estimating unit 145 searches reference pictures for a reference block most similar to a current block using the reference picture stored in the decoded picture storing unit 140 and then delivers position information of the searched reference block or the like to the entropy coding unit 160. The inter prediction unit 150 performs prediction of a current picture using the reference picture and then delivers inter prediction coding information to the entropy coding unit 160. The intra prediction unit 155 performs intra prediction from a decoded pixel within the current picture and then delivers intra prediction coding information to the entropy coding unit 160. The entropy coding unit 160 generates a video signal bitstream from performing entropy coding on the quantized transform coefficient, the inter prediction coding information, intra prediction coding information and the reference block information inputted from the motion estimating unit 145 and the like.