In step S1902, the system control unit 218 obtains the current focus detection region information for each of the right eye optical system 301R and the left eye optical system 301L, held in the system memory 219. If the focus detection regions for the right eye optical system 301R and the left eye optical system 301L are set to the same position with respect to the optical axis, it is sufficient to read out the information of one of the focus detection regions. The system control unit 218 notifies the image processing unit 214 of the information of the focus detection region information, and instructs the image processing unit 214 to calculate the defocus amount. The image processing unit 214 calculates the defocus amount and the reliability thereof based on the signals from the focus detection region for the right image and the left image, respectively, as described above.
In step S1903, the system control unit 218 obtains a defocus amount DEF_L of the left eye optical system 301L and a defocus amount DEF_R of the right eye optical system 301R from the image processing unit 214.
In step S1904, the system control unit 218 calculates the difference, from the defocus amount of the imaging optical system set as the standard in step S1901, of the defocus amount of the other imaging optical system. For example, if the right eye optical system 301R is set as the reference in step S1901, the system control unit 218 calculates a difference DEF_dif in the defocus amount through the following formula. DEF_dif=DEF_L?DEF_R