What is claimed is:1. A focus detecting apparatus comprising at least one processor, and a memory coupled to the at least one processor, the memory having instructions that, when executed by the processor, perform operations as:a first determining unit configured to determine an image stabilizing area based on object information; anda second determining unit configured to determine a focus detecting area based on the object information, and to determine a calculation area for focus detection based on the focus detecting area,wherein the second determining unit determines the calculation area based on a relationship between the image stabilizing area and the focus detecting area, andwherein in a case where the image stabilizing area is an entire image, the calculation area is smaller than an object in the object information.2. The focus detecting apparatus according to claim 1, wherein the instructions further perform operations as an image stabilizing unit configured to perform image stabilization based on the image stabilizing area.3. The focus detecting apparatus according to claim 1, wherein the instructions further perform operations as a calculating unit configured to calculate an image shift amount between image signals in the calculation area.4. The focus detecting apparatus according to claim 1, wherein the object information includes information about at least one of a position, size, reliability, and type of the object.5. A focus detecting apparatus comprising at least one processor, and a memory coupled to the at least one processor, the memory having instructions that, when executed by the processor, perform operations as:a first determining unit configured to determine an image stabilizing area based on object information; anda second determining unit configured to determine a focus detecting area based on the object information, and to determine a calculation area for focus detection based on the focus detecting area,wherein the second determining unit determines the calculation area based on a relationship between the image stabilizing area and the focus detecting area, andwherein the calculation area in a case where the image stabilizing area and the focus detecting area are the same is larger than that in a case where the image stabilizing area and the focus detecting area are different.6. A focus detecting apparatus comprising at least one processor, and a memory coupled to the at least one processor, the memory having instructions that, when executed by the processor, perform operations as:a first determining unit configured to determine an image stabilizing area based on object information; anda second determining unit configured to determine a focus detecting area based on the object information, and to determine a calculation area for focus detection based on the focus detecting area,wherein the second determining unit determines the calculation area based on a relationship between the image stabilizing area and the focus detecting area, andwherein the calculation area in a case where the focus detecting area is part of the image stabilizing area is larger than in a case where the image stabilizing area and the focus detecting area are different.7. A focus detecting apparatus comprising at least one processor, and a memory coupled to the at least one processor, the memory having instructions that, when executed by the processor, perform operations as:a first determining unit configured to determine an image stabilizing area based on object information; anda second determining unit configured to determine a focus detecting area based on the object information, and to determine a calculation area for focus detection based on the focus detecting area,wherein the second determining unit determines the calculation area based on a relationship between the image stabilizing area and the focus detecting area, andwherein the calculation area in a case where the image stabilizing area and the focus detecting area are related object types is larger than that in a case where the image stabilizing area and the focus detecting area are not related object types.8. An image pickup apparatus comprising:an image sensor; anda focus detecting apparatus,wherein the focus detecting apparatus includes at least one processor, and a memory coupled to the at least one processor, the memory having instructions that, when executed by the processor, perform operations as:a first determining unit configured to determine an image stabilizing area based on object information; anda second determining unit configured to determine a focus detecting area based on the object information, and to determine a calculation area for focus detection based on the focus detecting area,wherein the second determining unit determines the calculation area based on a relationship between the image stabilizing area and the focus detecting area, andwherein in a case where the image stabilizing area is an entire image, the calculation area is smaller than an object in the object information.9. A focus detecting method comprising:a first determining step configured to determine an image stabilizing area based on object information; anda second determining step configured to determine a focus detecting area based on the object information, and to determine a calculation area for focus detection based on the focus detecting area,wherein the second determining step determines the calculation area based on a relationship between the image stabilizing area and the focus detecting area, andwherein in a case where the image stabilizing area is an entire image, the calculation area is smaller than an object in the object information.10. A non-transitory computer-readable storage medium storing a program for causing a computer to execute the focus detecting method according to claim 9.11. The focus detecting apparatus according to claim 5, wherein the instructions further perform operations as an image stabilizing unit configured to perform image stabilization based on the image stabilizing area.12. The focus detecting apparatus according to claim 5, wherein the instructions further perform operations as a calculating unit configured to calculate an image shift amount between image signals in the calculation area.13. The focus detecting apparatus according to claim 5, wherein the object information includes information about at least one of a position, size, reliability, and type of the object.14. The focus detecting apparatus according to claim 6, wherein the instructions further perform operations as an image stabilizing unit configured to perform image stabilization based on the image stabilizing area.15. The focus detecting apparatus according to claim 6, wherein the instructions further perform operations as a calculating unit configured to calculate an image shift amount between image signals in the calculation area.16. The focus detecting apparatus according to claim 6, wherein the object information includes information about at least one of a position, size, reliability, and type of the object.17. The focus detecting apparatus according to claim 7, wherein the instructions further perform operations as an image stabilizing unit configured to perform image stabilization based on the image stabilizing area.18. The focus detecting apparatus according to claim 7, wherein the instructions further perform operations as a calculating unit configured to calculate an image shift amount between image signals in the calculation area.19. The focus detecting apparatus according to claim 7, wherein the object information includes information about at least one of a position, size, reliability, and type of the object.