An image processing apparatus is provided which can perform image recovery processing with high accuracy. The image processing apparatus acquires first image data from a first imaging element configured to receive a first light flux as a result of a division of light performed by an optical element, acquires second image data from a second imaging element configured to receive a second light flux as a result of the division of the light performed by the optical element, performs image recovery processing on the first image data by using a first image recovery filter generated based on information relating to an optical transfer function of the first light flux, and performs image recovery processing on the second image data by using a second image recovery filter generated based on information relating to an optical transfer function of the second light flux.