Thus conventionally, when magnification, reduction, or other scaling process is to be applied to color image data obtained from an image pickup apparatus having light receiving elements that form a Bayer pattern array, first in step S2 in FIG. 6, a demosaicing process of performing a linear interpolation for each color to prepare the respective color plane data is performed, and then in step S3, s