A signal processing apparatus according to claim 1, wherein the signal of the spectral sensitivity characteristic having a large information amount corresponds to a luminance signal and the signals other than the above signal having a large information amount corresponds to color signals.